NYC’s AI chatbot was caught telling businesses to break the law. The city isn’t taking it down
Institute Associate Professor Julia Stoyanovich criticized New York City’s decision to leave an AI-powered chatbot that has dispensed inaccurate small-business advice on its official government website. Stoyanovich called the approach "reckless and irresponsible," stating that the city is "rolling out software that is unproven without oversight" and has "no intention of doing what's responsible." She highlighted the dangers of governments embracing AI-powered systems without sufficient guardrails, emphasizing the need for proper oversight and responsible implementation of such technologies.
Researchers
