AI in Schools: New York’s Pause for 600,000 Children Raises Questions of Trust
The largest school district in the United States has placed a one-year moratorium on student-facing generative AI. Whatever view you take of the decision itself, what it did and did not restrict is worth studying closely in the wider debate over AI in schools.
What did New York City Public Schools announce?
On 2 September 2026, New York City Public Schools announced a one-year moratorium on student-facing generative AI for grades 2-K (the city's new programme for two-year-olds) through 8 (the equivalent of Year 9 in England), roughly 600,000 students, around two-thirds of the district's enrolment. The policy was announced by Mayor Zohran Mamdani and Schools Chancellor Kamar Samuels, and the administration calls it the most expansive student-facing AI moratorium in the United States.
The detail matters more than the headline. Companion chatbots are prohibited across all grades, not only the younger ones, and mainstream services including ChatGPT and Claude are blocked district-wide. Teachers may continue to use approved tools for lesson planning. Decisions about grades, behaviour and promotion remain with humans.
Paused or prohibited
- All student-facing generative AI from 2-K to eighth grade
- AI features in nearly 40 previously approved programmes, switched off or the product removed
- Companion chatbots, in every grade
- Mainstream chatbots such as ChatGPT and Claude, blocked district-wide and excluded even from the high school pilots
- Teachers using AI to grade work, monitor behaviour, decide promotion or write special education plans
Kept
- Teacher use of approved AI tools for lesson planning, translation and communications
- Assistive technology for students with disabilities
- Support for multilingual learners
- Career-readiness programmes such as computer science
- Five supervised pilots for up to 50,000 high school students
A Technology in Schools Coalition of students, educators, parent leaders, elected officials, advocates, union partners and subject experts will assess the impact over the year and publish recommendations.
It is a moratorium with a review mechanism attached, not a permanent prohibition. That distinction is frequently lost in coverage, and it changes how the decision should be read. New York has also been here before: it blocked ChatGPT on school devices and networks in January 2023, then lifted the block that May. And it is not alone. On the same day, Los Angeles Unified paused student use of generative AI on district-owned devices for the school year.
Are both cases reasonable?
Supporters point to developmental appropriateness: the evidence base for generative AI with primary-age children is thin, companion chatbots raise distinct concerns about attachment and dependency, and a district serving around 900,000 students has a defensible interest in moving more slowly than the market. Mayor Mamdani put it more simply: children "need their teachers and human connection". He also argued that families deserve to know their children's data will not be mined by big tech, and some advocates wanted the city to go further, with the AI Moratorium Coalition pushing for a two-year pause. New York had previously moved towards embracing these tools, so the reversal reflects institutional learning rather than reflexive caution.
Critics point to equity: students whose families can afford these tools will use them at home regardless, so a school-only restriction may widen the gap it hopes to close. Jean-Claude Brizard, chief executive of Digital Promise, told Education Week that "blocking kids from even trying out the technology before high school presents an equity issue". Critics also argue that preparing students for a world that uses these tools is part of the job, that a blanket restriction is a blunt instrument where targeted policy might work better, and that a year is a long time in a field moving this quickly. Former deputy mayor Richard Buery called it "a blanket one-year AI ban, without exceptions", and the teachers' union president, Michael Mulgrew, warned that working out whether tools comply will fall on schools after the fact.
Both positions are held in good faith by people who know more about primary education than most technologists do. This piece takes no view on which is right: the coalition exists precisely because the evidence is not settled.
What did New York keep, and why does it matter?
For anyone deploying AI inside an institution, the interesting question is not what was banned. It is what was not.
Teacher-facing tools survived, subject to an approval process. Human accountability for consequential decisions was explicitly preserved. What was removed was autonomous, student-facing, unbounded interaction, and companion chatbots, the least bounded category of all, were restricted most broadly.
Even where student use continues, it is bounded. The high school pilots are capped at five classes per school, run under the direct supervision of trained educators and come with time limits, such as no more than 15 minutes a week on Quill.
Assistive and bounded survived. Autonomous and unsupervised did not.
That is a design pattern, not a coincidence, and it recurs wherever an institution is asked to justify a system to people who did not choose it.
Why does this generalise well beyond education?
Edtech vendors have been put on notice, but the reasoning transfers directly to healthcare, financial services, local government, legal services and HR. In each, a system is deployed by an institution and experienced by people who had no say in selecting it and often cannot opt out.
In those settings trust operates as a hard constraint rather than a marketing consideration. An institution that cannot explain a system to its stakeholders, whether parents, patients, customers, regulators or unions, will eventually restrict or remove it, and the technical quality of the system will not save it. The restriction may well arrive after procurement, after integration and after the budget is spent. In New York, AI features in nearly 40 already approved programmes are being switched off.
This is the same lesson visible in the UK Jurisdiction Taskforce's work on AI liability under English law, from a completely different direction. There, systems that cannot show what they did risk having uncertainty resolved against them in court. Here, systems that cannot be explained to stakeholders risk being switched off by their own operator. Both point at the same property: a deployment needs to be accountable to someone other than the people who built it.
What does this mean for AI in UK schools?
England has taken a different route so far, setting expectations for AI products rather than pausing their use. The Department for Education's generative AI product safety standards, updated in January 2026, cover filtering, monitoring and reporting, and now ask products for clear statements of purpose and use cases. They also address the risk of cognitive offloading, and of dependence on AI replacing real human relationships. Keeping Children Safe in Education 2026, in force since 1 September 2026, points schools to the Department's generative AI guidance on filtering, monitoring and data protection.
For any supplier selling into UK schools, these standards and New York's decision point the same way: say what the product is for, bound what it does and avoid designs that encourage dependence.
What does that imply at design time?
1Keep a human accountable for consequential decisions
Not as a compliance gesture but as an architectural commitment, with the boundary drawn by consequence rather than by what the technology can technically do unsupervised. In the AI-powered CRM we built for ourselves, every action that changes data is approved by a person first.
2Make the system's role explainable in a sentence
If you cannot describe what the tool does, and does not do, to a non-technical stakeholder in plain language, expect that stakeholder to assume the worst when asked. The Department for Education's request for clear statements of purpose and use cases asks for exactly this.
3Build the approval path in advance
New York permitted approved teacher tools. Institutions rarely ban categories outright when a credible approval mechanism exists; they ban what they cannot supervise. Our guide to AI agent governance sets out how to decide what a system may see, change and send before it goes live.
4Prefer bounded scope to broad capability
General-purpose assistants are the hardest thing to defend in an institutional setting, precisely because their boundaries cannot be stated. New York kept them out even of its supervised high school pilots.
What should institutions take from New York's decision?
You can disagree entirely with New York's decision and still take the signal seriously. A large public institution, under scrutiny, reviewed its AI deployments and kept the ones that were bounded, supervised and explainable while pausing the ones that were not.
That is likely to be the shape of institutional AI governance for some time, in a good many sectors that are nothing to do with schools. The deployments that survive scrutiny will be the ones that were made explainable before anybody demanded an explanation, which is a decision taken at design time, not during the review.
Deploying AI to people who didn't choose it?
We design and build LLM and generative AI applications with a defined purpose, human approval on consequential actions and a record of what the system did, so you can explain it to the people it affects.
If your AI system has to stand up to parents, patients, customers or regulators, we can help you design it that way from the start.
Talk to us about your AI projectFrequently asked questions
What did New York City Public Schools actually ban?
A one-year moratorium on student-facing generative AI for grades 2-K through 8, roughly 600,000 students. Companion chatbots are prohibited across all grades, and mainstream services including ChatGPT and Claude are blocked district-wide. Teacher-facing tools can still be used, subject to an approval process.
Is New York's AI ban permanent?
No. It's a one-year moratorium with a review mechanism attached, not a permanent prohibition. A Technology in Schools Coalition of students, educators, parents, elected officials, advocates, union partners and subject experts will assess the impact over the year and publish recommendations.
Can New York high school students still use AI?
Some can. Up to 50,000 high school students will use five approved tools in supervised pilots, capped at five classes per school. General-purpose chatbots such as ChatGPT and Claude are not included.
Why were companion chatbots restricted more than other AI tools?
The district didn't give a reason, but the pattern suggests one: they're the least bounded category of interaction. The pattern across the whole policy is that assistive, bounded, supervised tools survived, while autonomous, unsupervised, unbounded interaction was removed, and companion chatbots sit furthest on the unbounded end.
Are UK schools banning AI?
Not at a national level. England's Department for Education sets generative AI product safety standards for edtech, updated in January 2026, covering filtering, monitoring, a clear statement of purpose and the risk of dependence.
Does this decision only matter for schools and edtech?
No, the reasoning transfers directly to healthcare, financial services, local government, legal services and HR, anywhere a system is deployed by an institution and experienced by people who had no say in choosing it and often can't opt out.
What should organisations building AI systems take from this?
Keep a human accountable for consequential decisions as an architectural commitment, make the system's role explainable in plain language to non-technical stakeholders, build an approval path before you're forced to justify one, and prefer bounded scope over broad general-purpose capability.
Sources
- Mayor Mamdani and Chancellor Samuels put students first with nation's broadest generative AI moratorium in schools, NYC Mayor's Office, 2 September 2026
- NYC's new school AI ban explained, Chalkbeat, 2 September 2026
- AI gets a timeout: Mamdani puts one-year moratorium on generative AI for younger NYC students, amNY, 2 September 2026
- New York, Los Angeles restrict student AI use. Will other districts follow?, Education Week, September 2026
- New York City's school AI moratorium, in facts, Shelly Palmer, 3 September 2026
- NYC's DOE AI ban? Here is what the policy actually says, BetaNYC, 4 September 2026
- NYC to launch 2-K: free child care for 2-year-olds, Chalkbeat, 3 March 2026
- Generative AI: product safety standards, Department for Education
- The DfE updates its gen AI product safety standards, Stone King, 21 January 2026