Skip to content

AI VERSE NEWS

Menu
  • Home
  • AI Tools
  • AI Breaking News
  • AI Tools & Products
  • Google AI
  • Privacy Policy
  • Terms of Use
  • contact
Menu

When tech workers have to quit their jobs to raise the alarm, it’s time to worry | Isabelle Ferreras

Posted on by admin

Over the past two years, a troubling pattern has emerged across the world’s leading AI laboratories. Time and again, a safety researcher or engineer walks out of the door with a public warning that commercial pressures are overriding safety guardrails. Last month, the person who oversaw safety reports for OpenAI’s product releases said he was quitting the ChatGPT creator because the company’s culture was “broken” and the entire AI industry was too careless in developing the technology. The previous month it was a researcher at OpenAI’s rival Anthropic who quit, warning that he believed AI “could kill us all by the end of the decade”.

As a society we applaud the courage of these individuals and debate their warnings for a news cycle – and then we move on. But we miss the deeper institutional failure those resignations reveal: as the great political scientist Albert Hirschman made clear, exit is not voice.

When the only way for a conscientious engineer to raise the alarm is to leave, it is a clear sign that corporate governance in the industry is broken. Each departure takes with it the very knowledge needed to steer these systems safely.

As policymakers, tech workers, trade unionists, members of parliament and experts from a wide range of global institutions, including the Vatican and the UN, gather in London this week to discuss AI safety, we must confront an uncomfortable truth: we cannot regulate AI safely from the outside if the companies building it remain autocracies on the inside.

Regulatory debates remain trapped in a narrow mindset where governments treat AI either as a consumer product to be tested for defects or as a geopolitical race to be won by relaxing rules on business. This is the logic of Ursula von der Leyen’s EU digital omnibus, which delays implementation of rules enshrined in the EU’s landmark 2024 AI Act that set out specific safety requirements for developers of “high-risk” AI systems. Corporate lobbies encourage this framing of a trade-off between safety and innovation by arguing that legislation imposes too many burdens.

This is a dangerous path. AI is not merely a software product; it is a technology of government. Yet inside frontier labs such as OpenAI, Anthropic, Microsoft and Google, a handful of executives and capital investors decide which values are coded into models that shape millions of lives.

As the Oxford legal scholar Jeremias Adams-Prassl, who pioneered research into the gig economy and is leading research into automated work in Europe, has shown, algorithmic management already monitors, evaluates and dismisses workers across the socioeconomic spectrum, often without any human oversight.

In a democratic society, the exercise of governing power requires the consent of the governed. Yet corporate law still treats firms as the property of shareholders, and the labour investors, who put their intellect, health and lives into the firm, as subordinates. To align AI with the public interest, we need a dual strategy: alongside solid public regulations on AI “from the outside”, we need to enter the corporate black box and force corporate governance into alignment with democratic principles.

Legislators must move forward on three critical reforms. First, in AI development, they must protect and empower those who build AI models. Governments must outlaw non-disclosure and non-disparagement clauses that silence staff on safety risks, and enact robust whistleblower protection. Tech workers also need a collective standing over corporate strategy, independent channels to report safety breaches and formal representation inside frontier labs before models are deployed.

The second reform relates to AI deployment. Remember what happened at Meta over the summer: Mark Zuckerberg’s firm faced a backlash from employees after Facebook, Instagram and WhatsApp introduced a tool that tracked staff keystrokes, mouse clicks and content displayed on computer screens to collect data for training its AI models. Not only were workers worried that privacy and consent was in ruins, they worried their jobs were on the line.

Legislators must establish a binding right to co-decision over workplace AI. No algorithmic system that monitors, evaluates or disciplines workers should be deployed without prior negotiation. At national and EU level, we need to consider collective bargaining on AI deployment and veto rights for works councils or trade unions, backed by independent technical experts and a strict ban on automated firing.

skip past newsletter promotion



Sign up to This is Europe

The most pressing stories and debates for Europeans – from identity to economics to the environment

after newsletter promotion

Third, across the economy, we must democratise boardrooms and reward firms that refuse to concentrate power at the top. Legislators should mandate worker-elected directors on boards, moving towards dual-majority governance in which strategic decisions require the consent not only of capital but of labour.

As Daron Acemoglu and Simon Johnson, the 2024 Nobel laureates in economics, have shown, technological revolutions do not automatically produce shared prosperity: institutions decide who benefits and who pays. Extending democracy into the firm is not an old battle over power for its own sake, but a practical necessity for more ethical judgment. Aligning AI with the good of workers and society requires more wisdom than closed executive rooms can offer. It needs what the Yale political theorist Hélène Landemore calls “democratic reason”, the collective intelligence of diverse, deliberating voices, brought to bear on corporate decision-making.

Left to self-regulation and the occasional whistleblower, AI governance will entrench an unaccountable algorithmic oligarchy. Accountability and aligment begins with giving those who build these systems and those whose work they govern an enforceable voice, from the code floor to the boardroom.

  • Isabelle Ferreras is accelerator fellow at the University of Oxford’s Institute for Ethics in AI, FNRS research director at the University of Louvain, Belgium and co-founder of DemocraticIntelligence.org

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

  • How does Anthropic make money? Inside the business of AI.
  • Anthropic gave $40M to an AI safety group. Most of the candidates it backed won.
  • Wife of Senior Nvidia Executive Caught Up in Alleged AI Chip Smuggling Scandal
  • I let Apple’s always-listening AI summarize my life for two weeks
  • Takeaways From the 2026 DealBook Summit
©2026 AI VERSE NEWS | Design: Newspaperly WordPress Theme