A New Zealand Government Department Just Made Automated Benefit Decisions Without Any Human Oversight
The country’s Ministry of Social Development has started automatically deciding welfare benefit payments, sparking shock and confusion among experts.
This system, which is supposed to help the government save $2.4 billion, relies on data analysis to determine whether someone should receive a benefit. However, when questioned about the use of AI, the Ministry of Social Development insists it isn’t relying on automated decision-making tools. Instead, it’s the Labour department that’s behind the automated system.
Alexa Johnston, a leading AI ethicist, is gobsmacked by the news. “It’s astonishing that the government would introduce a system like this without any transparency or clear explanation of how it works,” she says. “Automated decision-making can lead to biased outcomes and, in this case, it’s concerning that no human oversight is in place.”
The use of automated benefit decisions has a history overseas, specifically in the US. However, it’s led to costly blunders, with some individuals being wrongly denied benefits or receiving incorrect amounts. While this might temper some of the criticism in New Zealand, it also undermines Finance Minister Nicola Willis‘ message that AI is a key tool in reducing public service spending.
What this means for the citizens of New Zealand is that they might not be aware of the automated system making decisions on their behalf. It raises questions about accountability, as well as the potential for biased or incorrect outcomes. The Ministry of Social Development must provide clarity on how the automated system works and ensure that it’s operating fairly and transparently.
