Argieffoto (Photo: DC Studio / Freepik)
The Home Office has provisionally suspended two senior officials after “apparent AI hallucinations” were found in the reference list of the revised citizenship, immigration and refugee protection white paper.
An AI hallucination refers to cases where an AI system creates information, sources or facts that sound believable, but do not actually exist or are correct.
Interior Minister Leon Schreiber’s department says the reference list is attached to the white paper that was recently approved by the cabinet. In this case it appears that references were made up or could not be located.
Maroela Media earlier reported that Solly Malatsi, minister of communications and digital technology, scrapped his department’s draft policy on artificial intelligence (AI) after it was reported that at least six fictitious references appeared in it. Malatsi also ordered an investigation to determine whether officials used AI to draft the policy. Rapport meanwhile reported that two senior officials in Malatsi’s department have been provisionally suspended following this department’s AI blunder.
According to the Department of Internal Affairs, a chief director in the relevant unit has already been provisionally suspended in connection with the incident at this department, while a director who was involved in the drafting process will also be suspended.
The department has also appointed two independent law firms. One firm will handle the disciplinary process, while the other will review all of the department’s policy documents since the first major language models were made publicly available.
The department says it will also introduce AI checks and declarations as part of its internal approval processes from now on.
According to an initial internal investigation, the problem appears to be related to the list of references attached to the white paper. The references are presumably created and added to the document afterwards, as they are not cited in the text itself.
The department has since withdrawn the reference list pending the completion of the independent investigation to determine how the “hallucinations” were added to the list.
However, the department maintains that the content of the revised white paper still accurately reflects the government’s position on intended policy reforms in this area. According to the department, the document was prepared through an extensive process of interdepartmental collaboration and public participation, and its core content is not materially affected by the errors in the stand-alone reference list.
“Nevertheless, the department sincerely apologizes for this unacceptable oversight,” the statement said.
The department says the provisional suspensions, independent investigations and internal reforms show that it is taking steps to correct the situation and prevent similar mistakes from happening again.
According to the department, it simultaneously recognizes the benefits of AI and the fact that it is widely used in society.
“While the department regrets the embarrassment, it not only takes immediate corrective action, but also views this painful experience as an opportunity to further modernize its internal processes and keep pace with a rapidly changing world,” the statement said.