As the use of artificial intelligence (AI) in hiring processes becomes increasingly prevalent, legal challenges are emerging regarding its potential for discrimination and lack of transparency. A notable case involves Erin Kistler, a product manager with nearly 20 years of experience, who has filed a class-action lawsuit against Eightfold AI, a Silicon Valley company that provides hiring software used by numerous firms, including major players like PayPal, Microsoft, and Netflix. Kistler claims that the automated screening processes employed by these systems function as undisclosed consumer reports, ranking applicants without allowing them to view or contest the results. This lawsuit is part of a broader trend of legal scrutiny surrounding AI in employment decisions, with other cases targeting companies like Meta and IBM for alleged discriminatory practices.

Growing Use of AI in Hiring

According to a report from the World Economic Forum, 90% of employers utilized some form of automation in their hiring processes last year. These tools range from basic filtering mechanisms to more advanced AI systems that assess candidates’ skills and conduct initial interviews. Eightfold AI claims to maintain the “world’s largest, self-refreshing source of talent data,” continuously updating its database with information from over a billion job applicants. This data is used to score candidates on a scale of 0 to 5, predicting their potential job performance and influencing interview selections.

Critics argue that such systems lack transparency, leaving applicants unaware of how their qualifications are evaluated. Rachel Dempsey, an attorney representing Kistler, emphasizes the need for candidates to have access to the same transparency in hiring processes that they receive in credit reporting, allowing them to dispute inaccuracies and improve their chances.

Algorithmic Bias and Blacklisting Concerns

Despite claims that AI can eliminate human biases in hiring, experts warn that these systems can perpetuate or even exacerbate existing biases. Ifeoma Ajunwa, a professor at Emory University, notes that AI systems often replicate the biases of human managers. For instance, a previous AI tool used by Amazon was found to downrank women’s résumés due to historical data favoring male candidates. Furthermore, research indicates that AI models can make biased inferences about candidates based on demographic characteristics, leading to algorithmic blacklisting where rejected candidates face ongoing challenges in securing employment.

Katie Creel, co-author of a study on “algorithmic monoculture,” warns that negative flags from AI systems could hinder candidates’ job prospects across multiple companies, effectively blackballing them from opportunities.

Responsible Integration of AI in Hiring

While AI tools can enhance efficiency in hiring, experts advocate for a balanced approach where human judgment remains central. Iman Abuzeid, CEO of Incredible Health, emphasizes that AI should assist rather than dictate hiring decisions. Her company audits about 10% of AI interviews for bias, a practice that is becoming a legal requirement in various jurisdictions.

Recent regulations in cities like New York mandate annual bias audits for automated hiring systems and require employers to notify candidates when AI is used. However, these laws often contain loopholes, and advocates argue for greater transparency regarding the algorithms that evaluate applicants. Jenny Yang, a partner at Outten & Golden, stresses the importance of transparency in identifying potential issues within AI hiring systems.

As the legal landscape surrounding AI in hiring evolves, the outcomes of these cases could significantly impact employment practices and the rights of candidates in the hiring process. For further details, visit The Guardian.