AI is more likely than humans to form biases when hiring

Summary: The next time you apply for a job, AI may screen your résumé before any human sees it. But there’s good reason to question whether AI will judge you fairly. Researchers already know that LLMs pick up human biases from their training data.

Artificial intelligence is rapidly becoming a standard component of recruitment, helping organizations screen résumés, rank candidates, and automate parts of the hiring process. While these systems are often promoted as a way to reduce human subjectivity, new research suggests that AI can develop its own forms of bias—sometimes producing decisions that are less fair than those made by human recruiters. The findings reinforce the need for careful oversight as organizations increasingly rely on AI to make high-impact employment decisions.

Recent studies highlighted by MIT Technology Review found that some AI hiring systems can exhibit stronger biases than human evaluators under certain conditions. Rather than simply reproducing historical discrimination present in training data, the models may amplify subtle patterns, leading to systematic disadvantages for particular groups of applicants depending on the job, dataset, or evaluation criteria.

One reason AI hiring remains challenging is that recruitment is not a purely objective task. Hiring decisions often involve subjective qualities such as communication skills, leadership potential, creativity, cultural fit, and career trajectory. When AI models attempt to infer these characteristics from historical hiring data, they may inadvertently learn patterns influenced by past organizational preferences, existing workforce demographics, or biased performance evaluations.

Researchers also emphasize that bias is not always obvious when evaluating AI systems. An algorithm may appear fair when measuring overall hiring outcomes but still disadvantage specific demographic groups for individual job categories or specialized roles. This makes comprehensive auditing more difficult, as organizations must evaluate fairness across multiple positions rather than relying solely on aggregate statistics.

The findings challenge the assumption that simply placing a human in the decision-making process automatically eliminates algorithmic bias. Previous research has shown that recruiters can become overly reliant on AI recommendations, sometimes accepting biased rankings without sufficient scrutiny. Effective human oversight requires independent judgment rather than treating AI output as inherently objective.

To reduce these risks, organizations are increasingly adopting responsible AI practices throughout the recruitment process. These include using diverse and representative training datasets, conducting regular bias audits, validating models across different job categories, documenting model behavior, maintaining transparency around automated decision-making, and ensuring that final hiring decisions remain subject to meaningful human review.

Regulatory attention is also increasing. Governments in several jurisdictions are introducing rules governing automated employment decision systems, requiring organizations to demonstrate fairness, explainability, and accountability when AI influences hiring outcomes. Compliance is becoming as important as technical performance for organizations deploying recruitment algorithms.

Despite these challenges, AI continues to offer significant benefits when used appropriately. Automated systems can process large numbers of applications more efficiently, reduce repetitive administrative work, identify qualified candidates more quickly, and support recruiters with data-driven insights. The goal is not necessarily to replace human judgment but to augment it with tools that improve efficiency while preserving fairness and accountability.

As AI becomes more deeply integrated into recruitment, organizations will need to balance automation with rigorous governance. Building trustworthy hiring systems will require continuous testing, independent auditing, transparent evaluation criteria, and human oversight to ensure that efficiency gains do not come at the expense of equal opportunity and fair employment practices.

Key facts

  • AI may screen résumés before human review in job applications
  • Large language models (LLMs) are known to pick up biases from their training data
  • New research suggests LLMs can also develop their own biases
  • There is reason to question the fairness of AI-driven judgment in hiring

Why it matters

As organizations increasingly adopt AI for recruitment and résumé screening, understanding the potential for algorithmic bias is critical. This research highlights a significant challenge for ensuring equitable hiring practices and necessitates robust validation and auditing of AI systems before widespread deployment to prevent discriminatory outcomes and potential regulatory scrutiny.

Embedded content for: AI is more likely than humans to form biases when hiring