The algorithm will see you now—but only if you’re the perfect patient

The future of AI in healthcare is rapidly evolving, promising early detection, hyper-efficiency, and optimized outcomes. However, a recent study conducted by researchers at Georgia Tech warns that these advancements may inadvertently leave behind those who do not fit the mold of the “perfect patient.”

The study, published in the Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, analyzed 21 AI-driven health tools, ranging from fertility apps to diagnostic platforms. The researchers found that these tools promote a vision of healthcare that is seamless, automatic, and always on, but also overlook the messy realities of illness, disability, and socioeconomic complexity.

Four recurring narratives emerged from the analysis of AI-powered healthcare:

1. Care that never sleeps: Devices constantly monitor vital signs and health data in real-time, blurring the boundaries between surveillance and care.
2. Efficiency as empathy: AI is presented as faster, more objective, and more accurate than humans, potentially devaluing human judgment and connection.
3. Prevention as perfection: AI-driven tools suggest that illness can be avoided through early detection and lifestyle modifications.
4. The optimized body: Healthcare is framed as an opportunity for self-improvement and performance enhancement, rather than just treatment.

The researchers caution that AI in healthcare is transitioning from being a diagnostic tool to a decision-maker, reshaping how care is delivered. AI systems are now being personified and given decision-making roles, potentially redefining who receives treatment and who does not.

While AI tools promise streamlined care and optimized outcomes, they also risk sidelining patients with chronic illnesses, disabilities, or complex medical needs. By prioritizing predictive algorithms and automation, these systems may overlook the context and humanity necessary for real-world care.

The researchers advocate for the development of AI systems in collaboration with those who do not fit the mold of the “perfect patient.” They emphasize the importance of ethical innovation in AI healthcare to prevent the reinforcement of existing inequalities and ensure better outcomes for all individuals.

Ultimately, the researchers do not seek to halt the advancement of AI in healthcare but urge developers to consider who they are truly serving. Technological progress should not only focus on what can be done but also on what should be done and for whom. By prioritizing inclusivity and ethics in AI development, the future of healthcare can be more equitable and beneficial for all individuals.