As artificial intelligence becomes an increasingly integral part of the health insurance industry, a fundamental question emerges: who should ultimately make decisions about your healthcare coverage – a human or a machine? While insurers laud AI's ability to sift through vast amounts of data for personalized plans and enhanced efficiency, the burgeoning trend is sparking a critical debate about fairness, transparency, and the potential for unintended biases.
The core dilemma centers on whether AI, designed to analyze "facts," can truly replace the nuanced judgment of a human, especially when life-or-death medical procedures are at stake. Insurers are leveraging AI algorithms for various functions, including processing prior authorization requests, managing utilization, and adjudicating claims, aiming to streamline operations and potentially reduce costs.
However, experts like Jim Walker and Katrina Dixon, contributors to tonight's discussion, advocate strongly for human involvement. "I think it's okay that they're using AI as an initial screening process," stated Jim Walker, "But if someone is denied, I think it should automatically be kicked back to a doctor or board of doctors to make this decision. I don't want a computer deciding if if me or someone I love dies, lives or dies. I mean, I think that there needs to be a human somewhere in that process."
Katrina Dixon echoed this sentiment, acknowledging AI's speed but emphasizing the necessity of human review for final decisions. "It takes a human decision to create a good decision at the end of this. So I feel like at the end of the day, a human needs to be making the final say. It should be reviewed by a human at the end of its procedure."
A significant concern highlighted by the discussion is the potential for inherent bias within AI systems. As one contributor pointed out, "AI is only as good as the information that goes into it. So if you have insurance companies that are inputting data for this algorithm, it's automatically going to come out on their side to deny more people." This raises fears that algorithms could be intentionally or unintentionally designed to favor insurers' financial interests, leading to increased denials or discriminatory outcomes, particularly for vulnerable populations or those with complex conditions that may not fit neatly into pre-defined AI models.
Both Walker and Dixon agreed that current regulations for AI in healthcare are lagging behind the rapid pace of technological development. "I think we're way behind with regulation in AI as a whole," Dixon remarked, drawing parallels to the early days of the internet where law struggled to keep pace with innovation.
Some states, like California, have begun to implement legislation, such as a 2024 statute requiring a licensed physician to supervise the use of insurance coverage algorithms and preventing AI from being the sole basis for denial. However, critics argue that such regulations often still grant too much control to insurers in defining "medical necessity" and may not mandate independent testing of algorithms for fairness and accuracy before deployment.
The consensus among the contributors is clear: while AI offers undeniable benefits in efficiency and data processing, its role in critical health insurance decisions necessitates robust human oversight and strong regulatory frameworks to safeguard patient well-being and ensure equitable access to care. The ethical imperative is to leverage AI as a tool to augment, rather than replace, human judgment, especially when lives are on the line.
By: Fred Roggin
June 26, 2025
