Financial Markets


The US Center for Medicare and Medicaid Services (CMS) issued a memo that can be seen as a warning shot to insurance companies using artificial intelligence. The policy essentially lays down a crucial marker in the ongoing debate about the extent to which AI should be permitted to shape and influence healthcare coverage decisions. Health insurance companies are now forbidden from using AI or algorithms to determine healthcare or deny coverage for Medicare Advantage members. This landmark announcement is indicative of the shifting landscape of healthcare, one that stands to heavily impact future care provision.

The memo was penned in response to a series of lawsuits against health insurance giants UnitedHealth and Humana. These companies had allegedly used a flawed AI tool named nH Predict to deny care to elderly patients, sparking disconcert among healthcare providers and patients alike. Critics argued that while AI can be useful for predicting post-acute care lengths using expansive datasets, it often fails to consider nuances in individual circumstances. Patient care, they state, should not be solely dictated by machine learning algorithms and should instead be tailored to each patient based on the advice of the healthcare professionals who know best.

The lawsuits pointed out that nH Predict often contradicted physicians' recommendations or even Medicare's coverage rules, underscoring the dangers of an uncritical reliance on an AI-based decision-making model in the healthcare sector.

The CMS' directive therefore centered on the idea that while AI can assist in decisions, insurers should base coverage decisions on the individual patient's circumstances, not solely AI-powered predictions. AI and algorithms, the CMS clarified, can be helpful for ensuring compliance with coverage rules, but should not be allowed to alter coverage criteria over time or implement hidden coverage policies.

Ultimately, while the potential for AI to streamline healthcare processes and increase efficiency is clear, the CMS' warning to insurers highlights the need to keep a careful eye on human rights and fairness. Using AI in decision-making might inadvertently entrench existing biases and introduce new ones, especially if there are flaws in the underlying data or models.

CMS has also stated they will increase audits and closely monitor whether Medicare Advantage plans are using undisclosed internal coverage criteria. Penalties for non-compliance include warning letters, corrective action plans, monetary fines, and marketing sanctions.

This move will hopefully curtail any unethical and impermissible uses of AI in healthcare, setting the stage for a more careful and considered implementation of this transformative technology in the sector. In the future, insurance companies need to incorporate AI responsibly and respectfully, so as not to exploit the trust of the public and preserve the integrity of healthcare. Both patients and health insurers will have to navigate this new terrain with circumspection, in a landscape that's being reshaped by both policy and technology.

Keeping machine learning and AI regulated within the healthcare sector will likely emerge as a trending topic of future discussions. The CMS memo stands as an initial foray into ensuring the ethical application of AI in the sector, and only time will tell how this situation evolves, reshaping the future of healthcare.