As North Carolina’s healthcare providers adopt AI technologies, state leaders push for regulations to ensure responsible integration and accountability.
North Carolina’s health care systems are increasingly integrating artificial intelligence (AI) technologies, prompting state leaders to consider the need for regulatory measures to guide the development and use of these rapidly evolving systems. Amidst this rising trend, officials aim to establish policies that might serve as a precedent for AI governance in the health sector.
Artificial intelligence, which utilises vast amounts of data to perform tasks traditionally requiring human intelligence, has seen major advancements, particularly with the emergence of generative AI. This innovative technology allows robots to not only analyse data for predictions or recommendations but also to create new content autonomously.
Within North Carolina, a number of health care providers are pioneering the application of generative AI tools. Notable implementations include ambient documentation systems capable of recording patient interactions and automatically generating clinical notes. As noted by Christina Silcox, research director for digital health at the Duke-Margolis Institute for Health Policy, while the potential for AI to enhance healthcare efficiency is substantial, the challenges it presents are equally significant. Silcox highlighted key concerns surrounding AI, including the risk of algorithms based on biased data, privacy issues stemming from the utilisation of extensive patient information, and the possibility of healthcare professionals over-relying on AI insights instead of their clinical judgement.
Amid these developments, Senator Jim Burgin (R-Angier) is preparing to propose legislation aimed at addressing some of the obstacles associated with the use of AI in health care. He expressed intentions to create a policy framework that could help set a standard for similar efforts in other states. “AI is making all these decisions for us, but if it makes the wrong decision, where’s the liability?” Burgin questioned, underscoring the urgency for accountability in clinical decision-making facilitated by AI technology.
The legislative landscape regarding AI regulation remains sparse at the federal level. As Congress has yet to advance comprehensive federal legislation, the responsibility for regulatory frameworks is beginning to shift to individual states. For instance, Utah recently enacted a law necessitating that state-licensed health professionals inform patients when engaging with generative AI applications. Meanwhile, other states are contemplating regulations designed to mitigate discrimination within AI algorithms.
In preparation for the potential implementation of AI-related policies, North Carolina’s health care providers are already constructing their own oversight systems. Eric Poon, Chief Health Information Officer at Duke Health, noted that AI clinical tools undergo a rigorous vetting process involving a committee made up of health system and university experts before being approved for broader use. “We ask project teams to try out the technology, deploy them with the right guardrails and see whether it works before pushing it out to the masses,” Poon stated.
Despite these strides toward self-regulation, concerns remain regarding the sufficiency of institutional oversight. The North Carolina Medical Board has articulated that while physicians are encouraged to use AI tools, they hold ultimate responsibility for any clinical decisions derived from AI recommendations. Currently, however, the board does not have plans to establish specific guidance on the use of AI nor has it initiated any disciplinary actions related to it.
As the landscape evolves, the challenge of creating coherent and effective state legislation continues to unfold. David McSwain, UNC Health’s Chief Medical Informatics Officer, remarked on the complexities involved in achieving coherent regulations, advocating for a “gold-standard state legislation” that can address the specific needs of health systems while aiming to reduce burdens on providers. The developing situation underscores the critical balance between fostering technological innovation in health care and safeguarding patient rights and equitable treatment.
Source: Noah Wire Services
- https://ncmedicaljournal.com/article/120571 – This article discusses the integration of AI in North Carolina’s health care system, highlighting the potential benefits and challenges, including the role of EHRs and the need for careful implementation.
- https://www.aidoc.com/about/news/aidoc-novant-health-partnership/ – This article details the partnership between Aidoc and Novant Health, showcasing how AI is being used to improve patient outcomes and workflow efficiencies in North Carolina’s health care sector.
- https://news.unchealthcare.org/2023/05/unc-health-works-with-epic-on-integration-of-generative-artificial-intelligence-ai-tools/ – This article describes UNC Health’s adoption of generative AI tools, including the integration with Epic’s software and the initial rollout to physicians, highlighting the use of AI in clinical settings.
- https://www.techtarget.com/whatis/feature/10-ways-to-spot-disinformation-on-social-media – While not directly about AI in health care, this article provides general guidelines on evaluating information, which is crucial when assessing the credibility of sources discussing AI and health care.
- https://wit-ie.libguides.com/c.php?g=648995&p=4551538 – This guide on evaluating internet information is relevant for assessing the credibility and reliability of sources discussing AI in health care, emphasizing criteria such as authority, objectivity, and relevance.
- https://www.noahwire.com – Although the specific article is not provided, this link is the source of the original information about North Carolina’s health care systems integrating AI and the regulatory considerations involved.
- https://www.healthcareitnews.com/news/north-carolina-health-systems-adopt-ai-improve-patient-outcomes – This link would provide additional context on how various health systems in North Carolina are adopting AI to improve patient outcomes, though it is not directly cited in the sources provided.
- https://www.healthleadersmedia.com/technology/how-ai-changing-healthcare-north-carolina – This link would offer insights into how AI is transforming health care in North Carolina, including the challenges and regulatory considerations, though it is not directly cited in the sources provided.
- https://www.ncmedboard.org/ – The North Carolina Medical Board’s website would provide information on their stance and guidelines regarding the use of AI in clinical decision-making, aligning with the article’s discussion on professional responsibility.
- https://www.dukehealth.org/ – Duke Health’s website can provide details on their AI initiatives and the rigorous vetting process mentioned by Eric Poon, highlighting their approach to integrating AI tools.
- https://unchealth.org/ – UNC Health’s website offers information on their use of AI, including their partnership with Epic and their commitment to safely integrating AI tools into clinical practice.
