iSpeak Blog

Why Governance, Validation, and Human Responsibility May Be More Important Than the Technology Itself

Sakshi Gupta
Governance-Validation-and-Human-Responsibility-750px

A major takeaway from the 2026 ISPE AI in Life Sciences Summit – Powered by GAMP® which took place in June was the realization that the pharmaceutical industry has reached a turning point in its AI journey. The conversation is no longer about whether organizations should use AI. Instead, the focus has shifted to how AI can be implemented responsibly, how it can create value, and how organizations can maintain accountability while adopting AI at scale.

Throughout the summit, one message was consistent: AI adoption is accelerating across the industry. Organizations are actively exploring ways to incorporate AI into their operations, often beginning with open-source tools and readily available platforms. However, it also became clear that not all AI strategies are evolving at the same pace. The organizations making the most meaningful progress are moving beyond experimentation. They are developing agentic AI systems designed around their specific business processes, building controlled data environments, and investing in infrastructure such as data centers that allows AI to operate in a scalable and reliable way.

In other words, the differentiator is no longer whether an organization uses AI. The differentiator is how intentionally AI is being integrated into business processes, governance structures, and decision-making frameworks.

Another important theme was the evolving role of regulators. Discussions suggested that agencies such as the US Food and Drug Administration are evaluating opportunities to leverage AI in activities such as inspections and regulatory processes. This represents an important shift. AI is no longer just an innovation tool being adopted by industry; it is becoming part of the broader regulatory landscape as well.

As both industry and regulators increase their use of AI, expectations around transparency, traceability, data integrity, and system robustness will continue to rise. Organizations will need to demonstrate that AI enabled processes are well understood, properly governed, and supported by appropriate documentation. The future increasingly appears to be one where compliance and technology evolve together.

One of the most significant insights for the author, however, had less to do with technology and more to do with mindset.

From a personal perspective, the author used to look at highly polished or lengthy content and immediately assumed AI had been used to create it. In many cases, it felt like a shortcut. The conference challenged that thinking.

Rather than asking whether AI was used, a more valuable question emerged:

Does the individual presenting the work understand it, validate it, and stand behind it?

That simple shift in mindset can change perspectives. The focus should not be on the tool itself. The focus should be on the quality of the outcome and the accountability of the person using the tool.

This message surfaced repeatedly throughout the summit. AI should be embraced, not avoided. If AI can help perform a task more efficiently, organizations should explore that opportunity. However, using AI does not remove responsibility from the individual. In fact, it may increase it.

Whether the output is a report, a presentation, an analysis, or a recommendation, the individual presenting it remains accountable for every word, every conclusion, and every decision influenced by that output. AI can assist in generating content, but ownership cannot be delegated to technology.

This idea was closely connected to another recurring theme: accountability.

The phrase "human-in-the-loop" appeared throughout the conference, but the message went far beyond simply having a human review AI generated content. Speakers consistently emphasized the importance of meaningful human oversight. The goal is not to have a person passively approve an AI-generated output. The goal is to ensure that the individual understands what was generated, can challenge assumptions, can identify potential issues, and can confidently defend the decisions made using AI supported information.

For a highly regulated industry such as pharmaceuticals, this distinction is critical. AI may support decisions, but humans remain responsible for product quality, regulatory compliance, and ultimately patient safety.

Another area that generated significant discussion was validation. The message was not that validation is new, but that AI requires organizations to place even greater emphasis on validating inputs, assumptions, and data sources early in the lifecycle. For AI-enabled systems, the quality of outputs is heavily influenced by the quality of the data and context provided at the outset.

Several discussions emphasized the importance of validating input before focusing on output. Organizations need to understand the quality of the data feeding AI systems, establish expectations early, and ensure that inputs are accurate, complete, and fit for purpose. In many respects, effective validation starts long before an AI model generates its first output.

This perspective aligns with broader industry trends toward lifecycle validation and continuous assurance. Quality cannot be added at the end of a process; it must be incorporated from the beginning.

Perhaps the most important takeaway for the author was that AI transformation is fundamentally a people transformation. Organizations that succeed with AI will likely be those that invest as much effort in education, change management, and culture as they do in the technology itself. Employees need opportunities to learn about AI, understand its capabilities and limitations, ask questions, and develop confidence in its appropriate use. Building trust and helping people adapt to new ways of working may ultimately be the difference between AI initiatives that succeed and those that struggle to gain adoption.

Taken together, the summit highlighted a more mature view of AI adoption in life sciences. Success is no longer measured solely by technical capability. Increasingly, it is defined by governance, validation, accountability, and the ability to bring people along on the journey.

The opportunities presented by AI are significant. AI has the potential to improve efficiency, enhance decision making, and accelerate innovation across the pharmaceutical lifecycle. However, realizing those benefits will require more than technology investment. It will require thoughtful governance, early validation, meaningful human oversight, and a culture that embraces accountability.

Ultimately, the success of AI in life sciences will not be determined solely by what the technology can do.

It will be determined by how effectively organizations combine innovation with governance, validation, and human accountability.

AI can generate the work, but people must own the outcome.


Disclaimer

iSpeak blog posts provide an opportunity for the dissemination of ideas and opinions on topics impacting the pharmaceutical industry. Ideas and opinions expressed in iSpeak blog posts are those of the author(s) and publication thereof does not imply endorsement by ISPE.

ISPE members: View ISPE Communities of Practice. 
Not an ISPE member? Join today.

Submit Your Best Content to ISPE

ISPE’s official blog, iSpeak accepts contributions from our Members and professionals in the pharma industry.  

What We Look For 

References