Trust, Transformation & Technology: Kay Firth-Butterfield on the Ethical Future of AI and Digital Innovation
As one of the world’s foremost authorities on artificial intelligence governance and ethics, Kay Firth-Butterfield has spent her career shaping how technology serves humanity.
A former barrister, professor, and judge, she was the world’s first Chief AI Ethics Officer and has advised global organisations, including the World Economic Forum, on the responsible adoption of emerging technologies. From corporate boardrooms to international policy circles, Kay continues to champion the importance of trustworthy AI, data governance, and equitable innovation.
In this exclusive interview with Champions Speakers, she shares her insights on AI’s business applications, the future of the Metaverse, and the ethical challenges we must address as technology evolves.
Q: With so many potential applications across sectors, how can businesses strategically implement AI while ensuring it’s both effective and ethically sound?
Kay Firth-Butterfield: “That’s a huge question because there are so many ways AI can be used in a business. But I’d say to use it successfully, you need to be very aware of the responsible or trustworthy aspects of artificial intelligence.
“You shouldn’t deploy AI—or if you’re creating it yourself, design and develop it—without keeping ethics in mind. We call it responsible or trustworthy AI now, because those factors might affect successful deployment if you don’t get it right.
“There’s the possibility of serious damage to a company, not just brand or customer loss, but financial loss too. More and more regulators are starting to sue those using AI irresponsibly or without trust built in. No one wants to be seen as untrustworthy with AI—it’s not a good look.
“Where to deploy AI? Some common uses are in human resources, to help with talent spotting. But there are big problems with using AI in HR because it can bring in human biases. We’re seeing some lawsuits in the US where companies unwisely bought AI for HR, and are being sued for using discriminatory tech. You have to be really careful; it’s a balance between AI’s benefits and thoroughly thinking through buying and deploying these systems.
“Other AI business uses? Manufacturing companies across factory floors; drug companies to help design pharmaceuticals. For example, DeepMind’s AlphaFold enabled big advances in using AI for biological work.
“There’s generative AI, which everyone’s talking about. You could use it in business—but be really aware that if you use models like ChatGPT, the data you feed it goes in and could come out anywhere. Don’t give it trade secrets. We saw a confidential Samsung memo get leaked globally when an employee had ChatGPT transcribe it.
“So, if you’re using generative AI in business, understand what AI is. It just predicts the next word—it’s not actually intelligent. Let teams play with it after your legal department green-lights it, and your C-suite understands AI and how you use it, with guidelines from your CTO or CIO.”
Q: There was a time when the Metaverse dominated headlines as the next frontier for digital interaction. How do you see its current role and future potential for business innovation and collaboration?
Kay Firth-Butterfield: “It’s interesting because we’ve been through a bit of an exciting Metaverse concept where everybody was very enthusiastic and wanted to get on board, but now we’re more in a Metaverse winter—or perhaps autumn—because it’s actually very hard to create content for the Metaverse.
“Where we’re seeing great applications for business are in industrial uses. However, we’re struggling to achieve the vision of us all entering the Metaverse in a Ready Player One scenario, where we can shop, buy houses, inhabit the Metaverse, and experience full 3D interaction. That’s really because it takes a lot of compute power and dedicated resources to create the immersive backgrounds needed.
“So, if you ask me what will happen in five years, I think we’ll see the Metaverse beginning to deliver the rewards we expect for business. Customers will have exceptional shopping experiences where, instead of just browsing online, they can enter a virtual store, ‘feel’ fabrics—although not physically—and make decisions in real time.
“We may also see remote working in the Metaverse so you’re virtually with colleagues. A recent study found that remote work makes it hard for young people to get proper supervision. But you could imagine truly supervising younger staff in the Metaverse.
“Also, young people miss getting to know colleagues when working remotely, so the Metaverse could help. It frees us from physical limits and provides new virtual environments. But we need balance—many people likely don’t want to spend all their time in an immersive space.”
Q: Digital transformation is often framed as a technological shift, but it begins with mindset. What foundational steps should leadership teams take to approach transformation effectively—particularly when integrating AI?
Kay Firth-Butterfield: “Let’s start with the most important thing when you’re thinking about digital transformation, and that’s data.
“First of all, you can’t digitally transform—you can’t begin to use artificial intelligence—without data. And it’s not just any data. You have to get your data into machine-readable form. One of the problems we see when we talk to companies is that all their data is on paper. You have to have digital data, and then you have to clean and prepare that data to enable a machine to run on it.
“It’s only once you get there that you can even contemplate using AI. Another question about data is: do you want it to be created by human beings or do you want synthetic data? There’s a big difference between the two in terms of what you can get out of it and how you use it. So again, data is your first step.
“Once you have that, you can begin to think about digital transformation. My best advice would be to do it slowly and carefully, and to always keep in mind the trustworthy AI aspect—how you are using it, and how it integrates with customers and employees.
“There’s going to be legislation around AI in Europe. If you trade with Europe, you’ll have to comply. There are also existing laws that can challenge unwise AI use. So, think not just about applications, but also about risk, compliance, and legal frameworks during the transition.
“Involve the Chief Strategy Officer too—where is this digital transformation going? What do you want to achieve from it?
“You can spend a lot without getting far if AI isn’t the right solution. Have a true AI strategy aligned with your goals. That’s an essential part of digital transformation. I’d say for manufacturing or B2B, there’s less risk. But B2C means you must consider customer data use and how you encourage purchasing. There are lots of factors, but start with good data, then consider AI. Make it a collaborative decision across leadership to determine whether it’s the right tool.”
Q: As businesses become increasingly data-driven, what are the most pressing ethical risks you see in the use of AI and big data—and how should companies navigate them?
Kay Firth-Butterfield: “This is where I’ve spent much of my career. I started in the AI world after my legal career, thinking about the risks of AI to humanity, business and governments. I became the world’s first Chief AI Ethics Officer. I had to come up with a title, and I think now I might have chosen Trustworthy Technology Officer or Responsible AI Officer.
“But in those days, we weren’t really talking about ethics. Why are we talking so much about ethics now? Well, because people’s ethics differ—geographically, culturally. The world broadly agrees that we should focus on safety and robustness, but we also need to worry about bias in the system.
“Bias is created when you feed in biased historical data. The machine makes decisions from that data.
“The other way bias enters the system is through the people who code. A lot of coders are young men under the age of 30, and only 22% of coders are women—those are pre-generative AI figures, but it’s unlikely to have changed dramatically. There are simply more men using generative AI, often because of the kinds of jobs they hold.
“So those coders bring in their own values, and the values of young men may not reflect mine—or yours.”
Q: Generative AI has rapidly captured public imagination and industry attention. Can you explain how it works in practical terms—and what implications this has for trust and accuracy in business use?
Kay Firth-Butterfield: “It’s very exciting because it’s the next iteration of artificial intelligence. What generative AI allows you to do is ask questions of the world’s data just by typing them in.
“If we think back to science fiction, that’s what we’ve always wanted—to ask a computer a question and have it come back with an answer based on all available knowledge.
“How does it do that? It predicts what word comes next. It does this using enormous datasets—we call them large language models. These models access all the data available on the open web. In some cases—and this is potentially a significant legal issue—they access copyrighted or IP-protected material. We’ll see a lot of court cases on this.
“Once the system has ingested all this data, it predicts what word naturally comes after another word. It constructs really complex answers through this process. Anyone who’s used it knows it can return very eloquent, interesting responses through word prediction alone.
“But sometimes it gets it wrong. In the AI community, we call this ‘hallucinating’—essentially, it lies. That’s a problem, because we need to get to a point where we can trust the outputs. If it fabricates something and that fabrication is then recirculated, it becomes a self-reinforcing falsehood.”
Q: From a business and societal perspective, what do you see as the most significant opportunities—and limitations—of generative AI as it becomes more widely adopted?
Kay Firth-Butterfield: “All of us can use AI now. It’s a hugely democratising tool. It means small and medium-sized enterprises, which previously couldn’t afford AI, now can. But we must also recognise that the bulk of the data these models use is created in the US, then Europe and China.
“There are several challenges here. These large language models aren’t actually using global data—they’re using a small, regional subset. This has led to a conversation about digital colonisation. We’re projecting data-derived content from America and Europe to the rest of the world and expecting other cultures to consume it.
“Clearly, different cultures need different answers. So, while generative AI offers immense benefits, it also brings substantial challenges that we need to address as it becomes more central to business and society.”
This exclusive interview with Kay Firth-Butterfield was conducted by Mark Matthews.