|
๐ค๐ต The UK Just Told Apple and Google: Stop letting Kids Send Nudes. Or Else. ๐
TLDR; Keir Starmer has given Apple and Google three months to stop children taking, sharing and viewing nude images on their devices. The objective is difficult to argue with. The technical, privacy and regulatory consequences are another matter entirely. ๐
Speaking at London Tech Week, Starmer gave technology companies until September to introduce protections preventing under-18s from taking, sharing or viewing sexually explicit images on smartphones and tablets.
Fail to comply, and the government says legislation will follow โ potentially including fines and criminal liability for senior executives. โ๏ธ
The political case is straightforward.
-
๐ The National Crime Agency receives around 1,700 child abuse referrals every week.
-
๐ 91% of child sexual abuse reports in 2024 contained self-generated content.
-
๐ The average child now encounters pornography by age 13.
The government's argument is simple: if technology companies can build AI models capable of generating videos, writing essays and understanding images, surely they can stop a teenager sending a nude photo.
It's a compelling headline.
It's also where the easy part of the conversation ends.
๐ค The Technical Reality Is Far More Complicated
The proposal is being presented as though it's simply a case of "switching on" existing technology.
It isn't.
To make this work at scale, devices would likely need some combination of:
๐ฑ Age verification
๐ฑ Content classification
๐ฑ Image scanning
๐ฑ Operating-system-level intervention
๐ฑ Rules determining what content gets blocked and what gets through
In other words, your device needs to look at content, classify it, and make decisions on your behalf.
That's not a minor product update.
That's a significant change in how personal devices operate.
And it raises a question politicians seem reluctant to answer directly:
How much visibility into user behaviour are we comfortable giving operating systems in pursuit of safety? ๐
๐จ The False Positive Problem
The announcement also glosses over something every AI engineer already knows: Context is hard.
Can a system reliably distinguish between:
The answer is probably most of the time.
The problem is that "most of the time" isn't the standard people expect when technology starts blocking communications, restricting content or verifying identity.
We've spent the last decade discovering how difficult content moderation is for social media companies.
Now we're proposing that operating systems solve a version of the same problem automatically.
๐ The Privacy Trade-Off Nobody Wants To Talk About
The government insists this isn't surveillance. Privacy campaigners insist it is.
The truth is more nuanced.
No one is suggesting your photos are suddenly being uploaded to Whitehall.
But if devices are required to inspect content before deciding what can be viewed, shared or stored, then we are undeniably moving further towards device-level content governance.
That's a significant precedent.
Because once the infrastructure exists, the obvious question becomes:
What's next?
Today it's child sexual abuse imagery.
Tomorrow it could be:
-
๐ซ Social media access for under-16s
-
๐ฐ Gambling content
-
๐ค Deepfake content
-
โ ๏ธ Extremist material
-
๐ฐ Misinformation
-
๐ธ Financial scams
-
๐Political campaigns
-
๐ฃ๏ธUnpalatable opinions
-
๐ตโ๐ซOpposition to any government action
Every one of those categories has genuine public-interest arguments behind it.
That's precisely why this debate matters.
The slippery slope argument is often dismissed.
But technology regulation rarely moves in reverse.
Once governments establish a capability, they usually find new reasons to use it.
This story is less about nude images and more about power.
For years, Silicon Valley's implicit position has been:
"We build the tools. Society decides how to use them."
Governments are increasingly rejecting that argument.
The UK's position is becoming:
"If your products contribute to a social problem, you are responsible for helping solve it."
That's a profound shift.
We're moving from regulating platforms to regulating capabilities.
The question is no longer:
"Should harmful content be removed?"
It's becoming:
"Should technology be designed so certain behaviours become impossible in the first place?"
That's a much bigger conversation than most headlines suggest. ๐
๐ฟ So What?
Most people will instinctively support protecting children online.
The harms are real. But good intentions don't eliminate trade-offs.
The real debate isn't whether children should be safer online.
It's what technical infrastructure we're willing to build to make that happen.
Because if the answer is age verification, content scanning and operating-system intervention, then we're not just talking about child safety anymore.
We're talking about creating a precedent where governments can require technology companies to redesign products around public policy goals.
Maybe that's necessary.
Maybe it's overdue.
But it's also worth asking where that logic ends.
Because the real story isn't whether Apple and Google can do this.
It's what governments ask them to do once they can. ๐
Read more:
๐ The Guardian: https://www.theguardian.com/technology/2026/jun/08/starmer-tech-firms-ultimatum-block-explicit-images-children-phones
๐ BBC: https://www.bbc.co.uk/news/articles/cly752ydjw6o |