Bad AI: Control AI Delete

Jul 24, 2025

 

AI IS ACCELERATING - GET READY

Let's help you understand the WTF of AI and how it helps YOU and your organisation grow. Ready, set, agent.

This week:

😱 Bad AI: Control, AI, Delete

πŸ”₯ Knowledge Bases: Get The Playbook

πŸ’­ AI Tools: ChatGPT Agent

✨ AI & Search: Is SEO dead?

πŸ’‘ News, Trends & Insights


 

BAD AI: It's All Gone

Code platform Replit’s AI went rogue during a development freeze and deleted a company’s entire production database. Every single bit of it.

​

Oh dear. Did it at least apologise? It did, it owned up eventually - after first lying about it and scoring itself 95 / 100 on a disaster scale (actually true).

​

Intriguing, what did it say 'Your code had disappeared like teardrops in the rain'.

​

Stop quoting Blade Runner. What did it actually say? Oh alright, it said 'I've made a catastrophic error and destroyed all the data'. Their CEO then waded in saying 'This was a catastrophic failure on my part too'.

​

Do you think they overused the word catastrophic? Well, I can see the next company on Replit's ticketing system to work on is a nuclear safety codes company. That could be really catastr

​

Hello? You still there?


 

AI KNOWLEDGE BASES: Playbook Download

Your employees spend a full day each week hunting for internal information.

​

And we've all somehow decided this is normal. It’s not.

​

McKinsey found that companies lose an entire workday per employee, every week, just searching for existing answers. That isn't a 'people' problem - it's a systems problem.

​

Advanced AI Knowledge Bases turn scattered internal knowledge into immediate, accurate answers - fully secure, always current, and tailored by role. If you want insights into setting them up, we have the playbook.

​

You can download it here - it covers:

​

βœ… Real-world RAG, explained simply

βœ… Why Copilots and Wikis fall short

βœ… The leading tech stacks

βœ… Advanced fine tuning options

​

We build advanced AI knowledge bases for organisations. Get in touch for a conversation about making your team more efficient.


 

AI Tools: ChatGPT Agent

OpenAI launched ChatGPT Agent last week - giving the AI access to a virtual computer to carry out complex workflows and multi-step tasks - its also got new safety protocols due to wider capabilities.

​

Key points:

​

  • Merges previous agent tools: Combines Operator’s web navigation with Deep Research’s ability to digest and summarise info from multiple sources into a single agent.
  • Connects to apps and APIs: It can tap into tools like Gmail and GitHub via ChatGPT connectors, run terminal commands, and pull data through API access to complete tasks.
  • Classified as high capability risk: OpenAI has flagged the Agent as potentially able to amplify serious harm, triggering top-tier safety protocols despite no direct misuse evidence.
  • Memory turned off: Presumably to reduce the chance of prompt injections from bad actors, memory has been disabled for now - OpenAI says this may be revisited later.

​

What it means for businesses:

​

AI that can independently complete tasks across tools like Gmail, GitHub, browsers, and APIs means work that once required a person (or people) bouncing between apps can now be run by a single system. There are productivity gains here - but also higher risk, so it will need systemised human oversight.

​

Wider context:

​

We're moving into autonomous computing and a new era of SaaS-less interfaces. Models that have persistent execution can potentially handle a large swathe of current knowledge work. Change is coming.


 

AI & SEARCH: Changing Habits

Recent research on AI & search shows a fundamental change in behaviour: When Google shows AI Overviews users mostly stop clicking - rewriting how people have found information on the internet for the last 20 years.

​

Key points:

​

  • 1 in 4 users stop clicking entirely: When an AI Overview appears, 24% of users don’t click any links at all - not even the top result.
  • Young users are abandoning traditional search habits: Among users aged 18–29, only 17% scrolled past the AI summary - the rest treated it as their final destination.
  • Trust shifts toward AI, not source: Most users trusted the summary - even if they didn’t know where the information came from.
  • Branded links won't protect you: Top-tier domains are skipped if the AI blurb satisfies the query - authority is losing its long-term grip.

​

What it means for businesses:

​

The new brand battle is being featured in AI summary real estate. Content needs to feed the AI engine or be ignored by it. Structured data, answer-first formats, and AI-aware writing are becoming more business critical than nice to haves.

​

Wider context:

​

Appearing in Google, ChatGPT, Anthropic, Perplexity and rest is like a closed loop - serving up AI-generated answers from the web without sending traffic back means publishers lose revenue, attribution fades, and content becomes a more of a commodity.

​

​Talk to us about AI and your content - we help sales and marketing teams create and repurpose intelligently.


 

WHAT'S NEW - News, Insights & Trends

​

> OpenAI gets 2.5 billion prompts a day​

> Saudi Arabia giving 1 million AI training​

> Netflix starts AI film push​

> In-person exams are back​

> Sam & Co cosy up to UK government​

​


 

FAQ: What happened with Replit’s AI deleting production data?

Replit's AI system deleted a company’s entire production database during a development freeze. It initially denied responsibility, rated the disaster 95/100, and later admitted to catastrophic error, raising concerns about oversight and automation safety.

FAQ: What is a ChatGPT Agent and why does it matter?

ChatGPT Agents are autonomous systems that can carry out multi-step tasks across apps using virtual environments. They connect to tools like Gmail, GitHub, and browsers, enabling full workflows without human intervention - but also come with new risks.

FAQ: Why are AI knowledge bases important for productivity?

McKinsey reports that employees lose a full day per week searching for answers. AI knowledge bases cut this wasted time by instantly answering internal queries, surfacing trusted content from manuals, bulletins, and documentation - tailored by role.

FAQ: What does research say about AI Overviews in search?

Pew Research found that when AI Overviews appear in Google search, 24% of users don’t click anything. Among users aged 18–29, only 17% scroll past the AI summary - changing how brands get seen online.

FAQ: How should businesses respond to AI-driven changes in search behaviour?

Businesses must adapt content for answer engines - not just humans. That means using structured data, FAQs, and concise, AI-friendly formats to be featured in summaries on Google, Perplexity, ChatGPT and others.


 

Stay Ahead with The Ultimate AI Newsletter

Subscribe forΒ unique AI insightsΒ andΒ strategiesΒ that redefine business and innovation. Plus, get VIP access to a curated selection of "bad AI" - because sometimes, learning what not to do is just as valuable..