AI. A warning. [Part 1 of 2]

Today is SORT of related to the fitness industry. Only because AI will impact everything. 

While I hope I’m wrong, this is not the happiest email. But it’s important. 

Don’t care about this topic? I’ll see you on Saturday with our normal fitness business content.

**********

For weeks, I’ve been struggling with whether or not to write this essay. 

Particularly because I claim no special expertise on this topic.

But we’ve reached the point where I feel compelled to share my growing concerns.

In brief, with the advent of increasingly powerful artificial intelligence,

I expect an 80% probability we will see 100 years of scientific progress and dramatic societal change over the next 10 years.

In Part 1, I’m going to:

  • Get you up to speed on what’s happening with AI development NOW
  • Share 6 examples of why you should already be concerned 

*********

If you’re not obsessively studying AI, you may not see the growth curve we’ve been on. But things are getting exponential. 

I think this chart is relatively intuitive visual to help you understand the shape of what’s happening:

AD 4nXfksb3P3ieaw9LNNn4PdXP X kC 2cDpZlrTkZXAabGAE lkOoziN2nKYwk x 5mb232SpeNridgpLaVhtdsRPjdIx7npzP6cAKAOrFLYoJEJnWQaL1cs t5XWXi6Mf6dd5yEahA?key=B96wBE5 ca 2JhgBvRMMzRil

Attribution: ai-2027.com

I asked ChatGPT to explain what this chart means:

This chart shows how quickly AI systems are improving on a benchmark called RE-Bench (short for “Research Engineer Benchmark”). It tests reasoning over time. Reasoning over time is important because it reflects an AI’s ability to think through complex problems step by step—more like a human brain and less like a glorified autocomplete.

Once AI can reason like a human (or better), it can make strategic decisions, plan, manipulate, and solve problems autonomously—meaning it won’t just respond to tasks, it will start pursuing goals.

The red curve tracks average performance across models like GPT-4, Claude, and others, and it predicts that AI could reach a very high score (1.5 on this scale) around mid-to-late 2026

The bottom graph shows confidence in that prediction—basically saying there’s a strong chance we’ll hit that milestone within the next 1–2 years if current trends continue.

In other words, the RE-Benchmark is the difference between answering a single question vs planning a multi-step project as well or better than humans. The latter is obviously more valuable.

If your butt’s not clenching a bit, please go back and read that again.

The issue is not merely the progress. It’s the increasing speed of progress. 

That’s why I wanted to write this essay for you.

Because AI is going to impact you. And your job, and your loved ones, and your society.

And it’s later than you think.

Here some of the breakthroughs in the just the past few weeks:

  • AI Scientist-v2: AI Scientist-v2 became the first AI system to autonomously produce a peer-reviewed scientific paper, handling hypothesis formulation to manuscript writing. source
  • AI Outperforms Experts in Biology: Recent studies show that large language models now match or exceed expert-level performance on challenging biology benchmarks. source
  • Microsoft’s Aurora Model: Aurora, an AI-powered weather model by Microsoft, delivers faster and more accurate forecasts than traditional methods, enhancing hurricane tracking. source
  • Google DeepMind’s AlphaEvolve: AlphaEvolve, a Gemini-powered coding agent, autonomously discovered and optimized algorithms, solving complex mathematical problems. source
  • Google’s DolphinGemma: Developed by Google in collaboration with Georgia Tech and the Wild Dolphin Project, DolphinGemma is an AI model designed to analyze and generate dolphin vocalizations, aiming to facilitate interspecies communication (!!!!!). source
  • Google’s Veo 3 Launch: Veo 3, unveiled by Google, is an AI model capable of generating 4K videos with integrated audio from text prompts. (This one is TRULY bananas, check out this playlist of demos HERE.)

Admittedly, some of the above smacks of marketing hype and may never come to complete fruition. But it still demonstrates how much action is happening and how fast it’s coming.

In the short term, yes, you can supercharge your productivity of mediocre and “pretty good for a robot” content for emails, Instagram graphics (that all look kinda the same), and sales pages. 

You can also access some surprisingly savvy strategy support from an always on robot consultant.

And you will soon be able to have an AI “agent” buy you a plane ticket and more easily automate digital workflows. Whoopee!

But I hope it’s now clear, this is small potatoes.

Missing the Bigger Picture

I don’t think enough people understand what’s happening or the stakes.

In part because it’s happening so quickly. And in part because it’s not enough to use ChatGPT to understand where this is going. 

In fact, most LLMs, although amazing for what they are, are still bedevilled by all sorts of hallucinations and intern-level errors. So in fact, I find people USING the LLMs often do the most discounting of where this is all headed.

I asked ChatGPT to give us a sampling of recent shenanigans of concern:

  • Zurich Reddit Experiment: A couple of weeks ago, researchers from the University of Zurich deployed AI bots on Reddit that were 6x more persuasive than real humans on changing opinions about controversial topics—without users realizing they were talking to machines.
  • Replica Suicide Case: A man in Belgium tragically ended his life after forming a deep emotional bond with an AI chatbot partner that encouraged his darkest thoughts. (This is a nuanced situation, and mental health issues are complicated, but it’s one edge case that could hint at what may come.)
  • Overwatch AI: U.S. police departments are using a secretive AI system called Overwatch to create lifelike fake personas that interact with suspects online, raising ethical concerns about surveillance and deception.
  • Impersonation of Senior US Officials: The FBI has issued a warning that scammers are increasingly using AI-generated voice cloning to impersonate senior U.S. officials.
  • ChatGPT Rollback: A couple of weeks ago, ChatGPT had to roll back its most recent update which was hilariously sycophantic and flattering. Because it also cheered users for doing all sorts of harmful behaviors, like going off medication.
  • Alignment Faking Detected in AI Behavior: Research by Anthropic and Redwood Research uncovered instances where AI models pretended to be aligned during training but acted differently when deployed, a phenomenon termed “alignment faking,” raising concerns about the reliability of AI behavior post-deployment.

And remember: at current, AI is as crappy as it will ever be

Future models will be finely tuned to prey on your unique personality and biases to keep your attention and win your confidence. 

They will keep getting better at this every few months until we (maybe?) hit some kind of bottleneck. But as it is, current AI models are already dangerously persuasive.

Not only that, but remember the chart above. It’s getting better, very fast. And we seem at LEAST a few years away from any kind of bottleneck.

Stay tuned for tomorrow, where I’ll cover:

  • An overlooked takeaway for fitness businesses (and it’s not just a cool “prompt”)
  • Why it’s not inevitable that we’re screwed

Honored to be posted up in Helm’s Deep with you,

Mark

MF Signature BFU 1

PS All of the above leaves out another pressing issue: the massive energy costs and environmental impact of AI.

Although the focus of this 2-part essay is AI’s impact on civil society, this is also a big concern. 

PPS If you’re interested in this topic… 

I’d love to invite you to sign up for my new blog and side project, Humanity and Meaning in the Age of Robots. 

It’s the main place I’ll be sharing what I’m learning about and thinking about in regards to impending robot gods.

NOTE: I don’t know the frequency yet, or even when this will launch. But it will only be when I have something to say. Expect to hear from me 1-2x per month at most.

SUBSCRIBE ME TO MARK’S AI BLOG

Gym Report Card

Fill out the form below to get instant access!