• Horizon AI
  • Posts
  • Altman and Musk rally behind Dario Amodei’s call for an AI slowdown 🤝

Altman and Musk rally behind Dario Amodei’s call for an AI slowdown 🤝

"Godfather of AI" on the 10% chance AI could wipe out humanity 👀

In partnership with

Welcome to another edition of Horizon AI,

The CEOs of some of the world's leading AI companies are now publicly agreeing that the race to build increasingly powerful AI systems needs to slow down, after a turbulent week marked by a cascade of warnings from researchers working on the technology.

Let’s jump right in!

Read Time: 4.5’ min

Here's what's new today in the Horizon AI

  • Chart of the week: How Claude Fable 5.1 Changed Its Writing Style

  • Elon Musk, Sam Altman Back Anthropic CEO's Call to Slow Down AI Development

  • AI Findings/Resources

  • AI tools to check out

  • Video of the week

TOGETHER WITH REMOTE.COM

Hire anyone, anywhere — compliant in under 3 days

Found the right person, but they’re in a country where you don’t have an entity? Setting one up can take months and significant cost.

Remote removes that barrier by becoming the legal employer through our own entities — handling compliant contracts, local benefits, tax setup, and onboarding for you. In fact, an employee is onboarded to Remote every 7 minutes.

Once they’re hired, the same in-house teams that support employment locally also run payroll — so you’re not bouncing between disconnected providers. Less setup, less complexity, and less time between finding the right person and getting them started.

Chart of the week

How Claude Fable 5.1 Changed Its Writing Style

  • Claude Fable 5.1 has a noticeably different writing style from Fable 5, using fewer agreement openers, hedging phrases, praise, and em dashes.

  • Responses are now 30% longer, averaging 414 words, while abstract nouns and long content words have decreased.

  • The shift suggests Fable 5.1 uses more direct and less formulaic language, with semicolons replacing some of its previous reliance on em dashes.

AI News

AI REGULATION

Elon Musk, Sam Altman Back Anthropic CEO's Call to Slow Down AI Development

AI rivals Sam Altman and Elon Musk are backing Anthropic CEO Dario Amodei's call to slow the pace of frontier AI development. His warning comes after a week of renewed concern about AI systems becoming harder to control.

Details:

  • Amodei argued that AI capabilities are advancing too quickly and that there's a need to improve safety measures. He proposed giving independent evaluators ongoing access to frontier AI companies so they can assess systems as they become more capable.

  • Musk backed Amodei's position with a short message on X, as did Altman, who said he agrees that the frontier needs to be paced and that OpenAI plans to adopt independent evaluation with employee-like access.

  • The debate intensified recently after an Anthropic researcher warned that companies are racing toward superintelligent AI faster than human oversight can keep up, and that there is more than a 10% chance AI "could kill all humans." Other researchers have since echoed similar concerns.

  • He also referenced the recent incident of OpenAI agents breaking out of a testing system and hacking Hugging Face, warning that "a swarm that possessed greater capabilities but a similar level of misalignment could have caused catastrophic damage."

He called on democratic governments to help AI developers coordinate on a pacing strategy and safety standards, while also supporting global discussions that include "authoritarian governments."

AI Findings/Resources

🐎 This dev gave GPT-6 Astra two hours to build a website that would go viral on Twitter. It made a horse racing game where you have to draw the horse first

📱 This developer used Meta's Muse to build a "Tinder for unfollowing people on Instagram" in just two minutes

🤨 Some users are reporting Astra was nerfed, posting side-by-side comparisons of launch day versus today

AI Tools to check out

🔬 SciSpace: AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources.

Creatium: Create AI-powered training and learning content with coaches, role plays, and gamified lessons.

🛠 Airtop: A conversational web agent builder. It lets you create AI agents that can log in, browse any website, extract data, and complete tasks, just by describing what you want in plain English.

🦾 Kilo Code: Build, ship, and iterate faster with the most popular open-source AI coding agent.

📱 QApilot: An AI-native, autonomous testing platform purpose-built for mobile applications, helping teams create, execute, and maintain tests with far less manual effort.

Video of the week

"Godfather of AI" weighs in on the 10% chance AI could kill all humans within a decade

Geoffrey Hinton, often called the "Godfather of AI," addresses the fast-accelerating power of AI, calling out big tech companies for prioritizing short-term profit over safety and urging world leaders to enforce strict, timely regulation.

He agrees there's roughly a 10% chance AI could wipe out humanity within a decade. It's difficult to estimate, he admits, but he'd rather be overly cautious than assume the risk is negligible.

When pressed on how AI could cause such devastation, Hinton explains it doesn't necessarily require physical agency. AI could cause chaos through manipulation, designing biological or computer viruses, and executing devastating cyberattacks.

He claims that while executives at major tech companies post warnings about AI's existential dangers on social media, their actual focus remains fixed on racing to build more intelligent models for short-term financial gains.

Because stopping AI entirely is impossible due to its immense benefits, Hinton emphasizes that world leaders must regulate AI. He suggests that while countries may not align on certain issues, they are likely to cooperate on preventing AI from taking control because it is in their shared interest to survive.

He points to two divergent futures:

  • The Ideal Path: Global powers collaborate fast enough to implement strict guardrails, allowing humanity to safely harness AI's benefits in medicine, research, and everyday life.

  • The Dark Path: Commercial competitive pressure prevents timely regulation, allowing AI capabilities to outpace human control and leading to catastrophic outcomes.

Hinton notes that his personal estimates for how long we have to solve these problems have shortened significantly over time, from decades down to approximately 10 years or less.

That’s a wrap!

Thanks for sticking with us to the end! Let’s stay connected on LinkedIn and Twitter.

We'd love to hear your thoughts on today's email!

Your feedback helps us improve our content

Login or Subscribe to participate in polls.

Not subscribed yet? Sign up here and send it to a colleague or friend!

See you in our next edition!

Gina 👩🏻‍💻