Serious AI risks deserve clear distinctions. Scams and incorrect outputs are present-day problems. More severe future scenarios concern misuse of powerful capabilities or systems acting in ways people cannot reliably oversee. Evidence for an existing harm is not evidence for a precise probability of a future catastrophe.

Three different claims

How to read the debate

The International AI Safety Report synthesises research on capabilities and risks. It is a starting point for examining evidence, not a guarantee of what will happen. Ask which system is being discussed, what capability has been demonstrated, what assumptions the scenario requires, and which limits or safeguards were tested. Experts differ on future capabilities, timelines and the importance of different failure mechanisms. [Department of Industry: International AI Safety Report 2026 ↗]

The Australian policy context

Australia already has an AI Safety Institute within the Department of Industry, Science and Resources. Its work includes analysing capabilities and risks and engaging with technical partners. Calls for more resources, transparency or independent scrutiny are proposals about how that work should develop—not evidence that no institute exists. [Department of Industry: Australia’s AI Safety Institute ↗]

Preparing for a serious possibility does not require pretending we know its probability.

AI Down Under supports proportionate testing, accountable deployment and meaningful avenues for challenge. Those are editorial policy preferences. Readers should examine the sources and competing proposals rather than treat this article as a settled forecast.

Prepare your own policy letter →

Sources & scope

Edition 2026-10-09.3. AI-assisted editorial revision; independent specialist and reader review pending. Educational material, not legal, medical or financial advice. Examples are hypothetical unless explicitly documented.

How we publish and correct →