By William Leiss and Richard Smith

Publication details forthcoming. Expected publication date Spring 2027

This book begins with the story of the emergence of artificial intelligence (AI) for the general reader, detailing some of its benefits as well as its problematic side. It then brings the well-established risk management approach to bear on the catastrophic risks associated with Frontier AI, the newest AI models—risks which have been identified by many AI professionals as well as by leading AI firms. These risks include undermining cybersecurity, the creation of new biological and chemical weapons, and the real possibility that newer AI models may evolve beyond their human creators’ ability to understand or control the resulting systems. The Director of the CIA referred to the newest AI models as “digital nuclear weapons.”

Canada and other countries use the risk management approach for managing catastrophic risks, for example, those which arise from using nuclear power. When confronted by new catastrophic risks, the risk management approach first asks: How likely are they to happen? And if they happen, how bad will the outcomes be? This approach tells us (a) how severe the levels of risks are and (b) whether those levels are acceptable in terms of public security. We conclude that the catastrophic risks associated with AI are clearly unacceptable. Stringent regulations by governments must be created urgently, requiring the AI industry to implement a global indefinite pause on Frontier AI and on the goal of creating a superintelligent machine: Stop AI! We call upon the Government of Canada to enact such regulations and join with other countries to create an international treaty on AI safety.

Table of Contents

List of Figures

List of Tables

Preface

Part One: Artificial Intelligence

Introduction

Chapter 1: The Good

Chapter 2: The Bad

Chapter 3: The Ugly

Chapter 4: The Superhuman Machine

Part 2: Risk Policy and Analysis

Chapter 5: The Risk-Based Approach

Chapter 6: The Control Problem

Chapter 7: Catastrophic and Existential Risks

Chapter 8: Risk Estimation

Chapter 9: Quantitative Risk Assessment for Loss of Control (By Michael G. Tyshenko)

Part Three: Governance and Risk Management

Chapter 10: Regulation

Chapter 11: Risk Mitigation Options

Chapter 12: Heart of Darkness

Chapter 13: Blaming the Victims

Chapter 14: What Should the Public Do?

Chapter 15: What Should Governments Do?

Chapter 16: Risk Management Summary

References

Acknowledgements