AI & computation

Evaluation compares a defined task, dataset and measure; those choices affect what success means.

Start here

Introduction to AI & computation

What does it mean to evaluate an AI system?

AI & computation3h · IntroductionBeginner

Choose a direction

Foundations of computation

What can a machine compute?

AI & computation22h · TopicSome background

Deep learning

How do neural networks learn representations?

AI & computation22h · TopicSome background

Causal AI

Can a model learn causes?

AI & computation22h · TopicSome background

Datasets and decisions

How can a dataset shape a system’s behaviour?

AI & computation14h · TopicSome background

AI as a material system

What lies outside an AI model’s code?

AI & computation14h · TopicSome background

Read a thinker or author

Alan Turing

Work on computability, machine intelligence and morphogenesis. Begin by distinguishing a mathematical model, an operational test and a biological mechanism.

Karl Friston

Neuroscience and mathematical frameworks for inference, perception and action. Begin with a small probabilistic model before tackling the formal free-energy principle.

Claude Shannon

A mathematical account of communication under uncertainty. Separate the quantity of information in a model from the meaning or truth of a message.

Fei-Fei Li

Computer vision and human-centred approaches to AI. Study the relationship among a dataset, a benchmark and the people affected by a system.

Timnit Gebru

Research on dataset documentation, evaluation and harms in machine learning. Begin with how data was collected and which uses its documentation supports.

Ruha Benjamin

Social analysis of race and technological design. Examine how a system’s categories, defaults and institutional uses can reproduce inequality.

Kate Crawford

Research on AI’s material, labour and political conditions. Trace a system beyond its interface to extraction, human work and data infrastructures.

Connect this subject

What should count as success for an AI system?

Connect computation, datasets, labour and social consequences. Compare a technical evaluation with the people and purposes it leaves out.