Insights

Notes from the delivery floor

What we learn running annotation, validation and human-in-the-loop operations at production scale. Written by the people doing the work, not the people selling it.

A clipboard headed Agreement Score with two people shaking hands out of focus behind it

Your agreement score cannot see half your errors

Inter-annotator agreement measures whether your labellers disagree. Most of the expensive damage comes from the times they agree, all in the same wrong direction.

Read the article

Yellow and black circuit-board letters spelling AI

The real price of getting AI data wrong

A data error does not cost what it costs to fix. It costs what it costs to fix, multiplied by how long it was allowed to live. Why detection speed beats accuracy rate as a quality metric.

Read the article

Stay close to the work

Get the next note from the delivery floor.

One email when we publish something new. No newsletter filler, no sales sequence.

Notify me →

Talk to the delivery team

Send us a sample batch. We will send back the agreement score with it.

Managed annotation, validation and human-in-the-loop operations from Nairobi, ISO 27001 certified, with named delivery leads on every project.

Request a free trial batch