chipintegrity.org GitHub
OPEN SOURCE · MIT · OCP TEST AND VALIDATION OUTPUT

Does this AI chip still give the right answer?

A GPU can pass every vendor diagnostic and still return wrong numbers with no error raised. Chip Integrity is an open, vendor-neutral tester that checks whether a chip computed correctly, and publishes the evidence as a file anyone can check.

6
chips measured
10,070
compute runs checked element by element
75.0 billion
memory words written and read back
0
silent faults found so far
1443 of 1443
planted faults caught in self-tests
HOW IT WORKS

Three steps behind every result

The same three steps run on every chip, so a result on one chip means the same thing as a result on any other.

1 RUN REAL AI MATHSdozens of runs per step2 CHECK EVERY ANSWERproven bound, bit for bit3 PROVE AND PUBLISHplanted faults, OCP files
01

Run real AI maths, many times

Matrix multiplies in every precision, the kernels inside a transformer, data patterns built to reach particular bits, and a sweep of the device memory. Every step runs dozens of times.

02

Check every answer two ways

Each output is compared with an exact or float64 reference under a proven rounding-error bound, and with the first run bit for bit. A wrong answer has to get past both.

03

Prove the checks work, then publish

Next to every clean run, a self-test plants faults on purpose and every one must be caught. Everything is written in the OCP Test and Validation format and published with the result.

Read the full method

LATEST

NVIDIA's own fault patterns, caught on a real GPU

NVIDIA's gate-level study of a data-center GPU (Tung et al., DSN 2026) found that real faults are mostly zeroed values and multi-bit flips, arriving in warp-aligned groups. Since version 0.4.2 the self-test plants faults shaped that way. On a rented RTX 4090, the reference check on its own flagged all 294 of them across six precisions, which means the same faults would be caught even if they repeated identically on every run.

How the self-test works · The result file