Sentient Foundation releases model fingerprinting leaderboardMachine translation

Good news for anyone trying to prove a model is theirs. Sentient Foundation released the Fingerprinting Leaderboard, a free, open source benchmark that tests fingerprinting methods, meant to prove an AI model was copied from yours. Researchers submit a method for hiding an ownership mark inside a model, and Sentient puts that mark into its own test models, tries to strip it out, then ranks the method on a public website. The code that runs these tests, called mlprints, is released too. A fingerprint trains a model to return unlikely answers to secret prompts, so an owner can test a suspected copy through its API alone. But a fingerprint that survives every attack is still useless if the owner can’t read it back reliably. Sentient Foundation’s Fingerprinting Leaderboard scores that verification step directly, alongside how well the mark resists removal and how much model skill it costs. Sentient’s Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility, is also competing on the leaderboard, and the fingerprints survived standard fine-tuning.

Models cost millions to train and minutes to copy. Fine-tuning and distillation can erase where they came from. Introducing the Fingerprinting Leaderboard, an open benchmark for model provenance — built so the proof lives in the weights, not the paperwork. https://t.co/aHONvNd7o4