原帖引用 · 原文
该语言的正文暂不可用,当前显示已有版本。
Rohan Paul@rohanpaul_ai
You can go to their leaderboard, compare evaluated models by Microsoft, University of Washington, ETH Zurich, Tokyo Institute of Technology, and China Agricultural University, and submit your evaluation.
And here you will find more detailed information on what their Fingerprinting leaderboard is
Good news for anyone trying to prove a model is theirs.
Sentient Foundation released the Fingerprinting Leaderboard, a free, open source benchmark that tests fingerprinting methods, meant to prove an AI model was copied from yours.
Researchers submit a method for hiding an ownership mark inside a model, and Sentient puts that mark into its own test models, tries to strip it out, then ranks the method on a public website.
The code that runs these tests, called mlprints, is released too.
A fingerprint trains a model to return unlikely answers to secret prompts, so an owner can test a suspected copy through its API alone.
But a fingerprint that survives every attack is still useless if the owner can’t read it back reliably.
Sentient Foundation’s Fingerprinting Leaderboard scores that verification step directly, alongside how well the mark resists removal and how much model skill it costs.
Sentient’s Perinucleus method embedded 24,576 fingerprints in Llama-3.1-8B without degrading utility, is also competing on the leaderboard, and the fingerprints survived standard fine-tuning.
在 X 查看这条帖子 ↗
Models cost millions to train and minutes to copy. Fine-tuning and distillation can erase where they came from.
Introducing the Fingerprinting Leaderboard, an open benchmark for model provenance — built so the proof lives in the weights, not the paperwork.
https://t.co/aHONvNd7o4
在 X 查看这条帖子 ↗
· UTC+8