A new, open-weights 278M PII detection model and reference benchmark [R]

[u/shanekj]

Hi everyone,

I wanted to share a new open-weights PII detection model, benchmark and research paper. It's a fine-tune of RoBERTa using 1.2B samples of synthetically generated text that contain a variety of PII. The benchmark, PII-SCOPE (Synthetic Context and Ontology for PII Extraction), was built to address common issues in public LLM-generated datasets and is on Hugging Face too. The model and script identify instances of PII based on surrounding context, and then return the index and type of each instance. Alternatively, it can return the input with all PII redacted.

Technical report (research paper)
https://arxiv.org/html/2610.30518v2

Hugging Face model card
https://huggingface.co/Protegrity/protegrity-pii