Innovatrics Tops NIST FATE Age Estimation Composite Across 23 Vendors

Innovatrics’ age-estimation algorithm has placed first in the combined composite of the National Institute of Standards and Technology’s Face Analysis Technology Evaluation Age Estimation and Verification track, a leaderboard that includes 42 submissions from 23 vendors. The company’s algorithm finished second in each of the two underlying benchmarks individually, and first when the two are combined into a single composite measure.

NIST FATE AEV is the standing third-party evaluation for facial age estimation, the technology used to infer a person’s age from an image of their face. Operators of age-restricted online services have leaned on the program for independent measurement of accuracy and bias, particularly as governments in Europe, Australia, and several US states move toward age verification requirements for adult content, social media, and other services.

The two NIST benchmarks Innovatrics topped in composite measure different things. The Demographics aggregate is a broad accuracy score that combines results across two sexes and 13 age ranges spanning 18 to 30. Innovatrics placed second in that benchmark, with a Figure of Merit of 3.92. Challenge 25 is the operationally relevant benchmark for retail and online age gating, which tests how well an algorithm correctly classifies people who are at or near 25 years old, the common threshold operators use to decide whether to ask for further identity proof. Innovatrics finished second in that benchmark as well. The first-place composite ranking captures the balance between the two: other systems lead one benchmark but fall behind in the other.

“For age estimation to work in real deployments, accuracy has to be consistent across different users and capture conditions,” said Jakub Sochor, Chief Technology Officer at Innovatrics. “This result is important because it shows progress not only in ranking, but in balance, which is what our customers need when they deploy at scale.”

The result lands as NIST continues to expand the AEV track. The agency has previously added new vendor submissions to the program and has positioned it as a long-term effort, alongside the FATE program’s other tracks. NIST’s earlier round of age-estimation testing showed no single vendor leading on every measure, a pattern Innovatrics’ composite ranking is consistent with.

Detailed accuracy scoring, including mean-absolute-error figures, is available on the NIST FATE AEV leaderboard.

Sources: Innovatrics

–

By the ID Tech Editorial Team