person comparing two facial images (NIST)

Man + machine makes for most accurate facial recognition

Facial recognition technology has been gradually improving, leading to speculation as to when algorithms will be accurate enough to be widely used.

It might be soon if artificial intelligence can be paired with human experts, according to researchers with National Institute of Standards and Technology and three universities.

In a study to determine whether algorithms, professional facial examiners or people untrained in facial recognition perform best, the researchers determined that, so far, using a professional identifier and artificial intelligence in tandem produces the most accurate identifications.

The study itself involved a total of 184 participants, 87 of whom were trained professional facial examiners, 13 were "super recognizers," a term implying exceptional natural ability. The control group consisted of 53 fingerprint examiners and 31 undergraduate students, none of whom had training in facial comparisons.

For the test, the participants (humans and four of the latest algorithms) received 20 pairs of faces that featured images designed to be challenging because of limited control of illumination, expression and appearance. Participants (including the algorithms) rated the likelihood of each pair being the same person on a seven-point scale.

Some of the results were predictable: The trained professionals did significantly better than the untrained control groups, and the algorithms performed on par with the experts. It was also not surprising that the fused responses of the experts were more accurate than that of any individual expert because the fusing of scores decreased variability.

The most accurate identifications, however, came from results from single forensic facial examiners fused with the best-performing algorithm.

The results suggest "that humans and machines have different strengths and weaknesses that can be exploited/mitigated by cross-fusion," the study stated.

The researchers concluded that more testing of both humans and algorithms -- including a broader set of facial recognition tasks that features low quality images, video and faces from diverse demographics -- would provide a roadmap for highly accurate face identification.

Read the full study here.

About the Author

Susan Miller is executive editor at GCN.

Over a career spent in tech media, Miller has worked in editorial, print production and online, starting on the copy desk at IDG’s ComputerWorld, moving to print production for Federal Computer Week and later helping launch websites and email newsletter delivery for FCW. After a turn at Virginia’s Center for Innovative Technology, where she worked to promote technology-based economic development, she rejoined what was to become 1105 Media in 2004, eventually managing content and production for all the company's government-focused websites. Miller shifted back to editorial in 2012, when she began working with GCN.

Miller has a BA from West Chester University and an MA in English from the University of Delaware.

Connect with Susan at smiller@gcn.com or @sjaymiller.

inside gcn

  • prisoner using a cellphone (FBI)

    Cellphone jammer targets illicit calls by prisoners

Reader Comments

Fri, Jun 1, 2018 mike

I read an article in Wired a while ago about 'super-identifiers,' people who can identify people far better than mere normals. Scotland Yard tested their folks and people that scored high were assigned to watch videos in train stations and lots of folks were identified and arrested.

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group