Subscribe to the Free Print Edition!
Celebrating 25 Years

To share is human

By William Jackson, GCN Staff

Anonymous data-mining technology protects privacy

Sharing data among government agencies is easier said than done. Many groups want or need to protect the confidentiality of their information, meaning they’d like a secure way of letting other agencies know what data they have without showing them the actual data.

Systems Research and Development of Las Vegas, a developer of identity recognition software, has come up with a scheme to let organizations share and compare data without compromising privacy.

SRD’s Anonymous Entity Resolution software, dubbed Anna, uses a hashing algorithm to create a unique identifier for each piece of personal data in a file. Once hashed, the data is unrecognizable except by software and can’t be cracked. Hashed identifiers from different databases can then be compared for matches without revealing the identity of the underlying individual.

“In the last two years we have seen the need for sharing more information while protecting privacy,” said John Slitz, chief executive officer of SRD. “This is a technique that allows us to look at large quantities of data and only evaluate that data that is common to both sets.”

The technology caught the eye of In-Q-Tel, the CIA’s technology investment incubator, when it was in prototype stage. The group partially funded development of the Anna technology, In-Q-Tel CEO Gilman Louie said.

Louie said homeland security programs depend on the ability of agencies to share data and use private-sector information securely, while assuring the public that privacy is not being compromised.

“Unless there is a technical solution to enable the policies, we are not going to get there,” he said. “In some places we’re at a logjam.”

He cited the discontinued Total Information Awareness program and the Computer Aided Passenger Prescreening System II, both of which fell victim to privacy concerns. “There is no perfect technology,” he said. “But this could be a critical enabling technology, providing a degree of comfort.”

Next-generation analysis

Anna builds on two previous SRD products: the Erik Identity Recognition Architecture, which standardizes names, cleans up personal data and puts it into a common format for comparison; and Non-Obvious Relationship Awareness (Nora), which looks for pieces of information that could link individuals, such as shared telephone numbers and addresses.