Winning the DARPA Challenge: Crowdsourcing, algorithms and detective work

It’s easy to cut a piece of paper into little bits. The trick is putting it back together again to read what’s on it. Now imagine doing that on a battlefield. 

That was the goal of the Defense Advanced Research Agency’s Shredder Challenge, which was won this month by a small San Francisco-based team that correctly reconstructed the event’s five documents and solved their related puzzles. 

The “All Your Shreds Are Belong to U.S.” team developed custom-coded, computer vision algorithms that recommended fragment pairings to human assemblers for verification. 

Related coverage:

System would monitor feds for signs they're 'breaking bad'

DARPA's new cyber tack: act like a hacker

The team spent nearly 600 man-hours creating the algorithms and piecing together the documents that were shredded into more than 10,000 pieces. Some 9,000 teams registered for the Challenge, DARPA officials said. 

The most effective approaches in the event combined computational and crowdsourcing, with a dash of detective work thrown in, Dan Kaufman, director of DARPA’s Information Innovation Office, said in a statement. It took the winning team 33 days to solve all five puzzles and win the $50,000 prize.

DARPA’s Shredder Challenge is a preliminary look at potential technologies and applications that could help warfighters in the field. The agency is looking for capabilities that would allow soldiers to quickly reconstruct and pull information from shredded or destroyed documents. DARPA also wants to understand the potential vulnerabilities the U.S. government faces when it shreds sensitive documents and hopes to apply those lessons to new information security techniques. 

Agency personnel will meet with the winning team to learn more about the techniques they used to solve all five puzzles. However, DARPA has no plans at this time to develop software related to the Shredder Challenge, said agency spokesman Eric Mazzacone. He added that any intellectual property rights remain with the participants. 

inside gcn

  • security in the cloud (ShutterStock image)

    Cloud security is the agency’s responsibility

Reader Comments

Fri, Dec 9, 2011 Cowboy Joe

Don't know why some youngn' - or maybe some ol coot from the hills - hasn't figured out a way to take all those shredded documents, slurry 'em up into a mash, find some "wee beasties" to do ther magic, and presto - wood alcohol fuel for fuel cells and the like. As much useless paper as our dear Uncle Sam cranks out, and as much as that fair city is already alcohol fueled - this seems like a pretty low impact "renewable energy" project.

Thu, Dec 8, 2011 SoutheastUS

With the ability to assemble inexpensive "superclusters" for massive parrallel processing power (using the extremely efficient parallel processing of hundreds or thousands of graphic co-processor boards), the pattern-matching and OCR technologies could be linked into a method of reassembling shredded documents in hours rather than days or weeks. Time to start using oxygen-enriched shredder furnaces or high-speed pulping equipment on the shredded documents to ensure destruction.

Please post your comments here. Comments are moderated, so they may not appear immediately after submitting. We will not post comments that we consider abusive or off-topic.

Please type the letters/numbers you see above

More from 1105 Public Sector Media Group