Intercept: Speech Recognition is NSA's Best-Kept Open Secret

https://firstlook.org/theintercept/2015/05/11/speech-recognition-nsa-best-kept-secret/

Speech Recognition is NSA's Best-Kept Open Secret

By Dan Froomkin

11 May 2015

Siri can understand what you say. Google [1] can take dictation. Even your new smart TV [2] is taking verbal orders.

So is there any doubt the National Security Agency has the ability to translate spoken words into text?

But precisely when the NSA does it, with which calls, and how often, is a well-guarded secret.

It's not surprising that the NSA isn't talking about it. But oddly enough, neither is anyone else: Over the years, there's been almost no public discussion of the NSA's use of automated speech recognition.

One minor exception [3] was in 1999, when a young Australian cryptographer named Julian Assange stumbled across an NSA patent that mentioned "machine transcribed speech."

Assange, who went on to found WikiLeaks, said at the time: "This patent should worry people. Everyone's overseas phone calls are or may soon be tapped, transcribed and archived in the bowels of an unaccountable foreign spy agency."

The most comprehensive post-Snowden descriptions of NSA's surveillance programs are strangely silent when it comes to speech recognition. The report from the President's Review Group on Intelligence and Communications Technologies [4] doesn't mention it, and neither does the October 2011 FISA Court ruling, [5] or the detailed reports from the Privacy and Civil Liberties Oversight Board. [6]

There is some mention of speech recognition in the "Black Budget" [7] submitted to Congress each year. But there's no clear sign that anybody on the Hill has ever really noticed.

As The Intercept reported on Tuesday, [8] items from the Snowden archive document the widespread use of automated speech recognition by the NSA.

The strategic advantage, invasive potential and policy implications of being able to turn spoken words into text are not trivial: Suddenly, voice conversations, historically considered ephemeral and unsearchable, can be scanned, catalogued and archived -- not perfectly, but well enough to dramatically increase the effective scope of eavesdropping.

Former senior NSA executive turned whistleblower Thomas Drake, who's seen NSA's automated speech recognition at work, says the silence is telling.

"You're seeing a black hole," Drake told The Intercept. "That means there's something there that's really significant. You're seeing some of the fuzzy contours of this whole other program."

Not Technically a Secret

The NSA's ability to turn voice into text, interestingly enough, is not technically a secret. [9]

And speech recognition technology has been heavily -- and openly -- funded by the Defense Advanced Research Project Agency (DARPA) since the early 1970s. [10]

The latest of DARPA's many public research projects [11] in that area is the Robust Automatic Transcription of Speech program, [12] known as RATS, which focuses on "noisy or degraded speech signals that are important to military intelligence."

Meanwhile, DARPA's intelligence-world counterpart, IARPA, [13] announced the Babel Program in 2011, with its goal of "developing agile and robust speech recognition technology that can be rapidly applied to any human language in order to provide effective search capability for analysts to efficiently process massive amounts of real-world recorded speech."

Despite openly announcing its speech-to-text program, IARPA declined an interview request by The Intercept.

Robert Litt, who as general counsel for the Office of the Director of National Intelligence is the intelligence community's chief lawyer, was asked about the NSA's speech-to-text capabilities at a forum on transparency on Capitol Hill on Friday.

He took the opportunity to lash out [14] at The Intercept's reporting: "I think that story is a great example of what is wrong with a lot of media coverage of this," he said. "That story made absolutely no distinction between technical capabilities and legal authorities. There are all sorts of technical capabilities that NSA has. I'm not commenting on the existence or nonexistence of any such authority. The question is when are they used and what are the legal authorities under which they are used. And I think that that's something that a lot of the press reporting completely ignores, including that story you wrote."

Asked to explain in what ways the use of speech-to-text is limited, Litt repeatedly refused [15] to even acknowledge its existence.

"I'm not saying that the government isn't using these techniques. I am not acknowledging that these techniques exist even."

You won't hear much about the use of speech recognition for surveillance in academe, either.

Researchers in the field are divided between those who don't take NSA funding, and can only speculate about what goes on over there -- and those who do take NSA funding, but won't say what they know.

"There's a lot of weird hush-hush that goes on," said Bhiksha Raj, an associate professor at Carnegie Mellon University's Language Technologies Institute, who said he does not receive NSA funding. "Academics who work for the NSA must go through various clearances. They sign several papers. They hold closed meetings that are only attended by people with clearances."

Some non-NSA affiliated academics were once "quite keen" on seeing how the NSA was faring in the face of the technical challenges in the field, Steve Young, a professor of information engineering at the University of Cambridge, recalled. "But unless you actually work for the NSA and you've been vetted, you're not going to get close to the real data."

Ironically, even GCHQ, NSA's intelligence partner in the U.K., has complained about DARPA and NSA's secrecy. A 2009 GCHQ assessment [16] of speech-to-text technology said that "The DARPA evaluation programme, with significant steer from NSA, has been the main driving force behind technology improvements in the field. Unfortunately, the results of the evaluations are not put in the public domain, making reference difficult."

All the secrecy has an obvious advantage for the NSA. If the NSA can keep their speech-recognition capabilities secret, nobody can tell them what to do. And if nobody knows what they are doing, then nobody can tell them to stop.

Senator Ron Wyden, D-Ore., arguably the foremost congressional critic of NSA overreach, wouldn't comment directly on the question of speech recognition. But, he said through a spokesperson: "After 14 years on the Intelligence Committee, I've learned that senators must be constantly on the lookout for secret interpretations of the law and advances in surveillance that Congress isn't aware of."

He added: "For centuries, individual privacy was protected in part by the limited resources of governments. It simply wasn't possible for governments to secretly collect information on every single citizen without investing in massive networks of spies and informants. But in the 21st century mass surveillance is no longer difficult and expensive -- it's increasingly cheap and easy. The only privacy protections that will matter in the future are the ones that are written into law and defended by public demand for freedom and openness."

Research on the Snowden archive was conducted by Intercept researcher Andrew Fishman.

Email the author: dan.froomkin@theintercept.com

[1] https://www.google.com/intl/en/chrome/demos/speech.html

[2] http://www.theguardian.com/technology/2015/feb/19/samsung-smart-tvs-send-unencrypted-voice-recognition-data-across-internet

[3] http://www.independent.co.uk/arts-entertainment/network-this-is-just-between-us-and-the-spies-1126316.html

[4] https://www.whitehouse.gov/sites/default/files/docs/2013-12-12_rg_final_report.pdf

[5] http://www.scribd.com/doc/162016974/FISA-court-opinion-with-exemptions

[6] https://www.pclob.gov/library.html#oversightreports

[7] https://firstlook.org/theintercept/document/2015/05/05/black-budget-fy-2013-congressional-budget-justificationnational-intelligence-program-pp-360-364/

[8] https://firstlook.org/theintercept/2015/05/05/nsa-speech-recognition-snowden-searchable-text/

[9] https://firstlook.org/theintercept/document/2015/05/05/classification-guide-human-language-technology-hlt-models/

[10] http://books.google.com/books?id=iDHgboYRzmgC&pg=PA551#v=onepage&q&f=f

[11] http://books.google.com/books?id=iDHgboYRzmgC&pg=PA551#v=onepage&q&f=f

[12] http://www.darpa.mil/Our_Work/I2O/Programs/Robust_Automatic_Transcription_of_Speech_(RATS).aspx

[13] http://www.iarpa.gov/

[14] http://www.c-span.org/video/?c4537220/bob-litt-speech-to-text-part

[15] http://www.c-span.org/video/?c4537221/bob-litt-speech-to-text-part-2

[16] https://firstlook.org/theintercept/document/2015/05/05/sirdcc-speech-technology-wg-assessment-current-stt-technology