The Daily Sandwich

"We have to learn the lesson that intellectual honesty is fundamental for everything we cherish." -Sir Karl Popper

Name:
Location: Boston, Massachusetts, United States

...........................

Thursday, May 18, 2006

NSA scrapped legal surveillance program

And apparently it worked quite well, in addition to working within the law. I'm not sure this is another manifestation of the rabid ideologues who were determined to do nothing like Clinton did, no matter how effective, but it certainly indicates the

The National Security Agency developed a pilot program in the late 1990s that would have enabled it to gather and analyze huge amounts of communications data without running afoul of privacy laws. But after the Sept. 11 attacks, it shelved the project - not because it failed to work but because of bureaucratic infighting and a sudden White House expansion of the agency's surveillance powers, according to several intelligence officials.

The agency opted instead to adopt only one component of the program, which produced a far less capable and rigorous program. It remains the backbone of the NSA's warrantless surveillance efforts, tracking domestic and overseas communications from a vast databank of information, and monitoring selected calls.

Four intelligence officials knowledgeable about the program agreed to discuss it with The Sun only if granted anonymity because of the sensitive nature of the subject.

The program the NSA rejected, called ThinThread, was developed to handle greater volumes of information, partly in expectation of threats surrounding the millennium celebrations. Sources say it bundled four cutting-edge surveillance tools. (. . .)

A number of independent studies, including a classified 2004 report from the Pentagon's inspector-general, in addition to the successful pilot tests, found that the program provided "superior processing, filtering and protection of U.S. citizens, and discovery of important and previously unknown targets," said an intelligence official familiar with the program who described the reports to The Sun. The Pentagon report concluded that ThinThread's ability to sort through data in 2001 was far superior to that of another NSA system in place in 2004, and that the program should be launched and enhanced.

The obvious implication is that they scrapped a streamlined program in favor of one that addressed the 'needle in a haystack' problem by adding more hay. Just one more blow to the myth of small-government conservatism.

Recommended reading.