About us Login Get email updates
Research
Print

Weekly Standard misleadingly touted "data-mining" as "crucial" to terror investigations

May 16, 2006 11:49 am ET

SUMMARY: A Weekly Standard editorial criticized the Bush administration for not hyping "data-mining," demonstrated by the National Security Agency's reported data collection program, as "a crucial tool against unknown mass-murderers." The editorial offered little to justify the claim that "data-mining" is "a crucial tool," though there are experts who question the utility of "data-mining" in terrorism investigations -- specifically the type of "data-mining" the in which NSA is allegedly engaged.

3 Comments

In an editorial in the May 22 edition of The Weekly Standard, Manhattan Institute scholar Heather Mac Donald criticized the Bush administration for not hyping "data-mining" as "a crucial tool against unknown mass-murderers." Mac Donald was referring to the National Security Agency's (NSA) reported data collection program to cull the telephone records of millions of Americans and analyze them for patterns indicating possible terrorist activity. MacDonald offered little to justify her claim that "data-mining" is "a crucial tool"; indeed, there are experts who question the utility of "data-mining" in terrorism investigations -- specifically the type of "data-mining" the in which NSA may be engaged.

Mac Donald also repeated the claim that the NSA is only tracking phone calls and not listening to them without noting that the programs are reportedly linked -- because the call-records analysis "helps the NSA choose its targets for listening."

From Mac Donald's editorial in the May 22 Weekly Standard:

Ever since allowing the Pentagon's Total Information Awareness project to go down the tubes in 2003, the administration has failed to explain the potential of data mining, even as it secretly continues to use this vital technology. Thus, at every revelation of a government data mining program, privacy extremists enjoy unchallenged supremacy in characterizing the technology as a massive threat to life as we know it.

[...]

The Washington Post calls this numbers analysis the "most extensive ... domestic surveillance [program] yet known involving ordinary citizens and residents." Bunk. The NSA's data mining program is not surveillance; no one is being listened to or observed.

Data mining looks for mathematical patterns in computerized information; it is not a real-time spying operation. The government didn't need to go to the Foreign Intelligence Surveillance Court for a wiretap or pen register order (which governs the collection of phone numbers in real time from a single phone) because it is not listening to or recording any individual's calls. FISA is built around the notion of an individualized investigation of specific spies or terrorists; it is seriously outdated for the application of American computer know-how to ferret out terror plots before they happen and before the government has individual suspects in mind.

But it may be too late to convey these truths. The time to explain how data mining protects privacy while providing a crucial tool against unknown mass-murderers was while the Pentagon's Total Information Awareness program was under attack. That program, which hoped to uncover patterns of terrorist activity in publicly available commercial data, was merely in its preliminary research stages, but the Senate killed it in a demagogic display of privacy hysteria.

Despite Mac Donald's affirmative characterization of data mining as "a crucial tool," the merits of data mining in terror investigations have been questioned. For example, Newsweek technology columnist Steven Levy noted in his column for the May 22 edition that the utility of data mining is, as yet, undetermined: "While the practice works wonders in detecting credit-card fraud and targeting direct-marketing prospects, it's yet to be proved that the techniques of data mining can zoom in on terrorist behavior from billions of phone records." Levy continued:

The bane of such schemes is the false positive, when a suspicious pattern sounds an alarm bell-but turns out to be benign. This can be a real problem when looking for the evasive trail of a terrorist, as opposed to the relatively common and recognizable footprints of a credit-card thief. "When a disease is rare, even an accurate medical test has an excessive failure rate," says Bruce Schneier, chief technical officer of the Counterpane security firm. "[Data mining for terrorists] is a huge waste of money for very little return."

Moreover, though it is unclear exactly how the NSA analyzes the phone records it collects, Levy noted that Valdis Krebs, a "social network analysis" expert, indicated that certain analysis methods are more effective than others, and that the sheer volume of data the NSA has reportedly collected suggests that it employs an unwieldy and ineffective method, and also that it has unnecessarily collected vast amounts of useless data. According to Levy:

The NSA's historic request for the nation's phone logs signals a desire to perform massive "traffic analysis" of calls within the U.S. -- an examination of who calls whom, when they call and for how long -- to identify potential threats. This in turn is expected to be used for the kind of analysis that Krebs performed. But Krebs says you don't need the indiscriminate volume of phone records requested by NSA in order to perform effective social network analysis. The best way to snare the bad guys is to "go bottom up," he says, beginning with the bad guys, charting only the people in their circles and investigating from there.

Of course it's possible that the NSA will only tread within those narrow boundaries: but if that's so, why would our spooks need everyone's records? By asking only for the calls of suspected terrorists and their contacts, the agency could avoid the painful (and possibly illegal) tradeoff of handing over the telephonic fingerprints of millions of innocent Americans who never get within spitting distance of a malfeasant.

Levy did note that Robert Popp, the second-ranking official in the Pentagon's now-defunct Total Information Awareness (also known as Terrorism Information Awareness) project to which Mac Donald referred, defends data mining as a tool for terror investigations -- indicating that there is, at best, disagreement among experts regarding the efficacy of data mining. According to Levy:

Robert Popp, who was second ranking official of the Defense Department's discontinued Terrorist Information Awareness office, says false positives can be mitigated by a "multistage analysis" involving other sources of information. If an analysis of phone records unearths a daunting proliferation of leads, those could be matched up with other databases, like credit-card records or Internet activity. "With lots of data, you could then corroborate and accrue sufficient evidence," says Popp. If that technique works, the leads could be winnowed down before the FBI is sent out to knock on doors.

A May 15 Christian Science Monitor article also cited Krebs and "other experts" voicing skepticism about a "top-down" analysis method:

What Mr. Krebs, a Cleveland-based expert in social network analysis, did in a small way was what he and others say US agencies are trying to do on a much larger scale - by piling up mountains of data to sift for unseen patterns that reveal hidden terrorist networks.

"This can be a very powerful tool," he says, if the technique is used to "drill down" into known terrorists for their associates and those they call and connect with.

But Krebs and other experts are doubtful about the opposite method, a "top down" approach in which the bulk of data on innocent Americans is sifted for terrorists.

Expand All Expand 1st Level Collapse All Add Comment
    • Author by pete592 (May 16, 2006 11:56 am ET)
         

      Grammar check, summary and first paragraph.

      Report Abuse
    • Author by pick of the litter (May 16, 2006 12:51 pm ET)
         

      Well Heather Mac Donald must have some friends in high places since she seems to be privy to more particulars of latest NSA spy-scandal operations than most members of Congress. I think Bush welcomes this type of criticism, same as Gringrich's remarks, that the only thing wrong with these circumventions of law is the public relations campaign behind the hard sell. Thank you Heather, you are so much more rational than the Congress who sets the bar for privacy rights, those wacko privacy extremists supposedly elected to represent the people. Too bad that your beloved Total Information Awareness wasn't proven effective or Constitutionally legal. (gag cough gag)

      Report Abuse
    • Author by pick of the litter (May 16, 2006 1:07 pm ET)
         

      " Officials say the FBI makes extensive use of a new provision of the Patriot Act which allows agents to seek information with what are called National Security Letters (NSL).

      The NSLs are a version of an administrative subpoena and are not signed by a judge. Under the law, a phone company receiving a NSL for phone records must provide them and may not divulge to the customer that the records have been given to the government.

      Monday evening's report from Ross and Esposito followed their revelation earlier in the day that they had been told by "a senior federal law enforcement official" that the government is monitoring phone calls they are other journalists are making in order to identify confidential sources.

      Ross and Esposito wrote in their mid-day Monday entry on the ABC News blog that:

      A senior federal law enforcement official tells ABC News the government is tracking the phone numbers we (Brian Ross and Richard Esposito) call in an effort to root out confidential sources.

      "It's time for you to get some new cell phones, quick," the source told us in an in-person conversation.

      ABC News does not know how the government determined who we are calling, or whether our phone records were provided to the government as part of the recently-disclosed NSA collection of domestic phone calls.

      Other sources have told us that phone calls and contacts by reporters for ABC News, along with the New York Times and the Washington Post, are being examined as part of a widespread CIA leak investigation.

      If these reports are accurate - and Ross and Esposito have a solid record of getting things right - it does not require much of an imagination to determine what has transpired.

      Any serious discussion will turn, for reasons hardly unreasonable considering recent revelations regarding this White House's disregard for the rule of law, to the question of whether a frustrated Bush-Cheney administration is seeking the phone records of journalists not merely to identify leakers but to thwart the sort of whistleblowing that has embarrassed the president and vice president by linking them to warrantless wiretaping, rendition of prisoners, the defense of torture, the distribution of classified information in order to punish political critics and other abuses of power.

      If the administration has begun reviewing the telephone calls of reporters not to catch lawbreakers but to prevent revelations of its own lawlessness, then this White House has strayed onto dangerous political turf. "

      from FBI Said to Seek Phone Records of News Reporters, By John Nichols, The Nation,

      Tuesday 16 May 2006

      [link to www.truthout.org]

      Report Abuse

my.MediaMatters.org

Login  Sign Up

Push Back

Phone calls, emails and letters from the public do make a difference. Remember that to be effective you must be polite, and professional. Express your specific concerns regarding that particular news report or commentary, and indicate what you would like the media outlet to do differently in the future.

  • The Weekly Standard
    Weekly Standard

    The Weekly Standard
    1150 17th Street, NW
    Suite 505
    Washington, DC 20036