“Look over there!” said Dick Cheney, and the media dutifully looked as he directed.
If the media hadn’t looked as he directed, they might have figured out the underwear bomber’s attack was Dick Cheney’s fault.
Dick’s administration – yes, the one that Dick was running with George Bush acting as a meat puppet – spent $500 million of your tax dollars on a boondoggle counterterrorism database initiative nicknamed “Railhead” which failed to meet requirements to which it was supposed to perform. Railhead was supposed to screen for terrorist suspects attempting to enter the U.S.
The government even knew on Dick’s watch that Railhead was a debacle; the House of Representatives Committee on Science and Technology investigated the project’s technical shortcomings, way back in summer of 2008. You can be certain that problems with Railhead were recognized well before investigation and analysis which developed subsequent diagnostic memos.
But let’s back up to the point of origin. Railhead was launched after 2004, in an effort to create an improved datamining tool which would eventually replace the Terrorist Identities Datamart Environment (TIDE), operated by the National Counterterrorism Center (NCTC). TIDE was ordered in 2003 by the Bush administration, centralizing data on suspected terrorists from across the intelligence community. After several years, the hastily created and implemented TIDE had exploded in size but not become more effective in the process, yielding far too many “bad” names in the no-fly component.
A handful of different contractors were involved in creating the new Railhead database search tool; Boeing and SRI International have been mentioned most often by various sources. Boeing was apparently responsible for managing the project while the other entities involved contributed content. Numerous complaints about Railhead, from the appearance of conflicts of interest between Boeing and SRI, to the misuse of funds for building a Sensitive Compartmentalized Information Facility, and to the inability of the initiative to provide basic contracted deliverables, may have spurred additional oversight by Congress.
The House of Representatives Committee on Science and Technology’s research into Railhead revealed that the program could not do basic Boolean searches. This may be Greek to the average non-techie reader; here’s a fairly straightforward explanation by Rep. Brad Miller from the Committee on Science and Technology’s Subcommittee on Investigations and Oversight:
The TIDE database does not conduct text based searches like popular search engines, such as Google, for instance. Instead, TIDE relies on Structured Query Language (SQL), a cumbersome and complex computer code that must utilize complicated sentence structures to query the TIDE database. Without a detailed index of the data stored in each table in TIDE, the SQL search engine is blindfolded, unable to locate or identify undocumented data. The current TIDE database is composed of data fields that are presented in 463 separate tables, 295 of which are undocumented.[7] As a result, critical terrorist intelligence in the TIDE system may not be searched at all. [Source, page 2]
The failures are not completely outlined here, but you get the gist; this is what three years and half a billion dollars bought for our national security — a failed project.
But Dick Cheney would have you believe that the Obama administration should have cleaned this up and corrected this mess in less than a year’s time (and one would imagine with little money), in order to prevent the underwear bomber’s attempted attack.
Note this well: the Cheney-era cobbled up system which ran over budget and past its due date, which cannot perform a search even as well as a commercial search engine could do a decade ago, could not match up Umar Farouk Abdulmutallab with his father, Dr. Umaru Mutallab after Dr. Mutallab expressed concerns about his son’s intentions.
Abdul, in Arabic, means “servant of God”; any construction of a name including Abdul should also be searched without Abdul. A query for “Abdulmutallab” should also have included occurrences of “Mutallab” for this reason. It’s been suggested that Railhead could not handle this simple rule in queries; if it couldn’t do Boolean searches, it couldn’t do this.
Worse, as their systematic obstruction has demonstrated to date, Republican members of Congress have not supported the administration’s nominees to political appointments, including those in key positions in national security. Which means that Cheney’s peeps believe the Obama administration should already have cleaned up this CheneyCo mess using the very same persons and teams which created the mess to being with.
We’ve seen how this works with the financial industry: it doesn’t.
There was moderately good coverage in 2008 of the problems with Railhead, from Karen DeYoung at The Washington Post to Michael Krigsman at ZDNet. But the public didn’t fully grasp the magnitude of the problem, what with the lion’s share of media coverage focusing on the presidential campaigns and on the incipient financial crisis. And while the media did a fair job of recognizing the problem, it did not make this particular national security problem a campaign issue; the media failed to break through to the public’s general awareness.
And now the media exacerbates the situation by giving Dick Cheney a bully pulpit through which he can redirect our attention away from the gross errors of governance committed by the previous administration, when he was calling many of the shots on national security. Cheney says Obama makes us weaker and presto, the media gives his claim oxygen instead of pressing back at Cheney and asking him why he was such a national security fuck-up, leaving Obama’s administration to straighten out both Cheney’s messes while our nation remains exposed to terrorism.



83 Comments




Links aren’t hooked up..
This project has all of Dick Cheney’s hallmarks: secrecy, incompetence, expploitation of national security issues and, I’m willing to bet, a pay envelope for Dick or his friends.
Cheney and Bush are bullies, and, being bullies, they’re cowards. Fortunately for them, Congressional Democrats are bigger cowards, which is why Cheney and Bush have gotten away with — oh, pretty much everything so far.
Why the hell is this ass hat not in front of a judge and jury and getting prosecuted for the war crimminal he is,come on Holder do the right thing.1-202-514-2001..Call and tell Eric Holder we want investigations.I am also tired of seeing Karl Rove out and about.
“463 separate tables, 295 of which are undocumented”
To actually create SQL queries one has to understand all the tables, their contents and relationships. What they are saying is the database schema is also undocumented.
No one on the planet can handle 493 things in their memory at once, even if documented.
Rayne, I suspect you could summarize the Cheney Admin failure on Railhead and how that allowed undie bomber to enter U.S. in 3 sentences. Would you care to try?
clus-ter-fuck
This is the only question… the only reasonable demand. Thank you.
“Business as usual.”
“It doesn’t work.”
“We don’t care.”
Conclusory, as the lawyer’s would say. While accurate, I would look for something more meaty. A slogan with the essence of accuracy, if you will.
Ditto my response to Raven at 9.
There are far too many questions concerning the “underwear bomber” to be classified as part of a boondoggle. The man had help getting on a plane to the US without proper identification and according to witnesses, was filmed during flight by someone. Sounds more like a CIA screw up. The bigger boondoggle, is this stupid Homeland Security and their color coded terror system…today it’s blue, tomorrow it’s orange, yesterday it was magenta…..total waste of money.
Or, perhaps you’d care to invest the time to do what you suggest some one else should do?
My request was to Rayne, who wrote the post.
Mark Twain allegedly said that he apologized for writing a long letter because he didn’t have time to write a short one. As Rayne knows more about this subject than I do, I thought he might spend a bit more time to write the short version.
I’ve been thinking about this panty bomber,doesnt Cheney still have loyalist in the CIA?
What about your comment:
do I not understand?
I doubt that we will find out the real undie bomber story in my lifetime. Which leaves Cheney available for freestyle mouth without fear of contradiction.
Don’t know what your problem is. I was requesting Rayne to summarize his post in 3 sentences. I have now typed this 3 times. If Rayne doesn’t want to do it, fine. Didn’t intend to make a federal case out of it.
“I read in the newspapers they are going to have 30 minutes of intellectual stuff on television every Monday from 7:30 to 8. to educate America. They couldn’t educate America if they started at 6:30.”
Groucho Marx
“if I had more time I would have written you a shorter letter”
SLC
(((Groucho)))
My 13.
I know but you need to come out and say it!
Facepalm.
Why the fuck did they need 493 tables to collect data on individuals? Were they using tables to offset acquisition of too small database servers in creating reports? Was the number of people on who they were collecting data so large as to require that many tables? Was the security mechanism so complicated that a lot of those tables weren’t for queries but for security?
Dollars to donuts, it was built on an Oracle database engine. With all the limitations that come with that technology.
Oh yipee. Eric Cantor is Rachel’s target tonight.
I don’t give a FF is she doesn’t poke O. For now it’s enough that even one or two people are willing to poke Rs.
Okey dokey.
Well, we can start with the fact that Rayne is a “she”.
And why are you asking her to do what you could do if you were willing to invest the time?
I think this is a great post.
I don’t know how one can get through the current frame, hypothesis, necessary background for true understanding, offer an example, offer an opinion and make a conclusion ins less space than what Rayne has done.
I write SQL and understand databases and I don’t know how I could have made this post shorter.
Chomsky is correct about “concision.” http://globetrotter.berkeley.edu/people2/Chomsky/chomsky-con3.html
Just my opinion, but this topic was covered quite concisely.
A little bit of technical knowledge is very dangerous.
I hate Larry Ellison as much as anyone, but “using SQL” or “using Oracle” is not “outmoded” technology or an inherently inferior approach to the problem.
Having 463 separate tables is probably still really bad database design whether the underlying database is “SQL/Relational” or “XML” or “Object Oriented” or massive simplistic word indexes like Google.
To those who say if they just “organized it with Google” is stupid: if you’d done it that way putting just one wrong term in your “query” would ensure that the first 400 pages of results would be all the wrong ones: anyone who has spent 5 minutes with Google knows this.
I know we’re all libtards here and we blame the gun rather than the shooter, but when we do, we miss the point: the problem is not the tool, its the idiot contractors who got the job because of their crony/rolodex relationships in spite of their technical stupidity…
I thought the Republiks were all about hiring private contractors instead of using government workers for this kind of thing (and everything else, including hiring mercenaries instead of using US soldiers.)
Why the hell didn’t they hire Google to create their damn search engine? Does Cheney not get a kickback from Google?
oh shit, answered my own question.
Thanks, Kelly.
eCAHNomics — I have to write something like this for a much wider audience who may have no background in the technology mentioned in this piece. I’m sure you must be in a hurry to get somewhere if you don’t have the time for this.
shekissesfrogs — thanks for letting me know, I’ll go and fix the links now. Suspect I broke them all when I pasted from word processor.
This was all a game to Cheney – a serious game to be sure. I really believe that he thinks of himself as James Bond with all these “toys” to play with and who bow to him. He’s a thoroughly evil man who should never have been allowed in gov’t at any level.
Because she knows more about the subject than I do.
That’s just an impossible number to deal with.
Programs can have interfaces that help, but you’re still limited in what you can look for. (I do genealogy; the program only has maybe ten tables involved. The search engine that’s built in is not bad (the search terms are built-in also, so there’s no visible SQL), but I still can’t do some of the searches that should be possible, because not everything is searchable.
At work we’re building a GIS system that has lots of tables – not hundreds, I don’t think – and it’s a lot of data. There, though, we can display stuff graphically, which means we can show more information than we can using text. You still have to know what you’re looking at and looking for ….
It’s not that I don’t have the time. It’s that I think the message is important, and also think that it can be sound-bited. And that it is important that it be sound-bited.
I’m sorry that my request has placed me in the bad gal corner. It was orginally stated for purposes of blasting the important short version all over the place.
So, she write a post, and then include a three sentence summary, so that you can do what with it?
and he apparently plays the game like J. Edgar Hoover.
He’s got the wiretap info on every politician in America, and knows he will never be prosecuted because of what he knows.
Rat fucking bastard.
Oops, and now I see you most recent reply which answers my question.
and exactly what is your issue (problem?)
if it persists more than 4 hours you should seek medical assistance.
Blast it all over the place. Did you not live thru the W admin? Are you unfamiliar with Lakoff?
Whew. We were really typing past each other. & Rayne. Glad you, RBG, got it. Hope Rayne did too.
I did don’t-blink-or-you’ll-miss-it instant analysis on cable financial channels after econ data were released. It’s a skill. An important one.
Ditto short, to-the-point analysis of spying or terrorism analysis. Probably even more important than instant analysis of econ data because so few people are able to do it. Need more of those.
Haiku form:
Cheney’s database snafu
Cost half a billion
Can’t find Abdullah for squat
Please see my comment at #37.
Agreed.
Responded at 40, hope you think, as I do, that we’ve worked thru our differences.
Snoopy dance!
Look, if you have a beef about the explanation about SQL in the excerpt, take it up with Rep. Brad Miller who wrote that.
The point he was making was that Railhead couldn’t do what we expect and get every day when querying commercial databases or using commercial search engines.
They could have simple bought an Oracle database and they’d have been done several hundreds of millions of dollars sooner, leaving us with an effective package.
Now maybe if you’re done insulting us “libtards” you’ll start asking yourself far more important questions, like why did Boeing misappropriate funds from this project to renovate a building for a Sensitive Compartmentalized Information Facility.
Next haiku assignment: why won’t any MSM point that out? And when you accomplish that, send it to Rachel. Or Jon Stewart, or Colbert.
Very nice, but I think this one really needs far more than one haiku.
Like this next one:
Cheney’s bastard plan
Stole money for secret place,
Leaving us exposed.
Now that’s the short version I was looking for.
Hee, the joy of SQL:
SELECT cash
FROM TaxPayer
UPDATE Railhead
SETMyBal = MyBal + TaxPayerBal
UPDATE
MyCheney
SET MyCheneyContents = MyCheneyContents + TaxPayerBal
INSERT INTO
Boeing VALUES(‘Sensitive Compartmentalized Information Facility’)
END
GO
But if you’re trying to explain it to the media, they absolutely must have the background and links to the entire story. Because frankly, Cheney had more than one bastard plan which stole money and left us exposed; this happens to be one which he pointedly wants us to ignore.
Three sentences aren’t going to give the media what they need if they are ever going to get it right about Mr. 18% Approval Rating. Christ, they had difficulty figuring him out for eight years, couldn’t piece together what was going on even when some people took the pains to write a fracking book about him.
Googled that, result #4 was this:
http://thinkprogress.org/2007/10/09/savage-cheney/
Ha!
Goodness: This was for the edification of your readers since you repeated his incorrect assertion here.
Yah. Something I agree with completely.
My point is that it draws attention to the technology itself as the evil, and I am agreeing completely with your snide remark to me about Boeing: it’s all about the cronyism.
I’m sorry this was so unclear in my post.
I’m quite sure I had a “we” in there…um…yah. It was probably my fault that I didn’t capitalize it to make it clear.
You were quite right to assume that because I had an oblique issue that called into question a quote in your post that I must be some sort of Tea Bagger. I will be sure in the future never to use such a phrase even if it is referring to myself because it might be misinterpreted.
My apologies.
I think you can work enough of the real story into a sound-bite to entice media to ask the right follow-on Qs. I’m not trying to be obstreperous, but rather to encourage a talking to the media way of thinking.
I’m not naive enough to think that will make a big diff. I did it for long enough on economics data to know that ain’t gonna happen. But I also think that fighting against the usual meme is valuable, and you can’t do that unless you can condense your message to its essence, and in a way that will resonate.
It may seem as though I’m being harsh and setting up standards that are hard to meet. I am. But unless we jump those hurdles, we won’t get anywhere.
Sorry Rayne that you are the post on which this came up. It is much more broadly applicable. And I am not the model. I recognized the problems and tried hard to overcome them, but not very successfully.
AGH!!! It burns!!!
Now if only the extended code could tell me if this was related to the SCIF…
Um Code says:
UPDATE QuanitcoCircuit
SETPROPERTY “False”
COMMIT
DROP
Not that it’s right, but yanno, that’s what they did.
*snerk*
Shouldn’t there be a ‘join’ in there somewhere?
Dude, is there anything you can’t do?
Code SQL? Check.
Speak/Write Greek? Check.
Cook? Check.
Seriously. As da’ Yoopers say, Holy wah.
Not if the data was all in the same table. *snark*
Rayne, Great piece. Can you get it to KO or Rachel. I think this is the kind of story, they like to run with.
Heh, stop.
SQL = Work
Greek/Latin = Ancient History, literally…
Cooking = Hobby.
Just a weird little person, getting along!
To me it indicates they succeeded in producing something that somebody wanted kept secret.
I don’t see Boeing (or any decent group of IT people) producing crap for $500B and not documenting it properly. Get Boeing under oath in a closed-door committee hearing and squeeze ‘em.
I have a very ugly idea. I don’t like this idea, but here it is:
Boeing database says someone is going to have a bomb on a non-Boeing airplane and that’s not something anybody should be warned about.
Very ugly.
So if I understand this correctly (probably not), they just made up a parameter for each factiod they had, and neglected to keep track of what all the parameters were?
If they were building an SCIF, they may have been acting not under a purchase order alone for the systems integration/project management work, but a classified compartmentalized program which they may not disclose except under highly specific conditions. Where did this need for a SCIF come from, for example; was it part of a classified order?
The other thing niggling at me is timing. Keep in mind that we have the Plame outing and a mess of emails which go missing between the time TIDE is launched and Railhead ends up scrutinized by Congress. A lot of other crap was going on at exactly the same time as this SCIF was being built and Railhead was allegedly being built, too.
Nah. I don’t think that’s where this goes. At least my gut isn’t twinging and my hinkey detector isn’t going off.
oops, sorry, not $500B, $500Million for a db that doesn’t work…
They don’t have to be serious because, seriously, the terrorist threat is just not that great as to entail hundreds of billions of dollars. Hence all the cases of entrapment, the trumped up charges and plots (remember the faked “dirty bomb” plot by Binyam and Padilla?).
The war on terror is mostly manufactured. Even the big time real-world terrorists, like Bin Laden, were first hyped and given training by the CIA.
Terror is a tactic in war and insurgency. You can’t have a “war” against it. The whole emphasis on “terrorism” hides the politics of empire and the struggle of marginalized groups and nationalities against larger powers, against whom they have no hope to win militarily.
The U.S. uses terror regularly, whether its implemented via “shock and awe” blitzkrieg like tactics, or supporting covert ops and assassinations in foreign countries.
Imagine this headline: “Iran to Run Pilotless Drone Surveillance Planes over U.S. Territory”. What would the U.S. do?
I hope you’re right.
It’s more complicated than that, at least that’s my read.
The other thing to keep in mind is that sometimes what appears to be a bug is not a bug at all but a feature.
A bolluxed database which one cannot reliably query and pull reports might still have utility to someone for specific reasons.
If Boeing kept something like that secret, their business would become toast shortly afterward. Its competition would see to it (after all, Airbus already owns one senator).
I’m thinking several POs for separate parts, which only become the SCIF and database at the end, when the people who actually use it (officially, anyway) put all the pieces together.
sounds like a newbie screwing around created it.
Remember this guy was a CEO, and as that He has the supposition that He knows it all. The pompous ass shows His pure ignorance everytime He opens His mouth, yet people have looked up to Him for years.
People brag about His years of service and positions He held, yet forget to look at His actions while in those offices. He fucked up everything He has touched in Government and shown Himself to be brash over rated bully, even to picking Himself for Vice President.
Yet when He opens His pie hole the Media jumps to report His every word.
I will repeat Myself. If the ass was in jail where He belongs we wouldn’t have to worry about what He says or thinks.
The letter from the committee spells out gross incompetence.
It’s no wonder Cheney is so scared, we’re intellectually unarmed (at the top.)
Maybe it was done on purpose because they didn’t want it to work.
I mean honestly, you all know lying, torturing mass murderers are in charge, why would they want ‘national security’ to actually work? All the incentives for them are for it to not work. So it doesn’t work. Duh.
Yeah. It’s a feature, not a bug, when stuff costing big money fails.
Rayne, this is a great post. I never even heard of Railhead.
Thanks, Spencer; you might want to poke around and find out where Railhead is right now, as well as TIDE. Are they still in use? How are they being fixed? Which contractors are involved?
And by contractors I mean more than Boeing and SRI International — there were more names which came up but I couldn’t corroborate without better sourcing. You may have that sourcing.
Tremendous reporting, Rayne. I’m sorry I came to the thread so late. With all of the money spent on this project, what do you want to bet that there were zero linguists with expertise in Arabic? Coupling your observation about the “Abdul” portion of a name with the difficulties of transliterating Arabic to English (we have to provide the vowels when we do that; witness the reporting on the Afghanistan offensive as occurring in Marja, Marjah or Marjeh appearing in various news sources), could that be a major part of how the database became so inflated, because each entry could have so many variants?
Yup. Exactly. But these variants shouldn’t pose a problem with a good search tool.
Go to Google, type in this query and see what I mean: “omar farook mutallab”
Not James Bond! Dr. No is more akin to his personality. Joseph Mengele comes to mind also as well as Torquemada. Chaney is a good student.