The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
Web wide crawl with initial seedlist and crawler configuration from March 2011. This uses the new HQ software for distributed crawling by Kenji Nagahashi.
What’s in the data set:
Crawl start date: 09 March, 2011
Crawl end date: 23 December, 2011
Number of captures: 2,713,676,341
Number of unique URLs: 2,273,840,159
Number of hosts: 29,032,069
The seed list for this crawl was a list of Alexa’s top 1 million web sites, retrieved close to the crawl start date. We used Heritrix (3.1.1-SNAPSHOT) crawler software and respected robots.txt directives. The scope of the crawl was not limited except for a few manually excluded sites.
However this was a somewhat experimental crawl for us, as we were using newly minted software to feed URLs to the crawlers, and we know there were some operational issues with it. For example, in many cases we may not have crawled all of the embedded and linked objects in a page since the URLs for these resources were added into queues that quickly grew bigger than the intended size of the crawl (and therefore we never got to them). We also included repeated crawls of some Argentinian government sites, so looking at results by country will be somewhat skewed.
We have made many changes to how we do these wide crawls since this particular example, but we wanted to make the data available “warts and all” for people to experiment with. We have also done some further analysis of the content.
If you would like access to this set of crawl data, please contact us at info at archive dot org and let us know who you are and what you’re hoping to do with it. We may not be able to say “yes” to all requests, since we’re just figuring out whether this is a good idea, but everyone will be considered.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20110423203634/http://donklephant.com/
I keep asking myself if Trump is actually this clueless or is this all an act?
Oh, he also says that he has learned some very interesting things about Obama’s origins and will reveal them soon. Something tells me we’re seeing another Geraldo Rivera “Al Capone’s Vault” moment. Anybody else feel the same?
Some bad news for Trump, his unfavorables are WAY up among Republicans. So while he may be leading in some polls, if half of Republicans don’t like him…does he really think he can grab the nomination?
Long story short, Palin and Trump don’t have a chance…and they know it. This will be between Romney and Huckabee…and something tells me that Huckabee just might pull it off.
For the first time since he and his brother came to power more than a half century ago, President Raul Castro proposed term limits for Cuba’s leaders, admitted that errors have left the country with no obvious successor and promised to rejuvenate the island’s political class.
The term-limit proposal made Saturday at the launch of a key Communist Party summit would make it all but impossible for a repeat of the Castros’ own political dynasty, which has dominated Cuba since their 1959 revolution. But it would have little practical impact on Raul’s future.
The 79 year-old leader officially took over from his brother in 2008, meaning he wouldn’t be term-limited out of office until at least 2018, depending on how the law is written.
Castro promised to launch a “systematic rejuvenation” of the government.
Many economic proposals have been debated for months, after Raúl Castro announced last fall that half a million Cubans would be taken off state payrolls. Many of them will be allowed to establish private enterprises.
Obviously this doesn’t excuse any of the things he has done as the brother of a dictator, but it certainly signals a significant change and that shouldn’t be discounted.
Despite an almost universal refusal by Republican establishment figures and the press to take him seriously, Donald Trump is taking very concrete steps toward forming — and announcing — a presidential campaign.
He has interviewed at least two people for a campaign manager position, sources said. He is in contact with several well-known media consultants and has spoken to figures in the evangelical community such as Ralph Reed and Tony Perkins.
Something tells me that evangelicals will not take a shine to Trump and his personal politics. Huckabee or Palin would be their candidate of choice.
Still, some in the fold feel he’s serious…
“I’m convinced he’s probably going to run,” said Steve Scheffler, the head of the Iowa Faith and Freedom Coalition, who said Trump contacted him this past Wednesday in an “introduction” phone call.
“If he comes to Iowa and he engages in conversations in small groups of people one-on-one he might play well on that,” said Scheffler. “I think a lot of it has to do with where he stands on the issues, and if he can convince people that he’s going to go forward on the issues.”
Note that he’s already talking to folks in Iowa.
And not only that, they’re excited…
Trump’s scheduled keynote speech at the Iowa GOP’s annual Lincoln Day fundraising dinner in June is already such a draw that one attendee is planning to drive in from Northeast Wisconsin to see The Donald speak, a local Republican said.
So he won’t make the mistake that Giuliani made in 2008 and bypass the early states. That’s smart if he actually does plan to run.
But again…I don’t buy it.
Regardless…Palin who?
By the way, the picture above is from a Tea Party rally. He’ll be right at home with all those birthers.
Townes Van Zandt was an incredible songwriter and a great storyteller.
I first heard this song on a live album where he’s playing in Germany. He explains that Amarillo is a town in Texas where the wind blows 80 miles per hour all the time. He says the hippies look real funny there because their hair is always sticking straight out in front of them, or behind or to the side.
Then he tells them that the Gunnison is a river and the Raton Pass is the only way to get through the mountains to New Mexico from Colorado.
The real estate mogul has chosen the season finale of his NBC reality show, “The Apprentice” as the venue for announcing his presidential decision, Newsmax reported late Wednesday. The show is set to air May 15. Newsmax reports that Trump will announce plans to hold a press conference to announce his candidacy in the Trump Tower in New York “a few days after” the finale.
Trump had previously stated he would wait until June to make a final decision about about a presidential campaign.
He just couldn’t resist it.
And yet he’s still making noises like he’ll actually run…
This past Monday, Trump yet again slapped down the suggestion this is all a stunt. “I don’t need to do this for ratings on ‘The Apprentice,’” he told the Wall Street Journal. “This is too important. Our country is in trouble. Our country is not being properly led. It needs help.”
Trump’s organization is now somewhat walking back its claims. Michael D. Cohen, Trump’s special counsel, said this in a just-released statement: “To clarify earlier reports, on the May 22nd Season Finale of Celebrity Apprentice, Mr. Trump may announce the time and place of a press conference at which time he will make a statement as to whether or not he will run for President of the United States.”
It was forceful, it was direct and it was very pointed in putting the lie to the Ryan’s budget cuts that don’t include any revenue plans.
And let me say this for the record…Ryan’s plans are cruel. He had a chance to lead on this, but he failed.
In any event, Obama said that EVERYTHING was on the table and he pulled no punches today. With good reason. The budget issue had gotten away from him and he was trying to reign it back in. He would reduce the deficit by $4T over the next 12 years, with 75% of that coming through spending cuts, and 25% coming from revenue generation.
So what is he cutting?
Discretionary, defense, and Medicare/Medicaid spending will be affected significantly over the next 10 years.
But hey, don’t take my word for it. Check out the speech…
Nineteen percent of Republicans and Republican-leaning independents questioned in the poll say that as of now, they’d be most likely to support Trump for next year’s GOP presidential nomination. Trump says he’ll decide by June whether he runs for the White House. An equal amount say they’d back Huckabee. The former Arkansas governor and 2008 Republican presidential candidate says he’ll decide by later this year if he’ll make another bid for the White House.
Twelve percent say they’d support former Gov. Sarah Palin of Alaska, who was the party’s 2008 vice presidential nominee, with 11 percent backing former Massachusetts Gov. and 2008 White House hopeful Mitt Romney and the same amount supporting former House Speaker Newt Gingrich. Seven percent say they are backing Rep. Ron Paul of Texas, another 2008 presidential candidate, with five percent supporting Rep. Michele Bachmann of Minnesota, who enjoys strong backing from many in the Tea Party movement. Everyone else registers in the low single digits.
So he’s getting some good publicity right now for his TV show, but is he serious?
Well, the following video makes it seem like he will, regardless of the outcome of the primaries.
And yet he still brings up the birther issue. Jeezus…
My initial advice to him still stands. He should run as an indy who is beholden to no party. After all, he has always branded himself as a maverick so an indy run fits perfectly into his personal narrative. But he’s letting his ego (shocker!) get in the way of common sense.
Or maybe he’s not. Maybe this is all just a ploy (likely) to get more people to watch a 7 year old TV show. That’s my gut on it.
Regardless, he’s definitely making things more interesting.
I’m not sure what kind of national attention this story is getting, but it’s a pretty big local story.
The investigation into a suspected serial killer who may have preyed on prostitutes, dumping their bodies near beaches on Long Island, has spawned new warnings for sex workers who advertise online.
Seems to me like more compelling evidence for the legalization of prostitution. Theoretically, legalized prostitution, licensed and regulated, would provide income for the state and a safer environment for the prostitutes.
Looks like Mitt is taking the “insulated President” tact and it’s an easy hit. As President, Obama doesn’t come off as the warmest guy and this is a good place to start.
However, as a Presidential candidate, Obama can bring the warmth and whip up inspiration better than anybody we’ve seen since Reagan. And Mitt isn’t exactly Huckabee, or, for that matter, Palin.
In his remarks, which come after Friday’s bipartisan deal to cut domestic spending by about $38 billion for the remainder of this budget year, Mr. Obama will not offer details but will set deficit-cutting goals, White House officials said. The numbers were still under discussion on Sunday.
“He’ll lay out his approach this week in terms of the scale of debt reduction he thinks the country needs so we can grow economically and win the future — a balanced approach,” David Plouffe, the senior White House political strategist, said on “Fox News Sunday,” one of four talk shows on which he appeared Sunday.
“Obviously, we need to look at all corners of government,” Mr. Plouffe said, adding, “We’re going to have a big debate.”
What are Republicans saying?
Republicans reacted skeptically to word of Mr. Obama’s speech. “I sit here and I listen to David Plouffe talk about, you know, their commitment to cut spending and knowing full well that for the last two months we’ve had to bring this president kicking and screaming to the table to cut spending,” Representative Eric Cantor of Virginia, the House majority leader, said on Fox.
This even though Obama has said he wants to cut spending…but just doesn’t want to do that during one of the worst recessions in history. Oh well, par for course with the Repubs.
If something substantive comes out of this, will Obama get credit for tackling yet another tough issue? Probably not. Republicans have no reason to cooperate with him and ever reason to keep saying no to nearly everything this President proposes.
I’ve watched several videos of the tsunami in Japan. The following is the most demonstrative of the inevitability of the event. The ocean just comes. Most disconcerting is the pace. It’s not a giant wave wiping everything out at once, it’s the ocean slowly and thoroughly claiming the land and everything on it.
The city is flawed in many ways but it’s beautiful in many more ways.
American history runs through Baltimore’s veins.
The War of 1812: Stand on the point at Ft. McHenry and imagine watching British ships coming up the Bay. Imagine seeing them well before they are in range and waiting/anticipating the first cannon fire.
The Civil War: Sit on Federal Hill and imagine the Union army’s big guns pointed at downtown Baltimore. Lincoln’s warning that if Maryland even thinks of seceding … running through your head.
The Industrial Revolution: Take a bike ride up the Jones Falls River and see the mills. See the workers homes next to the mills and the owners mansions on the hills above.
Baltimore is kind of infectious is what I’m saying. I left there a huge fan of the Ravens, the Orioles and Senator Mikulski.
“They want to cut spending, but they’re unwilling to cut their own pay,” Senator Mikulski said. “If there is a government shutdown, I don’t think members of Congress should be paid. If there is a government shutdown and we tell dedicated federal employees that they’re not going to get paid, that they’re nonessential, well the fact that we couldn’t stop a shutdown shows we’re nonessential.”
Just in his mid-20s, Brian Deschane has no college degree, very little management experience and two drunken-driving convictions.
Yet he has landed an $81,500-per-year job in Gov. Scott Walker’s administration overseeing environmental and regulatory matters and dozens of employees at the Department of Commerce. Even though Walker says the state is broke and public employees are overpaid, Deschane already has earned a promotion and a 26% pay raise in just two months with the state.
The rest (Haley Barbour, John Bolton, Godfather’s Pizza CEO Herman Cain, Mitch Daniels, Jon Huntsman, Gary Johnson, Sarah Palin, Ron Paul and Rick Santorum): 34%
The usual caveats apply…straw polls are usually just a popularity contest, it’s very early still and this is just one county in SoCa.
Still, it’s interesting to see that Huckabee has so much support, while Palin doesn’t. And once again…Bachmann shows up over Romney. Interesting…
My bet is Huckabee will wait on running until 2016. I think most GOP hopefuls feel that Obama’s campaign machine is just too big to beat and that folks like Palin, Romney and Gingrich will suck the air out of the room.
The Texas congressman raised $1 million through his federal PAC and $2 million through Campaign for Liberty, a 501C(4) which cannot transfer funds directly to political organizations. Paul’s fundraising documents, to be filed later Thursday with the FEC, will also show he has $1.7 million on hand in his congressional campaign account.
“Dr. Paul’s fundraising comes almost exclusively from individuals, not special interests,” LibertyPAC director Jesse Benton told POLITICO. “He received contributions from all 50 states, and his average gift this quarter was under $70, demonstrating his broad grassroots support.
“Dr. Paul’s grassroots fundraising prowess is unmatched, and any 2012 political endeavor on which he embarks will have the financial backing it takes to win,” Benton added.
Michele Bachmann became the queen of 2011 fundraising this quarter, bringing in a combined $2.2 million for the quarter – bigger than the $1.9 million that frontrunner Mitt Romney reported bringing in, officials confirmed for POLITICO.
Bachmann raised $1.7 million for her congressional committee, and another $500,000 for her leadership PAC, Bachmann adviser Andy Parrish said.
Of course, Romney hasn’t said he’ll run for POTUS yet. We all know he will, but nothing has been announced yet.
I’d argue that nearly all politicians do the following, which is nothing more than organize their messaging so they get on the same page, but only Dems would figure out a way to get caught doing it.
Moments before a conference call with reporters was scheduled to get underway on Tuesday morning, Charles E. Schumer of New York, the No. 3 Democrat in the Senate, apparently unaware that many of the reporters were already on the line, began to instruct his fellow senators on how to talk to reporters about the contentious budget process.
After thanking his colleagues — Barbara Boxer of California, Benjamin L. Cardin of Maryland, Thomas R. Carper of Delaware and Richard Blumenthal of Connecticut — for doing the budget bidding for the Senate Democrats, who are facing off against the House Republicans over how to cut spending for the rest of the fiscal year, Mr. Schumer told them to portray John A. Boehner of Ohio, the speaker of the House, as painted into a box by the Tea Party, and to decry the spending cuts that he wants as extreme. “I always use the word extreme,” Mr. Schumer said. “That is what the caucus instructed me to use this week.”
A minute or two into the talking-points tutorial, though, someone apparently figured out that reporters were listening, and silence fell.
Then the conference call began in earnest, with the Democrats right on message.
Palm -> Forehead
Hey guys, instead of using the oppositions tactics (which were finely honed by Gingrich back in the 90s) how about you just prove their ideas aren’t good for the country?
At least that’s what Haley Barbour is saying about her appearance at Rep. Steve King’s conference…and after watching this video I tend to agree. She really knows how to rile up a conservative crowd. Lots of good old fashiony call and response speechifying.
So big deal, right?
Well, when it comes to the caucuses in Iowa, let’s remember that this is the state that voted for Pat Robertson over George Bush in ’88.
Talking loudly and waving her hands, a pumped Bachmann used a slide presentation of various numbers — the national debt, the cost of a gallon of gas two years ago the day before Obama took office, the corporate tax rate — to make her points and pull the crowd in.
Suggesting that Iowa caucus voters had the power to halt Obama, Bachmann wrapped up her speech by asking, “Are you in? Are you in for 2012?”
“I agree with you!” she said as the crowd cheered, and added, “I’m in!”
Tired of the rhetoric, bomb-throwing and partisan hackery? Here we offer a respectful, honest forum for people who want to have a conversation about politics, the world and beyond.
All we ask is you keep your language clean and your arguments sharp.
