The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
Web wide crawl with initial seedlist and crawler configuration from March 2011. This uses the new HQ software for distributed crawling by Kenji Nagahashi.
What�s in the data set:
Crawl start date: 09 March, 2011
Crawl end date: 23 December, 2011
Number of captures: 2,713,676,341
Number of unique URLs: 2,273,840,159
Number of hosts: 29,032,069
The seed list for this crawl was a list of Alexa�s top 1 million web sites, retrieved close to the crawl start date. We used Heritrix (3.1.1-SNAPSHOT) crawler software and respected robots.txt directives. The scope of the crawl was not limited except for a few manually excluded sites.
However this was a somewhat experimental crawl for us, as we were using newly minted software to feed URLs to the crawlers, and we know there were some operational issues with it. For example, in many cases we may not have crawled all of the embedded and linked objects in a page since the URLs for these resources were added into queues that quickly grew bigger than the intended size of the crawl (and therefore we never got to them). We also included repeated crawls of some Argentinian government sites, so looking at results by country will be somewhat skewed.
We have made many changes to how we do these wide crawls since this particular example, but we wanted to make the data available �warts and all� for people to experiment with. We have also done some further analysis of the content.
If you would like access to this set of crawl data, please contact us at info at archive dot org and let us know who you are and what you�re hoping to do with it. We may not be able to say �yes� to all requests, since we�re just figuring out whether this is a good idea, but everyone will be considered.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20110811044414/http://planetquake.gamespy.com/
Submit Those Files! The mighty Planet Quake is always hungry for the latest and koolest Quake files! Be it the ever classic Quake 1, the Strogg infested Quake 2, the deadly arenas of Quake III or beyond, we want those files. Make them yourself or submit a great work of Quake art you love. Just fill us up with crunchy Quake goodness! More >
NEW Enemy Territory: QUAKE Wars Demo! The NEW Enemy Territory: QUAKE Wars Demo v2.0 is your way to check out the hottest and newest Quake action with all the features of the latest version of the game including the new Training Mode! More >
Restoring KOTOR II Knights of the Old Republic II had significant content cuts but these mods bring them back and more.
The v2.3 of this mod is coming soon, so I'm gonna show you little "teaser".�I've added portal-proof walls, forcefields of various purposes, new gun skin, new portal gates (what do you think of them?) and bunch of textures...�Please feel free to suggest any feature, notify a bug or just say hello :)
He's still looking for help too so feel free to keep the Quake modding community alive!
QuakeCon 2011: John Carmack Keynote![ Comment ] 15:39 PST | Pappy-R | Print News | Category: Community NewsHey, hey hey, the John Carmack Keynote from QuakeCon 2011 is up and ready to fry your mind. I've also added a short flick from KJkoolguy showing some of the QuakeCon related items released for Team Fortress 2 in-game. Any headaches John gives you are not my fault BTW. Enjoy!
John Carmack to Doom fans: GPL Code Soon[ Comment ] 5:52 PST | TheHappyFriar | Print News | Category: Community NewsFrom the looks of it JC yesterday announced that the Doom 3 (id Tech 4) engine will go GPL after Rage's release. It was announced during the Keynote speech today. I'm not there so I don't know all the details but this is good news for id fans all over. I'm glad id releases the engines under the GPL instead of just the mod SDK like so many other companies do, and they don't ask any royalties either.
The Doom 3 (id Tech 4) engine is behind the Quake games Quake 4 and ETQW.
Thanks moddb.com for posting this.
Thursday, 4 August, 2011 – Planet Quake News
QuakeCon 2011 Begins![ Comment ] 11:59 PST | Pappy-R | Print News | Category: Community News - Quake LiveIf you're unaware, then you need to know that QuakeCon 2011 is underway down in Dallas and the fun and funk has already cranked up. You can keep an eye on the action via the live feed at Own3d.tv, and make sure to keep checking out the official QuakeCon site for updates and changes to the coverage. The QuakeCon YouTube channel should start to see additions soon, and you can also keep your eye on the QuakeCon 2011 Twitter feed for updates as well. Now I've got to get back to watching the QUAKE Live matches that are already underway!
Wednesday, 3 August, 2011 – Planet Quake News
Steel Storm included FREE with Humble Indie Bundle[ Comment ] 18:49 PST | TheHappyFriar | Print News | Category: Community News - Quake NewsThe Humble Indie Bundle is a �Pay What You Want� for a set of Win+Mac+Linux indy games. They're a great deal to get some great games. What makes it even better now is that if you buy the bundle you get the Quake 1 GPL engine top-down shooter �Steel Storm!� That alone is worth the price. It's a single player and multiplayer top-down shooter. Lots of action and worth more then what you'll end up paying for it. Head on over to the Humble Indie Bundle site, purchase a copy and get your free complimentary copy of Steel Storm! I'm hoping to see the MP servers hopping so I can share in some frags!
There's an App for that...[ Comment ] 18:41 PST | TheHappyFriar | Print News | Category: Community NewsX7 @ Tastyspleen showed me that there's a App for the Quakecon 2011 schedule. That's pretty cool! I don't have one of those super-fancy app-capable phones (I still use this old thing called a �computer�. You can play a nifty game called �Quake� on it.). What you do is head over to GuideBook App, install it and do a search for �QuakeCon�. Then the entire QuakeCon schedule is at your finger tips! Enjoy!
For those not familiar with the Rally Quake mods, they're a racing mod. They're always a lot of fun and are pretty addictive. Keep an eye on the Q3Rally site & IRC for when it's out!
QuakeCon staff has decided the players for the Intel QL Duel
The events schedule has also been announced:
Thursday:
Welcome and Keynote @ 2pm by John Carmack
Friday:
Skyrim Presentation @ 1pm
20 Years of id Software @ 2:30
Ultimate Origins: The Games that Influence Us @ 4pm
Prey 2 Presentation @ 5:30
Saturday:
Community Managers: Un-moderated! @ 1pm
First Person Perspectives @ 2:30pm
Exhibitors this year:
BAWLS Acquisition
Blaine Warren Advertising
Cooler Master
CPU Magazine
Dell Computer
Diamond Multimedia
FSP GROUP USA CORP
Glitch Gaming Apparel
Grow Up Japan Co., Ltd.,
Gunnar Optiks
Hi-Rez Studios
IN WIN Development
Intel Americas, Inc.,
Plantronics
Psyko Audio Labs, Inc.
The 20 Years of id looks really interesting to me and I always like John's keynotes.
If this if your first year going, QuakeCon is a free event held annually in Dallas, TX. It has it's own LAN and event stage. My wife and I honeymooned there, GREAT honeymoon for anyone who's thinking about it!
Quake 2 Physics, Mythbusters Style[ Comment ] 17:11 PST | TheHappyFriar | Print News | Category: Quake II Newsn00k1e over at Tasty Spleen has written an article explaining some physics quirks about Quake 2. One thing really interesting to note is that how high you can jump not only depends on your game FPS (something known for a while) but also on whether you're above or below the 0 X-Axis!
LVL Update Galore[ Comment ] 4:12 PST | TheHappyFriar | Print News | Category: Quake III Arena NewsTigger at LVL wants everybody to know that they've updated the site so thing should load faster and works nicer with a slight change of bugs because of changes. Also, a nice list of level reviews!
For the 2011 QuakeCon the following tournaments are being hosted:
The Intel QUAKE LIVE Duel Invitational Masters
The QUAKE LIVE Team Deathmatch Invitational Masters
The Brink Open Tournament
Brink will be a 16 team first come-first serve onsite (that's AT the con) registration the Thursday of the event. The QUAKE LIVE tournaments will require pre-registeration at registration.quakecon.org. A committee will select the players for QL. QL players aren't able to play in Brink.
In other QuakeCon news, there's going to be a �20 Years of id Software� panel with tales of id-e-goodness by John Carmack, Todd Hollenshead, Kevin Cloud and Tim Willits. Hosted by the oh-so-gorgeous Morgan Webb from G4TV (I've got a sign picture of her & Adam right behind me!). That should be a great event to be at as tales of id �growing up� are always a blast to hear.Keep an eye on PQ for more QuakeCon news.
Bug 388: Fixed teleporter shader issue in MopAn's Jail, rings should be shown correctly now
Fixed music playlist reading from disk once more, will now err on overly large files and remain silent on empty playlist
Fixed memory leak in bots path finding
Head on over to moddb.com to get the latest update!
World of Padman is a free, Quake 3 Arena based stand alone game. The standout about it is that it's blood-and-guts free with colorful characters. If you're wanting to introduce little Dick and Jane to some fragging, this could be the way to make the spouse happy.
Don't forget that EntityPlus is a single player modification for Quake 3 Arena that tried to make the game so it's SP mod/game friendly. If you are wanting to make a single player mod for Quake 3, this code is a good place to start.
Friday, 1 July, 2011 – Planet Quake News
Darkplaces Releases some Fixes[ 2 Comments ] 9:47 PST | TheHappyFriar | Print News | Category: Quake NewsLordHavok posted on his site that he's updates his Darkplaces Quake 1 engine. He also wants to point out that there's a new commercial game based on the Darkplaces engine called Steel Storm: Burning Retribution. I think it might be the first commercial GPL Quake powered game out there (the engine is GPL, not the game).
Here's the skinny on the recent fixes, you can download the latest stable and development builds at his site:
OSX build now supports .ogg music and .ogv theora video recording as intended (and as the other platforms do).
Really fixed the solid water bug on dedicated servers this time.
Fixed a bug where dedicated servers would incorrectly load Quake1 BSP Files and treat water as solid.
Significantly optimized rendering, much higher framerates than previous release.
Photon traced 3D texture radiosity in realtime world mode (r_shadow_bouncegrid 1).
Experimental Software Renderer (vid_soft 1;vid_soft_threads 4;vid_restart), not recommended for serious play, framerate is poor (but it renders very accurately), not feature complete yet; no fog for instance...
Experimental Direct3D9 renderer choice (vid_dx9 1;vid_restart), not recommended because the D3D9 shadowmapping method is very slow compared to the OpenGL method, with shadows off it performs almost identically to the OpenGL 2.0 renderer.
Unforgiven by Tronyn & PM - Epic fantasy episode with three huge levels, hardcore horde combat, lots of new monsters, items, and weapons.
There's also a new Quake 1 mod released, Incas vs. Pharaos. Unlike most strategies where you take out the enemy, in this mod you take out the ground they're standing on. Interesting concept, looks like it could be some fun in MP.
Be sure to check these out if you're in to Quake 1.
Monday, 27 June, 2011 – Planet Quake News
Project RDX adds MD5 support[ Comment ] 19:27 PST | TheHappyFriar | Print News | Category: Quake III Arena NewsNubstrike let everyone on moddb.com know that they're slowly (and surely) advancing on their Quake 3 Arena Engine + Mod called Project RDX. The newsworthy announcement is the change from MD3 (Q3A) player models to id's Doom 3 MD5 model format. The advantages are obvious he says: skeletal based, separate mesh and animation data and, of course, from id!
Read the whole posting over at their moddb.com site.
For those wondering what Project RDX is, it's an engine & game modification that bring Q3A to a more modern style.
Sunday, 26 June, 2011 – Planet Quake News
EntityPlus 0.7.1 Update[ Comment ] 18:09 PST | TheHappyFriar | Print News | Category: Quake III Arena NewsEraser let PQ know that EntityPlus has released a new version. This update fixes a serious bug in the scoring system that ignored your accuracy score when comparing it with the high score. Download the update to fix this.
He's also putting the word out that a twitter feed was setup so users can get immediate updates on patches, news and new features as they're being implemented in to the code.
If you are wondering what EntityPlus is, it is a mod offers level designers and other modders a complete single player tool set so you can do your own SP games/mods with the Q3A engine. It's SP only so don't get to excited if you're a MP fanatic (and, according to the twitter feed, MP support will be dropped very soon!).
Quake! Quake turned 15 yesterday. That's right, the one, the only, Quake, was released as shareware 15 years ago. While today it's easy to see how wonderful the game is, 15 years ago nobody thought it would still be a powerhouse today. Not only is it the engine that brought fully 3D first person shooters to everybody, it's also the engine behind many, many, many popular games over the years (including some still for sale today!). Quake is the game that brought us the term �Foxed�. It's what introduced the rocket and grenade jumps. It introduced 3D acceleration to the masses. It nearly invented in-game internet play. It introduced GPL to a great many gamers (Doom became GPL around the same time but Quake was more popular at the time).
Happy birthday Quake! I'm expecting we'll still be here in another 15 years talking about all the advancements made to this game long after other games, currently more popular games, fade away.
Please use the comments to post your own Quake-related stories. The biggest history of the game is about the players who played it and turned it in to the legacy it is today.