The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
Web wide crawl with initial seedlist and crawler configuration from March 2011. This uses the new HQ software for distributed crawling by Kenji Nagahashi.
What�s in the data set:
Crawl start date: 09 March, 2011
Crawl end date: 23 December, 2011
Number of captures: 2,713,676,341
Number of unique URLs: 2,273,840,159
Number of hosts: 29,032,069
The seed list for this crawl was a list of Alexa�s top 1 million web sites, retrieved close to the crawl start date. We used Heritrix (3.1.1-SNAPSHOT) crawler software and respected robots.txt directives. The scope of the crawl was not limited except for a few manually excluded sites.
However this was a somewhat experimental crawl for us, as we were using newly minted software to feed URLs to the crawlers, and we know there were some operational issues with it. For example, in many cases we may not have crawled all of the embedded and linked objects in a page since the URLs for these resources were added into queues that quickly grew bigger than the intended size of the crawl (and therefore we never got to them). We also included repeated crawls of some Argentinian government sites, so looking at results by country will be somewhat skewed.
We have made many changes to how we do these wide crawls since this particular example, but we wanted to make the data available �warts and all� for people to experiment with. We have also done some further analysis of the content.
If you would like access to this set of crawl data, please contact us at info at archive dot org and let us know who you are and what you�re hoping to do with it. We may not be able to say �yes� to all requests, since we�re just figuring out whether this is a good idea, but everyone will be considered.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20110430183131/http://gwvault.ign.com/
Rather than swap weapons to adjust to new situations, the multi-faceted elementalist quickly adapts to new threats by attuning to different elements as needed. When the elementalist attunes to any of the four elements, she receives intrinsic bonuses that continually empower her.
One of the ranger�s main tools is their pet. These animals remain loyal to the ranger and help boost not only his potential DPS, but also his survivability. Instead of having 1 boring, never changing pet though, the rangers have a much wider choice of what pet they want to use. This is done via charming pets and then bonding with them. A ranger can have up to 3 pets charmed but may only use 1 at a time. A pet�s health, armor and damage is based on the level of the player it is bonded to, i.e. YOU.
Presenting the most recent Guild Wars 2 profession - the guardian! A versatile fighter who empowers his allies and crushes his enemies, the guardian is as dangerous with a staff as he is with a massive two- handed hammer. Discover the powerful offensive and defensive abilities of the guardian right here!
The Warrior is quite possibly the coolest looking class thus far in Guild Wars 2. The mighty Warrior is a class that charges across the battle field, rallying and leading his allies to victory. Dressed in full plate and wielding a variety of weapons, the warrior is a God amongst men. With Guild Wars 2 rewarding strategy and tactics; what better way to display this than an interactive weapon system. The Warrior truly is the master of all arms. This means he knows which weapon is called for which situation. The warrior knows that sometimes bigger isn�t always better, and that each weapon has a boon and a flaw. Here is the current list of weapons available to the Warrior, as provided by ArenaNet, and what they offer to the class. Please remember that this list is subject to change as we draw every closer to beta and release.
In my turbulent youth, way back in 20 ought 7 (not to be confused with the Glen Beck article �19 ought 7�), when I was just a wee lad, starry eyed by the myriad of countless streets and buildings in the large urban sprawl of the Canthan biway�s, I wrote an article for this site called �I Be Monk� . It was meant as a satirical piece where I took on the persona of an egotistical, know it all monk, that would only ordain to join pugs that worshipped the grown I walked (the reality of course is that I actually played warrior tank but the rest of the description was/ is really quite spot on). What surprised me later, and much to the chagrin of the site manager at the time was the absolute venom that spewed from the comments the readers left. To say that the readers missed the over the top sarcasm is an understatement (to this day, I still wonder how many readers and advertisers this site lost because of that one article).
As some of you may know, I recently came back to the lands of Guild Wars after a long absense (about four years). One of the topics I said I would write about was my experience coming back as basically a newb in an old game. Just to recap, in my previous Guild Wars incarnation, I was not in a guild, did almost no group stuff and never pvp�d. I was a social hermit. This time around I will do all of that and of course from time to time chronicle the highlights.
Need an answer to your gaming question? Good! Head on over and check out IGN Answers for all your gaming Q&A; needs. Ask a game related question and get an answer quick.
n a recent article in the online news magazine �Slate� the author Linda Perlstein wrote a piece about the 21st � century classroom, and posed the following �American classrooms are outdated. Slate seeks your great ideas for how to modernize them (Slate http://www.slate.com/id/2269307/). � While the intent of the article was more a focus on the physical buildings that make up a classroom/school my thoughts immediately went to gaming (ok, to be fair my thoughts are never that far astray from gaming but that�s a separate issue one I am dealing with in an online 12 step program).
If there is one aspect of Guild Wars that is implemented superbly, it's the in-game events such as this week's celebration of Halloween. Special yearly events are not unique to Guild Wars but the Guild Wars developers have captured the essence of what makes an in-game event successful.
These special occasions are so awesome in their ability to foster a sense of community and camaraderie amongst the player base. On the specific day of a special event, such as Halloween, certain locations, such as Lions Arch, are packed with revelers celebrating the day. These events are virtual parties that bring people together just as much as their counterparts in the real world do. In some ways, it could be argued, that in terms of celebrating special occasions they are more successful then their real world counterparts.
Guild Wars 2 is taking radical steps to give players a new and exciting way to fight enemies. One of the main factors in this new combat system is the lack of healers. That is right, there are no healers in Guild Wars 2. Instead, every class is given several support abilities. Only a handful of these support abilities, across the entire profession spectrum, will be healing. Buff type support skills will be your bread and butter for the most part. The idea behind this is simple. No one wants to wait�and wait�and wait for a healer to log on so they can start an instance. No one should fight carelessly and rely on powerful heals to aid their weak tactical maneuvers. Players must fight smart!
After several years away, Sonya has returned to continue writing her scribbles, you can read the latest one I'm Back here, for past work of Sonya Click here
We are excited in announcing the launching of our latest site, Halo Ring, for the mega-series by Bungie. So please take a moment to drop by and see what is going on over at the Ring. While there be sure to check out the Halo Ring Wiki section for all your needs and maybe add a bit of your knowledge while you are there. There will also be extensive beta coverage with guides, screenshots and editorials. Time to suit up!
April 19, 2010 - This spring NCsoft and ArenaNet celebrate the fifth anniversary of Guild Wars with Guild Wars Beyond, an ongoing campaign that expands upon the Guild Wars storyline by focusing on key characters and events that are destined to make history leading up to Guild Wars 2. The first such event, the War in Kryta, sweeps players up in a savage struggle between the oppressive White Mantle zealots and the Shining Blade rebels for the fate of Kryta.
Guild Wars Beyond allows players to experience the War in Kryta from the very beginning to its fateful finale through an intriguing viral campaign, a website that enhances the storyline, and with gripping new in-game content. They�ll join the battle for Kryta by participating in exciting quests, taking part in decisive battles, and by purchasing the new White Mantle and Shining Blade costumes for their character. Guild Wars players will literally take part in history, as the War in Kryta has a profound effect on the world of Guild Wars 2.
Within the war, players help the Shining Blade rebels oppose the White Mantle, a militarized cult that rules Kryta, in the hopes of restoring the Krytan monarchy and installing Princess Salma as queen. The legacy of these deeds carries 250 years into the future, where Salma�s descendent Queen Jennah leads the embattled humans in Guild Wars 2. In addition to Salma�s storyline, the War in Kryta also focuses on several key characters that are destined to make history - Gwen, a brooding, beautiful mesmer, and Lieutenant Keiran Thackeray, a charr-hunting ranger. Gwen and Lt. Thackeray are destined to marry and establish the human city of Ebonhawke, a key location in Guild Wars 2, and their descendent, Logan Thackeray, is one of the iconic characters in Guild Wars 2.
In the coming months, Guild Wars Beyond will continue to unveil important Guild Wars 2 information and content via the current Guild Wars live game. For more information on Guild Wars and the War in Kryta, please visit www.guildwars.com.