The Internet Archive discovers and captures web pages through many different web crawls.
At any given time several distinct crawls are running, some for months, and some every day or longer.
View the web archive through the Wayback Machine.
Web wide crawl with initial seedlist and crawler configuration from March 2011. This uses the new HQ software for distributed crawling by Kenji Nagahashi.
What�s in the data set:
Crawl start date: 09 March, 2011
Crawl end date: 23 December, 2011
Number of captures: 2,713,676,341
Number of unique URLs: 2,273,840,159
Number of hosts: 29,032,069
The seed list for this crawl was a list of Alexa�s top 1 million web sites, retrieved close to the crawl start date. We used Heritrix (3.1.1-SNAPSHOT) crawler software and respected robots.txt directives. The scope of the crawl was not limited except for a few manually excluded sites.
However this was a somewhat experimental crawl for us, as we were using newly minted software to feed URLs to the crawlers, and we know there were some operational issues with it. For example, in many cases we may not have crawled all of the embedded and linked objects in a page since the URLs for these resources were added into queues that quickly grew bigger than the intended size of the crawl (and therefore we never got to them). We also included repeated crawls of some Argentinian government sites, so looking at results by country will be somewhat skewed.
We have made many changes to how we do these wide crawls since this particular example, but we wanted to make the data available �warts and all� for people to experiment with. We have also done some further analysis of the content.
If you would like access to this set of crawl data, please contact us at info at archive dot org and let us know who you are and what you�re hoping to do with it. We may not be able to say �yes� to all requests, since we�re just figuring out whether this is a good idea, but everyone will be considered.
TIMESTAMPS
The Wayback Machine - https://web.archive.org/web/20110511183636/http://nwvault.ign.com/
Here are some of the entries that are short of the 25 votes needed to be considered for the NWN2 Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the NWN2 Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
We have one new entry in our NWN1 Gameworld Database to let you know about. These are servers on the net where you can join and play. Here they are with the description they entered:
Shattered Lands - Scars of Time (NWN-1.69)
Shattered Lands, is based in Forgotten Realms, and is a server where most play styles are welcome. The server is meant for fun and relaxation with guidelines, rather than rules. It has been designed around a role-playing or acting concept, but "power-gamers" are welcome, so long as they are respectful to the community, and are even encouraged to participate; as long as they bring something to the metaphorically placed table.
The setting takes place in Faerun, as mentioned above, along the High Ice glacier, which for unknown reasons to the random traveler, has had a path cut through the ice, where rumors of vast gold, artifacts, and even tales of ancient ruins of Netheril await. It is said that the land beyond the ice, is known as the "Shattered Lands", and has had native residents for a much, much, longer a time, than the path has been opened to Greater Faerun. A path that is rumored to only have been accessible for some estimated five hundred years. These estimates come from the Sheragrad nomads, who have only discovered this peculiar region in the last one hundred years.
The Gether Caravans have taken it upon themselves to aid travelers through the Anauroch desert, to the nomadic camp, and even provide them with a small boon so as to keep them safe during their first few travels, for reasons unknown. The traveler arrives in the desert, the caravans pulling near the mines; the nomadic camp lay shortly off to the West. Their destiny lay in their own hands.
If you'd like your game world promoted, enter it and we'll post it here. Thanks for the news.
Here are some of the entries that are short of the 25 votes needed to be considered for the NWN2 Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the NWN2 Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the NWN2 Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are some of the entries that are short of the 25 votes needed to be considered for the Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Here are the most recent news items added to our News Announcement system which allows fans to enter news items concerning things that they want to share with the community.
"A pic from "Rise of Forbidden Friendship" campaign mod im making. I will NOT tell anything about it before release, i am VERY carefull about that! But i honestly think that this has award-winning elements. Welcome to my atmosphere and story-telling. (in development) Music from NWN 2 and SoZ are used in this mod."
Thanks for the submission WBMS Interactive. You can add your own screenshots and we'll publish one a day so the authors get good coverage.
Here are some of the entries that are short of the 25 votes needed to be considered for the NWN2 Hall of Fame. If you've downloaded any of these files, please visit their pages and rate them. Getting feedback from the community is very important to content authors and ensures that they continue to produce more for you to download.
Site
