eXceem

Go Back   eXceem > Off Topic > Interesting Websites

Claim your amazing £1,000 slots booster bonus now!


Want Wikipedia offline?

This is a discussion on Want Wikipedia offline? within the Interesting Websites forums, part of the Off Topic category; You can download it from here . Full 2.8TBs of it! Any 50 meggers want to give this a go? ...

Reply
 
Thread Tools
Old 15-10-09, 10:11 PM   #1
1 new message
 
omairt's Avatar
 
Join Date: Jul 2007
Location: Omicron Persei 8
Posts: 2,518
omairt has much to be proud ofomairt has much to be proud ofomairt has much to be proud ofomairt has much to be proud ofomairt has much to be proud ofomairt has much to be proud of

Want Wikipedia offline?


You can download it from here. Full 2.8TBs of it!

Any 50 meggers want to give this a go? Shouldn't take longer than a week lol

Enjoy!
 
Reply With Quote
Old 15-10-09, 11:07 PM   #2
iPod 20gb
 
elliotknell's Avatar
 
Join Date: Jul 2009
Location: U.S.
Posts: 673
elliotknell is a jewel in the rough
Time to break out the external hard drives... all 10 of them...
 
Reply With Quote
Old 15-10-09, 11:10 PM   #3
- - - - - - -
 
mcgrou's Avatar
 
Join Date: Jul 2008
Location: -
Posts: 5,148
mcgrou has much to be proud ofmcgrou has much to be proud ofmcgrou has much to be proud ofmcgrou has much to be proud ofmcgrou has much to be proud ofmcgrou has much to be proud of
Quote:
Originally Posted by omairt View Post
Full 2.8TBs of it!
__________________
Spoiler
 
Reply With Quote
Old 16-10-09, 01:15 AM   #4
iPod Shuffle
 
Join Date: Oct 2009
Posts: 11
kulla8 is an unknown quantity at this point
Quote:
Originally Posted by omairt View Post
You can download it from here. Full 2.8TBs of it!

Any 50 meggers want to give this a go? Shouldn't take longer than a week lol

Enjoy!
Sure, let me go out and buy a couple more external hard drives...
and with my internet connection it should take....
 
Reply With Quote
Old 16-10-09, 04:53 AM   #5
iPod 20gb
 
MegamanEXE's Avatar
 
Join Date: Jul 2009
Location: Pakistan
Posts: 841
MegamanEXE is a jewel in the rough
Send a message via AIM to MegamanEXE Send a message via MSN to MegamanEXE Send a message via Yahoo to MegamanEXE Send a message via twitter to MegamanEXE
No, thanks, I'm good. Some people are just too kind these days. =P
 
Reply With Quote
Old 11-12-09, 07:12 AM   #6
iPod Shuffle
 
Join Date: Dec 2009
Posts: 20
axxo08 is an unknown quantity at this point
thanx man for the link...gonna use it for my upcoming projects
 
Reply With Quote
Old 30-11-10, 02:32 PM   #7
iPod Shuffle
 
Join Date: Nov 2010
Posts: 5
Sarah87 is an unknown quantity at this point
Wow I had no idea that was even possible! Thanks for the tip and the link I'm going to download that as soon as possible. Great for when you are doing important projects and perhaps your internet dies! A real saviour.
 
Reply With Quote
Old 30-11-10, 03:27 PM   #8
iPod Nano 4GB
 
DieselDragn's Avatar
 
Join Date: Jun 2010
Location: Location, Location!
Posts: 302
DieselDragn will become famous soon enough
Quote:
Originally Posted by Sarah87 View Post
Wow I had no idea that was even possible! Thanks for the tip and the link I'm going to download that as soon as possible. Great for when you are doing important projects and perhaps your internet dies! A real saviour.
Bear in mind that's an immense amount of data to download just for contingency purposes...If you have an internet capable mobile phone, the Mobile version of Wikipedia would be a much quicker and more efficient way to go about it.

As for me, I often find that I'd like to have an offline Wikipedia knocking around...But as I havn't got much storage space here, I think I'll just download the pages-articles.xml.bz2 at a smaller 6.07GB (Compressed) and use on-the-fly extraction for retrieving pages when needed. The BZip2 format (Very handily) resets it's compression algorhythm every 900KB or so. All that'd be needed is a one-time scan through the file to create an index database...Then simply read the relevant blocks from the file, extract them, then display the text from within!

Voila! A 30GB text-only Wikipedia small enough to fit onto a DVD!
 
Reply With Quote
Old 30-11-10, 07:42 PM   #9
iPod 20gb
 
justme's Avatar
 
Join Date: Aug 2010
Location: Limassol
Posts: 645
justme is on a distinguished road
Send a message via MSN to justme
No thanks, I don't wanna be downloading until 2090!
 
Reply With Quote
Old 02-12-10, 09:23 PM   #10
iPod Nano 4GB
 
DieselDragn's Avatar
 
Join Date: Jun 2010
Location: Location, Location!
Posts: 302
DieselDragn will become famous soon enough
Omairt: Ye opened this thread on the 15th October, which was a month and a half ago...

...Have ye managed to finish downloading the full version of Wikipedia yet, or is there still a bit left to go?
 
Reply With Quote
Old 02-12-10, 09:25 PM   #11
Mini Mac
 
Djoscar's Avatar
 
Join Date: Jan 2009
Posts: 4,364
Djoscar has much to be proud ofDjoscar has much to be proud ofDjoscar has much to be proud ofDjoscar has much to be proud ofDjoscar has much to be proud ofDjoscar has much to be proud of
Quote:
Originally Posted by DieselDragn View Post
Omairt: Ye opened this thread on the 15th October, which was a month and a half ago...
+1 year
__________________
 
Reply With Quote
Old 02-12-10, 09:27 PM   #12
Mini Mac
 
iFreeZone's Avatar
 
Join Date: May 2009
Posts: 7,364
iFreeZone is just really niceiFreeZone is just really nice
'09
__________________
 
Reply With Quote
Old 02-12-10, 10:49 PM   #13
iPod 30gb
 
SometingStu's Avatar
 
Join Date: Oct 2009
Posts: 1,485
SometingStu is a jewel in the rough
So it'll be bigger by now?

Ugh, if anything I think that Diesel's idea is best, but I honestly think that there must be an easier way...like, a kindle, but for Wikipedia!

I'm off the to the dragons for this one.
 
Reply With Quote
Old 03-12-10, 12:04 AM   #14
iPod Nano 4GB
 
DieselDragn's Avatar
 
Join Date: Jun 2010
Location: Location, Location!
Posts: 302
DieselDragn will become famous soon enough
Quote:
Originally Posted by DieselDragn View Post
Omairt: Ye opened this thread on the 15th October, which was a month and a half ago...Have ye managed to finish downloading the full version of Wikipedia yet?
Quote:
Originally Posted by Djoscar View Post
+1 year
Ahh...So he should've at least got 45% of it done by now!
(Although I'd hope he's on a truly unlimited provider...Thinking of BT's charges for going over bandwidth, all I can think is Ouch! )

Quote:
Originally Posted by SometingStu View Post
So it'll be bigger by now?
According to the Wiki page in the OP:
  • The latest dump - Taken 30th Jan 2010 - Is ~280GB as a BZip2 archive, and ~32GB as a 7-Zip. Both decompress to about ~5.2TB (That's 5,325 Gigabytes) of XML wrapped data.
  • The articles-only dump - No metadata or page history - Is a much more managable 6.07GB as a BZip2, and (I'd guess) about ~3.15GB as a 7-Zip. The decompressed size is ~27GB.
That said, the download server for the Wikipedia database dumps has been down for the last few days for server maintenance as seen in the message Here...So either this thread got bumped at a bad time, or it's costing Wikipedia too much to host and serve these dumps!
Quote:
Originally Posted by SometingStu View Post
Ugh, if anything I think that Diesel's idea is best, but I honestly think that there must be an easier way...like, a kindle, but for Wikipedia!
A while ago I had an idea for taking the articles-only dump, stripping out everything but the bare essentials (So most text formatting and styling etc gets dropped, with single-case plain text left over) and seeing if I could cram the whole lot down enough to fit on a 4GB SD card.

Havn't made a start on anything yet...But if ever I managed it, it would allow a plain copy of the entire Wikipedia to be carried on most smartphones and other devices that can support large storage volumes and run a decompression app...Potentially including the iPad, Kindle, and Galaxy Tab!
 
Reply With Quote
Old 03-12-10, 12:56 AM   #15
Call me Vlad
 
Larkino's Avatar
 
Join Date: Jun 2008
Location: South London
Posts: 9,503
Larkino has a reputation beyond reputeLarkino has a reputation beyond reputeLarkino has a reputation beyond reputeLarkino has a reputation beyond reputeLarkino has a reputation beyond reputeLarkino has a reputation beyond reputeLarkino has a reputation beyond repute
lol, so you want the whole of Wikipedia on a memory card?

If you can do that, you could sell that on ebay for profitttzzz!
__________________
 
Reply With Quote
Old 03-12-10, 01:38 AM   #16
iPod 60gb
 
Join Date: Jul 2007
Posts: 1,713
Cefca is a jewel in the rough
Then probably get $ued.

Last edited by Cefca; 03-12-10 at 01:38 AM..
 
Reply With Quote
Old 07-12-10, 10:36 AM   #17
iPod Nano 4GB
 
DieselDragn's Avatar
 
Join Date: Jun 2010
Location: Location, Location!
Posts: 302
DieselDragn will become famous soon enough
Quote:
Originally Posted by Larkino View Post
lol, so you want the whole of Wikipedia on a memory card? If you can do that, you could sell that on ebay for profitttzzz!
Quote:
Originally Posted by Cefca View Post
Then probably get $ued.
Actually, it'd be completely within the law. Wikipedia's content is released under a Creative Commons licence, meaning that it can be downloaded, passed around, mirrored, edited, and derived from without Wikipedia's prior permission as long as Wikipedia is cited as the original source, and the derivative work is also released under Creative Commons licencing!

In short: If I wanted to pack Wikipedia on a memory card/USB pen and sell it on eBay, I could do so without breaking any laws. If nothing else I'd be packaging an online "product" in physical form and charging for it, which has been done for years with Linux distributions that are available for free online!

That said, what I've got in mind is a very plain (No pictures) text only version of the encyclopaedia which wouldn't be good enough to sell for a profit...But being crammed onto DVD, it would be really handy for schools and academic bodies in third-world countries where Internet access is expensive or non existent!

Quote:
Originally Posted by Larkino View Post
...sell that on ebay for profitttzzz!
...Or offer it to people in a Lockerz redemption!
 
Reply With Quote
Old 19-08-11, 10:53 AM   #18
iPod Shuffle
 
apanova's Avatar
 
Join Date: Aug 2011
Posts: 6
apanova has a little shameless behaviour in the past
I would really like an offline version of Encyclopedia Dramatica!
 
Reply With Quote
Old 19-08-11, 11:12 AM   #19
hurr durr!
 
Ojaser6's Avatar
 
Join Date: Jul 2009
Location: Planet Urth
Posts: 3,654
Ojaser6 has a spectacular aura about
Send a message via MSN to Ojaser6 Send a message via Skype™ to Ojaser6
Congratulations on a huge bump!
__________________
Get some Free Cash from FreebieJeebies!
Or, get a Free Galaxy S from Xpango!


 
Reply With Quote
Reply

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are On
Refbacks are Off





All times are GMT. The time now is 12:57 AM.
All trademarks and copyrights held by respective owners. Forum posts are owned by the poster.

Powered by vBulletin® Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.
SEO by vBSEO
no new posts