Editing CommunityData:Wikia data
From CommunityData
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
== XML Dumps == | == XML Dumps == | ||
So far our Wikia projects all use the XML dumps. These are stored on hyak at / | So far our Wikia projects all use the XML dumps. These are stored on hyak at /com/raw_data/wikia_dumps. | ||
=== Use the 2010 dumps === | === Use the 2010 dumps === | ||
The 2010 wikia dumps were created by wikia and are the only ones that approach being complete or reliable. They include the full history of ~76K wikis. In general, if the questions you want to answer don't require newer data then use the 2010 dumps. | The 2010 wikia dumps were created by wikia and are the only ones that approach being complete or reliable. They include the full history of ~76K wikis. In general, if the questions you want to answer don't require newer data then use the 2010 dumps. | ||
The next most useful dumps are from WikiTeam and were obtained from archive.org. | The next most useful dumps are from WikiTeam and were obtained from archive.org. | ||
As of 5-23-2017, the most recent complete dumps [https://archive.org/download/wikia_dump_20141219] from Wikiteam | As of 5-23-2017, the most recent complete dumps [https://archive.org/download/wikia_dump_20141219] from Wikiteam are from December 2014. Mako found some missing data in these dumps and contacted them. They released a patch [https://archive.org/details/wikiteam-incomplete-2014-12], which we have yet to validate. | ||
These, and all other dumps after 2010, have a few issues that make using them complicated: | These, and all other dumps after 2010, have a few issues that make using them complicated: |