Editing Human Centered Data Science/Datasets
From CommunityData
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
In order to complete your project, you will each need a dataset. If you are at the stage of your career where you already have a dataset, great! If not, there are many datasets to draw from. Here are some ideas: | In order to complete your project, you will each need a dataset. If you are at the stage of your career where you already have a dataset, great! If not, there are many datasets to draw from. Here are some ideas: | ||
* If there's an author of a study you loved, you can send a polite email asking if they are able or willing to share an archival or replication version of the dataset used in their paper. Be very polite and make it clear that this is starting as a class project but that might turn into a paper for publication. Make your timeline clear. In communication, replication datasets are still very rare, so be prepared for a negative answer. | |||
* Do some Google Scholar and normal Google searching for datasets in your research area. You'd be surprised at what's available. | |||
* [https://docs.google.com/document/d/1RPjvoxYX87DM_px8UX9my6rEg0V3rTcNvRHzSAHxAzU/edit# This Google Doc] provides documentation and descriptions of datasets (and potential research questions) from Yelp, [https://data.seattle.gov/ Data.seattle.gov], and Wikimedia. | |||
* Take a look at datasets available in the [https://dataverse.harvard.edu/ Harvard Dataverse] (the largest collection of social science research data) or one of the other members of the [http://dataverse.org/ Dataverse network]. | * Take a look at datasets available in the [https://dataverse.harvard.edu/ Harvard Dataverse] (the largest collection of social science research data) or one of the other members of the [http://dataverse.org/ Dataverse network]. | ||
* Look at the collection of social scientific datasets at [https://www.icpsr.umich.edu/icpsrweb/ICPSR/ ICPSR] (UW is a member). There are an enormous number of very rich datasets. | * Look at the collection of social scientific datasets at [https://www.icpsr.umich.edu/icpsrweb/ICPSR/ ICPSR] (UW is a member). There are an enormous number of very rich datasets. | ||
* Use the [http://scientificdata.isa-explorer.org/index.html ISA Explorer] to find datasets. Keep in mind the large majority of datasets it will search are drawn from the natural sciences. | * Use the [http://scientificdata.isa-explorer.org/index.html ISA Explorer] to find datasets. Keep in mind the large majority of datasets it will search are drawn from the natural sciences. | ||
* If you're interested in using Wikimedia/Wikipedia data, and want to know what's available, come talk to Jonathan and Oliver. | |||
* If you're interested in using Wikimedia/Wikipedia data, and want to know what's available | |||
== Other open online datasets | == Other open online datasets == | ||
* [https://www.data.gov/developers/apis Data.gov] provides access to a variety of US Federal datasets and data sources, along with an API and online tools for searching for data. | * [https://www.data.gov/developers/apis Data.gov] provides access to a variety of US Federal datasets and data sources, along with an API and online tools for searching for data. | ||
* The [https://sunlightfoundation.com/api/ Sunlight Foundation] used to provide a one-stop shop for datasets and tools around political activity in the USA. The Foundation has closed down, but their website points to a variety of other organizations, datasets, and tools for accessing public civic data. | * The [https://sunlightfoundation.com/api/ Sunlight Foundation] used to provide a one-stop shop for datasets and tools around political activity in the USA. The Foundation has closed down, but their website points to a variety of other organizations, datasets, and tools for accessing public civic data. | ||
Line 23: | Line 17: | ||
* [https://www.reddit.com/r/datasets/top/?sort=top&t=all r/datasets on Reddit] contains links to many interesting datasets, although some of these data may not be freely licensed. | * [https://www.reddit.com/r/datasets/top/?sort=top&t=all r/datasets on Reddit] contains links to many interesting datasets, although some of these data may not be freely licensed. | ||
* [https://elitedatascience.com/datasets Elite Data Science] has published a list of public datasets that can be used for a variety of data science and machine learning projects. | * [https://elitedatascience.com/datasets Elite Data Science] has published a list of public datasets that can be used for a variety of data science and machine learning projects. | ||
* [https://www.kaggle.com/datasets Kaggle] also provides many data science datasets that can be explored and used. | * [https://www.kaggle.com/datasets Kaggle] also provides many data science datasets that can be explored and used. | ||
== Dataset documentation examples == | == Dataset documentation examples == |