Community Data Science Workshops (Fall 2015)/Day 3 Projects/Civic data: Difference between revisions

From CommunityData
No edit summary
No edit summary
Line 18: Line 18:


We will also explore an important non-technical part of data science: thinking critically about data. Thinking critically about the data you have, and what conclusions you can draw from it, is especially important when you are visualizing data, because its easy to mislead people with visualizations. We'll discuss how visualizations based on incorrect data can lead people to make false conclusions, using an example from a recent visualization of building demolitions published in the Northwest design magazine ''Arcade''.
We will also explore an important non-technical part of data science: thinking critically about data. Thinking critically about the data you have, and what conclusions you can draw from it, is especially important when you are visualizing data, because its easy to mislead people with visualizations. We'll discuss how visualizations based on incorrect data can lead people to make false conclusions, using an example from a recent visualization of building demolitions published in the Northwest design magazine ''Arcade''.


== Preparation ==
== Preparation ==


;Step 1: Download today's scripts and sample datasets: [http://jtmorgan.net/cdsw/may9cdsw2.zip FIXME]
;Step 1: Download today's scripts: [http://jtmorgan.net/cdsw/nov7cdsw_scripts.zip Python scripts]
;Today's dataset: [https://data.seattle.gov/Permitting/Building-Permits-Current/mags-97de Click here to view the Seattle Building Permits database]
;Step 2: Download today's datasets: [http://jtmorgan.net/cdsw/nov7cdsw_data.zip datasets]
 
''If you are confused by anything today, go back and refresh your memory with the [[Community Data Science Workshops (Fall 2015)/Day 0 setup and tutorial|Day 0 setup and tutorial]] and [[Community Data Science Workshops (Fall 2015)/Day 0 tutorial|Day 0 tutorial]]''


== Visualizing new home construction in Seattle over time ==
== Part 1: getting the building permit data ==
;Question: Has the rate of apartment construction increased since 2010?
;Question: Has the rate of apartment construction increased since 2010?




;Today's dataset: [https://data.seattle.gov/Permitting/Building-Permits-Current/mags-97de Click here to view the Seattle Building Permits database]


== Part 2: new construction by month ==
== Part 3: new construction by neighborhood ==
== Visualizing new home construction in Seattle by neighborhood ==
== Visualizing new home construction in Seattle by neighborhood ==
;Question: which Seattle neighborhoods have had the most multifamily residential construction (apartments and townhomes) since 2010?
;Question: which Seattle neighborhoods have had the most multifamily residential construction (apartments and townhomes) since 2010?
Line 45: Line 53:




== Resources ==


=== Resources ===
''If you are confused by anything today, go back and refresh your memory with the [[Community Data Science Workshops (Fall 2015)/Day 0 setup and tutorial|Day 0 setup and tutorial]] and [[Community Data Science Workshops (Fall 2015)/Day 0 tutorial|Day 0 tutorial]]''
;Sample API queries
* Building permit data: https://data.seattle.gov/resource/mags-97de.json?$where=issue_date%20IS%20NOT%20NULL%20&action_type=NEW&category=MULTIFAMILY&$limit=100
* Google maps location (using street address): http://maps.googleapis.com/maps/api/geocode/json?address=5601+22ND+AVE+NW+Seattle+WA
* Google maps location (using lat/long): http://maps.googleapis.com/maps/api/geocode/json?latlng=47.66979666%2C-122.38570052
;Sample charts/maps
* Google Fusion table map of permits 2010-2015 [https://www.google.com/fusiontables/DataSource?docid=1aOSWYuXXqh7U2bnUsBH7mM2w3JfsYHzjk29ihbi8]
;Help resources and inspiration
* About Google maps API: https://developers.google.com/maps/documentation/geocoding/#ReverseGeocoding
* About Google Fusion tables: https://support.google.com/fusiontables/answer/2571232
* Google Fusion Tables mapmaking tutorial: https://support.google.com/fusiontables/answer/2527132?hl=en&topic=2573107&ctx=topic
* API sandbox tool: https://www.hurl.it
* API-powered app: http://web6.seattle.gov/mnm/
* Socrata API help resources: http://dev.socrata.com/consumers/getting-started.html
:* filtering results: http://dev.socrata.com/docs/filtering.html
:* dealing with timestamps: http://dev.socrata.com/docs/datatypes/timestamp.html
:* writing API queries: http://dev.socrata.com/docs/queries.html
;Other data.seattle.gov datasets with neighborhood, timeseries, and/or location data
*[https://data.seattle.gov/Community/Seattle-Cultural-Space-Inventory/vsxr-aydq Seattle Cultural Space Inventory]
*[https://data.seattle.gov/Transportation/MTS-Trail-west-of-I-90-Bridge/u38e-ybnc MTS trail bike/ped traffic]
*[https://data.seattle.gov/Transportation/Burke-Gilman-Trail-north-of-NE-70th-St-Bike-and-Pe/2z5v-ecg8 Burke Gilman trail bike/ped traffic]
*[https://data.seattle.gov/Transportation/Road-Weather-Information-Stations/egc4-d24i Road temps in Seattle]
*[https://data.seattle.gov/Public-Safety/Seattle-Police-Department-911-Incident-Response/3k2p-39jp SPD 911 incident respose]
;Instructional videos
* https://data.seattle.gov/videos
* https://www.youtube.com/watch?v=YlKzXTrTLOQ
* https://www.youtube.com/watch?v=Whfp8ojMf0U
* https://www.youtube.com/watch?v=Vd6bwz3ivVA


;Other Socrata sites that use this API
* https://data.austintexas.gov/
* https://data.cityofchicago.org/
* https://data.cityofnewyork.us/


[[Category:Fall_2015_series]]
[[Category:Fall_2015_series]]

Revision as of 23:41, 6 November 2015

What neighborhoods have changed the most since the beginning of the Seattle building boom?


Building and visualizing datasets using data.seattle.gov and Google apps

In this project, we will explore a few ways to analyze and visualize data from data.seattle.gov. We will examine trends in the construction of houses, townhomes, and condos in Seattle over the last five years, in order to determine the true extent of the current "construction boom".

  • We'll download data from two APIs (Socrata open data platform and Google Maps)
  • We'll analyze trends over time in our dataset
  • We'll visualize our data in graphs and heatmaps

Topics we will cover

  • Writing and testing complex API queries
  • Reading and writing CSV and JSON files
  • Filtering and aggregating data
  • Combining data from multiple APIs
  • Graphing and mapping data

We will also explore an important non-technical part of data science: thinking critically about data. Thinking critically about the data you have, and what conclusions you can draw from it, is especially important when you are visualizing data, because its easy to mislead people with visualizations. We'll discuss how visualizations based on incorrect data can lead people to make false conclusions, using an example from a recent visualization of building demolitions published in the Northwest design magazine Arcade.


Preparation

Step 1
Download today's scripts: Python scripts
Step 2
Download today's datasets: datasets

If you are confused by anything today, go back and refresh your memory with the Day 0 setup and tutorial and Day 0 tutorial

Part 1: getting the building permit data

Question
Has the rate of apartment construction increased since 2010?


Today's dataset
Click here to view the Seattle Building Permits database

Part 2: new construction by month

Part 3: new construction by neighborhood

Visualizing new home construction in Seattle by neighborhood

Question
which Seattle neighborhoods have had the most multifamily residential construction (apartments and townhomes) since 2010?


Mapping new home construction in Seattle

Question
what locations have experienced the highest density of new construction since 2010?

Challenge questions

Try to answer these additional questions that draw on the data and methods we're learning today. Ask a mentor if you get stuck!

  1. In which Seattle neighborhood is the cost of new construction projects highest, on average?
  2. Where in Seattle are the most commercial buildings being constructed in 2015?
  3. How does the rate of residential construction in Seattle from 2010-2015 compare to the previous 5 years?
  4. How many townhouses have been constructed in Seattle since 2011?


Resources