Community Data Science Workshops (Spring 2015)/Day 3 Projects/Civic data: Difference between revisions

Revision as of 02:38, 9 May 2015

Building and visualizing datasets using data.seattle.gov and Google apps

In this project, we will explore a few ways to gather data from data.seattle.gov using the Socrata API, the Google Maps API, and Google Fusion tables.

Goals

Collect data on building permits in Seattle, by neighborhood and by year awarded.
Combine those data with neighborhood data from the Google Maps API
Download the results in a CSV file
Upload results to Google's Fusion Table visualization engine

Download the Day 3 Socrata project

If you are confused by these steps, go back and refresh your memory with the Day 0 setup and tutorial and Day 0 tutorial

Today's dataset: Seattle Building Permits database

Topics to cover

creating API queries and filtering and grouping the results
combining results from multiple APIs
downloading API results as CSV files
building visualizations of timeseries and geolocated data

Questions we will try to answer with our data

which Seattle neighborhoods have had the most multifamily residential construction (apartments and townhomes) since 2010?
how much has the rate of apartment construction increased since 2010?
where are the most expensive construction projects currently being built?

Resources

About Google Fusion tables: https://support.google.com/fusiontables/answer/2571232
Google Fusion Tables mapmaking tutorial: https://support.google.com/fusiontables/answer/2527132?hl=en&topic=2573107&ctx=topic
API sandbox tool: https://www.hurl.it
API-powered app: http://web6.seattle.gov/mnm/
Socrata API help resources: http://dev.socrata.com/consumers/getting-started.html

filtering results: http://dev.socrata.com/docs/filtering.html
dealing with timestamps: http://dev.socrata.com/docs/datatypes/timestamp.html
writing API queries: http://dev.socrata.com/docs/queries.html

Data.seattle.gov datasets with lat/long or street addresses

Instructional videos

Other Socrata sites that use this API

@@ Line 11: / Line 11: @@
 * Combine those data with neighborhood data from the Google Maps API
 * Download the results in a CSV file
-* Upload results to Google's Fu
+* Upload results to Google's [https://support.google.com/fusiontables/answer/2571232 Fusion Table] visualization engine
 === Download the Day 3 Socrata project ===
-<font size="+1">[http://jtmorgan.net/cdsw/may9scripts.zip Click here to download the Socrata scripts]</font>
+<!--< font size="+1">[http://jtmorgan.net/cdsw/may9scripts.zip Click here to download the Socrata scripts]</font> -->
 If you are confused by these steps, go back and refresh your memory with the [[Community Data Science Workshops (Spring 2015)/Day 0 setup and tutorial|Day 0 setup and tutorial]] and [[Community Data Science Workshops (Spring 2015)/Day 0 tutorial|Day 0 tutorial]]
-(Estimated time: 10 minutes)
+;Today's dataset: [https://data.seattle.gov/Permitting/Building-Permits-Current/mags-97de Seattle Building Permits database]
 === Topics to cover ===
-* explain Socrata open data platform, exists on other government websites
+* creating API queries and filtering and grouping the results
-* navigate to [http://en.wikipedia.org/w/api.php api page] and show the documentation, point out examples
+* combining results from multiple APIs
-* introduce the [https://www.hurl.it API sandbox] as a tool for building queries
+* downloading API results as CSV files
+* building visualizations of timeseries and geolocated data
-=== Example questions ===
+=== Questions we will try to answer with our data ===
-* What Seattle neighborhood has the most art galleries? - [http://jtmorgan.net/cdsw/neighborhood_culture1.py neighborhood_culture1.py]
+# which Seattle neighborhoods have had the most multifamily residential construction (apartments and townhomes) since 2010?
-* What Seattle neighborhood has the most square feet devoted to arts & culture?  - [http://jtmorgan.net/cdsw/neighborhood_culture2.py neighborhood_culture2.py]
+# how much has the rate of apartment construction increased since 2010?
-* Which trail gets more bike traffic per month--the [[w:Burke-Gilman_Trail|Burke Gilman]] or the [[w:Mountains_to_Sound_Greenway|Mountain to Sound Trail]]?  - [http://jtmorgan.net/cdsw/traffic_counter1.py traffic_counter1.py], [http://jtmorgan.net/cdsw/traffic_counter2.py traffic_counter2.py]
+# where are the most expensive construction projects currently being built?
-* Do people use the trails less when it's cold? [http://jtmorgan.net/cdsw/monthly_weather.py monthly_weather.py]
-* Does the Burke-Gilman get more bike or pedestrian traffic? [http://jtmorgan.net/cdsw/bike_and_peds1.py bike_and_peds1.py]
-* What is the primary commute direction on the Burke Gilman? [http://jtmorgan.net/cdsw/bike_and_peds1.py bike_and_peds2.py]
-;Other example questions
+=== Other questions you can answer with these data ===
-* What day of the week does the Burke Gilman have the most total traffic?
+# which Seattle developer has built the most apartments and townhomes since 2010?
-* What day has the most pedestrian traffic?
+# where in Seattle are the most single-family homes being constructed?
-* What ''time of day'' has the most southbound traffic, on average?
-* How many shoplifting calls has SPD responded to this month so far?
 === Resources ===