OpenHatch wiki

Community Data Science Workshops (Fall 2014)/Day 2 SQL project: Difference between revisions

< Community Data Science Workshops (Fall 2014)
imported>Jtmorgan
(basic info for afternoon session)
 
imported>Mako
No edit summary
 
(7 intermediate revisions by one other user not shown)
Line 1:
{{CDSW Moved}}
[[File:Twitter.png|right|260px]]▼
 
▲[[File:TwitterDatabase-mysql.png|right|260px]]
 
__NOTOC__
 
== Building a Dataset using the Twitter APIMySQL ==
 
In this project, we will explore a few ways to gather data from Wikimedia andusing StackExchange[https://en.wikipedia.org/wiki/MySQL projectsMySQL] usingand the [http://quarry.wmflabs.org/ Quarry] andweb Data Explorer applicationsapplication. Once we've done that, we will download the results of our queries in [https://en.wikipedia.org/wiki/Comma-separated_values CSV filesformat] which can be used to ask and answer questions and visualize data in the final session.
 
=== Goals ===
 
* Learn how to use SQLMySQL (a [https://en.wikipedia.org/wiki/SQL Structured Query Language]) to build datasets.
* Get set up to run SQLMySQL queries to gather data from Wikimedia and StackExchange projects.
* Practice running SQLMySQL queries on your own to get data about who is editing particular Wikipedia articles and answering questions on StackOverflow.
* Create a few collections of Wikipedia data that you can do research with in the final section.
 
=== Prerequisite ===
 
To participate in the afternoon session, you must have an a Wikimedia account. IfThis youis dothe notaccount haveis used to run queries with Quarry. It is also an account already, you can createuse when you edit oneWikipedia byand followingother theseWikimedia stepswebsites.
 
If you do not have a Wikimedia account already, <font size="+1">[https://en.wikipedia.org/wiki/Special:UserLogin >>click here to create an account <<]</font>.
 
If for some reason you are unable to create your account via the link above, try creating it via one of the links below. No matter which link you use, your account will allow you to log in to Quarry as well as any of the 100s of [https://meta.wikimedia.org/wiki/Wikimedia_projects Wikimedia project].
 
;Alternate account creation links
* [https://meta.wikimedia.org/wiki/Special:UserLogin meta.wikimedia.org]
* [https://commons.wikimedia.org/wiki/Special:UserLogin commons.wikimedia.org]
* [https://www.mediawiki.org/wiki/Special:UserLogin mediawiki.org]
* [https://en.wikisource.org/wiki/Special:UserLogin en.wikisource.org]
* [https://en.wiktionary.org/wiki/Special:UserLogin wiktionary.org]
* [https://en.wikivoyage.org/wiki/Special:UserLogin wikivoyage.org]
 
 
 
 
=== Practice ===
If you would like to practice SQL on your own, you can do so in the tutorial section of [http://sqlzoo.net/wiki/Main_Page SQLZoo].
 
=== Notes ===
* For this session, you will not need to use Python or type commands on the command line.
 
==== Queries and other notes ====
* https://etherpad.wikimedia.org/p/CDSW_fall_2014_SQL_session_1

Latest revision as of 22:05, 15 March 2015

Page Moved
All material related to the Community Data Science Workshops have been moved from the OpenHatch wiki to a new dedicated wiki and this page is no longer being updated here. Please visit the new version of the page on the Community Data Science Collective wiki.


Building a Dataset using MySQL

In this project, we will explore a few ways to gather data from Wikimedia using MySQL and the Quarry web application. Once we've done that, we will download the results of our queries in CSV format which can be used to ask and answer questions and visualize data in the final session.

Goals

  • Learn how to use MySQL (a Structured Query Language) to build datasets.
  • Get set up to run MySQL queries to gather data from Wikimedia projects.
  • Practice running MySQL queries on your own to get data about who is editing particular Wikipedia articles.
  • Create a few collections of Wikipedia data that you can do research with in the final section.

Prerequisite

To participate in the afternoon session, you must have an a Wikimedia account. This is the account is used to run queries with Quarry. It is also an account you can use when you edit Wikipedia and other Wikimedia websites.

If you do not have a Wikimedia account already, >>click here to create an account <<.

If for some reason you are unable to create your account via the link above, try creating it via one of the links below. No matter which link you use, your account will allow you to log in to Quarry as well as any of the 100s of Wikimedia project.

Alternate account creation links



Practice

If you would like to practice SQL on your own, you can do so in the tutorial section of SQLZoo.

Notes

  • For this session, you will not need to use Python or type commands on the command line.

Queries and other notes

Retrieved from "https://wiki.openhatch.org/wiki/Community_Data_Science_Workshops_(Fall_2014)/Day_2_SQL_project?oldid=15347"