Community Data Science Workshops (Spring 2014)/May 3rd Wikipedia project: Difference between revisions

← Older edit

Community Data Science Workshops (Spring 2014)/May 3rd Wikipedia project (view source)

Revision as of 22:08, 15 March 2015

686 bytes added , 9 years ago

m

moved to wiki.communitydata.cc

Anonymous user

imported>Jtmorgan

Revision as of 21:57, 30 April 2014 (view source) imported>Mako No edit summary ← Older edit		Latest revision as of 22:08, 15 March 2015 (view source) imported>Jtmorgan m (moved to wiki.communitydata.cc)
(5 intermediate revisions by 2 users not shown)
Line 1: {{CDSW Moved}} [[File:Wikipedia.png\|right\|250px]]▼ ▲[[File:Wikipedia.png\|right\|250px]] __NOTOC__ == Building a Dataset using the Wikipedia API == In this project, we will explore a few ways to gather data using the Wikipedia API. Once we've done that ~~done~~, we will extend this to code to create our own datasets of Wikipedia edits or ~~oter~~other data that we might be able to use to ask and answer questions in the final session. === Goals === Line 9 ⟶ 11: * Get set up to build datasets with the Wikipedia API * Have fun collecting different types of data from Wikipedia * ~~Pratice~~Practice reading and extending other people's code * Create a few collections of different types of data from Wikipedia that you can do research with in the final section Line 21 ⟶ 23: * [[Community Data Science Workshops/May 3rd Wikipedia project OS X setup\|OS X]] * [[Community Data Science Workshops/May 3rd Wikipedia project Linux setup\|Linux]] === Example topics to cover in Lecture === * explain MediaWiki, exists on other wikis * navigate to [http://en.wikipedia.org/w/api.php api page] and show the documentation, point out examples * looking at the images within a page http://en.wikipedia.org/w/api.php?action=query&titles=Seattle&prop=images&imlimit=20&format=jsonfm * change the city with a custom URL * edit count http://en.wikipedia.org/w/api.php?action=query&list=users&ususers=Benjamin_Mako_Hill\|Jtmorgan\|Sj\|Mindspillage&usprop=editcount&format=jsonfm * get the content of the main page http://en.wikipedia.org/w/api.php?format=json&action=query&titles=Main%20Page&prop=revisions&rvprop=content