Anonymous user
Importing a data snapshot: Difference between revisions
m
→In case of memory problems
imported>Paulproteus No edit summary |
imported>Onceuponatimeforever |
||
| (17 intermediate revisions by 9 users not shown) | |||
Line 1:
{{Hacking OpenHatch}}
When you get your own instance of the OpenHatch code running, you'll discover you're missing the ''data'' that are on the main OpenHatch site.
== Where you can find the snapshots ==
You may download a snapshot of the OpenHatch data from:
* http://inside.openhatch.org/snapshots/
'''Note''': We go through some effort to remove private information before we publish user data in these snapshots. The code for that is [https://github.com/openhatch/oh-mainline/blob/master/mysite/customs/management/commands/snapshot_public_data.py here].
== Privacy implications ==
We discuss some privacy implications in the [https://openhatch.org/policies-etc/ privacy policy] document. We do suggest people read the privacy policies when they make their accounts.
== How to use a snapshot ==
'''Note''': You must run
<tt>python manage.py syncdb --noinput</tt>
and
<tt>python manage.py migrate</tt>
before the following steps will work. Read <tt>README.mkd</tt> to learn more about those commands. It should take less than one minute.
1. Copy the downloaded snapshot file into the 'oh-mainline' directory. The snapshot file is named as ''date.json.gz'' where 'date' is in the form YYYY-MM-DD.
2. To load the snapshot file into your database, input the following (no need to uncompress the snapshot file):
python manage.py loaddata ''2012-08-12.json.gz''
'''Note:''' This may take a long time (10-15 minutes) without any output. This is normal.
You'll see output that looks something like this:
▲ Installed 25288 object(s) from 1 fixture(s)
3. Then, run the following command to update the database file ''mysite.db'' with the new data snapshot:
python manage.py syncdb
You can test that it worked by loading up your local projects page and ensuring it is not empty. Access http://127.0.0.1:8000/projects/ (and compare it to http://openhatch.org/projects/ if you like!) to check.
== In case of memory problems ==
In case your operating system has problems with loading the giant set of all the production data, you can get the db file directly from http://inside.openhatch.org/snapshots/. The important critical step is to remember to change the name of the existing development db file to a different name (in case you need it later) and then you change the newly downloaded db file name to ''site.db''.
python manage.py syncdb --noinput --migrate
python manage.py migrate
python manage.py loaddata NAME_OF_SNAPSHOT.gz
== More about this ==
* We go through some effort to remove private information before we publish user data in these snapshots. The code for that is
* We
* We don't snapshot every single table. If you find there's something that we don't publish that we should, do [http://openhatch.org/bugs/ file a bug]!
Line 35 ⟶ 62:
* How it works, on the servers: On ''linode2.openhatch.org'', a cron job wakes up daily and runs mysite/scripts/snapshot_then_push.sh
| |||