[Developers] Bulk download

Vijay Ramesh vijay.ramesh at powerset.com
Tue Sep 9 18:29:46 UTC 2008


I'm not sure what the "obvious problems" you refer to are (if you can be more specific, we might be able to help there), but you could easily use the type-specific tsvs (http://download.freebase.com/datadumps/2008-07-01/freebase-datadump-tsv.tar.bz2) and your scripting language of choice to pick and choose what you wanted & insert/update the information into MySql/MSSQL/BDB/whatever you wanted to use.  For that matter, you could use the link export tsv (http://download.freebase.com/datadumps/2008-07-01/freebase-datadump-quadruples.tsv.bz2) to build objects with the info you want, and then store those objects into your DB.

>From what I know, no matter how you limit the data you get (for example, downloading as a saved view as Shawn described) you're still going to have to use a scripting language to turn those tsv lines into database insert/update statements.

Cheers,
 Vijay


On 9/9/08 2:21 PM, "Shawn Simister" <narphorium at gmail.com> wrote:

If you can represent the data that you want to download as a Saved View <http://blog.freebase.com/2008/07/23/save-me-storing-filtered-views-on-freebase/>  then you can click the Use Results button to get a custom TSV file.

Rishav Rastogi wrote:

Hi,

I want to download information(type constrained) from freebase and store it in a db.

I have already seen the TSV dumps but they have a few obvious problems.

Is there a tool provided Freebase which can be used to import the information to be stored in a db other than Mql which has obvious problems of query timeouts.

Thanks

Rishav



________________________________

_______________________________________________
Developers mailing list
Developers at freebase.com
http://lists.freebase.com/mailman/listinfo/developers



-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.freebase.com/pipermail/developers/attachments/20080909/bb6c7fdc/attachment-0001.htm 


More information about the Developers mailing list