From thimon at gmail.com Sun Nov 1 15:27:27 2009 From: thimon at gmail.com (Thimon) Date: Sun, 1 Nov 2009 16:27:27 +0100 Subject: [Developers] Conflict History In-Reply-To: References: <307A7BA6-68B1-46E7-A51B-10CBB2C9E0F9@metaweb.com> <0215A5CB-17CD-46B2-9FD1-C2D2F34607C8@metaweb.com> Message-ID: Yeah 'play' will be nice! Got it on my Todo list now. Thimon On Wed, Oct 28, 2009 at 5:06 PM, Kirrily Robert wrote: > On 28/10/2009, at 7:59 AM, Spencer Kelly wrote: > > > wicked app thimon, > > cool feature would be just to press play. Infact it'd be cool to see > > this with any type, map+timeline is a really awesome idea. > > its like call of duty! does it predict future events? ;) > > Oh yes please! "Press play" would be the killer feature for this. > > K. > > -- > Kirrily Robert > Freebase Community Director > kirrily at metaweb.com > > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091101/007723e7/attachment.htm From thimon at gmail.com Sun Nov 1 15:31:02 2009 From: thimon at gmail.com (Thimon) Date: Sun, 1 Nov 2009 16:31:02 +0100 Subject: [Developers] Conflict History In-Reply-To: <0215A5CB-17CD-46B2-9FD1-C2D2F34607C8@metaweb.com> References: <307A7BA6-68B1-46E7-A51B-10CBB2C9E0F9@metaweb.com> <0215A5CB-17CD-46B2-9FD1-C2D2F34607C8@metaweb.com> Message-ID: This was a bug. Thanks for finding it. Got it now fixed and a lot of new conflicts are appearing on the end of the timeline. Thanks again, Thimon On Wed, Oct 28, 2009 at 12:58 AM, Gordon Mackenzie wrote: > There was no ending date for the main topic, I added it, it is now > appearing. > > Any event that has no start or end date will not resolve in your flash app. > A problem with our data that will require some adding correct dates on > Freebase (is the simple answer). > > Info popup when clicking on the 'i' con is working now. Hmm, my firefox may > be not functioning as well as I like, with too many tabs open. > > ~ Gordon > > <<< gordon at metaweb.com >>> > > > > On Oct 27, 2009, at 3:55 PM, Thimon wrote: > > Thank you. I did a bit of searching and found the American > Revolutionary war here: > http://www.conflicthistory.com/#/period/1776-1786/conflict/+en+american_revolutionary_war > . > Strange it is not working well on 3.5.3. I will have a look at it. > > Thanks, > Thimon > > > > On Tue, Oct 27, 2009 at 10:14 PM, Gordon Mackenzie wrote: > >> Great looking application. >> >> Not getting the infobox appearing in firefox 3.5.3, but does work very >> well in Chrome. >> >> I cannot get the American Revolutionary War to appear, just the topic for >> the Treaty of Alliance >> >> ~ Gordon >> >> <<< gordon at metaweb.com >>> >> >> >> >> On Oct 24, 2009, at 4:37 PM, Thimon wrote: >> >> Hi all, >> >> Its still an alpha version but ready to be posted on the developers list. >> Im building a freebase/googlemaps mashup which allows you to browse the >> timeline of militairy conflicts across the globe: >> http://www.conflicthistory.com (flash player 10 requered) >> The app query's the militairy conflicts type every time the time changes. >> >> Thimon >> >> >> >> >> >> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers >> >> >> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers >> >> > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091101/b14c3d7c/attachment.htm From ma at zive.at Mon Nov 2 00:46:30 2009 From: ma at zive.at (Michael Aufreiter) Date: Mon, 2 Nov 2009 01:46:30 +0100 Subject: [Developers] Ken 0.2.0 (Ruby Freebase Lib) now also wraps the new Topic API Message-ID: I just added support for the new Topic API to the Ken Ruby Library (http://github.com/michael/ken ). As usual the library wraps the JSON result of the web service to convenient Ruby Objects. The wrapped Topic API may be a good starting point for those who wanna get going with Ruby and Freebase. It should now be even easier to build simple Ruby Freebase apps (based on the Topic API). Next steps are: - Support for mediator properties ('CVT') / I need to find a way to wrap them appropriately. - e.g. Ken::Topic.get("/en/bill_clinton").attribute("/people/person/ education").values #=> could return the concrete mediators either modelled as a Ken::Topic or using it's own Ken::Mediator class - Make use of the updated library in the ASKKEN browser (http://askken.heroku.com ) Comments/Suggestions/Bugreports (ideally posted to the Github issue tracker) very welcome ;) Regards, Michael http://twitter.com/simply_mql -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091102/21934c25/attachment.htm From philip-freebase at shadowmagic.org.uk Mon Nov 2 08:02:19 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Mon, 2 Nov 2009 08:02:19 +0000 Subject: [Developers] eMQL questions Message-ID: <20091102080219.GS31466@sphinx.int.mythic-beasts.com> 1) Is there a way for an eMQL adapter to get access to the outer envelope of the query that is being processed? The use case I'm looking at here is where an adapter is going to be making a query back into Freebase, and it would like to pass down the same as_of_time envelope parameter as the original. 2) Is there a way for an eMQL adapter to signal an error in any way? For example, my random hack shouldn't be passed anything other than an integer as its right-hand side, and it would be nice to give a friendly error message to the user if something else is given. Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From vajda at metaweb.com Mon Nov 2 09:08:47 2009 From: vajda at metaweb.com (Andi Vajda) Date: Mon, 2 Nov 2009 01:08:47 -0800 Subject: [Developers] eMQL questions In-Reply-To: <20091102080219.GS31466@sphinx.int.mythic-beasts.com> References: <20091102080219.GS31466@sphinx.int.mythic-beasts.com> Message-ID: <983118D9-F276-4384-816D-0D30FBFEFAD6@metaweb.com> On Nov 2, 2009, at 0:02, Philip Kendall wrote: > 1) Is there a way for an eMQL adapter to get access to the outer > envelope of the query that is being processed? The use case I'm > looking at here is where an adapter is going to be making a query > back into Freebase, and it would like to pass down the same > as_of_time envelope parameter as the original. No, not at the moment but that could be added. Then, you may not need it at all if you can do this back query via MQL insertions from the 'pre' phase to be run with the main query before the 'fetch' phase. > 2) Is there a way for an eMQL adapter to signal an error in any way? > For > example, my random hack > > shouldn't be passed anything other than an integer as its right-hand > side, and it would be nice to give a friendly error message to > the user if something else is given. You can raise an error in your Acre script. That's going to be propagated to the user but it may not be very pretty at the moment. Errors in adapters are propagated. You can also return a 'fetch' or 'reduce' phase result that is in fact an error message of your choice. Andi.. > > Cheers, > > Phil > > -- > Philip Kendall > http://www.shadowmagic.org.uk/ > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From jason at metaweb.com Mon Nov 2 17:49:37 2009 From: jason at metaweb.com (Jason Douglas) Date: Mon, 2 Nov 2009 09:49:37 -0800 Subject: [Developers] eMQL questions In-Reply-To: <983118D9-F276-4384-816D-0D30FBFEFAD6@metaweb.com> References: <20091102080219.GS31466@sphinx.int.mythic-beasts.com> <983118D9-F276-4384-816D-0D30FBFEFAD6@metaweb.com> Message-ID: <0C071025-91DB-4E4B-A30E-7D59B8293751@metaweb.com> On Nov 2, 2009, at 1:08 AM, Andi Vajda wrote: > >> 2) Is there a way for an eMQL adapter to signal an error in any way? >> For >> example, my random hack >> >> shouldn't be passed anything other than an integer as its right-hand >> side, and it would be nice to give a friendly error message to >> the user if something else is given. > > You can raise an error in your Acre script. That's going to be > propagated to the user but it may not be very pretty at the moment. We are working on an Acre library, that among other things, will automatically package Acre errors more like MQL errors. -jason From paul at ontology2.com Mon Nov 2 22:04:16 2009 From: paul at ontology2.com (Paul Houle) Date: Mon, 02 Nov 2009 17:04:16 -0500 Subject: [Developers] What the hell is Juggle? In-Reply-To: <0C071025-91DB-4E4B-A30E-7D59B8293751@metaweb.com> References: <20091102080219.GS31466@sphinx.int.mythic-beasts.com> <983118D9-F276-4384-816D-0D30FBFEFAD6@metaweb.com> <0C071025-91DB-4E4B-A30E-7D59B8293751@metaweb.com> Message-ID: <4AEF5760.4040108@ontology2.com> "Juggle" seems to be one of the most popular types in Freebase, but I've got not idea what it is. What is it? From philip-freebase at shadowmagic.org.uk Mon Nov 2 22:11:57 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Mon, 2 Nov 2009 22:11:57 +0000 Subject: [Developers] What the hell is Juggle? In-Reply-To: <4AEF5760.4040108@ontology2.com> References: <4AEF5760.4040108@ontology2.com> Message-ID: <20091102221157.GD31466@sphinx.int.mythic-beasts.com> On Mon, Nov 02, 2009 at 05:04:16PM -0500, Paul Houle wrote: > "Juggle" seems to be one of the most popular types in Freebase, but > I've got not idea what it is. What is it? http://www.juggle.com/ Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From tyler at metaweb.com Mon Nov 2 23:02:21 2009 From: tyler at metaweb.com (Tyler Pirtle) Date: Mon, 02 Nov 2009 15:02:21 -0800 Subject: [Developers] Expanded "id": { ... } clauses in MQL In-Reply-To: <386B3209-39D5-4913-A9D5-A85119CE4B9B@metaweb.com> References: <20091029083937.GA31466@sphinx.int.mythic-beasts.com> <386B3209-39D5-4913-A9D5-A85119CE4B9B@metaweb.com> Message-ID: <4AEF64FD.5070401@metaweb.com> > > For that maybe you want: > > [{ > "id": null, > "a:id!=": "/lang/en", > "b:id!=": "/lang/fr", > "id|=": [ > "/lang/en", > "/lang/hr" > ] > }] > > returns: > [{ > "id": "/lang/hr" > }] > Phil, Did this query work out for you? I realize it's not optimal, you'll have to list out each id prefixed with _:id!=, but does it get the job done? There is a fix coming for this, but it's in a major revision of MQL thats soon to be released. Let me know if you're still stuck and we'll figure it out. Tyler From philip-freebase at shadowmagic.org.uk Mon Nov 2 23:08:41 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Mon, 2 Nov 2009 23:08:41 +0000 Subject: [Developers] Expanded "id": { ... } clauses in MQL In-Reply-To: <4AEF64FD.5070401@metaweb.com> References: <20091029083937.GA31466@sphinx.int.mythic-beasts.com> <386B3209-39D5-4913-A9D5-A85119CE4B9B@metaweb.com> <4AEF64FD.5070401@metaweb.com> Message-ID: <20091102230841.GF31466@sphinx.int.mythic-beasts.com> On Mon, Nov 02, 2009 at 03:02:21PM -0800, Tyler Pirtle wrote: > > Did this query work out for you? I realize it's not optimal, you'll have to > list out each id prefixed with _:id!=, but does it get the job done? I'm currently working around the issue by filtering out the unwanted IDs post-query in Acre, which is good enough for me, if not optimal. Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From iainsproat at gmail.com Tue Nov 3 15:41:50 2009 From: iainsproat at gmail.com (Iain Sproat) Date: Tue, 3 Nov 2009 19:41:50 +0400 Subject: [Developers] Typewriter scores Message-ID: I was wondering if there is an app/service that exposed the score/probabilities which are used to create the data for the typewriter app? I would like to feed in a topic id and have it return a list of most likely types that it could be typed with and the associated probability/score. Is something like this available? Iain From paul at ontology2.com Tue Nov 3 16:06:05 2009 From: paul at ontology2.com (Paul Houle) Date: Tue, 03 Nov 2009 11:06:05 -0500 Subject: [Developers] What the hell is Juggle? In-Reply-To: <20091102221157.GD31466@sphinx.int.mythic-beasts.com> References: <4AEF5760.4040108@ontology2.com> <20091102221157.GD31466@sphinx.int.mythic-beasts.com> Message-ID: <4AF054ED.4010507@ontology2.com> Philip Kendall wrote: > On Mon, Nov 02, 2009 at 05:04:16PM -0500, Paul Houle wrote: > >> "Juggle" seems to be one of the most popular types in Freebase, but >> I've got not idea what it is. What is it? >> > > http://www.juggle.com/ > > Cheers, > > Phil > Cool site. Looking at the schema, http://www.freebase.com/type/schema/user/juggleapp/juggle/juggle it looks like it contains a "score". Is this the score that's used to compute "Top 5" lists like the ones I see at http://www.juggle.com/language-arts ? I also don't see the scores, and note that there's a "hidden" attribute in the schema, so is it right to say that Juggle is using the Juggle type to store private data inside of Freebase? From philip-freebase at shadowmagic.org.uk Tue Nov 3 16:24:41 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Tue, 3 Nov 2009 16:24:41 +0000 Subject: [Developers] What the hell is Juggle? In-Reply-To: <4AF054ED.4010507@ontology2.com> References: <4AEF5760.4040108@ontology2.com> <20091102221157.GD31466@sphinx.int.mythic-beasts.com> <4AF054ED.4010507@ontology2.com> Message-ID: <20091103162441.GL31466@sphinx.int.mythic-beasts.com> On Tue, Nov 03, 2009 at 11:06:05AM -0500, Paul Houle wrote: > > I also don't see the scores, and note that there's a "hidden" > attribute in the schema, so is it right to say that Juggle is using the > Juggle type to store private data inside of Freebase? No :-) Firstly, all the "hidden" attribute means is that it doesn't display in the Freebase web client. The data is still accessible via MQL (or Explore Mode). Secondly, they don't actually seem to have filled in the score or scoredate properties for any topics Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From paul at ontology2.com Tue Nov 3 17:21:00 2009 From: paul at ontology2.com (Paul Houle) Date: Tue, 03 Nov 2009 12:21:00 -0500 Subject: [Developers] What the hell is Juggle? In-Reply-To: <20091103162441.GL31466@sphinx.int.mythic-beasts.com> References: <4AEF5760.4040108@ontology2.com> <20091102221157.GD31466@sphinx.int.mythic-beasts.com> <4AF054ED.4010507@ontology2.com> <20091103162441.GL31466@sphinx.int.mythic-beasts.com> Message-ID: <4AF0667C.6020601@ontology2.com> Philip Kendall wrote: > > Firstly, all the "hidden" attribute means is that it doesn't display in > the Freebase web client. The data is still accessible via MQL (or > Explore Mode). > > Secondly, they don't actually seem to have filled in the score or > scoredate properties for any topics > That could be pretty useful. Pretty often I have a list of 10-100k or so items and I'd like to rank them by "importance"; I've got a lot of tricks up my sleeves for this, but I'm always happy to see a new score. From tfmorris at gmail.com Tue Nov 3 18:22:28 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 3 Nov 2009 13:22:28 -0500 Subject: [Developers] mql_filter for geosearch API? Message-ID: Anyone have a working example of using the mql_filter parameter with the geosearch API? I can't for the life of me figure out why the following doesn't work: mql_filter = [{"type" : "/base/usnris/nris_listing", "significance_level":"National" }] just_checking = session.mqlread(mql_filter) response = session.geosearch(location=r.id, type='/base/usnris/nris_listing', mql_filter = mql_filter, within=50.0,order_by='distance', limit=10) The second statement works just fine, but the same query used as a filter in the third statement gives the following error, not matter how many different ways I try to format it. { "status": "400 Bad Request", "code": "/api/status/error", "messages": [{ "code": "/api/status/error/geosearch", "message": "Parameter mql_filter: invalid JSON: '[{'significance_level': 'National', 'type': '/base/usnris/nris_listing'}]'", "error": "ParameterError"}], "transaction_id": "cache;cache01.sandbox.sjc1:8101;2009-11-03T18:19:52Z;0002" } Tom From vajda at metaweb.com Tue Nov 3 19:44:45 2009 From: vajda at metaweb.com (Andi Vajda) Date: Tue, 3 Nov 2009 11:44:45 -0800 (PST) Subject: [Developers] mql_filter for geosearch API? In-Reply-To: References: Message-ID: On Tue, 3 Nov 2009, Tom Morris wrote: > Anyone have a working example of using the mql_filter parameter with > the geosearch API? I can't for the life of me figure out why the > following doesn't work: > > mql_filter = [{"type" : "/base/usnris/nris_listing", > "significance_level":"National" > }] > just_checking = session.mqlread(mql_filter) > response = session.geosearch(location=r.id, > type='/base/usnris/nris_listing', > mql_filter = mql_filter, > within=50.0,order_by='distance', limit=10) > > The second statement works just fine, but the same query used as a > filter in the third statement gives the following error, not matter > how many different ways I try to format it. Guessing what your query is, this seems to work just fine: http://api.freebase.com/api/service/geosearch?location=/en/san_francisco&within=50&type=/base/usnris/nris_listing&indent=1&limit=10&mql_filter=[{%22type%22:%20%22/base/usnris/nris_listing%22,%20%22significance_level%22:%20%22National%22}] http://api.freebase.com/api/service/geosearch?location=/en/san_francisco&within=50&type=/base/usnris/nris_listing&indent=1&limit=10&mql_filter=[{%22type%22:%20%22/base/usnris/nris_listing%22,%20%22significance_level%22:%20%22National%22}]&debug=1 Andi.. > > { > "status": "400 Bad Request", > "code": "/api/status/error", > "messages": [{ > "code": "/api/status/error/geosearch", > "message": "Parameter mql_filter: invalid JSON: > '[{'significance_level': 'National', 'type': > '/base/usnris/nris_listing'}]'", > "error": "ParameterError"}], > "transaction_id": "cache;cache01.sandbox.sjc1:8101;2009-11-03T18:19:52Z;0002" > } > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > From stefano at metaweb.com Tue Nov 3 20:16:12 2009 From: stefano at metaweb.com (Stefano Mazzocchi) Date: Tue, 03 Nov 2009 12:16:12 -0800 Subject: [Developers] jquery-acre integration utilities Message-ID: <4AF08F8C.7020102@metaweb.com> It's very easy to use jquery in Acre apps, but there are certain things that one tends to do over and over when creating new apps, so I spent a little time today and organized all jquery-related utilities into a single acre app that you can use for all your jquery needs. Find it at http://jquery.freebaseapps.com/ and read how to use it there. If you want/need more functionality or plugins connected, just let me know and I'll add them. NOTE: the acre default library at http://default.freebaseapps.com/ now uses the jquery utilities library for the jquery-related activities but it's completely back compatible, you don't need to change anything in your code, the defaults templates will just transparently pass thru to the jquery ones. Enjoy! -- Stefano Mazzocchi Application Catalyst Metaweb Technologies, Inc. stefano at metaweb.com ------------------------------------------------------------------- From stefano at metaweb.com Tue Nov 3 20:22:06 2009 From: stefano at metaweb.com (Stefano Mazzocchi) Date: Tue, 03 Nov 2009 12:22:06 -0800 Subject: [Developers] Typewriter scores In-Reply-To: References: Message-ID: <4AF090EE.3000902@metaweb.com> Iain Sproat wrote: > I was wondering if there is an app/service that exposed the > score/probabilities which are used to create the data for the > typewriter app? I would like to feed in a topic id and have it return > a list of most likely types that it could be typed with and the > associated probability/score. Is something like this available? It is possible to obtain a list of typewriter questions for a given topic, but no score and probabilities. Not sure that's enough for what you want but it's available now (and it's what the client uses to show you guesses for topics) -- Stefano Mazzocchi Application Catalyst Metaweb Technologies, Inc. stefano at metaweb.com ------------------------------------------------------------------- From tfmorris at gmail.com Tue Nov 3 21:32:47 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 3 Nov 2009 16:32:47 -0500 Subject: [Developers] mql_filter for geosearch API? In-Reply-To: References: Message-ID: On Tue, Nov 3, 2009 at 2:44 PM, Andi Vajda wrote: > Guessing what your query is, this seems to work just fine: > http://api.freebase.com/api/service/geosearch?location=/en/san_francisco&within=50&type=/base/usnris/nris_listing&indent=1&limit=10&mql_filter=[{%22type%22:%20%22/base/usnris/nris_listing%22,%20%22significance_level%22:%20%22National%22}] > http://api.freebase.com/api/service/geosearch?location=/en/san_francisco&within=50&type=/base/usnris/nris_listing&indent=1&limit=10&mql_filter=[{%22type%22:%20%22/base/usnris/nris_listing%22,%20%22significance_level%22:%20%22National%22}]&debug=1 > Thanks for the quick response Andi. That's not the URL that the Python library generates, so I guess that's where the problem lies. It doesn't look like any of mql_input, mql_output, or mql_filter will work the way it is set up now. I'll submit a patch with the fix. I couldn't figure out where the unit tests for this part of the API were, so I just patched the code, not the tests. Tom From vajda at metaweb.com Tue Nov 3 22:31:05 2009 From: vajda at metaweb.com (Andi Vajda) Date: Tue, 3 Nov 2009 14:31:05 -0800 (PST) Subject: [Developers] mql_filter for geosearch API? In-Reply-To: References: Message-ID: On Tue, 3 Nov 2009, Tom Morris wrote: > On Tue, Nov 3, 2009 at 2:44 PM, Andi Vajda wrote: > >> Guessing what your query is, this seems to work just fine: >> http://api.freebase.com/api/service/geosearch?location=/en/san_francisco&within=50&type=/base/usnris/nris_listing&indent=1&limit=10&mql_filter=[{%22type%22:%20%22/base/usnris/nris_listing%22,%20%22significance_level%22:%20%22National%22}] >> http://api.freebase.com/api/service/geosearch?location=/en/san_francisco&within=50&type=/base/usnris/nris_listing&indent=1&limit=10&mql_filter=[{%22type%22:%20%22/base/usnris/nris_listing%22,%20%22significance_level%22:%20%22National%22}]&debug=1 >> > > Thanks for the quick response Andi. That's not the URL that the > Python library generates, so I guess that's where the problem lies. > It doesn't look like any of mql_input, mql_output, or mql_filter will > work the way it is set up now. > > I'll submit a patch with the fix. I couldn't figure out where the > unit tests for this part of the API were, so I just patched the code, > not the tests. What library are you talking about ? When making an HTTP call with Python, all the parameters that take JSON should be stringified first via json.dumps(). Letting python's str() do the trick on the json list/dict tree doesn't produce valid json text. Andi.. From tfmorris at gmail.com Tue Nov 3 22:36:39 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 3 Nov 2009 17:36:39 -0500 Subject: [Developers] mql_filter for geosearch API? In-Reply-To: References: Message-ID: On Tue, Nov 3, 2009 at 5:31 PM, Andi Vajda wrote: > When making an HTTP call with Python, all the parameters that take JSON > should be stringified first via json.dumps(). > > Letting python's str() do the trick on the json list/dict tree doesn't > produce valid json text. Exactly. The bug report and patch is at http://code.google.com/p/freebase-python/issues/detail?id=8 Tom From alecf at metaweb.com Tue Nov 3 23:38:25 2009 From: alecf at metaweb.com (Alec Flett) Date: Tue, 3 Nov 2009 15:38:25 -0800 Subject: [Developers] mql_filter for geosearch API? In-Reply-To: References: Message-ID: I just checked a fix into freebase-python trunk, and will try to do a release today (tuesday) or wednesday. Alec On Nov 3, 2009, at 2:36 PM, Tom Morris wrote: > On Tue, Nov 3, 2009 at 5:31 PM, Andi Vajda wrote: > >> When making an HTTP call with Python, all the parameters that take >> JSON >> should be stringified first via json.dumps(). >> >> Letting python's str() do the trick on the json list/dict tree >> doesn't >> produce valid json text. > > Exactly. The bug report and patch is at > http://code.google.com/p/freebase-python/issues/detail?id=8 > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From jack.alves at gmail.com Fri Nov 6 03:31:01 2009 From: jack.alves at gmail.com (Jack Alves) Date: Thu, 5 Nov 2009 19:31:01 -0800 Subject: [Developers] pdf of documentation Message-ID: <554723b0911051931g4ae5815aq835b5ef7b2d1e6@mail.gmail.com> Is there an up to date pdf of the MQL Reference documentation? I can't find a link to is on freebase -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091105/065cd924/attachment.htm From tyler at metaweb.com Fri Nov 6 04:05:36 2009 From: tyler at metaweb.com (Tyler Pirtle) Date: Thu, 5 Nov 2009 20:05:36 -0800 (PST) Subject: [Developers] pdf of documentation In-Reply-To: <554723b0911051931g4ae5815aq835b5ef7b2d1e6@mail.gmail.com> Message-ID: <1980324239.230041257480336447.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> theres this one, http://download.freebase.com/MQLReferenceGuide.pdf Also viewable online at http://mql.freebaseapps.com ----- "Jack Alves" wrote: > Is there an up to date pdf of the MQL Reference documentation? I can't > find a link to is on freebase > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From jack.alves at gmail.com Fri Nov 6 16:56:42 2009 From: jack.alves at gmail.com (Jack Alves) Date: Fri, 6 Nov 2009 08:56:42 -0800 Subject: [Developers] pdf of documentation In-Reply-To: <1980324239.230041257480336447.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> References: <554723b0911051931g4ae5815aq835b5ef7b2d1e6@mail.gmail.com> <1980324239.230041257480336447.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> Message-ID: <554723b0911060856l6a2dc7b0jf1ab9d369a219a6f@mail.gmail.com> Thanks. I'll enter a request for the Developers page to include a link to Downloads. jack On Thu, Nov 5, 2009 at 8:05 PM, Tyler Pirtle wrote: > theres this one, > > http://download.freebase.com/MQLReferenceGuide.pdf > > Also viewable online at http://mql.freebaseapps.com > > > ----- "Jack Alves" wrote: > > > Is there an up to date pdf of the MQL Reference documentation? I can't > > find a link to is on freebase > > > > _______________________________________________ > > Developers mailing list > > Developers at freebase.com > > http://lists.freebase.com/mailman/listinfo/developers > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091106/25fbb4eb/attachment-0001.htm From jack.alves at gmail.com Fri Nov 6 18:31:32 2009 From: jack.alves at gmail.com (Jack Alves) Date: Fri, 6 Nov 2009 10:31:32 -0800 Subject: [Developers] sandbox down? Message-ID: <554723b0911061031l17058865mb44f334729c85aa@mail.gmail.com> http://www.sandbox-freebase.com/ is reporting "*Http/1.1 Service Unavailable *" I got just after trying to create a namespace. Ultimately I want to create /base/bkn as a namespace in addition or to replace /base/bibliographicknowledgenetwork. Yesterday I tried to change it via the edit settings user interface on the base's page. The name did not change and I did not get an error so I reported a bug. Today I'm on sandbox experimenting with how I can do this with MQL. On the sandbox, when I issued the following via the query editor, I did not get a response. When I refreshed I got the unavailable message. My test was to do a similar operation on the /base/popstra domain. This is what I did to try to create /base/starwideweb. [{ "keys": [{ "namespace": { "create": "unless_connected", "type": "/type/namespace", "unique": false }, "value": "starwideweb" }], "id": "/base", "type": "/type/namespace" }] What did I do? What should I do. I'm just working my way through the documentation related to writing namespaces and keys. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091106/08d81af0/attachment.htm From gordon at metaweb.com Fri Nov 6 18:37:21 2009 From: gordon at metaweb.com (Gordon Mackenzie) Date: Fri, 6 Nov 2009 10:37:21 -0800 Subject: [Developers] sandbox down? In-Reply-To: <554723b0911061031l17058865mb44f334729c85aa@mail.gmail.com> References: <554723b0911061031l17058865mb44f334729c85aa@mail.gmail.com> Message-ID: <9F935929-0FE4-4940-A842-1FEB390FE4EC@metaweb.com> Yup, we are trying to update sandbox's client code, didn't go as well as we'd hoped. ~ Gordon <<< gordon at metaweb.com >>> On Nov 6, 2009, at 10:31 AM, Jack Alves wrote: > > http://www.sandbox-freebase.com/ is reporting "Http/1.1 Service > Unavailable" > > I got just after trying to create a namespace. Ultimately I want to > create /base/bkn as a namespace in addition or to replace /base/ > bibliographicknowledgenetwork. Yesterday I tried to change it via > the edit settings user interface on the base's page. The name did > not change and I did not get an error so I reported a bug. > > Today I'm on sandbox experimenting with how I can do this with MQL. > > On the sandbox, when I issued the following via the query editor, I > did not get a response. When I refreshed I got the unavailable > message. My test was to do a similar operation on the /base/popstra > domain. This is what I did to try to create /base/starwideweb. > > [{ > "keys": [{ > "namespace": { > "create": "unless_connected", > "type": "/type/namespace", > "unique": false > }, > "value": "starwideweb" > }], > "id": "/base", > "type": "/type/namespace" > }] > > > What did I do? What should I do. I'm just working my way through the > documentation related to writing namespaces and keys. > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091106/5744fd4b/attachment.htm From philip-freebase at shadowmagic.org.uk Fri Nov 6 18:55:48 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Fri, 6 Nov 2009 18:55:48 +0000 Subject: [Developers] sandbox down? In-Reply-To: <554723b0911061031l17058865mb44f334729c85aa@mail.gmail.com> References: <554723b0911061031l17058865mb44f334729c85aa@mail.gmail.com> Message-ID: <20091106185548.GK19375@sphinx.mythic-beasts.com> On Fri, Nov 06, 2009 at 10:31:32AM -0800, Jack Alves wrote: > > I got just after trying to create a namespace. Ultimately I want to create > /base/bkn as a namespace in addition or to replace > /base/bibliographicknowledgenetwork. I think what you want is { "id": "/base/bibliographicknowledgenetwork", "keys": { "namespace": "/base", "value": "bkn", "connect": "insert" } } but I'd suggest not running that on production as it's entirely untested. > What did I do? What should I do. Honestly I'd say "slow down". Finish reading the documenation, then go and fiddle with some test topics before you try changing your base as at the moment it looks like you're not 100% sure how namespaces work, and it's pretty easy to get things wrong. Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From tfmorris at gmail.com Fri Nov 6 19:01:55 2009 From: tfmorris at gmail.com (Tom Morris) Date: Fri, 6 Nov 2009 14:01:55 -0500 Subject: [Developers] freebase-suggest 0.9.5 In-Reply-To: References: <7BF0CB90-5277-4F3C-807C-6F9B131A32E5@metaweb.com> Message-ID: On Thu, Sep 3, 2009 at 9:08 PM, Andi Vajda wrote: > > On Thu, 3 Sep 2009, Dae Park wrote: > >> More on search by type name... >> >> Our relevance guru also points out: >> >>> Andi Vajda wrote: >>> >>> ...type also accepts pseudo type names such as 'volcano', a mountain >>> type (but not technically a type). >>> Such type names are stemmed, so you can also use type=volcanos, for >>> example. >> >> >> I believe you can also treat people's professions as a pseudo type as >> well (i.e., "johnson type:lawyer"). > > The values in the properties returned by [1] are indexed as pseudo type > names. > > For example, "/en/volcano" occurs in "/geography/mountain/mountain_type" > values and its name, "volcano" is indexed as the a type name of things that > have "/en/volcano" in their "/geography/mountain/mountain_type" property. > > Andi.. > > [1] http://tinyurl.com/mz2fnb To make it easier to find in the archives and preserve posterity if tinyurl goes away, the Andi's query is: [{ "type": "/type/property", "!/freebase/relevance/hint/on": { "id": "/freebase/relevance/is_a" }, "id": null, "schema": { "id": null }, "master_property": { "id": null, "optional": true }, "limit": 4096 }] From micah at metaweb.com Fri Nov 6 19:11:31 2009 From: micah at metaweb.com (Micah Saul) Date: Fri, 6 Nov 2009 11:11:31 -0800 Subject: [Developers] sandbox down? In-Reply-To: <20091106185548.GK19375@sphinx.mythic-beasts.com> References: <554723b0911061031l17058865mb44f334729c85aa@mail.gmail.com> <20091106185548.GK19375@sphinx.mythic-beasts.com> Message-ID: <63471C52-9EDC-411C-9A25-95CE1707130F@metaweb.com> Hey Jack- Sorry, meant to respond to your bug last night, but we were chasing down some other sandbox issues and I got distracted. So, the reason the write was failing through the UI is just that there is a requirement that base IDs be at least 5 characters long... I thought that an informative error would pop up when attempting to write a shorter ID but it apparently isn't doing that anymore. I spawned an issue at https://bugs.freebase.com/browse/CLI-9394 m On Nov 6, 2009, at 10:55 AM, Philip Kendall wrote: > On Fri, Nov 06, 2009 at 10:31:32AM -0800, Jack Alves wrote: >> >> I got just after trying to create a namespace. Ultimately I want to >> create >> /base/bkn as a namespace in addition or to replace >> /base/bibliographicknowledgenetwork. > > I think what you want is > > { > "id": "/base/bibliographicknowledgenetwork", > "keys": { > "namespace": "/base", > "value": "bkn", > "connect": "insert" > } > } > > but I'd suggest not running that on production as it's entirely > untested. > >> What did I do? What should I do. > > Honestly I'd say "slow down". Finish reading the documenation, then go > and fiddle with some test topics before you try changing your base > as at > the moment it looks like you're not 100% sure how namespaces work, and > it's pretty easy to get things wrong. > > Cheers, > > Phil > > -- > Philip Kendall > http://www.shadowmagic.org.uk/ > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From gordon at metaweb.com Fri Nov 6 23:58:32 2009 From: gordon at metaweb.com (Gordon Mackenzie) Date: Fri, 6 Nov 2009 15:58:32 -0800 Subject: [Developers] Film Commons: Proposal to change /film/film/estimated_budget to be made a dated currency CVT Message-ID: http://www.freebase.com/type/schema/film/film It has been brought up recently in discussions (prodded by the recent talk of local currencies) that the property of /film/film that deals with the estimated budget of the film would be much more useful for interesting queries if it was a dated currency CVT (/measurement_unit/ dated_money_value) instead of the current money value ( / measurement_unit/money_value). This way we could have comparisons that could take in account the change in value of currency for various versions of then-blockbuster hit films, 1925's Ben Hur versus 1959's Ben Hur (http://www.freebase.com/view/en/ben_hur_1925 , the estimated budget was an insane $4 million in 1925, when the average film budget at the time was $200,000). Titanic vs, Gone With The Wind (My bet is on Tara over Titanic). Which Star Wars dwarfed them all in $2008 dollars (Or is 2001 the true king of budgets)? (Really, many of the current types that use money value might be better served with a conversion to dated currency: Structure, Disaster, Automotive' Trim Level & option package, etc.) Well, I made a task for it, won't go forawrd with it until we get some feedback from the community. Does your Application link directly to the /measurement_unit/ money_value or to the /film/film/estimated_budget? Proposal: https://bugs.freebase.com/browse/DA-977 ~ Gordon <<< gordon at metaweb.com >>> From pauljmackay at gmail.com Sun Nov 8 18:24:36 2009 From: pauljmackay at gmail.com (Paul Mackay) Date: Sun, 8 Nov 2009 10:24:36 -0800 Subject: [Developers] An interest in an OO Python library similar to KEN? Message-ID: Hi, Has anyone thought about developing an OO Python library similar to the KEN Ruby library (http://github.com/michael/ken/)? I experimented with this a little. Perhaps a dev branch in the freebase-python repo could be started? Thoughts? cheers paul -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091108/c4b769d7/attachment.htm From kurt at spaceship.com Mon Nov 9 07:45:58 2009 From: kurt at spaceship.com (Kurt Bollacker) Date: Sun, 8 Nov 2009 23:45:58 -0800 Subject: [Developers] Fun with animated gifs Message-ID: <20091109074558.GG9543@spaceship.com> I'm trying to uploads some films for which I have a snapshot still. Unfortunately (for many reasons), the stills are available only as animated gifs, the first slice of which is often solid black. I've tried using /api/service/uri_submit_image to submit the image, but this mangles the gif by only including the (often black) first slice. Is the there a recommended way to upload animated gifs, or have the Freebase Web UI police sensibly declared them verboten? I can extract a reasonable still, but it would help me out a lot to avoid doing that. Kurt :-) From alecf at metaweb.com Mon Nov 9 17:51:59 2009 From: alecf at metaweb.com (Alec Flett) Date: Mon, 9 Nov 2009 09:51:59 -0800 Subject: [Developers] Fun with animated gifs In-Reply-To: <20091109074558.GG9543@spaceship.com> References: <20091109074558.GG9543@spaceship.com> Message-ID: On Nov 8, 2009, at 11:45 PM, Kurt Bollacker wrote: > > to submit the image, but this mangles the gif by only including the > (often black) first slice. I suspect the image is being stored in our system correctly, but image_thumb is not delivering an animated thumb. Have you tried accessing the images via /api/trans/raw to see if they're at least unmangled in the system? > Is the there a recommended way to upload > animated gifs, or have the Freebase Web UI police sensibly declared > them verboten? There's no web UI police :) This is purely a technical issue, and animated gifs haven't really been a priority. BUT... that said I *personally* think animated gifs aren't really images - mainly because they're not appropriate in all image-based contexts (for instance, would you want an animated thumbnail while viewing a topic on a mobile device? What about when you're browsing an image gallery? yuck.) - we may feel like we'd be enhancing an API by broadening support for animated images, but I think we'd really be screwing up user experience for a lot of applications that use the image_thumb public API. Alec > > I can extract a reasonable still, but it would help me out a lot to > avoid doing that. > > > Kurt :-) > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From alecf at metaweb.com Mon Nov 9 17:54:00 2009 From: alecf at metaweb.com (Alec Flett) Date: Mon, 9 Nov 2009 09:54:00 -0800 Subject: [Developers] An interest in an OO Python library similar to KEN? In-Reply-To: References: Message-ID: On Nov 8, 2009, at 10:24 AM, Paul Mackay wrote: > Hi, > > Has anyone thought about developing an OO Python library similar to > the KEN Ruby library (http://github.com/michael/ken/)? > > I experimented with this a little. Perhaps a dev branch in the > freebase-python repo could be started? Thoughts? > I think this sounds like an interesting idea, if you're willing to give it a shot... go ahead and pull the trunk of freebase-python. When you have something up and running send it to me, and we can also give you access to the svn repository on google code. It might be time for us to call version 1.0 "done" (sans point- releases) and start work on freebase-python 1.1 on the trunk, which could include a module like this. Alec > cheers > > paul > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091109/4f8be03f/attachment.htm From gordon at metaweb.com Mon Nov 9 18:03:25 2009 From: gordon at metaweb.com (Gordon Mackenzie) Date: Mon, 9 Nov 2009 10:03:25 -0800 Subject: [Developers] Fun with animated gifs In-Reply-To: References: <20091109074558.GG9543@spaceship.com> Message-ID: <9E786C8F-FC01-4C52-93C7-8428365262C5@metaweb.com> http://monster.freebase.com/ Made that animated image in header myself with photoshop (and it works on the iPhone ;) I uploded animated gifs for my topic about me and user dude profile. On Nov 9, 2009, at 9:51 AM, Alec Flett wrote: > > On Nov 8, 2009, at 11:45 PM, Kurt Bollacker wrote: > >> >> to submit the image, but this mangles the gif by only including the >> (often black) first slice. > > I suspect the image is being stored in our system correctly, but > image_thumb is not delivering an animated thumb. Have you tried > accessing the images via /api/trans/raw to see if they're at least > unmangled in the system? > >> Is the there a recommended way to upload >> animated gifs, or have the Freebase Web UI police sensibly declared >> them verboten? > > There's no web UI police :) This is purely a technical issue, and > animated gifs haven't really been a priority. > > BUT... that said I *personally* think animated gifs aren't really > images - mainly because they're not appropriate in all image-based > contexts (for instance, would you want an animated thumbnail while > viewing a topic on a mobile device? What about when you're browsing an > image gallery? yuck.) - we may feel like we'd be enhancing an API by > broadening support for animated images, but I think we'd really be > screwing up user experience for a lot of applications that use the > image_thumb public API. > > > > Alec > > > >> >> I can extract a reasonable still, but it would help me out a lot to >> avoid doing that. >> >> >> Kurt :-) >> >> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From iainsproat at gmail.com Mon Nov 9 18:21:52 2009 From: iainsproat at gmail.com (Iain Sproat) Date: Mon, 9 Nov 2009 22:21:52 +0400 Subject: [Developers] Fun with animated gifs In-Reply-To: References: <20091109074558.GG9543@spaceship.com> Message-ID: On Mon, Nov 9, 2009 at 9:51 PM, Alec Flett wrote: > There's no web UI police :) This is purely a technical issue, and > animated gifs haven't really been a priority. > > BUT... that said I *personally* think animated gifs aren't really > images Geocities-style 'under construction' animated gifs anyone?! > we'd really be > screwing up user experience for a lot of applications that use the > image_thumb public API. Some animated gifs do help explain a topic though, http://en.wikipedia.org/wiki/File:4-Stroke-Engine.gif Iain From brendan at metaweb.com Tue Nov 10 20:17:28 2009 From: brendan at metaweb.com (brendan) Date: Tue, 10 Nov 2009 12:17:28 -0800 Subject: [Developers] architecture schema property migration to /projects/project Message-ID: <74E49CBF-7FD1-40EB-B8CC-A22E3AFD5939@metaweb.com> As discussed months ago on this list: /projects/project is a better, more generalized home for "project-ish" related property values. I'd like to move ahead with migrating property values off of /architecture/ structure and on to /projects/project. I will take a conservative approach: mark the properties as hidden in architecture and copying the values over to project: 3rd party apps will see a degradation of data quality but will not break (degradation meaning the data will become stale as users add/improve the preferred assertions on "project") 1. hide /architecture/structure properties that have a clear "projecty" nature to them: engineer engineering_firm construction_started contractor construction_cost the compromise: I will keep "architect" "architecture_firm" and "opened". This is not ideal. To be absolutely consistent, these probably should be migrated to project, too. But we have so much data for these slots and the topic page for these buildings is much enhanced by their presence ("project" values are 3 plies out so you would only see them by going to the "edit" view and clicking on the "project_focus" cvt.) So, I contend, we should live with the denormalization for now and push for the features we need to overcome it (a way of seeing/editing deep-deep properties on a freebase.com topic page) 2. migrate (copy) property values from structure to project. engineer (147) engineering_firm (95) construction_started (984 date values) contractor (155) construction_cost (120 money_value objects) brendan -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091110/cfeafe65/attachment.htm From kirrily at metaweb.com Wed Nov 11 00:31:50 2009 From: kirrily at metaweb.com (Kirrily Robert) Date: Tue, 10 Nov 2009 16:31:50 -0800 Subject: [Developers] Monthly Freebase meetups in San Francisco Message-ID: <7C76F410-8BEF-4FF4-8191-97C29839DFB6@metaweb.com> For those of you in the San Francisco Bay Area, I wanted to let you know I've just created a monthly Freebase meetup on meetup.com: http://www.meetup.com/sf-freebase/ The plan is to have a regular gathering each month, a couple of talks/ presentations, some pizza, some hack time, and a chance to talk to other people who use Freebase and swap tips/ideas/etc. If you're interested in attending, please join the meetup.com group and share it with your friends. K. -- Kirrily Robert Freebase Community Director kirrily at metaweb.com http://freebase.com/ From tyler at metaweb.com Thu Nov 12 17:48:03 2009 From: tyler at metaweb.com (Tyler Pirtle) Date: Thu, 12 Nov 2009 09:48:03 -0800 (PST) Subject: [Developers] Fun with animated gifs In-Reply-To: <1592272998.245001258047979614.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> Message-ID: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> > BUT... that said I *personally* think animated gifs aren't really > images - mainly because they're not appropriate in all image-based > contexts (for instance, would you want an animated thumbnail while > viewing a topic on a mobile device? What about when you're browsing an > > image gallery? yuck.) - we may feel like we'd be enhancing an API by > > broadening support for animated images, but I think we'd really be > screwing up user experience for a lot of applications that use the > image_thumb public API. > > Oh dear. I won't comment on your personal opinion but I'm sure you know where I stand on this. ;) Whether or not animated images have a place in the client I think is a question best left to the design dept., all I would say is that there are several rather clever uses of animated gifs and maybe they shouldn't be written off completely. For example, you can use them to display video on the iphone (check out robo.to). ;) However, correctly thumbnailing them could just mean "extracting a relevant key frame" and displaying that, don't you think ? T From bobby at metaweb.com Thu Nov 12 19:46:03 2009 From: bobby at metaweb.com (Bobby Rullo) Date: Thu, 12 Nov 2009 11:46:03 -0800 Subject: [Developers] Fun with animated gifs In-Reply-To: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> References: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> Message-ID: <4371B389-3ED7-413E-A321-B4C99CCD3028@metaweb.com> > > > > Whether or not animated images have a place in the client I think is > a question best left to the design dept., all I would say is that > there > are several rather clever uses of animated gifs and maybe they > shouldn't > be written off completely. > Here's a great example of animated GIF's being useful: using them as a way to visualize sorting algorithms: http://en.wikipedia.org/wiki/Quick_sort -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091112/f8c6303a/attachment.htm From jh at metaweb.com Thu Nov 12 19:55:12 2009 From: jh at metaweb.com (James Home) Date: Thu, 12 Nov 2009 11:55:12 -0800 Subject: [Developers] Fun with animated gifs In-Reply-To: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> References: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> Message-ID: <6AAEA056-1217-4CF5-966E-02F3D33C87C6@metaweb.com> I am working on a proposed spec around image formats and thumbnailing - I'll be sure to address animated gif support. - J. On Nov 12, 2009, at 9:48 AM, Tyler Pirtle wrote: > >> BUT... that said I *personally* think animated gifs aren't really >> images - mainly because they're not appropriate in all image-based >> contexts (for instance, would you want an animated thumbnail while >> viewing a topic on a mobile device? What about when you're browsing an >> >> image gallery? yuck.) - we may feel like we'd be enhancing an API by >> >> broadening support for animated images, but I think we'd really be >> screwing up user experience for a lot of applications that use the >> image_thumb public API. >> >> > > Oh dear. I won't comment on your personal opinion but I'm sure you know > where I stand on this. ;) > > Whether or not animated images have a place in the client I think is > a question best left to the design dept., all I would say is that there > are several rather clever uses of animated gifs and maybe they shouldn't > be written off completely. > > For example, you can use them to display video on the iphone (check out > robo.to). ;) > > However, correctly thumbnailing them could just mean "extracting a relevant > key frame" and displaying that, don't you think ? > > > > T > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From alecf at metaweb.com Thu Nov 12 22:30:19 2009 From: alecf at metaweb.com (Alec Flett) Date: Thu, 12 Nov 2009 14:30:19 -0800 Subject: [Developers] Fun with animated gifs In-Reply-To: <4371B389-3ED7-413E-A321-B4C99CCD3028@metaweb.com> References: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> <4371B389-3ED7-413E-A321-B4C99CCD3028@metaweb.com> Message-ID: <5209FB90-91BE-48C3-B361-3D44301E02F9@metaweb.com> On Nov 12, 2009, at 11:46 AM, Bobby Rullo wrote: > > Here's a great example of animated GIF's being useful: using them as > a way to visualize sorting algorithms: > > http://en.wikipedia.org/wiki/Quick_sort I totally agree that an moving visual is a good way to illustrate a concept, I'm just saying that I don't consider that to be an *image* - i.e. a single two dimensional region of pixels that doesn't move. the fact that the first 6 bytes of that file are "GIF89a" or whatever is irrelevant. thumbnailing images is a very different problem than determining the most semantically useful keyframe of an animation. that animation would be just as useful as a mpeg, avi, mng, or even flv. But none of those are images either. Alec > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091112/2a296863/attachment.htm From kurt at spaceship.com Thu Nov 12 22:55:05 2009 From: kurt at spaceship.com (Kurt Bollacker) Date: Thu, 12 Nov 2009 14:55:05 -0800 Subject: [Developers] Fun with animated gifs In-Reply-To: <5209FB90-91BE-48C3-B361-3D44301E02F9@metaweb.com> References: <584537392.245021258048083987.JavaMail.root@zimbra01.corp.sjc1.metaweb.com> <4371B389-3ED7-413E-A321-B4C99CCD3028@metaweb.com> <5209FB90-91BE-48C3-B361-3D44301E02F9@metaweb.com> Message-ID: <20091112225505.GN27371@spaceship.com> On Thu, Nov 12, 2009 at 02:30:19PM -0800, Alec Flett wrote: > > On Nov 12, 2009, at 11:46 AM, Bobby Rullo wrote: > > > >Here's a great example of animated GIF's being useful: using them as > >a way to visualize sorting algorithms: > > > >http://en.wikipedia.org/wiki/Quick_sort > > I totally agree that an moving visual is a good way to illustrate a > concept, I'm just saying that I don't consider that to be an *image* - > i.e. a single two dimensional region of pixels that doesn't move. the > fact that the first 6 bytes of that file are "GIF89a" or whatever is > irrelevant. > > thumbnailing images is a very different problem than determining the > most semantically useful keyframe of an animation. > > that animation would be just as useful as a mpeg, avi, mng, or even > flv. But none of those are images either. I just wish animated gifs had a different mime type than image/gif. Then the discussed would be moot. For now my solution was to use heuristics to pick a likely useful frame and only upload that as a static image. Kurt :-) From philip-freebase at shadowmagic.org.uk Fri Nov 13 10:06:45 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Fri, 13 Nov 2009 10:06:45 +0000 Subject: [Developers] URL encoding in acre.response.set_header Message-ID: <20091113100645.GS19375@sphinx.mythic-beasts.com> I have an Acre script[1] which when given the key "P%C3%A8re_David%27s_Deer" should redirect to the URL http://www.bbc.co.uk/nature/species/P?re_David's_Deer, otherwise known as http://www.bbc.co.uk/nature/species/P%C3%A8re_David%27s_Deer when percent encoded. (See [2] you care _why_ it wants to do this!) What seems to be happening here is that the key is treated as UTF-8 when it comes in and successfully decoded to "P?re_David's_Deer". The app then sticks the appropriate bit on the front and produces the string "http://www.bbc.co.uk/nature/species/P?re_David's_Deer". However, using acre.response.set_header( 'Location', url ) to redirect the client seems to encode the url using ISO-8859-15, so the redirect is to http://www.bbc.co.uk/nature/species/P%E8re_David%27s_Deer rather than the desired UTF-8 encoded version. Therefore the obvious questions: * Is this the intended behaviour? * Is there any way to get the UTF-8 encoding behaviour I want, short of converting the string to UTF-8 in the Javascript? Cheers, Phil [1] http://acre.freebase.com/#app=/user/pak21/bbcnathist&file=index [2] http://www.freebase.com/view/guid/9202a8c04000641f800000000e5b4d2f -- Philip Kendall http://www.shadowmagic.org.uk/ From kurt at spaceship.com Fri Nov 13 16:44:00 2009 From: kurt at spaceship.com (Kurt Bollacker) Date: Fri, 13 Nov 2009 08:44:00 -0800 Subject: [Developers] No login on sandbox? Message-ID: <20091113164400.GQ27371@spaceship.com> Since sometime last night, I have been unable to login to sandbox. This is true with the client and through the API. Has anyone else experienced this? Kurt :-) From tfmorris at gmail.com Fri Nov 13 16:42:56 2009 From: tfmorris at gmail.com (Tom Morris) Date: Fri, 13 Nov 2009 11:42:56 -0500 Subject: [Developers] No login on sandbox? In-Reply-To: <20091113164400.GQ27371@spaceship.com> References: <20091113164400.GQ27371@spaceship.com> Message-ID: On Fri, Nov 13, 2009 at 11:44 AM, Kurt Bollacker wrote: > > Since sometime last night, I have been unable to login to sandbox. > This is true with the client and through the API. ?Has anyone else > experienced this? Ditto. Just hangs after submitting username/password. Tom From david at metaweb.com Fri Nov 13 17:00:40 2009 From: david at metaweb.com (David Huynh) Date: Fri, 13 Nov 2009 09:00:40 -0800 Subject: [Developers] No login on sandbox? In-Reply-To: References: <20091113164400.GQ27371@spaceship.com> Message-ID: <4AFD90B8.8040009@metaweb.com> Kurt, Tom, Thanks for reporting this. We know about it and are working on fixing it. David Tom Morris wrote: > On Fri, Nov 13, 2009 at 11:44 AM, Kurt Bollacker wrote: > >> Since sometime last night, I have been unable to login to sandbox. >> This is true with the client and through the API. Has anyone else >> experienced this? >> > > Ditto. Just hangs after submitting username/password. > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > From gordon at metaweb.com Fri Nov 13 19:13:50 2009 From: gordon at metaweb.com (Gordon Mackenzie) Date: Fri, 13 Nov 2009 11:13:50 -0800 Subject: [Developers] No login on sandbox? In-Reply-To: References: <20091113164400.GQ27371@spaceship.com> Message-ID: <8ADA311F-31D2-42F3-B7F6-B00269EC1731@metaweb.com> Fixed. Sorry about that. ~ Gordon <<< gordon at metaweb.com >>> On Nov 13, 2009, at 8:42 AM, Tom Morris wrote: > On Fri, Nov 13, 2009 at 11:44 AM, Kurt Bollacker wrote: >> >> Since sometime last night, I have been unable to login to sandbox. >> This is true with the client and through the API. Has anyone else >> experienced this? > > Ditto. Just hangs after submitting username/password. > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3742 bytes Desc: not available Url : http://lists.freebase.com/pipermail/developers/attachments/20091113/3422572d/attachment.bin From jack.alves at gmail.com Sat Nov 14 00:10:26 2009 From: jack.alves at gmail.com (Jack Alves) Date: Fri, 13 Nov 2009 16:10:26 -0800 Subject: [Developers] people recon Message-ID: <554723b0911131610k1101ece5k42e79836ce57c39b@mail.gmail.com> I'm about to start a reconciliation process toward an import of people who have academic bibliographies. I would appreciate any tips or tools you can offer. I'll be writing tools in Python. My first few steps will be to use the recon service and additional freebase queries to generate a list that outputs names with a recommendation (create, merge, punt). I did a few quick tests of the recon service and have some questions and comments. - What scores represent a generally acceptable level of confidence for a match or a no-match. The match=true result seems like a high bar based on some preliminary tests. - I sent a query with my name using just "name" and got a ".4" score. I added the "person" type and the score bumped up to ".6". Then I added an "alias" and type "software_developer". The the score did not improve. I noticed this in other cases with authors. Why doesn't the extra info increase the probability of a match? This request, { "/type/object/name":"Jack Alves", "/common/topic/alias":"John Alves", "/type/object/type":["/people/person","/computer/software_developer"] } returns: [{ "id":"/guid/9202a8c04000641f8000000003cbd280", "name":["Jack Alves", "John Alves", "jack alves" ], "score":0.62055033, "match":false, "type":["/people/person", "/common/topic", "/biology/organism", "/user/skud/freebase_events/speaker", "/user/skud/freebase_events/attendee", "/user/skud/freebase_events/tshirt_recipient", "/common/media_rights_holder", "/computer/software_developer" ] } ] - I learned a few things from previous tests using the recon ui with a tiny sample set. 1.) Only the first two recon results are worth reviewing for a match. 2.) A match is very likely if the recon score is above .4 and the person is type author, or the institution associated with the person is in the wikipedia article. 3.) A match is very unlikely if the first or last name of the person does not match either name in the first recon result. - In addition to the recon service I plan to make recommendations to merge or create based on a combination of some obvious checks like matches on name, alias, and types. Jack -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091113/a5fae465/attachment.htm From hirsch.christian at gmail.com Sat Nov 14 04:15:04 2009 From: hirsch.christian at gmail.com (Christian Hirsch) Date: Sat, 14 Nov 2009 17:15:04 +1300 Subject: [Developers] Announcing: Topic API In-Reply-To: <41F9B16E-58F4-4FCB-AF98-FCB22A638CAD@metaweb.com> References: <41F9B16E-58F4-4FCB-AF98-FCB22A638CAD@metaweb.com> Message-ID: <443bada30911132015v2487984es74672b59b578b86@mail.gmail.com> Thanks! I found this topic API very useful!! I have one suggestion to to improve it. At the moment all the related topics show up only with 1 of their types (the "expected_type"). It might be useful to know which other types are associated with them. e.g. the objects in the "values" array could have "types" (besides "id", "name", and "url"). Will the API leave the experimental status soon? Cheers, Christian On Tue, Oct 27, 2009 at 10:31 AM, Michael Masouras wrote: > We are launching a new API that we hope will facilitate the > development of applications around topics. > > This new API is a JSON HTTP service and provides most of the data > connected to a topic (including a lot of nitty-gritty around going > over mediators and handling addresses), without the need to write any > MQL or use the blurb service for getting descriptions. We have also > tailored the output of the API to make writing UIs easier. > > Here's an example API call: > http://www.freebase.com/experimental/topic/standard?id=/en/new_york_yankees > > and here is the documentation, including available Acre wrappers and > an example to get you going: > http://www.freebase.com/docs/topic_api > > As you can see from the URL, this is still in a testing period, and we > are particularly interested in your feedback. Let us know if you find > this handy, and especially things that would make it more useful to you. > > Thanks, > Michael > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091114/c39fa908/attachment.htm From tfmorris at gmail.com Sat Nov 14 07:33:29 2009 From: tfmorris at gmail.com (Tom Morris) Date: Sat, 14 Nov 2009 02:33:29 -0500 Subject: [Developers] people recon In-Reply-To: <554723b0911131610k1101ece5k42e79836ce57c39b@mail.gmail.com> References: <554723b0911131610k1101ece5k42e79836ce57c39b@mail.gmail.com> Message-ID: On Fri, Nov 13, 2009 at 7:10 PM, Jack Alves wrote: > I'm about to start a reconciliation process toward an import of people who > have academic bibliographies. I would appreciate any tips or tools you can > offer. I'll be writing tools in Python. My first few steps will be to use > the recon service and additional freebase queries to generate a list that > outputs names with a recommendation (create, merge, punt). I did a few quick > tests of the recon service and have some questions and comments. How many people? Roughly what percentage do you think you'll find in Freebase? The answers to these questions will influence the strategy that you want to pursue and how you want to bias your searches. Some resources: - Check the archives for a thread with the subject "Looking for people" from Mar 29-30 for some past discussion and tips. - Look at my freebase-utils project, particularly the congress-bioguide app which has the source code (Python) for most of the tricks that I learned while reconciling all the U.S. Congress people. It doesn't use any of the reconciliation services, but it might give you some ideas for ways to cross check your results. > - What scores represent a generally acceptable level of confidence for a > match or a no-match. The match=true result seems like a high bar based on > some preliminary tests. You want to set the bar quite high for false positives. It's a lot easier to merge accidental dupes than it is to split apart a topic which never should have been merged in the first place. > - In addition to the recon service I plan to make recommendations to merge > or create based on a combination of some obvious checks like matches on > name, alias, and types. This is a good idea. I'd compute a variety of scores, with the recon service being one, and look at the total result set when making your decision. The decision thresholds should be set so that you almost never get a false positive and rarely create unneeded duplicates. Topics in Freebase without much structured data (e.g. just a type of Person) will be almost impossible to reconcile automatically with confidence unless it's a very unusual name. A way to queue all the stuff in the middle for review is useful if you're going to have a lot of them (might want to look at RABJ). The more information you can feed in on your candidate the better off you'll be, both for machine matching and human review - birth date, alma mater, publications, department, etc. Good luck. Let me know if you've got any questions -- either with my code or with reconciling people in general. Tom From tfmorris at gmail.com Sat Nov 14 19:03:38 2009 From: tfmorris at gmail.com (Tom Morris) Date: Sat, 14 Nov 2009 14:03:38 -0500 Subject: [Developers] Google Wave sandbox and Android development Message-ID: Anyone else have a sandbox account for Google Wave? Anyone got an interest in Google Wave robots and/or plugins for Freebase? I'm playing with developing for Wave and considering adding some type of Freebase functionality, so am interested in others doing the same or who are interested in collaborating, testing, etc. Note that the sandbox doesn't interact with the beta servers, so folks with regular beta accounts can't play with any resulting code until it's approved and released. I've got a few ideas for things I'd like to play with, but if you've got something you're dying to see, let me know, whether it's a simple Wave Gadget version of the Topic widget or an all singing, all dancing, collaborative structured editing environment (of course, the latter is much less likely to get done as a demo, but perhaps a proof-of-concept showing the integration...). Anyone doing any Android development? I've got a little Android/Freebase app that I'll try to put someplace (not sure if freebase-utils is appropriate). It doesn't do much, but does demonstrate the basics. I'd be interested in chatting with others who are developing for Android. Tom From jason at metaweb.com Sat Nov 14 19:28:51 2009 From: jason at metaweb.com (Jason Douglas) Date: Sat, 14 Nov 2009 11:28:51 -0800 Subject: [Developers] Google Wave sandbox and Android development In-Reply-To: References: Message-ID: Michael Masouras here was hacking on Wave a few weeks back. He created 'freebasebot', which if you invite to your wave will allow you to use @ as a trigger for auto-complete which will then insert a link to that Freebase topic. It also would insert a full topic summary box with # autocomplete, but that seems broken now (probably should be updated to do TopicBlocks anyway). It was just a proof-of-concept... I think it would be really cool to do more. It did sound like it was tricky to do just that, though. Michael, any comment on how you ended up making that work? -jason On Nov 14, 2009, at 11:03 AM, Tom Morris wrote: > Anyone else have a sandbox account for Google Wave? Anyone got an > interest in Google Wave robots and/or plugins for Freebase? I'm > playing with developing for Wave and considering adding some type of > Freebase functionality, so am interested in others doing the same or > who are interested in collaborating, testing, etc. Note that the > sandbox doesn't interact with the beta servers, so folks with regular > beta accounts can't play with any resulting code until it's approved > and released. > > I've got a few ideas for things I'd like to play with, but if you've > got something you're dying to see, let me know, whether it's a simple > Wave Gadget version of the Topic widget or an all singing, all > dancing, collaborative structured editing environment (of course, the > latter is much less likely to get done as a demo, but perhaps a > proof-of-concept showing the integration...). > > Anyone doing any Android development? I've got a little > Android/Freebase app that I'll try to put someplace (not sure if > freebase-utils is appropriate). It doesn't do much, but does > demonstrate the basics. I'd be interested in chatting with others who > are developing for Android. > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From tfmorris at gmail.com Sat Nov 14 21:55:05 2009 From: tfmorris at gmail.com (Tom Morris) Date: Sat, 14 Nov 2009 16:55:05 -0500 Subject: [Developers] Google Wave sandbox and Android development In-Reply-To: References: Message-ID: Cool. I just now noticed that Kirrily added the bot to one of my Waves on the beta servers the other day. It seems to work for me on both the sandbox and beta servers. The bot's address is freebasebot at appspot.com for anyone who wants to play with it. It needs to be added using the "email" address, not the URL that's associated with it (ie "Add Gadget using URL" won't work). Tom On Sat, Nov 14, 2009 at 2:28 PM, Jason Douglas wrote: > Michael Masouras here was hacking on Wave a few weeks back. ?He created 'freebasebot', which if you invite to your wave will allow you to use @ as a trigger for auto-complete which will then insert a link to that Freebase topic. ?It also would insert a full topic summary box with # autocomplete, but that seems broken now (probably should be updated to do TopicBlocks anyway). > > It was just a proof-of-concept... I think it would be really cool to do more. ?It did sound like it was tricky to do just that, though. ?Michael, any comment on how you ended up making that work? > > -jason > > > On Nov 14, 2009, at 11:03 AM, Tom Morris wrote: > >> Anyone else have a sandbox account for Google Wave? ?Anyone got an >> interest in Google Wave robots and/or plugins for Freebase? ?I'm >> playing with developing for Wave and considering adding some type of >> Freebase functionality, so am interested in others doing the same or >> who are interested in collaborating, testing, etc. ?Note that the >> sandbox doesn't interact with the beta servers, so folks with regular >> beta accounts can't play with any resulting code until it's approved >> and released. >> >> I've got a few ideas for things I'd like to play with, but if you've >> got something you're dying to see, let me know, whether it's a simple >> Wave Gadget version of the Topic widget or an all singing, all >> dancing, collaborative structured editing environment (of course, the >> latter is much less likely to get done as a demo, but perhaps a >> proof-of-concept showing the integration...). >> >> Anyone doing any Android development? ?I've got a little >> Android/Freebase app that I'll try to put someplace (not sure if >> freebase-utils is appropriate). ?It doesn't do much, but does >> demonstrate the basics. ?I'd be interested in chatting with others who >> are developing for Android. >> >> Tom >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > From narphorium at gmail.com Sat Nov 14 22:42:10 2009 From: narphorium at gmail.com (Shawn Simister) Date: Sat, 14 Nov 2009 17:42:10 -0500 Subject: [Developers] Google Wave sandbox and Android development In-Reply-To: References: Message-ID: <4AFF3242.5040207@gmail.com> Very cool. Michael's bot worked well for me in Wave. I don't have sandbox access yet but I'm really interesting in seeing what sort of integration is possible between Google Wave and Freebase. Collaborative data games is one of the first things that comes to mind. Shawn Tom Morris wrote: > Cool. I just now noticed that Kirrily added the bot to one of my > Waves on the beta servers the other day. It seems to work for me on > both the sandbox and beta servers. The bot's address is > freebasebot at appspot.com for anyone who wants to play with it. It > needs to be added using the "email" address, not the URL that's > associated with it (ie "Add Gadget using URL" won't work). > > Tom > > On Sat, Nov 14, 2009 at 2:28 PM, Jason Douglas wrote: > >> Michael Masouras here was hacking on Wave a few weeks back. He created 'freebasebot', which if you invite to your wave will allow you to use @ as a trigger for auto-complete which will then insert a link to that Freebase topic. It also would insert a full topic summary box with # autocomplete, but that seems broken now (probably should be updated to do TopicBlocks anyway). >> >> It was just a proof-of-concept... I think it would be really cool to do more. It did sound like it was tricky to do just that, though. Michael, any comment on how you ended up making that work? >> >> -jason >> >> >> On Nov 14, 2009, at 11:03 AM, Tom Morris wrote: >> >> >>> Anyone else have a sandbox account for Google Wave? Anyone got an >>> interest in Google Wave robots and/or plugins for Freebase? I'm >>> playing with developing for Wave and considering adding some type of >>> Freebase functionality, so am interested in others doing the same or >>> who are interested in collaborating, testing, etc. Note that the >>> sandbox doesn't interact with the beta servers, so folks with regular >>> beta accounts can't play with any resulting code until it's approved >>> and released. >>> >>> I've got a few ideas for things I'd like to play with, but if you've >>> got something you're dying to see, let me know, whether it's a simple >>> Wave Gadget version of the Topic widget or an all singing, all >>> dancing, collaborative structured editing environment (of course, the >>> latter is much less likely to get done as a demo, but perhaps a >>> proof-of-concept showing the integration...). >>> >>> Anyone doing any Android development? I've got a little >>> Android/Freebase app that I'll try to put someplace (not sure if >>> freebase-utils is appropriate). It doesn't do much, but does >>> demonstrate the basics. I'd be interested in chatting with others who >>> are developing for Android. >>> >>> Tom >>> _______________________________________________ >>> Developers mailing list >>> Developers at freebase.com >>> http://lists.freebase.com/mailman/listinfo/developers >>> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers >> >> > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091114/f0e7460b/attachment.htm From david at metaweb.com Sun Nov 15 01:13:00 2009 From: david at metaweb.com (David Huynh) Date: Sat, 14 Nov 2009 17:13:00 -0800 Subject: [Developers] cubed: an experiment for collection queries Message-ID: <4AFF559C.9030101@metaweb.com> Hi all, If you're looking for a collection of topics, say, drama films starring Nicole Kidman, it takes a bit of mental work to translate that to a MQL query. Wouldn't it be nice if that can be automated? Here's an experiment that does just that http://www.freebase.com/labs/cubed/?q=nicole%20kidman%20drama%20films This is like a power version of the freebase suggest widget that can resolve "collection queries". Compare this example http://tinyurl.com/yevtv3v (female+african+american+politicians) with Google Squared results http://www.google.com/squared/search?q=female+african+american+politicians or this example http://www.freebase.com/labs/cubed/?q=republican%20presidents%27%20children%27s%20schools with http://www.google.com/squared/search?q=republican+presidents%27+children%27s+schools The goal is to make this widget embeddable in any app, such as this one for exporting collections as TSV http://collection-exporter.freebaseapps.com/ Please consider this "alpha" only, not yet production worthy. But let me know if you have any potential use for it! Comments, feedback very much appreciated! David From pauljmackay at gmail.com Sun Nov 15 03:39:40 2009 From: pauljmackay at gmail.com (Paul Mackay) Date: Sat, 14 Nov 2009 19:39:40 -0800 Subject: [Developers] cubed: an experiment for collection queries In-Reply-To: <4AFF559C.9030101@metaweb.com> References: <4AFF559C.9030101@metaweb.com> Message-ID: That's pretty neat! What's the scope of queries it should be able to resolve? I tried "community gardens vancouver" which relates to the Local Food base I'm working on, but it just shows a box with "No suggested matches". Any ideas why? thanks paul On Sat, Nov 14, 2009 at 5:13 PM, David Huynh wrote: > Hi all, > > If you're looking for a collection of topics, say, drama films starring > Nicole Kidman, it takes a bit of mental work to translate that to a MQL > query. Wouldn't it be nice if that can be automated? Here's an > experiment that does just that > > http://www.freebase.com/labs/cubed/?q=nicole%20kidman%20drama%20films > > This is like a power version of the freebase suggest widget that can > resolve "collection queries". > > Compare this example > http://tinyurl.com/yevtv3v (female+african+american+politicians) > with Google Squared results > > http://www.google.com/squared/search?q=female+african+american+politicians > > or this example > > > http://www.freebase.com/labs/cubed/?q=republican%20presidents%27%20children%27s%20schools > with > > > http://www.google.com/squared/search?q=republican+presidents%27+children%27s+schools > > The goal is to make this widget embeddable in any app, such as this one > for exporting collections as TSV > > http://collection-exporter.freebaseapps.com/ > > Please consider this "alpha" only, not yet production worthy. But let me > know if you have any potential use for it! Comments, feedback very much > appreciated! > > David > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091114/0745c7e2/attachment-0001.htm From david at metaweb.com Sun Nov 15 05:33:49 2009 From: david at metaweb.com (David Huynh) Date: Sat, 14 Nov 2009 21:33:49 -0800 Subject: [Developers] cubed: an experiment for collection queries In-Reply-To: References: <4AFF559C.9030101@metaweb.com> Message-ID: <4AFF92BD.9060701@metaweb.com> Glad you like it! I haven't decided how to score base and user types relative to common types yet, so that's why that community garden type doesn't show up. What else have you tried that didn't work? David Paul Mackay wrote: > That's pretty neat! > > What's the scope of queries it should be able to resolve? I tried > "community gardens vancouver" which relates to the Local Food base I'm > working on, but it just shows a box with "No suggested matches". Any > ideas why? > > thanks > > paul > > On Sat, Nov 14, 2009 at 5:13 PM, David Huynh > wrote: > > Hi all, > > If you're looking for a collection of topics, say, drama films > starring > Nicole Kidman, it takes a bit of mental work to translate that to > a MQL > query. Wouldn't it be nice if that can be automated? Here's an > experiment that does just that > > > http://www.freebase.com/labs/cubed/?q=nicole%20kidman%20drama%20films > > This is like a power version of the freebase suggest widget that can > resolve "collection queries". > > Compare this example > http://tinyurl.com/yevtv3v (female+african+american+politicians) > with Google Squared results > > http://www.google.com/squared/search?q=female+african+american+politicians > > or this example > > http://www.freebase.com/labs/cubed/?q=republican%20presidents%27%20children%27s%20schools > with > > http://www.google.com/squared/search?q=republican+presidents%27+children%27s+schools > > The goal is to make this widget embeddable in any app, such as > this one > for exporting collections as TSV > > http://collection-exporter.freebaseapps.com/ > > Please consider this "alpha" only, not yet production worthy. But > let me > know if you have any potential use for it! Comments, feedback very > much > appreciated! > > David > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > > ------------------------------------------------------------------------ > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > From iainsproat at gmail.com Sun Nov 15 08:16:17 2009 From: iainsproat at gmail.com (Iain Sproat) Date: Sun, 15 Nov 2009 12:16:17 +0400 Subject: [Developers] cubed: an experiment for collection queries In-Reply-To: <4AFF92BD.9060701@metaweb.com> References: <4AFF559C.9030101@metaweb.com> <4AFF92BD.9060701@metaweb.com> Message-ID: Awesome! And the MQL created is much cleaner than the query generated by the views in the client (no sorting/timestamp padding). Iain On Sun, Nov 15, 2009 at 9:33 AM, David Huynh wrote: > Glad you like it! I haven't decided how to score base and user types > relative to common types yet, so that's why that community garden type > doesn't show up. What else have you tried that didn't work? > > David > > Paul Mackay wrote: >> That's pretty neat! >> >> What's the scope of queries it should be able to resolve? I tried >> "community gardens vancouver" which relates to the Local Food base I'm >> working on, but it just shows a box with "No suggested matches". Any >> ideas why? >> >> thanks >> >> paul >> >> On Sat, Nov 14, 2009 at 5:13 PM, David Huynh > > wrote: >> >> ? ? Hi all, >> >> ? ? If you're looking for a collection of topics, say, drama films >> ? ? starring >> ? ? Nicole Kidman, it takes a bit of mental work to translate that to >> ? ? a MQL >> ? ? query. Wouldn't it be nice if that can be automated? Here's an >> ? ? experiment that does just that >> >> >> ? ? ?http://www.freebase.com/labs/cubed/?q=nicole%20kidman%20drama%20films >> >> ? ? This is like a power version of the freebase suggest widget that can >> ? ? resolve "collection queries". >> >> ? ? Compare this example >> ? ? ? ?http://tinyurl.com/yevtv3v (female+african+american+politicians) >> ? ? with Google Squared results >> >> ? ? http://www.google.com/squared/search?q=female+african+american+politicians >> >> ? ? or this example >> >> ? ? http://www.freebase.com/labs/cubed/?q=republican%20presidents%27%20children%27s%20schools >> ? ? with >> >> ? ? http://www.google.com/squared/search?q=republican+presidents%27+children%27s+schools >> >> ? ? The goal is to make this widget embeddable in any app, such as >> ? ? this one >> ? ? for exporting collections as TSV >> >> ? ? ? ?http://collection-exporter.freebaseapps.com/ >> >> ? ? Please consider this "alpha" only, not yet production worthy. But >> ? ? let me >> ? ? know if you have any potential use for it! Comments, feedback very >> ? ? much >> ? ? appreciated! >> >> ? ? David >> >> ? ? _______________________________________________ >> ? ? Developers mailing list >> ? ? Developers at freebase.com >> ? ? http://lists.freebase.com/mailman/listinfo/developers >> >> >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers >> > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > From spencerkelly86 at gmail.com Mon Nov 16 06:28:23 2009 From: spencerkelly86 at gmail.com (Spencer Kelly) Date: Mon, 16 Nov 2009 01:28:23 -0500 Subject: [Developers] cubed: an experiment for collection queries In-Reply-To: References: <4AFF559C.9030101@metaweb.com> <4AFF92BD.9060701@metaweb.com> Message-ID: i really love this so much. 'collection queries' means i guess that all answers take the form of ids - -why it doesn't answer ''david bowie's date of birth'. this is curious to me, as this sort of thing seems way easier to do than the advanced examples. Infact, i wrote it last week, using your pluralizer app http://ubiquity.freebaseapps.com so, is the collection query limitation a temporary thing? i'd love it to have a developper api that doesn't send things to suggest- text-in, mql-out. I tried to pull this out of the code but got so confused. i'd love to see it as a ubiquity command , i'd love an acre.cubed('japanese skateboarders') function. With properties, cubed is able to resolve 'nirvana albums' but not 'nirvana records', 'nevermind tracks' but not 'nevermind songs' , as /type/property doesn't have an alias property like /common/topic. i've recently made this type - http://www.freebase.com/view/base/natlang/property_alias and am trying to think of creative ways to fill it. wordnet? do you have plans for addressing this? is it true that it learns? cubed-helper.metaweb.com? you are the world's best. this is the killer app of the semantic web and it changes everything. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091116/1a557cd2/attachment.htm From david at metaweb.com Mon Nov 16 18:11:02 2009 From: david at metaweb.com (David Huynh) Date: Mon, 16 Nov 2009 10:11:02 -0800 Subject: [Developers] cubed: an experiment for collection queries In-Reply-To: References: <4AFF559C.9030101@metaweb.com> <4AFF92BD.9060701@metaweb.com> Message-ID: <4B0195B6.1040006@metaweb.com> Spencer Kelly wrote: > i really love this so much. Glad you like it :-) > 'collection queries' means i guess that all answers take the form of > ids - -why it doesn't answer ''david bowie's date of birth'. this is > curious to me, as this sort of thing seems way easier to do than the > advanced examples. Infact, i wrote it last week, using your pluralizer > app http://ubiquity.freebaseapps.com > so, is the collection query limitation a temporary thing? I didn't realize you've been going for something quite similar ... Will Moffat here has written a ubiquity command before and maybe he can help putting everything together. http://blog.hamstersoup.com/2008/08/27/freebase-search-for-ubiquity/ It shouldn't be hard to make cubed's core algorithm answer "david bowie's date of birth". The suggest UI (dropdown + flyout) might not be suitable for single value answers, though. But cubed can support a mode for value answers that you can use in ubiquity. > i'd love it to have a developper api that doesn't send things to > suggest- text-in, mql-out. I tried to pull this out of the code but > got so confused. That's probably because I tried to optimize it :-) You can play with the test entry point http://cubed.freebaseapps.com/ajax_suggest_test?search=0&mode=chunking-forms&query=republican%20presidents%20children mode can be one of chunking or chunking-forms growing unifying extending condensing approving explaining Those are stages of the algorithm. Most interesting are chunking (segmenting the query into terms), growing (building up the structured query), approving (selecting only non-empty results), explaining (generating English name for the structured query). > i'd love to see it as a ubiquity command , i'd love an > acre.cubed('japanese skateboarders') function. How would that work without UI interaction? > With properties, cubed is able to resolve 'nirvana albums' but not > 'nirvana records', 'nevermind tracks' but not 'nevermind songs' , as > /type/property doesn't have an alias property like /common/topic. > i've recently made this type - > http://www.freebase.com/view/base/natlang/property_alias and am > trying to think of creative ways to fill it. wordnet? > do you have plans for addressing this? I'd like to address this problem, but I don't have any plan yet. Properties are a pain to deal with because there are several naming schemes. I'd welcome aliases for properties, though I don't have any idea how to fill them in except for manually going through them ... In order to generate textual explanations of the suggestions, I had to manually annotate 1,400 properties with English phrasing patterns. > is it true that it learns? cubed-helper.metaweb.com > ? Not yet :-) David From daepark at metaweb.com Mon Nov 16 19:52:58 2009 From: daepark at metaweb.com (Dae Park) Date: Mon, 16 Nov 2009 11:52:58 -0800 Subject: [Developers] jquery-acre integration utilities In-Reply-To: <4AF08F8C.7020102@metaweb.com> References: <4AF08F8C.7020102@metaweb.com> Message-ID: <9EF4A797-BF3C-46FE-8855-C48D9787493C@metaweb.com> can you add jquery.form.js to jquery.freebaseapps.com? -dae On Nov 3, 2009, at 12:16 PM, Stefano Mazzocchi wrote: > It's very easy to use jquery in Acre apps, but there are certain > things > that one tends to do over and over when creating new apps, so I > spent a > little time today and organized all jquery-related utilities into a > single acre app that you can use for all your jquery needs. > > Find it at > > http://jquery.freebaseapps.com/ > > and read how to use it there. > > If you want/need more functionality or plugins connected, just let me > know and I'll add them. > > NOTE: the acre default library at http://default.freebaseapps.com/ now > uses the jquery utilities library for the jquery-related activities > but > it's completely back compatible, you don't need to change anything in > your code, the defaults templates will just transparently pass thru to > the jquery ones. > > Enjoy! > > -- > Stefano Mazzocchi Application Catalyst > Metaweb Technologies, Inc. stefano at metaweb.com > ------------------------------------------------------------------- > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From stefano at metaweb.com Mon Nov 16 20:49:42 2009 From: stefano at metaweb.com (Stefano Mazzocchi) Date: Mon, 16 Nov 2009 12:49:42 -0800 Subject: [Developers] jquery-acre integration utilities In-Reply-To: <9EF4A797-BF3C-46FE-8855-C48D9787493C@metaweb.com> References: <4AF08F8C.7020102@metaweb.com> <9EF4A797-BF3C-46FE-8855-C48D9787493C@metaweb.com> Message-ID: <4B01BAE6.7090102@metaweb.com> Dae Park wrote: > can you add jquery.form.js to jquery.freebaseapps.com? This one? http://jquery.malsup.com/form/ > > -dae > > On Nov 3, 2009, at 12:16 PM, Stefano Mazzocchi wrote: > >> It's very easy to use jquery in Acre apps, but there are certain >> things >> that one tends to do over and over when creating new apps, so I >> spent a >> little time today and organized all jquery-related utilities into a >> single acre app that you can use for all your jquery needs. >> >> Find it at >> >> http://jquery.freebaseapps.com/ >> >> and read how to use it there. >> >> If you want/need more functionality or plugins connected, just let me >> know and I'll add them. >> >> NOTE: the acre default library at http://default.freebaseapps.com/ now >> uses the jquery utilities library for the jquery-related activities >> but >> it's completely back compatible, you don't need to change anything in >> your code, the defaults templates will just transparently pass thru to >> the jquery ones. >> >> Enjoy! >> >> -- >> Stefano Mazzocchi Application Catalyst >> Metaweb Technologies, Inc. stefano at metaweb.com >> ------------------------------------------------------------------- >> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -- Stefano Mazzocchi Application Catalyst Metaweb Technologies, Inc. stefano at metaweb.com ------------------------------------------------------------------- From kirrily at metaweb.com Mon Nov 16 20:53:20 2009 From: kirrily at metaweb.com (Kirrily Robert) Date: Mon, 16 Nov 2009 12:53:20 -0800 Subject: [Developers] Please vote on the review queue Message-ID: <8D6E1BF5-8286-439D-9851-5C60E225F372@metaweb.com> Hi all, This isn't strictly a dev or data-modeling issue, so I hope you don't mind me posting about it, but we need to rally the troops to attack our review queue (http://www.freebase.com/tools/pipeline/showtask). The review queue is where things wind up that are flagged "delete" or "merge" via the Freebase website. Due to some mass-flagging of certain Wikipedia topics for delete (a good thing!) and a bug that meant some people's votes weren't being applied effectively (not such a good thing!) the queue has recently built up to over 3000 items. However, we've got a workaround for that bug so people's votes count fully now. If you've got a few minutes to spare, please go vote on some stuff! Each item needs a consensus between three voters to be processed. There's some more documentation of how it works and how you should vote here: http://wiki.freebase.com/wiki/Review_Queue K. -- Kirrily Robert Freebase Community Director kirrily at metaweb.com http://freebase.com/ From jack.alves at gmail.com Mon Nov 16 22:49:38 2009 From: jack.alves at gmail.com (Jack Alves) Date: Mon, 16 Nov 2009 14:49:38 -0800 Subject: [Developers] mqlreaditer timeout Message-ID: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> I get a MQL Query timeout error after about 8 iterations using the script below. If I set limit to 10 I get 80 results. If I set limit to 100 I get 800 results. The specific numbers aren't consistent but the general behavior of a timeouts after some number of iterations is consistent. Why could cause this? Are there ways to avoid this problem without changing the query? I have a stripped down query that works. When I first tried this I wasn't using HTTPMetawebSession. It seemed like results were worse without that but the doc doesn't say it is necessary. ----------------------------------------------------------------------------------------------- import simplejson import freebase from freebase.api import HTTPMetawebSession, MetawebError # Set the freebase query q = [{ "/book/author/book_editions_edited": [ { "id": None, "name": None, "optional": True, "type": "/book/book_edition" } ], "/book/author/contributing_author_to": [ { "id": None, "name": None, "optional": True, "type": "/book/book_edition" } ], "/book/author/openlibrary_id": [ { "optional": True, "type": "/type/enumeration", "value": None } ], "/book/author/series_written_or_contributed_to": [ { "id": None, "name": None, "optional": True, "type": "/book/literary_series" } ], "/book/author/works_edited": [ { "id": None, "name": None, "optional": True, "type": "/book/written_work" } ], "/book/author/works_written": [ { "id": None, "name": None, "optional": True, "type": "/book/written_work" } ], "/common/topic/article": { "guid": None, "limit": 1, "optional": True }, "/common/topic/image": { "id": None, "limit": 1, "optional": True }, "date_of_birth": None, "education": [ { "id": None, "major_field_of_study": [ { "id": None, "name": None, "optional": True, "type": "/education/field_of_study" } ], "optional": True, "specialization": [ { "id": None, "name": None, "optional": True, "type": "/education/field_of_study" } ], "start_date": None, "type": "/education/education" } ], "employment_history": [ { "id": None, "optional": True, "title": { "id": None, "name": None, "optional": True }, "to": None, "type": "/business/employment_tenure" } ], "id": None, "name": None, "nationality": [ { "id": None, "name": None, "optional": True, "type": "/location/country" } ], "profession": [ { "id": None, "name": None, "optional": True, "type": "/people/profession" } ], "creator": None, "key": [{ "namespace":None, "value":None }], "!pd:/people/profession/people_with_this_profession": [{ "id": "/en/mathematician", "name": None, "type": "/people/profession" }], "limit":10, "sort": "-date_of_birth", "type": "/people/person", "more:type":[] }] freebase = HTTPMetawebSession('freebase.com') result_set = freebase.mqlreaditer(q) for result_batch in result_set: print simplejson.dumps(result_batch,indent=4) -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091116/b031099f/attachment.htm From tfmorris at gmail.com Mon Nov 16 23:17:36 2009 From: tfmorris at gmail.com (Tom Morris) Date: Mon, 16 Nov 2009 18:17:36 -0500 Subject: [Developers] mqlreaditer timeout In-Reply-To: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> Message-ID: On Mon, Nov 16, 2009 at 5:49 PM, Jack Alves wrote: > I get a MQL Query timeout error after about 8 iterations using the script > below. If I set limit to 10 I get 80 results. If I set limit to 100 I get > 800 results. The specific numbers aren't consistent but the general behavior > of a timeouts after some number of iterations is consistent. To generalize Jack's questions: - What tools and documentation are available to help with query optimization? - Why aren't query complexity limits deterministic? I understand that there's a data component to this which will cause variability as the contents of the database change, but I think it's just plain wrong that *my* queries will timeout at some random time because of *someone else's* applied load which I have no control over. It makes application behavior totally random. > Why could cause this? Are there ways to avoid this problem without changing > the query? I have a stripped down query that works. It may be my imagination, but I think that using a lower limit (which results in higher overhead) is less likely to time out (it's got to do less work to fill the query). I know it doesn't mean your "no query changes" criteria, but it's my impression that sort is a fairly expensive operation, so I'd try to eliminate it if you can. Tom From jack.alves at gmail.com Tue Nov 17 00:21:50 2009 From: jack.alves at gmail.com (Jack Alves) Date: Mon, 16 Nov 2009 16:21:50 -0800 Subject: [Developers] mqlreaditer timeout In-Reply-To: References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> Message-ID: <554723b0911161621y5c18324bu45c8d1c630ae1be@mail.gmail.com> At one point it seemed like a lower limit was better but it isn't clear. Yes, removing the sort resolves the problem. On Mon, Nov 16, 2009 at 3:17 PM, Tom Morris wrote: > On Mon, Nov 16, 2009 at 5:49 PM, Jack Alves wrote: > > I get a MQL Query timeout error after about 8 iterations using the script > > below. If I set limit to 10 I get 80 results. If I set limit to 100 I get > > 800 results. The specific numbers aren't consistent but the general > behavior > > of a timeouts after some number of iterations is consistent. > > To generalize Jack's questions: > > - What tools and documentation are available to help with query > optimization? > > - Why aren't query complexity limits deterministic? I understand that > there's a data component to this which will cause variability as the > contents of the database change, but I think it's just plain wrong > that *my* queries will timeout at some random time because of *someone > else's* applied load which I have no control over. It makes > application behavior totally random. > > > Why could cause this? Are there ways to avoid this problem without > changing > > the query? I have a stripped down query that works. > > It may be my imagination, but I think that using a lower limit (which > results in higher overhead) is less likely to time out (it's got to do > less work to fill the query). > > I know it doesn't mean your "no query changes" criteria, but it's my > impression that sort is a fairly expensive operation, so I'd try to > eliminate it if you can. > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091116/a495b664/attachment.htm From sm at metaweb.com Tue Nov 17 00:11:32 2009 From: sm at metaweb.com (Scott Meyer) Date: Mon, 16 Nov 2009 16:11:32 -0800 Subject: [Developers] mqlreaditer timeout In-Reply-To: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> Message-ID: <4B01EA34.3050004@metaweb.com> Jack Alves wrote: > I get a MQL Query timeout error after about 8 iterations using the > script below. If I set limit to 10 I get 80 results. If I set limit to > 100 I get 800 results. The specific numbers aren't consistent but the > general behavior of a timeouts after some number of iterations is > consistent. > > Why could cause this? Are there ways to avoid this problem without > changing the query? I have a stripped down query that works. When I > first tried this I wasn't using HTTPMetawebSession. It seemed like > results were worse without that but the doc doesn't say it is necessary. I've filed a bug for you: https://bugs.freebase.com/browse/FREEBASE-1389 Initial triage shows that this problem is just due to heavy load on some of the graph servers. Your basic query seems to take about 3 - 5 seconds and heavy load on the graph can cause a timeout. We're moving towards a timeout based on user-time rather than elapsed, which should help this particular case. The current graph load problem should be resolved soon. -Scott From sm at metaweb.com Tue Nov 17 00:20:22 2009 From: sm at metaweb.com (Scott Meyer) Date: Mon, 16 Nov 2009 16:20:22 -0800 Subject: [Developers] mqlreaditer timeout In-Reply-To: References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> Message-ID: <4B01EC46.1080002@metaweb.com> Tom Morris wrote: > On Mon, Nov 16, 2009 at 5:49 PM, Jack Alves wrote: >> I get a MQL Query timeout error after about 8 iterations using the script >> below. If I set limit to 10 I get 80 results. If I set limit to 100 I get >> 800 results. The specific numbers aren't consistent but the general behavior >> of a timeouts after some number of iterations is consistent. > > To generalize Jack's questions: > > - What tools and documentation are available to help with query optimization? Unfortunately, we don't have much. Aside from avoiding obviously hard things: sorting large collections, intersecting large collections where the result set is small, the basic tool for optimizing a query is divide-and-conquer. What sort optimization tool would you like? > - Why aren't query complexity limits deterministic? What sort of determinism do you want? Deterministic response or deterministic effort? We started out with the former (it was easy to implement) and are migrating towards the latter. -Scott From pauljmackay at gmail.com Tue Nov 17 06:37:17 2009 From: pauljmackay at gmail.com (Paul Mackay) Date: Mon, 16 Nov 2009 22:37:17 -0800 Subject: [Developers] Example app that plots locations Message-ID: Hi, Can anyone suggest a good Acre app that shows a simple method of plotting location topics onto a map? thanks paul -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091116/8bc37606/attachment.htm From tfmorris at gmail.com Tue Nov 17 08:39:30 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 17 Nov 2009 03:39:30 -0500 Subject: [Developers] mqlreaditer timeout In-Reply-To: <4B01EC46.1080002@metaweb.com> References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> <4B01EC46.1080002@metaweb.com> Message-ID: On Mon, Nov 16, 2009 at 7:20 PM, Scott Meyer wrote: > Tom Morris wrote: >> On Mon, Nov 16, 2009 at 5:49 PM, Jack Alves wrote: >>> I get a MQL Query timeout error after about 8 iterations using the script >>> below. If I set limit to 10 I get 80 results. If I set limit to 100 I get >>> 800 results. The specific numbers aren't consistent but the general behavior >>> of a timeouts after some number of iterations is consistent. >> >> To generalize Jack's questions: >> >> - What tools and documentation are available to help with query optimization? > > Unfortunately, we don't have much. ?Aside from avoiding obviously > hard things: sorting large collections, intersecting large collections > where the result set is small, the basic tool for optimizing a query > is divide-and-conquer. > > What sort optimization tool would you like? Perhaps a list of the "obviously hard things" and a couple of paragraphs on best practices would be a good start. I've got kind of a mental model of how things might work, but no idea of how it matches up with what's actually expensive for the database. As far as tools go, I've got only the vaguest idea of something which highlights the "expensive" parts of a query. No idea as to how realistic that is, or what form it would take. >> - Why aren't query complexity limits deterministic? > > What sort of determinism do you want? ?Deterministic response or > deterministic effort? ?We started out with the former (it was > easy to implement) and are migrating towards the latter. Ideally I want a query that worked when I debugged it to work 100% of the time and for all eternity. Doing quotas based on resources used rather than elapsed time would probably fix 90%+ of the cases that I'm interested in. Hopefully a similar strategy will be applied to the Acre page time quota. Tom From philip-freebase at shadowmagic.org.uk Tue Nov 17 10:27:56 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Tue, 17 Nov 2009 10:27:56 +0000 Subject: [Developers] mqlreaditer timeout In-Reply-To: References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> Message-ID: <20091117102756.GL18508@sphinx.mythic-beasts.com> On Mon, Nov 16, 2009 at 06:17:36PM -0500, Tom Morris wrote: > - What tools and documentation are available to help with query optimization? I've just started http://wiki.freebase.com/wiki/Query_optimization Everyone please feel free to add to it :-) Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From tfmorris at gmail.com Tue Nov 17 12:03:09 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 17 Nov 2009 07:03:09 -0500 Subject: [Developers] Query timeout counting books Message-ID: Why does this query ?[{"type":"/book/book", "timestamp<=":"2006-10-22T08:49:31", "return":"count" }] time out, while the following returns an answer when the timestamp criterium is only 1 second different? ?[{"type":"/book/book", "timestamp<=":"2006-10-22T08:49:30", "return":"count" }] Tom From sm at metaweb.com Tue Nov 17 16:41:41 2009 From: sm at metaweb.com (Scott Meyer) Date: Tue, 17 Nov 2009 08:41:41 -0800 Subject: [Developers] mqlreaditer timeout In-Reply-To: References: <554723b0911161449j72ce1c1tb19a6eaf4d150b7a@mail.gmail.com> <4B01EC46.1080002@metaweb.com> Message-ID: <4B02D245.8030706@metaweb.com> Tom Morris wrote: >>> - Why aren't query complexity limits deterministic? >> What sort of determinism do you want? Deterministic response or >> deterministic effort? We started out with the former (it was >> easy to implement) and are migrating towards the latter. > > Ideally I want a query that worked when I debugged it to work 100% of > the time and for all eternity. Doing quotas based on resources used > rather than elapsed time would probably fix 90%+ of the cases that I'm > interested in. Hopefully a similar strategy will be applied to the > Acre page time quota. https://bugs.freebase.com/browse/FREEBASE-1391 OK, we're already moving in the right direction. I've created a bug to chivvy us along. -Scott From stefano at metaweb.com Tue Nov 17 17:26:09 2009 From: stefano at metaweb.com (Stefano Mazzocchi) Date: Tue, 17 Nov 2009 09:26:09 -0800 Subject: [Developers] Example app that plots locations In-Reply-To: References: Message-ID: <4B02DCB1.1070305@metaweb.com> Paul Mackay wrote: > Hi, > > Can anyone suggest a good Acre app that shows a simple method of > plotting location topics onto a map? codesearch is your friend http://codesearch.freebaseapps.com/?q=maps.google.com -- Stefano Mazzocchi Application Catalyst Metaweb Technologies, Inc. stefano at metaweb.com ------------------------------------------------------------------- From jg at metaweb.com Tue Nov 17 21:49:52 2009 From: jg at metaweb.com (John Giannandrea) Date: Tue, 17 Nov 2009 13:49:52 -0800 Subject: [Developers] Query timeout counting books In-Reply-To: References: Message-ID: <1D332C13-47B0-4076-96A0-B16FAC043E20@metaweb.com> Tom Morris wrote: > Why does this query > ?[{"type":"/book/book", > "timestamp<=":"2006-10-22T08:49:31", > "return":"count" > }] > time out, while the following returns an answer when the timestamp > criterium is only 1 second different? That's a nice bug. The estimate counts are way off in the two queries. I filed GD-802 -jg From bryan at metaweb.com Tue Nov 17 23:05:57 2009 From: bryan at metaweb.com (Bryan Culbertson) Date: Tue, 17 Nov 2009 15:05:57 -0800 Subject: [Developers] Flagging Model aka Opinion Collections and Duplicate Collections Message-ID: Hey all, We are revisiting the flagging model that we use for Freebase. If you've never heard of an Opinion Collection feel free to ignore this email and continue with your day. However if you have any code that depends on it please send me an email (bryan at metaweb.com) so we can discuss migration. For those interested /freebase/opinion_collection and /freebase/ duplicate_collection have historically been what the client uses to mark a topic for deletion or for merge. I am proposing scrapping these and moving to a more consistent model which I'm calling /freebase/ review_flag. For the details see http://wiki.freebase.com/wiki/Review_Flag_Proposal Thanks, Bryan Culbertson -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091117/fb1e5b03/attachment.htm From kurt at spaceship.com Tue Nov 17 23:44:11 2009 From: kurt at spaceship.com (Kurt Bollacker) Date: Tue, 17 Nov 2009 15:44:11 -0800 Subject: [Developers] Flagging Model aka Opinion Collections and Duplicate Collections In-Reply-To: References: Message-ID: <20091117234411.GD2607@spaceship.com> On Tue, Nov 17, 2009 at 03:05:57PM -0800, Bryan Culbertson wrote: > For those interested /freebase/opinion_collection and /freebase/ > duplicate_collection have historically been what the client uses to > mark a topic for deletion or for merge. I am proposing scrapping these > and moving to a more consistent model which I'm calling /freebase/ > review_flag. For the details see > http://wiki.freebase.com/wiki/Review_Flag_Proposal As the creator of opinion collections and duplicate collections, I'd say that after 2.5 years, a refactoring is probably long overdue. However, I thought I'd share some of the reasoning that went into the original model. - The authority property was used to explicitly indicate the holder of the opinion rather than implicit as a Freebase user. The reasonaing was that there might be alogrithmic sources of that opinion not tied to a specific user. Remember, this was built before we had a stable "attribution" model. - Opinion collections were not originally intended to be limited to a single topic for non-merge cases. It was thought that perhaps there was some dependency between multiple flags (i.e. Topic A should be deleted and topic B should be split into A' and B'). In reality, these complex cases turned out to be too rare to be worth the extra representational cost. The new proposal does not represent these dependencies. Overall, however, I like the new model. It is simpler and easier. Fascinating how much real world usage teaches you. Kurt :-) From philip-freebase at shadowmagic.org.uk Sun Nov 22 12:49:53 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Sun, 22 Nov 2009 12:49:53 +0000 Subject: [Developers] Ask Freebase a question Message-ID: <20091122124953.GO18508@sphinx.mythic-beasts.com> As people here are hopefully aware, Freebase isn't a "do what I mean" service... but that doesn't mean you can't build one using Freebase. http://askfreebase.freebaseapps.com/ or if you want to do something with the results yourself: http://askfreebase.freebaseapps.com/json?service=parse&q=What%20is%20the%20population%20of%20China? http://askfreebase.freebaseapps.com/json?service=fetch&subject=China&predicate=population or to do it in one step: http://askfreebase.freebaseapps.com/json?service=answer&q=What%20is%20the%20population%20of%20China? Note that (in particular) the question parsing is quite spectacularly dumb. Anyone who wants to contribute a better algorithm is more than welcome :-) Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/ From jason at metaweb.com Sun Nov 22 23:50:40 2009 From: jason at metaweb.com (Jason Douglas) Date: Sun, 22 Nov 2009 15:50:40 -0800 Subject: [Developers] save failure in app editor Message-ID: <6F7AE3F5-C49A-4DF6-949C-298A16F8375C@metaweb.com> just following instructions: { "code" : "/api/status/error", "messages" : [ { "code" : "/api/status/error/mql/result", "info" : { "subclass" : "OUTDATED" }, "message" : "Write partially complete (locking failure) -- please report this to developers at freebase.com", "path" : "content", "query" : { "content" : { "connect" : "update", "id" : "/guid/9202a8c04000641f800000001175117c" }, "id" : "/user/jdouglas/acre/test", "type" : "/common/document", "updated" : { "connect" : "update", "value" : "2009-11-22T23:42:44.396646Z" } } }, { "code" : "/service/external", "message" : "Error fetching external URL" } ], "status" : "400 Bad Request", "transaction_id" : "cache;cache02.p01.sjc1:8101;2009-11-22T23:42:43Z;0028" } From spencerkelly86 at gmail.com Mon Nov 23 05:38:09 2009 From: spencerkelly86 at gmail.com (Spencer Kelly) Date: Mon, 23 Nov 2009 00:38:09 -0500 Subject: [Developers] Ask Freebase a question In-Reply-To: <20091122124953.GO18508@sphinx.mythic-beasts.com> References: <20091122124953.GO18508@sphinx.mythic-beasts.com> Message-ID: > Anyone who wants to contribute a better algorithm is more than > welcome :-) > im so your guy. i cloned hey freebase a while back and have been hacking at it pretty hard. http://westport.freebaseapps.com/ lets work together things mine does well- uses a 500 or so property aliases ('/people/person/profession = 'job' etc) http://www.freebase.com/view/base/natlang/property_alias/ and growing. (i did them yesterday while watching dexter) you can run it in ubiquity - http://www.spencerwaterbed.com/soft/ubiquity/westport.html supports some alternate query forms- heres the algorythm its using so far: if it is one word, assume its a topic if it has the middle word 'of', assume its [property] of [topic] if it has an 'apostrophe s', try [topic]'s [property] else, permutate the words, use the first good match its not perfect, and has many bugs yet. plan to write something for ambiguous queries like 'length of the titanic', but want to keep it quick. plan to toss harder collection queries (like 'brunette cheerleaders') at cubed.freebaseapps.com. but agree there is defenetly a niche for quick, one-off answers to simple property-topic questions. shawn also has something running of this nature - http://answers.freebaseapps.com i'll add you as an author, let me stabilise it first, maybe tonight. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091123/1e751dd9/attachment.htm From jg at metaweb.com Mon Nov 23 06:18:50 2009 From: jg at metaweb.com (John Giannandrea) Date: Sun, 22 Nov 2009 22:18:50 -0800 Subject: [Developers] Ask Freebase a question In-Reply-To: References: <20091122124953.GO18508@sphinx.mythic-beasts.com> Message-ID: <3EC89302-1902-48C9-B571-59B381440682@metaweb.com> Spencer Kelly wrote: > uses a 500 or so property aliases ('/people/person/profession = > 'job' etc) http://www.freebase.com/view/base/natlang/property_alias/ > and growing. perhaps there is a way to use wordnet for this, for example: http://wordnet.freebaseapps.com/index?word=profession leads to: http://wordnet.freebaseapps.com/synset?synset=/user/jamie/wordnet/synset/100609953 -jg From jg at metaweb.com Mon Nov 23 06:23:17 2009 From: jg at metaweb.com (John Giannandrea) Date: Sun, 22 Nov 2009 22:23:17 -0800 Subject: [Developers] save failure in app editor In-Reply-To: <6F7AE3F5-C49A-4DF6-949C-298A16F8375C@metaweb.com> References: <6F7AE3F5-C49A-4DF6-949C-298A16F8375C@metaweb.com> Message-ID: <9597ABF3-9896-403B-8C13-534D9BC08A8B@metaweb.com> thanks. being tracked in MQL-592. -jg On Nov 22, 2009, at 3:50 PM, Jason Douglas wrote: > "status" : "400 Bad Request", > "transaction_id" : > "cache;cache02.p01.sjc1:8101;2009-11-22T23:42:43Z;0028" From kurt at spaceship.com Mon Nov 23 06:58:24 2009 From: kurt at spaceship.com (Kurt Bollacker) Date: Sun, 22 Nov 2009 22:58:24 -0800 Subject: [Developers] Ask Freebase a question In-Reply-To: References: <20091122124953.GO18508@sphinx.mythic-beasts.com> Message-ID: <20091123065824.GL8793@spaceship.com> I'm excited to see a long-ago-anticipated app like this finally appear. My pet feature would be to build a database of language syntactic patterns to be mapped to MQL queries. Examples include: Who are the cousins of Ben Stiller? Who are actors married to actors? Who are the republican presidents? These mappings would be topics (CVTs?) in themselves, and thus could be collaboratively collected. Kurt :-) On Mon, Nov 23, 2009 at 12:38:09AM -0500, Spencer Kelly wrote: > > Anyone who wants to contribute a better algorithm is more than > > welcome :-) > > > > im so your guy. i cloned hey freebase a while back and have been hacking at > it pretty hard. > http://westport.freebaseapps.com/ > > lets work together > > things mine does well- > uses a 500 or so property aliases ('/people/person/profession = 'job' etc) > http://www.freebase.com/view/base/natlang/property_alias/ and growing. > (i did them yesterday while watching dexter) > > you can run it in ubiquity - > http://www.spencerwaterbed.com/soft/ubiquity/westport.html > > supports some alternate query forms- > heres the algorythm its using so far: > if it is one word, assume its a topic > if it has the middle word 'of', assume its [property] of [topic] > if it has an 'apostrophe s', try [topic]'s [property] > else, permutate the words, use the first good match > > its not perfect, and has many bugs yet. > plan to write something for ambiguous queries like 'length of the titanic', > but want to keep it quick. plan to toss harder collection queries (like > 'brunette cheerleaders') at cubed.freebaseapps.com. but agree there is > defenetly a niche for quick, one-off answers to simple property-topic > questions. > shawn also has something running of this nature - > http://answers.freebaseapps.com > > i'll add you as an author, let me stabilise it first, maybe tonight. > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From iainsproat at gmail.com Mon Nov 23 07:01:12 2009 From: iainsproat at gmail.com (Iain Sproat) Date: Mon, 23 Nov 2009 11:01:12 +0400 Subject: [Developers] Ask Freebase a question In-Reply-To: <20091123065824.GL8793@spaceship.com> References: <20091122124953.GO18508@sphinx.mythic-beasts.com> <20091123065824.GL8793@spaceship.com> Message-ID: On Mon, Nov 23, 2009 at 10:58 AM, Kurt Bollacker wrote: > > I'm excited to see a long-ago-anticipated app like this finally > appear. ?My pet feature would be to build a database of language > syntactic patterns to be mapped to MQL queries. ?Examples include: > > Who are the cousins of Ben Stiller? > Who are actors married to actors? > Who are the republican presidents? > > These mappings would be topics (CVTs?) in themselves, and thus could > be collaboratively collected. Views in Freebase are just that. Views are nodes typed with query, and are used to relate a question to MQL http://www.freebase.com/type/schema/freebase/query?domain=/freebase e.g. the view http://www.freebase.com/tools/explore/user/sprocketonline/default_domain/views/cities_also_typed_as_business_locations is saved as http://www.freebase.com/api/trans/raw/guid/9202a8c04000641f800000000abfd9cf Linking together various ways of asking the same question needs a bit more thought. Iain From kurt at spaceship.com Mon Nov 23 07:22:43 2009 From: kurt at spaceship.com (Kurt Bollacker) Date: Sun, 22 Nov 2009 23:22:43 -0800 Subject: [Developers] Ask Freebase a question In-Reply-To: References: <20091122124953.GO18508@sphinx.mythic-beasts.com> <20091123065824.GL8793@spaceship.com> Message-ID: <20091123072243.GM8793@spaceship.com> On Mon, Nov 23, 2009 at 11:01:12AM +0400, Iain Sproat wrote: > On Mon, Nov 23, 2009 at 10:58 AM, Kurt Bollacker wrote: > > > > I'm excited to see a long-ago-anticipated app like this finally > > appear. ?My pet feature would be to build a database of language > > syntactic patterns to be mapped to MQL queries. ?Examples include: > > > > Who are the cousins of Ben Stiller? > > Who are actors married to actors? > > Who are the republican presidents? > > > > These mappings would be topics (CVTs?) in themselves, and thus could > > be collaboratively collected. > > Views in Freebase are just that. Views are nodes typed with query, > and are used to relate a question to MQL > http://www.freebase.com/type/schema/freebase/query?domain=/freebase > > e.g. the view http://www.freebase.com/tools/explore/user/sprocketonline/default_domain/views/cities_also_typed_as_business_locations > is saved as > http://www.freebase.com/api/trans/raw/guid/9202a8c04000641f800000000abfd9cf > > Linking together various ways of asking the same question needs a bit > more thought. Cool. I didn't think of using views. Since a framework in which to place the language templates exists, the language syntax mapping is the interesting part. Kurt :-) > Iain > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers From steward5732 at gmail.com Mon Nov 23 21:48:54 2009 From: steward5732 at gmail.com (Steward) Date: Mon, 23 Nov 2009 13:48:54 -0800 Subject: [Developers] Freebase wex convert xml to html Message-ID: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> Hi, Thanks for providing the excellent freebase wex. Did any one know how to convert the articles "xml" back to "html"? Thanks, Steward -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091123/0195ca0a/attachment.htm From zenkat at metaweb.com Mon Nov 23 21:57:54 2009 From: zenkat at metaweb.com (Brian Karlak) Date: Mon, 23 Nov 2009 13:57:54 -0800 Subject: [Developers] Freebase wex convert xml to html In-Reply-To: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> References: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> Message-ID: On Nov 23, 2009, at 1:48 PM, Steward wrote: > Thanks for providing the excellent freebase wex. Did any one know > how to convert the articles "xml" back to "html"? Hi Steward -- The XML is not created from the HTML. It is created directly from the raw MediaWiki source format. There is no easy way to convert to HTML without the MediaWiki rendering engine. Brian From steward5732 at gmail.com Mon Nov 23 22:06:22 2009 From: steward5732 at gmail.com (Steward) Date: Mon, 23 Nov 2009 14:06:22 -0800 Subject: [Developers] Freebase wex convert xml to html In-Reply-To: References: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> Message-ID: <967233d20911231406k3b094125w99b8e01588d76d82@mail.gmail.com> Hi Brian, Thanks for the reply. Is this the MediaWiki rendering engine that you refer to? http://svn.wikimedia.org/svnroot/mediawiki/trunk/wiki2xml/php/xml2xhtml.php or there are others that I am not aware of the MediaWiki rendering engine that you specify. Thanks, Steward On Mon, Nov 23, 2009 at 1:57 PM, Brian Karlak wrote: > > > On Nov 23, 2009, at 1:48 PM, Steward wrote: > > > Thanks for providing the excellent freebase wex. Did any one know > > how to convert the articles "xml" back to "html"? > > Hi Steward -- > > The XML is not created from the HTML. It is created directly from the > raw MediaWiki source format. There is no easy way to convert to HTML > without the MediaWiki rendering engine. > > Brian > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091123/1b564d07/attachment.htm From zenkat at metaweb.com Tue Nov 24 17:32:18 2009 From: zenkat at metaweb.com (Brian Karlak) Date: Tue, 24 Nov 2009 09:32:18 -0800 Subject: [Developers] Freebase wex convert xml to html In-Reply-To: <967233d20911231406k3b094125w99b8e01588d76d82@mail.gmail.com> References: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> <967233d20911231406k3b094125w99b8e01588d76d82@mail.gmail.com> Message-ID: <9123387B-C31D-4452-808E-7113BC199B10@metaweb.com> On Nov 23, 2009, at 2:06 PM, Steward wrote: > Thanks for the reply. Is this the MediaWiki rendering engine that > you refer to? > http://svn.wikimedia.org/svnroot/mediawiki/trunk/wiki2xml/php/xml2xhtml.php > > or there are others that I am not aware of the MediaWiki rendering > engine that you specify. Hi Steward -- I believe that's the main version. There may be others that I am not aware of. Brian -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091124/4f7eb65f/attachment.htm From tfmorris at gmail.com Tue Nov 24 18:12:05 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 24 Nov 2009 13:12:05 -0500 Subject: [Developers] ETA on BFG return to service? Message-ID: Any ETA on when BFG will be back? It's been 503ing for a couple of days now. The MQL service was offline for a while too, so I just chalked it up to a generalized disturbance in the force, but MQL has been back for ~24 hrs. Tom From colin at metaweb.com Tue Nov 24 19:11:07 2009 From: colin at metaweb.com (Colin Evans) Date: Tue, 24 Nov 2009 11:11:07 -0800 Subject: [Developers] ETA on BFG return to service? In-Reply-To: References: Message-ID: <4E92B80F-E976-486C-B0EF-519045303918@metaweb.com> Hi Tom, I just reset it, it is back again. -Colin On Nov 24, 2009, at 10:12 AM, Tom Morris wrote: > Any ETA on when BFG will be back? It's been 503ing for a couple of > days now. The MQL service was offline for a while too, so I just > chalked it up to a generalized disturbance in the force, but MQL has > been back for ~24 hrs. > > Tom > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 3736 bytes Desc: not available Url : http://lists.freebase.com/pipermail/developers/attachments/20091124/0f862393/attachment.bin From tfmorris at gmail.com Tue Nov 24 20:31:29 2009 From: tfmorris at gmail.com (Tom Morris) Date: Tue, 24 Nov 2009 15:31:29 -0500 Subject: [Developers] ETA on BFG return to service? In-Reply-To: <4E92B80F-E976-486C-B0EF-519045303918@metaweb.com> References: <4E92B80F-E976-486C-B0EF-519045303918@metaweb.com> Message-ID: Thanks! Next time I guess I should ask right away. t. On Tue, Nov 24, 2009 at 2:11 PM, Colin Evans wrote: > Hi Tom, > I just reset it, it is back again. > > -Colin > > > On Nov 24, 2009, at 10:12 AM, Tom Morris wrote: > >> Any ETA on when BFG will be back? ?It's been 503ing for a couple of >> days now. ?The MQL service was offline for a while too, so I just >> chalked it up to a generalized disturbance in the force, but MQL has >> been back for ~24 hrs. >> >> Tom >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > From steward5732 at gmail.com Tue Nov 24 22:39:12 2009 From: steward5732 at gmail.com (Steward) Date: Tue, 24 Nov 2009 14:39:12 -0800 Subject: [Developers] Freebase wex convert xml to html In-Reply-To: <9123387B-C31D-4452-808E-7113BC199B10@metaweb.com> References: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> <967233d20911231406k3b094125w99b8e01588d76d82@mail.gmail.com> <9123387B-C31D-4452-808E-7113BC199B10@metaweb.com> Message-ID: <967233d20911241439m3c295c32o40b2fbfc8f2b0239@mail.gmail.com> Hi Brian, Thanks. I did try that source code but it give me error "Fatal error: Call to a member function get_namespace_id() on a non-object in xml2xhtml.php on line 274" I tested it out using only 3 lines of codes. Did you have the same problem also when using this? Thanks, Steward ====================================================== Image:Youth-soccer-indiana.jpgthumb300pxrightSport inchildhood.Association football, shown above, is ateam sportwhich also providessocial interaction.Image:Showjumping white horse.jpgthumb200pxrightShow Jumping, anEquestrianismequestriansport.Sportis an activity that is governed by a set ofregulation of sportrulesortraditioncustomsand often engaged incompetitively.SportSportscommonly refer to activities where thephysical capabilitiesof the competitor are the sole or primary determinant of the outcome (victorywinningor losing), but the term is also used to include activities such asmind sports(a common name for somecard gamesandboard gameswith little to noluckelement of chance) andmotor sportswhereattentionmental acuityor equipment quality are major factors. Sport is commonly defined as anorganized, competitive and skillfulphysical activityrequiring commitment andsportsmanshipfair play. Some view sports as differing from games based on the fact that there are usually higher levels of organization andProfit (economics)profit(not alwaysmoneymonetary) involved in sports. Accurate records are kept and updated for most sports at the highest levels, while failures and accomplishments are widely announced insport news.'; $temp = convert_xml_xhtml($xmlstring); print $xmlstring; ============================================== On Tue, Nov 24, 2009 at 9:32 AM, Brian Karlak wrote: > > On Nov 23, 2009, at 2:06 PM, Steward wrote: > > Thanks for the reply. Is this the MediaWiki rendering engine that you refer > to? > http://svn.wikimedia.org/svnroot/mediawiki/trunk/wiki2xml/php/xml2xhtml.php > > or there are others that I am not aware of the MediaWiki rendering engine > that you specify. > > > Hi Steward -- > > I believe that's the main version. There may be others that I am not aware > of. > > Brian > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091124/ed9af216/attachment-0001.htm -------------- next part -------------- A non-text attachment was scrubbed... Name: ConvertXML.zip Type: application/zip Size: 11475 bytes Desc: not available Url : http://lists.freebase.com/pipermail/developers/attachments/20091124/ed9af216/attachment-0001.zip From zenkat at metaweb.com Tue Nov 24 23:16:34 2009 From: zenkat at metaweb.com (Brian Karlak) Date: Tue, 24 Nov 2009 15:16:34 -0800 Subject: [Developers] Freebase wex convert xml to html In-Reply-To: <967233d20911241439m3c295c32o40b2fbfc8f2b0239@mail.gmail.com> References: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> <967233d20911231406k3b094125w99b8e01588d76d82@mail.gmail.com> <9123387B-C31D-4452-808E-7113BC199B10@metaweb.com> <967233d20911241439m3c295c32o40b2fbfc8f2b0239@mail.gmail.com> Message-ID: Hi Steward -- Unfortunately, the code you are using isn't from Freebase, so I can't help you out. We don't have a need internally to translate the Wikipedia XML to HTML, so we don't have any experience with this code. What exactly are you trying to do? Perhaps there is a simpler way to reach your goal. Brian On Nov 24, 2009, at 2:39 PM, Steward wrote: > Hi Brian, > > Thanks. I did try that source code but it give me error > "Fatal error: Call to a member function get_namespace_id() on a non- > object in xml2xhtml.php on line 274" > > I tested it out using only 3 lines of codes. Did you have the same > problem also when using this? > > Thanks, > Steward > > ====================================================== > > include 'xml2xhtml.php'; > > $xmlstring = 'Image:Youth-soccer- > indiana.jpgthumb300pxright part>Sport inchildhood link>.Association football, > shown above, is ateam sport link>which also providessocial > interaction. link>Image:Showjumping white horse.jpg target>thumb200pxright part>Show Jumping, an >Equestrianismequestrian link>sport. synthetic="true">Sportis an > activity that is governed by a set of >regulation of sportrules link>ortraditioncustom part>sand often engaged in >competitively. >Sport target>Sportscommonly refer to > activities where thephysical capabilities target>of the competitor are the sole or primary > determinant of the outcome (victory target>winningor losing), but the term > is also used to include activities such asmind > sports(a common name for some >card games >andboard games link>with little to noluck target>element of chance) and >motor sportswhere >attentionmental acuity link>or equipment quality are major factors. > Sport is > commonly defined as anorganized link>, competitive and skillfulphysical > activityrequiring commitment and >sportsmanshipfair play. sentence> Some view sports as differing from games based > on the fact that there are usually higher levels of organization > andProfit (economics)profit part>(not alwaysmoney target>monetary) involved in sports. > Accurate records are kept and updated for most sports at > the highest levels, while failures and accomplishments are widely > announced insport news. sentence>'; > > $temp = convert_xml_xhtml($xmlstring); > > print $xmlstring; > ============================================== > > > On Tue, Nov 24, 2009 at 9:32 AM, Brian Karlak > wrote: > > On Nov 23, 2009, at 2:06 PM, Steward wrote: > >> Thanks for the reply. Is this the MediaWiki rendering engine that >> you refer to? >> http://svn.wikimedia.org/svnroot/mediawiki/trunk/wiki2xml/php/xml2xhtml.php >> >> or there are others that I am not aware of the MediaWiki rendering >> engine that you specify. > > Hi Steward -- > > I believe that's the main version. There may be others that I am > not aware of. > > Brian > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091124/d1e51faa/attachment.htm From steward5732 at gmail.com Tue Nov 24 23:30:06 2009 From: steward5732 at gmail.com (Steward) Date: Tue, 24 Nov 2009 15:30:06 -0800 Subject: [Developers] Freebase wex convert xml to html In-Reply-To: References: <967233d20911231348l22e20791q76bea99ef535fa15@mail.gmail.com> <967233d20911231406k3b094125w99b8e01588d76d82@mail.gmail.com> <9123387B-C31D-4452-808E-7113BC199B10@metaweb.com> <967233d20911241439m3c295c32o40b2fbfc8f2b0239@mail.gmail.com> Message-ID: <967233d20911241530q4c81accah58085430ec7e968a@mail.gmail.com> Hi Brian, Thanks for the response. What I need is to extract Wikipedia HTML into its "sections". For example, a wikipedia topic call "Snake", it has several sections (Etymology, Evolution, Biology, Behaviour, etc). http://en.wikipedia.org/wiki/Snake What I try to do is to extract Wikipedia HTML so in my tables I have rows of data Etymology --> section html contents Biology --> section html contents Behaviour -> section html contents Since freebase already have wex, I thought I only need the last step where it will convert "xml" back to "html" just like wikipedia html page. Thanks again Brian, Steward On Tue, Nov 24, 2009 at 3:16 PM, Brian Karlak wrote: > > Hi Steward -- > > Unfortunately, the code you are using isn't from Freebase, so I can't help > you out. We don't have a need internally to translate the Wikipedia XML to > HTML, so we don't have any experience with this code. > > What exactly are you trying to do? Perhaps there is a simpler way to reach > your goal. > > Brian > > On Nov 24, 2009, at 2:39 PM, Steward wrote: > > Hi Brian, > > Thanks. I did try that source code but it give me error > "Fatal error: Call to a member function get_namespace_id() on a non-object > in xml2xhtml.php on line 274" > > I tested it out using only 3 lines of codes. Did you have the same problem > also when using this? > > Thanks, > Steward > > ====================================================== > > include 'xml2xhtml.php'; > > $xmlstring = > 'Image:Youth-soccer-indiana.jpgthumb300pxrightSport > inchildhood.Association > football, shown above, is ateam > sportwhich also providessocial > interaction.Image:Showjumping > white > horse.jpgthumb200pxrightShow > Jumping, > anEquestrianismequestriansport. synthetic="true">Sportis an activity > that is governed by a set ofregulation of > sportrulesortraditioncustomsand > often engaged > incompetitively. synthetic="true">SportSportscommonly > refer to activities where thephysical > capabilitiesof the competitor are the sole or > primary determinant of the outcome > (victorywinningor > losing), but the term is also used to include activities such > asmind sports(a common name > for somecard > gamesandboard > gameswith little to > noluckelement of chance) > andmotor > sportswhereattentionmental > acuityor equipment quality are major > factors. synthetic="true">Sport is commonly defined as > anorganized, competitive and > skillfulphysical > activityrequiring commitment > andsportsmanshipfair > play. Some view sports as differing from > games based on the fact that there are usually higher levels of organization > andProfit > (economics)profit(not > alwaysmoneymonetary) > involved in sports. Accurate records are kept and > updated for most sports at the highest levels, while failures and > accomplishments are widely announced insport > news.'; > > $temp = convert_xml_xhtml($xmlstring); > > print $xmlstring; > ============================================== > > > On Tue, Nov 24, 2009 at 9:32 AM, Brian Karlak wrote: > >> >> On Nov 23, 2009, at 2:06 PM, Steward wrote: >> >> Thanks for the reply. Is this the MediaWiki rendering engine that you >> refer to? >> >> http://svn.wikimedia.org/svnroot/mediawiki/trunk/wiki2xml/php/xml2xhtml.php >> >> or there are others that I am not aware of the MediaWiki rendering engine >> that you specify. >> >> >> Hi Steward -- >> >> I believe that's the main version. There may be others that I am not >> aware of. >> >> Brian >> >> _______________________________________________ >> Developers mailing list >> Developers at freebase.com >> http://lists.freebase.com/mailman/listinfo/developers >> >> > _______________________________________________ > > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > > > _______________________________________________ > Developers mailing list > Developers at freebase.com > http://lists.freebase.com/mailman/listinfo/developers > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.freebase.com/pipermail/developers/attachments/20091124/9a54f52f/attachment-0001.htm From chris at liftux.com Wed Nov 25 02:18:56 2009 From: chris at liftux.com (Chris Wallace) Date: Tue, 24 Nov 2009 20:18:56 -0600 Subject: [Developers] looking for quote on development work Message-ID: <6E89F7B4-2431-4808-8373-756E4F1E0884@liftux.com> Hi everyone, I am a designer looking for a quote on some freebase development work. We have a client looking for a ballpark estimate on a project we have coming up. The requirements haven't been fully defined but I do have some basic requirements. The client is looking for a WordPress plugin that will allow them to find content on Freebase based upon search terms they provide OR content from their blog articles. They want to be able to pull in and post content to their WordPress website as supplemental content. Here are the pages and modules that may be needed: Admin - Plugin Main Page - Allow admin user to search for content on freebase and then quickly select a piece of content, categorize it, and post it to the site. Admin - Post Edit Page Module - Allow admin user to view related content by company name or keywords from current post being edited, with the ability to post that content to a specific category and make it a related post. Consumer-Facing - Widget - Related content widget that shows the related content determined by the tools on the backend (defined by admin user). Please let me know if you have any questions! Thanks! From philip-freebase at shadowmagic.org.uk Wed Nov 25 08:29:12 2009 From: philip-freebase at shadowmagic.org.uk (Philip Kendall) Date: Wed, 25 Nov 2009 08:29:12 +0000 Subject: [Developers] /en namespace Message-ID: <20091125082912.GB18508@sphinx.mythic-beasts.com> As far as I can tell, no new keys have been added to the /en namespace since March. Assuming I'm correct :-) is there any plan for any to be added in the future? Cheers, Phil -- Philip Kendall http://www.shadowmagic.org.uk/