Sounds like a transformers yell…”Transformers, Optimise!”
Anyways, thing to fix: all the CREATE TABLE AS SELECT…. create tables without keys. No key is definitely bad. Trying this for the one that really matters – the gene_term_related_citations query. EXPLAIN seems happier, but proof will be in the pudding (or [...]
Archive for April, 2007
Optimise
Posted in SQL, progress, todo on April 28, 2007 | Leave a Comment »
A cunning plan
Posted in SQL, progress on April 26, 2007 | Leave a Comment »
Time to get cracking on the optimisation. The dual plans are to
Expand the TF database with taxonids (and eventually load all of Entrez Gene)
Optimise queries using table indexes
Looks optimistic – I like orders of magnitude improvements.
Just hacked the Entrez Gene fetcher to extract the taxonid from the XML. I should look into [...]
Poster Snafus…
Posted in CGDN07, ISBI07 on April 25, 2007 | Leave a Comment »
I guess it’s the bane of any poster presenter – looking up at the poster and seeing a mistake on the poster. Now that I’ve made two (in about as many weeks), I think the realities of poster presenting strike home a bit more personally.
Maybe I’ve been working with computers a bit much, but being [...]
Related Articles – Pulling the Plug
Posted in SQL on April 24, 2007 | Leave a Comment »
Got back from CGDN, and the “genes to related articles” table creation querying was still stuck at “copying to tmp table”. Since that makes it a solid handful of days, I’m kind of scared as to exactly how big this table will be. So, in the spirit of not emptying disk partitions, I’ve pulled the [...]
Move Completed
Posted in blog on April 23, 2007 | Leave a Comment »
Interesting. First blog posting, and I’ve already confused my personal blog at TwinRAM with this one. Hopefully, once there’s a couple work related posts here, I’ll have no trouble keeping them separate. That, and keeping the two windows side by side is probably not such a good [...]