| 02:01.28 | *** join/#storm infobot (~infobot@rikers.org) |
| 02:01.28 | *** topic/#storm is The Storm Python ORM - http://storm.canonical.com/ - 0.18 released! || Review branches: https://code.launchpad.net/storm/+activereviews || IRC logs: http://ibot.rikers.org/#storm/ || API documentation: http://people.canonical.com/~jkakar/storm/ |
| 04:52.06 | *** part/#storm bigdog (~scmikes@8.8.197.72) |
| 06:02.00 | *** join/#storm RaceCondition (~erik@82.131.63.26.cable.starman.ee) |
| 06:20.28 | *** join/#storm stub (~stub@125.24.130.25.adsl.dynamic.totbb.net) |
| 06:20.28 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
| 06:21.39 | *** join/#storm sidnei (~sidnei@189-30-35-35.cslce701.dsl.brasiltelecom.net.br) |
| 07:06.11 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
| 07:32.41 | *** join/#storm zmijunkie (~sascha@pd95b6fd9.dip0.t-ipconnect.de) |
| 07:34.20 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
| 08:01.01 | *** join/#storm bigjools (~quassel@canonical/launchpad/bigjools) |
| 09:45.25 | *** join/#storm jdobrien (~john@50-88-19-25.res.bhn.net) |
| 10:13.20 | *** join/#storm jkakar (~jkakar@135.Red-83-55-101.dynamicIP.rima-tde.net) |
| 11:48.44 | *** join/#storm stub (~stub@125.24.108.146.adsl.dynamic.totbb.net) |
| 11:48.44 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
| 12:08.37 | *** join/#storm danilos (~danilo@canonical/launchpad/danilos) |
| 12:12.33 | *** join/#storm danilos (~danilo@canonical/launchpad/danilos) |
| 12:12.50 | *** join/#storm danilo_ (~danilo@static-213-198-236-193.adsl.eunet.rs) |
| 12:47.02 | mgedmin | hi folks |
| 12:47.12 | mgedmin | I don't suppose Storm has an API for checking if a table exists? |
| 12:48.42 | marienz | mgedmin: I don't think so, unless it was added recently. It basically only runs create/read/update/delete queries for you and leaves schema management up to you. |
| 12:49.14 | marienz | (some schema management stuff was added recently, but I think you still just have to write a bit of sql) |
| 12:50.09 | mgedmin | I've just discovered the downside of store.execute('SELECT 1 FROM table_that_may_not_exist') in the middle of a transaction -- if postgresql throws an error, I must roll back everything |
| 12:50.18 | mgedmin | I suppose I can insert a commit before that, but it feels a bit unclean... |
| 12:50.36 | mgedmin | or I could hardcode the postgres-way of checking for table existence, after googling it up |
| 12:58.44 | marienz | what do you intend to do if the table's not there yet? |
| 12:59.06 | marienz | if you're going to create it it seems likely you'll need a bit of slightly postgres-smelling sql anyway |
| 13:03.59 | mgedmin | yep |
| 13:04.29 | mgedmin | next question: what's the fastest way to insert multiple rows of data? on the order of a few thousand |
| 13:05.01 | mgedmin | repeated store.execute('INSERT INTO x (la,la,la) VALUES (?,?,?)', (...)) takes about 4 seconds, which is not bad |
| 13:05.12 | mgedmin | but if there's a cheap way to make it faster, I'd appreciate it |
| 13:06.11 | *** join/#storm niemeyer (~niemeyer@12.236.237.2) |
| 13:07.04 | therve | mgedmin, the only thing on the top of my head is to use COPY |
| 13:07.53 | mgedmin | so, no DBAPI-like executemany() in storm? |
| 13:10.03 | *** join/#storm stub (~stub@125.24.108.146.adsl.dynamic.totbb.net) |
| 13:10.03 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
| 13:50.09 | *** join/#storm bigdog (~scmikes@8.8.197.72) |
| 13:51.52 | jkakar | mgedmin: You could set a savepoint and rollback to it... but that's a bit crap. :/ |
| 13:51.55 | *** part/#storm jkakar (~jkakar@135.Red-83-55-101.dynamicIP.rima-tde.net) |
| 13:51.57 | *** join/#storm jkakar (~jkakar@135.Red-83-55-101.dynamicIP.rima-tde.net) |
| 13:52.06 | mgedmin | better than rolling back everything! |
| 13:52.33 | mgedmin | plays "guess the API": store.savepoint() and store.rollback()? |
| 14:09.38 | *** join/#storm magmatt (~Matt@74-92-245-181-Utah.hfc.comcastbusiness.net) |
| 14:11.55 | jkakar | mgedmin: There's on support in Storm to manage PostgreSQL savepoints. |
| 14:12.19 | jkakar | mgedmin: You'll need to use store.execute for, probably, both the statement to set a savepoint and the one to rollback to it. |
| 14:12.32 | jkakar | mgedmin: If you use store.rollback you'll invalidate the cache, which you probably don't want to do. |
| 14:12.43 | jkakar | mgedmin: It might be easier to just run a simple select to discover which tables exist. |
| 14:14.19 | jkakar | mgedmin: Something like: SELECT table_name FROM information_schema.tables; |
| 14:17.15 | *** join/#storm jkakar (~jkakar@135.Red-83-55-101.dynamicIP.rima-tde.net) |
| 14:17.38 | *** part/#storm jkakar (~jkakar@135.Red-83-55-101.dynamicIP.rima-tde.net) |
| 14:17.42 | *** join/#storm jkakar (~jkakar@135.Red-83-55-101.dynamicIP.rima-tde.net) |
| 14:26.42 | mgedmin | yeah, I went with that in the end -- SELECT relname FROM pg_class WHERE lower(relname) = ? |
| 14:26.56 | mgedmin | (this ignores table namespaces, which I don't care about in this app) |
| 14:33.25 | jkakar | Ah, nice. |
| 14:55.00 | *** join/#storm jtv_ (u2720@gateway/web/irccloud.com/x-zjbfscflastnwtnt) |
| 16:35.11 | *** join/#storm keppla (~keppla@p4FD47BF1.dip.t-dialin.net) |
| 19:55.03 | *** join/#storm keppla1 (~keppla@p4FD459BA.dip.t-dialin.net) |
| 20:14.19 | *** join/#storm keppla (~keppla@p4FD46541.dip.t-dialin.net) |
| 20:25.14 | *** join/#storm jdobrien (~john@50-88-19-25.res.bhn.net) |
| 20:56.20 | *** join/#storm john__ (~john@50-88-19-25.res.bhn.net) |
| 21:44.11 | *** part/#storm stub (~stub@canonical/launchpad/stub) |
| 23:15.28 | *** part/#storm magmatt (~Matt@74-92-245-181-Utah.hfc.comcastbusiness.net) |