| 00:13.53 | *** join/#storm srichter (n=quassel@c-76-19-135-180.hsd1.ma.comcast.net) |
| 00:19.46 | *** join/#storm keppla1 (n=keppla@i577B19B7.versanet.de) |
| 00:23.54 | *** join/#storm jkakar (n=jkakar@S0106001ee57a879c.vc.shawcable.net) |
| 00:24.35 | *** join/#storm philiKON (n=philiKON@cpc3-broo2-0-0-cust103.renf.cable.ntl.com) |
| 01:22.46 | *** join/#storm shaunm (n=shaunm@c-98-212-133-244.hsd1.il.comcast.net) |
| 01:43.59 | *** join/#storm keppla (n=keppla@i577B109B.versanet.de) |
| 01:45.33 | *** join/#storm srichter_ (n=quassel@c-76-19-135-180.hsd1.ma.comcast.net) |
| 02:49.58 | *** join/#storm keppla1 (n=keppla@i577B3C56.versanet.de) |
| 03:04.46 | *** join/#storm keppla2 (n=keppla@i577B047A.versanet.de) |
| 03:35.11 | *** join/#storm webmaven (n=webmaven@c-68-35-25-63.hsd1.nm.comcast.net) |
| 03:37.14 | *** join/#storm srichter (n=quassel@c-76-19-135-180.hsd1.ma.comcast.net) |
| 07:21.38 | *** join/#storm jukart (i=lovely@81.189.156.94) |
| 07:23.48 | *** join/#storm quodt (i=lovely@81.189.156.94) |
| 09:00.02 | *** join/#storm keppla (n=keppla@i577B047A.versanet.de) |
| 09:06.42 | *** join/#storm zmijunkie_ (n=chatzill@i59F5E510.versanet.de) |
| 09:49.21 | *** join/#storm philiKON (n=philiKON@cpc3-broo2-0-0-cust103.renf.cable.ntl.com) |
| 10:03.00 | *** join/#storm Maximillion|away (n=Kevin@wikimedia/Maximillion-Pegasus) |
| 11:04.03 | *** join/#storm mikex2 (n=mikael@193.11.22.216) |
| 11:29.17 | *** join/#storm kazade (n=luke@81-144-192-162.evanspinner.mezzonet.net) |
| 11:30.57 | kazade | Hi all, I have an app that sends out emails to users in a loop. After each email is sent a flag is updated (using Storm) to record it. This is the only update that happens in the loop, but store.commit() takes about 2-3 seconds, which is way too slow. Anyone know what the cause might be? |
| 11:32.06 | therve | how many emails do you send? |
| 11:32.54 | kazade | several thousand, but the slow commit happens on all (even the first one sent) and is commit() is called after each one |
| 11:33.04 | kazade | The update line is simply: self._store.find(CandidateEzine, CandidateEzine.id == self._candidate_ezine_id).set(date_sent=datetime.datetime.now()) |
| 11:34.59 | kazade | incidentally, removing the call to store.commit() and manually running store.execute("COMMIT") speeds it up massively |
| 11:35.41 | kazade | but that solutions seems like it might potentially cause problems with storm if I'm shoving my own commits in |
| 11:38.58 | therve | storm is invalidating his cache after commit |
| 11:39.02 | kazade | I notice that store.commit() calls invalidate - it's possible that there are many objects in the store |
| 11:39.05 | kazade | ah :) |
| 11:39.10 | therve | so you probably have lots of objects in the cache |
| 11:39.15 | kazade | how can I "evict" objects from the cache? |
| 11:39.35 | therve | reduce the cache size, and delete references to them |
| 11:40.24 | kazade | how do I reduce the cache size? |
| 11:42.16 | therve | you pass a Cache object with a custom size to the store |
| 11:44.40 | kazade | ok, thanks |
| 11:45.25 | *** join/#storm philiKON (n=philiKON@gw-trusted.physics.gla.ac.uk) |
| 11:55.04 | kazade | therve, thanks, reorganizing the code so it doesn't store instances to the users made it work fine |
| 12:03.32 | *** join/#storm niemeyer (n=niemeyer@189.73.142.161) |
| 12:25.16 | *** join/#storm fcorrea (n=fcorrea@187.3.137.148) |
| 13:48.59 | *** join/#storm andrea-bs (n=andrea@ubuntu/member/beeseek.developer.andrea-bs) |
| 14:04.06 | *** join/#storm niemeyer_ (n=niemeyer@189.73.142.161) |
| 15:06.04 | *** join/#storm quodt (i=lovely@81.189.156.94) |
| 15:27.07 | *** join/#storm mikex2 (n=mikael@193.11.22.216) |
| 18:50.15 | *** join/#storm keppla (n=keppla@i577B1B01.versanet.de) |
| 19:07.49 | *** join/#storm infobot (i=ibot@rikers.org) |
| 19:07.49 | *** topic/#storm is The Storm Python ORM - http://storm.canonical.com/ - 0.16 released! || Review branches: https://code.launchpad.net/storm/+activereviews || IRC logs: http://ibot.rikers.org/#storm/ || API documentation: http://people.canonical.com/~jkakar/storm/ |
| 19:39.40 | *** join/#storm philiKON (n=philiKON@cpc3-broo2-0-0-cust103.renf.cable.ntl.com) |
| 19:50.30 | *** join/#storm Maximillion|away (n=Kevin@wikimedia/Maximillion-Pegasus) |
| 19:52.00 | *** join/#storm webmaven (n=webmaven@c-68-35-25-63.hsd1.nm.comcast.net) [NETSPLIT VICTIM] |
| 19:52.00 | *** join/#storm oubiwann (n=oubiwann@c-24-8-208-199.hsd1.co.comcast.net) [NETSPLIT VICTIM] |
| 19:52.00 | *** join/#storm jamesh (n=james@canonical/launchpad/jamesh) [NETSPLIT VICTIM] |
| 19:52.16 | *** join/#storm oubiwann_ (n=oubiwann@c-24-8-208-199.hsd1.co.comcast.net) |
| 19:52.46 | *** join/#storm mup_ (n=mup@207.192.73.90) |
| 19:55.13 | *** join/#storm mup (n=mup@li37-90.members.linode.com) [NETSPLIT VICTIM] |
| 20:19.50 | *** join/#storm fcorrea (n=fcorrea@187.3.137.148) |
| 20:24.16 | *** join/#storm thumper (n=quassel@125-236-193-95.adsl.xtra.co.nz) |
| 20:24.16 | *** join/#storm jkakar (n=jkakar@S0106001ee57a879c.vc.shawcable.net) |
| 20:56.33 | *** join/#storm Fodder (n=pajs@carrick.bishnet.net) [NETSPLIT VICTIM] |
| 20:56.33 | *** join/#storm danilos (n=danilo@canonical/launchpad/danilos) [NETSPLIT VICTIM] |
| 20:56.33 | *** join/#storm mzz (n=mzz@flits102-164.flits.rug.nl) [NETSPLIT VICTIM] |
| 20:56.33 | *** join/#storm maxb (n=maxb@80.68.92.224) [NETSPLIT VICTIM] |
| 20:56.51 | *** join/#storm danilo_ (n=danilo@static-213-198-236-193.adsl.eunet.rs) |
| 21:15.08 | *** join/#storm seiflotfy (n=seif@P5118.pallas.wh.tu-darmstadt.de) |
| 21:21.18 | *** join/#storm webmaven (n=webmaven@c-68-35-25-63.hsd1.nm.comcast.net) |
| 21:34.25 | *** join/#storm jamesh (n=james@canonical/launchpad/jamesh) [NETSPLIT VICTIM] |
| 21:36.39 | *** join/#storm thumper (n=quassel@125-236-193-95.adsl.xtra.co.nz) [NETSPLIT VICTIM] |
| 21:39.20 | *** join/#storm jamesh (n=james@canonical/launchpad/jamesh) [NETSPLIT VICTIM] |
| 21:54.30 | *** join/#storm jkakar (n=jkakar@S0106001ee57a879c.vc.shawcable.net) |
| 21:54.30 | *** join/#storm webmaven (n=webmaven@c-68-35-25-63.hsd1.nm.comcast.net) [NETSPLIT VICTIM] |
| 21:54.30 | *** join/#storm Fodder (n=pajs@carrick.bishnet.net) [NETSPLIT VICTIM] |
| 21:54.30 | *** join/#storm maxb (n=maxb@80.68.92.224) [NETSPLIT VICTIM] |
| 21:54.30 | *** join/#storm mzz (n=mzz@flits102-164.flits.rug.nl) |
| 22:20.39 | *** join/#storm Maximillion|away (n=Kevin@wikimedia/Maximillion-Pegasus) |