| 00:18.29 | Baanano | it seems to work :) |
| 00:28.02 | Baanano | >_< Torhal what have you done to my svn repositories? |
| 00:28.28 | Torhal | Baanano: Nothing. What's up? |
| 00:28.53 | Baanano | i'm getting the uuid changed error |
| 00:29.32 | Torhal | Baanano: http://www.curseforge.com/announcements/subversion-rollbacks-for-a-subset-of-repositories/ |
| 00:29.43 | Torhal | That was quite awhile ago. |
| 00:31.03 | Baanano | i hadn't commited to this one since nov 01, thank you for the link |
| 01:10.30 | Torhal | :) |
| 04:10.14 | seebs | C:/Users/games/Documents/RIFT\UI.dat |
| 04:10.24 | seebs | Slashes: Still hard after all these years. |
| 06:01.15 | *** join/#riftuidev starlon (~starlon@tx-184-6-178-133.dhcp.embarqhsd.net) |
| 06:01.54 | *** join/#riftuidev starlon (~starlon@95.211.139.147) |
| 07:03.42 | *** join/#riftuidev starlon (~starlon@95.211.149.153) |
| 08:21.37 | *** join/#riftuidev starlon (~starlon@95.211.188.52) |
| 10:04.07 | *** join/#riftuidev Noshei (~quassel@c-67-161-146-244.hsd1.co.comcast.net) |
| 12:21.51 | ZorbaTHut | I use forward slashes almost exclusively because it turns out windows will happily accept them |
| 12:22.54 | *** join/#riftuidev Imhothar (~miranda@ppp-188-174-10-58.dynamic.mnet-online.de) |
| 14:38.02 | *** join/#riftuidev Imhothar (~miranda@ppp-88-217-32-218.dynamic.mnet-online.de) |
| 15:22.18 | *** join/#riftuidev Wildtide (0fe3b94c@gateway/web/freenode/ip.15.227.185.76) |
| 15:22.48 | Wildtide | afternoon folks |
| 15:22.55 | Noshei | hey ther ewild |
| 15:23.42 | Wildtide | level 58.2 and counting... i'll be able to start coding again soon :) |
| 15:25.01 | Noshei | 59 and 60 take forever |
| 15:25.14 | Wildtide | thanks for telling me that :( |
| 15:25.55 | Wildtide | clearly, Zorba needs to arrange for me to receive a giant pot of XP in the mail |
| 15:26.23 | Noshei | ikr |
| 17:50.47 | *** join/#riftuidev Noshei (~quassel@c-67-161-146-244.hsd1.co.comcast.net) |
| 18:36.52 | *** join/#riftuidev Baanano_ (~chatzilla@137.pool85-53-182.dynamic.orange.es) |
| 18:39.19 | *** join/#riftuidev Baanano__ (~chatzilla@137.pool85-53-182.dynamic.orange.es) |
| 18:47.52 | *** join/#riftuidev Imhothar (~miranda@ppp-88-217-32-218.dynamic.mnet-online.de) |
| 18:59.30 | *** join/#riftuidev Noshei_ (~quassel@c-67-161-146-244.hsd1.co.comcast.net) |
| 19:01.52 | *** join/#riftuidev Baanano (~chatzilla@137.pool85-53-182.dynamic.orange.es) |
| 19:01.52 | *** join/#riftuidev lcd (~starlon@melody.lyrical.net) |
| 20:34.42 | *** join/#riftuidev Baanano (~chatzilla@137.pool85-53-182.dynamic.orange.es) |
| 21:26.14 | *** join/#riftuidev Mortelugo (0219cb51@gateway/web/freenode/ip.2.25.203.81) |
| 21:26.20 | Mortelugo | evening |
| 21:26.29 | Imhothar | hi |
| 21:27.48 | Mortelugo | despite my google-fu, have been unable to find a recent/decent solution to this, hoping someone here might hve some insight. Basically, has anyone found an easy and reliable way to process the enormouse Items.xml file? |
| 21:29.00 | Mortelugo | ideally i'd like to end up with the data (or a subset of it) in a MySQL database |
| 21:29.09 | Imhothar | If you aren't scared of geting your hands dirty I'd suggest to write your own parser using libxml/Tinyxml, C#, etc |
| 21:29.25 | Imhothar | add libmysql to that and you can push it to a table as you need to |
| 21:29.27 | Mortelugo | have been experimenting with PHPs XMLReader and simplexml combo |
| 21:30.00 | Mortelugo | but lacking a bit in experience with xml manipulation, especially on files this size |
| 21:30.01 | Imhothar | if you have enough RAM you might be able to just load the entire DOM. If that doesn't work you'd probably have to use a SAX parser |
| 21:30.22 | Mortelugo | enough RAM being roughly? |
| 21:30.30 | Imhothar | or make an XSLT file to translate the XML to something different |
| 21:30.37 | Imhothar | hmm file size * 2 |
| 21:30.44 | Imhothar | just to be sure |
| 21:30.53 | Mortelugo | ah, definitely enough then |
| 21:31.01 | Mortelugo | got 8gb |
| 21:31.20 | Imhothar | hmm thinking about it |
| 21:31.27 | Imhothar | an XSLT processor might be easier |
| 21:31.54 | Mortelugo | just gonna try opening it in openoffice |
| 21:32.06 | Imhothar | good luck |
| 21:32.12 | Mortelugo | hmm didnt like that |
| 21:32.15 | Imhothar | even Notepad++ has it's problems with items.xml |
| 21:32.16 | Mortelugo | xD |
| 21:32.22 | Mortelugo | yeah tried that at work |
| 21:32.28 | Mortelugo | 'Too big!! |
| 21:32.35 | Imhothar | do you knoe XSLT? |
| 21:32.43 | Mortelugo | unfortunately not |
| 21:32.45 | Imhothar | http://en.wikipedia.org/wiki/XSLT |
| 21:32.48 | Mortelugo | a very bit of basic xpath |
| 21:34.08 | Mortelugo | http://forums.riftgame.com/rift-general-discussions/addon-api-development/336167-how-deal-500mb-items-xml.html#post3992486 |
| 21:34.13 | Mortelugo | somehing like that I guess |
| 21:39.19 | Mortelugo | do still need to be able to edit the Items.xml though to add the XLST in it looks like :p |
| 21:42.22 | Noshei | yeah, but it is a simple 1 line edit at the top of the fil,e |
| 21:43.17 | Mortelugo | best program to open it? :p |
| 21:43.29 | Mortelugo | never dealt with files of this size |
| 21:43.31 | Noshei | I use stylus studio x14 |
| 21:44.26 | Imhothar | Notepad++ definitely can open the file, but it takes ages |
| 21:46.47 | Noshei | yeah of all the different programs I tried out stylus worked the best |
| 21:47.04 | Mortelugo | free trial though for stylus |
| 21:50.48 | Mortelugo | notepad++ doesn't even try to load it, errors with a too big |
| 21:50.56 | Mortelugo | silly program :p |
| 21:51.05 | Imhothar | mhmm I thought it worked |
| 21:53.21 | Mortelugo | oh wow |
| 21:53.24 | Mortelugo | opens instantly with vim |
| 21:58.15 | Mortelugo | will be using that again :p |
| 21:58.35 | Noshei | with what? |
| 21:58.47 | Baanano | in my experience, preprocessing it to delete all the firstlootedby stuff helps a lot |
| 21:59.32 | *** join/#riftuidev Mortelugo_ (0219cb51@gateway/web/freenode/ip.2.25.203.81) |
| 21:59.42 | Mortelugo_ | ouch |
| 22:00.14 | Mortelugo_ | think ill work on a subset of the data while i refine th XSL |
| 22:05.41 | Baanano | Mortelugo: [23:00]Baananoin my experience, preprocessing it to delete all the firstlootedby stuff helps a lot |
| 22:06.26 | Baanano | i have a copy without those nodes of the 2012-11-28 discoveries file, if you want it |
| 22:09.07 | Mortelugo | as .xml? |
| 22:09.30 | Mortelugo | that would be very helpful :) |
| 22:09.48 | Baanano | ok, let me upload it somewhere |
| 22:10.21 | Baanano | do you want the xslt file too? |
| 22:11.06 | Mortelugo | <3 |
| 22:11.11 | Mortelugo | that would be seriously awesome |
| 22:11.20 | Mortelugo | you got dropbox? |
| 22:12.04 | Baanano | no, i usually upload things to filefactory |
| 22:15.15 | Mortelugo | works either way :) |
| 22:19.33 | Baanano | it's been uploaded very slowly, might take a while |
| 22:20.53 | Mortelugo | haha np :) |
| 22:20.56 | Mortelugo | very much appreciate it |
| 22:21.05 | Mortelugo | will definitely learn a lot from the XSLT |
| 22:22.11 | Baanano | it's a very simple xslt: copy everything recursively except FirstLootedBy nodes |
| 22:25.40 | Mortelugo | :) |
| 22:26.07 | Mortelugo | still something to leanr from though :) |
| 22:26.14 | Mortelugo | always work best by tinkering with something :D |
| 22:26.48 | Baanano | can i ask what do you want to do with the items.xml file? |
| 22:31.03 | Baanano | http://www.filefactory.com/file/1l63qf4ocx97/n/ItemsClean.zip |
| 22:31.53 | Mortelugo | yeah sure |
| 22:32.02 | Mortelugo | basically i want to import into a SQL db |
| 22:32.17 | Mortelugo | so i can try my hand at making a gear 'explorer' of sorts |
| 22:32.31 | Mortelugo | eventually being able to sort gear based on customisable stat weights |
| 22:32.47 | Mortelugo | thanks for the file btw :) |
| 22:33.20 | Baanano | np |
| 22:34.34 | Mortelugo | wow thats a lot smaller :D |
| 22:34.37 | Mortelugo | thanks a lot |
| 22:35.07 | Baanano | hope it helps you :) |
| 22:35.19 | Mortelugo | definitely think it will |
| 22:38.21 | *** join/#riftuidev Mortelugo_ (0219cb51@gateway/web/freenode/ip.2.25.203.81) |
| 22:41.20 | Mortelugo_ | bloody browser |
| 22:41.28 | Mortelugo_ | still didnt like trying to open the clean.xml directly |
| 22:41.35 | Mortelugo_ | :p |
| 22:42.36 | Baanano | :( |
| 22:42.42 | Mortelugo_ | opened in notepad++ though |
| 22:44.42 | Mortelugo_ | well, hopefully anyway |
| 22:45.28 | Baanano | still too much data? |
| 22:46.08 | Mortelugo_ | not sure |
| 22:46.14 | Mortelugo_ | maybe just takes a while |
| 22:52.37 | Mortelugo_ | ah yay loaded |
| 22:52.44 | Mortelugo_ | 2.6mil lines :p |
| 23:30.21 | Mortelugo_ | man this XSl stuff is confusing |
| 23:37.48 | Baanano | why? |
| 23:43.41 | Mortelugo_ | just all these tags to learn etc :p |
| 23:43.51 | Mortelugo_ | ive got it 'working' to a basic extent |
| 23:43.58 | Mortelugo_ | though for some reason the output doesnt show tags |
| 23:44.27 | Mortelugo_ | ie XML tags |
| 23:45.17 | Mortelugo_ | http://pastebin.com/vgU5tTsS |
| 23:47.10 | Mortelugo_ | anything glaringly wrong with that do you think? |
| 23:50.40 | Noshei | nope, looks good |
| 23:53.17 | Baanano | it works fine for me |
| 23:54.15 | Baanano | (it's processing items that aren't armors too, but you haven't filtered them out in your xslt file) |
| 23:54.24 | Noshei | ZorbaTHut: any changes for us on latest PTS build? |
| 23:56.18 | Noshei | http://pastebin.com/S4z6Wrg1 |
| 23:56.24 | Noshei | that might save you some time |
| 23:56.48 | Noshei | I use it to filter out items for my DPS/healing spreadsheet |