I have a problem that are beginning to annoy me beyond reason and besides I am running out of time and start to get desperat :-)
For my website (www.kjaerland.dk/DVD
) I download and decode several CSV and XML files daily for insertion into my MySQL database. However some of the XML files I need to get a hold of starts to get very large - in the area of 45MB and above which means that I start having problems loading them.
One of my limitations are that I have my site hosted externally (Microsoft server and MySQL 4.0) so I am not able to alter server settings to fit my needs.
I have this bit of sample code that I use for simple testing:
set objXML = Server.CreateObject("Msxml
objXML.async = false
objXML.setProperty "ServerHTTPRequest", true
. .... music_DK.xml")
Response.Write "<br><br><strong>" & objXML.parseError.reason & "</strong><br><br>"
Set NodeList = objXML.selectNodes("/cdon_
Response.Write NodeList.length & "<br>"
set objXML = nothing
It works fine on small XML files but when the size gets large I get an "Not enough storage is available to complete this operation." error and nothing gets loaded. I am not at all an XML expert so I might be overlooking something.
The only processing I need to do on the XML file is to get a few fields per product in the list and then insert it into my MySQL database. Nothing needs to be displayed.
Does anyone have a good idea of how to get around this "memory" limitation and get to those XML data that I so badly need inserted into my database. I have been playing a small bit with loading the XML with async set to true but didn't get close to that working and immediatly got XSL messed into it (and then it started to go beyond my limited knowledge of the XML world)...