Read data from xml to dataset and shows error out of memory

kamal chhabra

Hi,

I have xml file, which can be goes upto 2GB.

i want to convert that xml file to dataset. i am using below code

DataSet ds = new DataSet();

ds.ReadXml(@"c:\TempFiles\feed.xml");

that gives me error

"exception of type 'system.outofmemoryexception' was thrown".

Please suggest me.

Thanks

Kamal

5 Replies

Know the answer? Post it — somebody with the same question will find it here.

Hi Kamal,

DataSet ds = new DataSet();

FileStream filestream = File.OpenRead(pathtofile);

BufferedStream buffered = new BufferedStream(filestream);

ds.ReadXml(buffered);

Raja T11y ago

Hi Kamal,

Try this code

DataSet ds = new DataSet();

FileStream filestream = File.OpenRead(pathtofile);

BufferedStream buffered = new BufferedStream(filestream);

ds.ReadXml(buffered);

and also checkout below urls

https://msdn.microsoft.com/en-us/library/ekw4dh3f.aspx

http://stackoverflow.com/questions/2667828/large-xml-files-in-dataset-outofmemory

kamal chhabra11y ago
Hi Raja, Thanks for reply. On my system. i have 4gb RAM, 32-bit operating system. i think we have to see on other side of dataset defaultcation like some predefined parameters. can you please suggest me around this. Thanks Kamal
Raja T11y ago
Hi Kamal,

I am not aware of any memory size limits to data tables - you might hit the process size ceiling if you are running as a 32bit process however (the 3GB of addressable memory).

The approach (caching the data into an in memory structure like a DataTable) is valid and makes sense.

Please check out below URL

https://social.msdn.microsoft.com/Forums/en-US/41e1b19a-b5ee-4cf2-ac1e-ff0c9a35b961/out-of-memory-exception-adonet-dataset?forum=adodotnetdataset