Exception of type 'System.OutOfMemoryException' was thrown.

Sanjay Sharma

Hi,

I have two csv files Say 'File1.csv" (# records 3239972) & "File2.csv" (# 8927549).

So what I am doing Is I am polulating dataset by reading File Line by Line as.

DataTable dtCsv = new DataTable();

int i = 0;

foreach (var line in File.ReadLines(FilePath))

{

DataRow dr = dtCsv.NewRow();

//Set dr for columns

dtCsv.Rows.Add(dr); //add other rows

}

return dtCsv;

==================

This works fine for 'File1.csv" (# records 3239972)

but give an error 'System.OutOfMemoryException' after processing Row # 8147077 added to datatable

Please help its nightmare for me and client is sitting on my head :(

5 Replies

Know the answer? Post it — somebody with the same question will find it here.

Sanjay Sharma7y ago
Finally I resolved the issue.

Resolution - Visual Studio (VS) build any application by default targeting 32-bit. This option can lead into 'OutOfMemoryException' (Although limit is very Huge).

I have change the build target Platform to 64.
Prefer 32 bit should kept UnChecked.
Amit Mohanty7y ago
Hey Sanjay try this.
public DataTable GetDataFromCsv(string strFilePath)
{
    string[] str = File.ReadAllLines(strFilePath);
    DataTable dt = new DataTable();
    string[] temp = str[0].Split(',');
    foreach (string t in temp)
    {
        dt.Columns.Add(t.ToUpper(), typeof(string));
    }
    for (int i = 1; i < str.Length; i++)
    {
        string[] t = str[i].Replace("\"", "").Split(',');
        dt.Rows.Add(t);
    }
    return dt;
}
Rajanikant Hawaldar7y ago
Hi Sanjay read about this large size CSV
https://medium.com/@nuno.caneco/c-file-readlines-vs-file-readalllines-4742d738064e
Sanjay Sharma7y ago
Rajnikant i am not sure is root cause of error is reading CSV file Or that data table is becoming huge
Rajanikant Hawaldar7y ago
Hi Sanjay, Try this way,
https://www.codeproject.com/Articles/9258/A-Fast-CSV-Reader