Exception of type 'System.OutOfMemoryException' was thrown.

Question

Hi, I have two csv files Say 'File1.csv" (# records 3239972) & "File2.csv" (# 8927549). So what I am doing Is I am polulating dataset by reading File Line by Line as. DataTable dtCsv = new DataTable(); int i = 0; foreach (var line in File.ReadLines(FilePath)) { DataRow dr = dtCsv.NewRow(); //Set dr for columns dtCsv.Rows.Add(dr); //add other rows } return dtCsv; ================== This works fine for 'File1.csv" (# records 3239972) but give an error 'System.OutOfMemoryException' after processing Row # 8147077 added to datatable Please help its nightmare for me and client is sitting on my head :(

Sanjay Sharma · Answer

Finally I resolved the issue. Resolution - Visual Studio (VS) build any application by default targeting 32-bit. This option can lead into 'OutOfMemoryException' ( Although limit is very Huge ). I have change the build target Platform to 64. Prefer 32 bit should kept UnChecked.

Amit Mohanty · Answer

Hey Sanjay try this. public DataTable GetDataFromCsv( string strFilePath) { string [] str = File.ReadAllLines(strFilePath); DataTable dt = new DataTable(); string [] temp = str[0].Split( ',' ); foreach ( string t in temp) { dt.Columns.Add(t.ToUpper(), typeof ( string )); } for ( int i = 1; i { string [] t = str[i].Replace( "\"" , "" ).Split( ',' ); dt.Rows.Add(t); } return dt; }

Rajanikant Hawaldar · Answer

Hi Sanjay read about this large size CSV https://medium.com/@nuno.caneco/c-file-readlines-vs-file-readalllines-4742d738064e

Sanjay Sharma · Answer

Rajnikant i am not sure is root cause of error is reading CSV file Or that data table is becoming huge

Rajanikant Hawaldar · Answer

Hi Sanjay, Try this way, https://www.codeproject.com/Articles/9258/A-Fast-CSV-Reader