Binary file through C#

Sahil Dev

I amn writing a binary file.

My problem is in my machine after I write the file to 2GB the writing of the file gets stuck and nothing gets written. The input output operation stops.

I don't have a RAM problem or a disc space problem. My RAM is 48 GB and have sevral GB disc space free.

I really need to sort this. Can anyone please help why this occurs?

21 Replies

Know the answer? Post it — somebody with the same question will find it here.

Ramesh Palaniappan10y ago
C# program that uses BinaryWriter
using System.IO;
class Program
{
static void Main()
{
W();
}
static void W()
{
// Create 12 integers.
int[] a = new int[]
{
1, 4, 6, 7, 11, 55, 777, 23, 266, 44, 82, 93 };
// Use using statement and File.Open.
using (BinaryWriter b = new BinaryWriter( File.Open("file.bin", FileMode.Create)))
{
// Use foreach and write all 12 integers.
foreach (int i in a)
{
b.Write(i);
}
}
}
}
Ali Haider10y ago
C# program that uses BinaryWriter
using System.IO;
class Program
{
static void Main()
{
W();
}
static void W()
{
// Create 12 integers.
int[] a = new int[]
{
1, 4, 6, 7, 11, 55, 777, 23, 266, 44, 82, 93 };
// Use using statement and File.Open.
using (BinaryWriter b = new BinaryWriter( File.Open("file.bin", FileMode.Create)))
{
// Use foreach and write all 12 integers.
foreach (int i in a)
{
b.Write(i);
}
}
}
}
Sahil Dev10y ago
How/where did you get the eventviewer screenshot from?
Tapan Patel10y ago
Insert try catch block where you start writing bytes to file or while creating new line to file.
this.FileRep.WriteNBytes(nbytes);
Tapan Patel10y ago
I would still suggest to add Try Catch first in your code and see where it fails.

It is utility by windows where all events happening in current machine gets recorded.
Take a look at below screenshot. Look for something that has Error level immediately after you try running the program. (Be patient while it loads as there would be thousands of events data to be loaded)..
Sahil Dev10y ago
Hi Tapan,
Can you advise where to put the try catch block? Also about the event viewer?
Sahil Dev10y ago
Thanks, sorry I did not get about the event viewer? Where to look for that?
Tapan Patel10y ago
if .NET 4.5 is the issue, then you would get something as an exception.
Also, there is no TRY/CATCH block in your code. try adding some , then only you will get an exception.
Did you find anything in Event Viewer?
Sahil Dev10y ago
No exception. IT just stops to work (that is nothing gets written into the file)after generating file size of 1.5GB
On another machine, it stopsafter generating file size of 2GB
Tapan Patel10y ago
Your code looks okay but is it throwing any exception?
Try debugging the code (with setting as, Break on All Exceptions) and see if it hits any exception). At the same time, go through event viewer if OS is throwing any error which is not captured in CLR.
Sahil Dev10y ago
MAnas/Tapan,
Tapan: I posted my code as you advised
MAnas: I replied to your questions regarding the links.
Tapan/MAnas: Do you think NOT having .NET 4.5 is the reason for the problem?
Sahil Dev10y ago
1. //HereIbeginwriting
3. writer.WriteFEM(meshedResults,Path.Combine(OuputsPath,"WithPlasticStrains.fem"));
5. publicvoidWriteFEM(ITemporalMeshedResultsresults,stringfilename)
6. {
7. this.filename=filename;
8. this.FileRep=newBinaryItemFileWriter(filename);
12. this.Write(results);
13. }
15. privatevoid
17. Write(ITemporalMeshedResultsresults)
18. {
19. this.FileRep.Close();
21. if(File.Exists(this.filename))
22. {
23. File.Delete(this.filename);
24. }
26. this.FileRep.Open();
29. //nontimebasedresults:
31. if(ItemsToWrite.Contains(ItemKeywords.NodalCoordinates))
32. {
33. this.WriteNodalCoordinates(results.Mesh.Nodes);
35. }
36. if(ItemsToWrite.Contains(ItemKeywords.NodeLabels))
37. {
38. this.WriteNodeLabels(results.Mesh.Nodes);
40. }
41. if(ItemsToWrite.Contains(ItemKeywords.Topology))
42. {
43. this.WriteTopology(results.Mesh);
44. }
45. if(ItemsToWrite.Contains(ItemKeywords.ElementData))
46. {
47. this.WriteElementData(results.Mesh.Elements);
49. }
52. int[]navstrs=this.WriteOutputLocationRelatedItems(results.Mesh.Elements,results.Mesh,refiavstrs);
53. int[]iavstrsArray=iavstrs.ToArray();
56. //timebasedresults
57. foreach(vartimePointinresults.TimePointManager.TimePoints)
58. {
59. intramp;
60. intstep=1;
62. if(timePoint.SubSteps.Count>=2)
63. {
64. ramp=timePoint.SubSteps[0];
65. step=timePoint.SubSteps[1];
66. }
67. elseif(timePoint.SubSteps.Count==1)
68. {
69. ramp=timePoint.SubSteps[0];
70. }
71. else
72. {
73. ramp=timePoint.TP;
74. }
76. if(ItemsToWrite.Contains(ItemKeywords.CaseData))
77. {
78. if(timePoint.SubSteps.Count>=2)
79. {
80. this.WriteCaseData(timePoint.Time,0.0,ramp,step,0);
81. }
85. privatevoidWriteNodalCoordinates(INode[]nodes)
86. {
87. ItemRecorditem=newItemRecord();
88. item.SetName(EnumMethods.GetStringValue(ItemKeywords.NodalCoordinates));
89. item.It=2;
91. intnn=nodes.Length;
93. //item.N1=coords.Length/3;//cols
94. //item.N2=3;//rows
96. double[]coords=newdouble[nn*3];
97. for(inti=0;i
98. {
99. coords[i*3]=nodes[i].Coordinates.X;
100. coords[i*3+1]=nodes[i].Coordinates.Y;
101. coords[i*3+2]=nodes[i].Coordinates.Z;
102. }
104. item.N1=3;//cols
105. item.N2=nn;//rows
107. item.N3=0;
108. item.DData=coords;
109. this.WriteHeader(item);
110. this.WriteItem(item);
111. }
113. publicvoidWriteItem(ItemRecorditem)
114. {
115. RR.Utility.Logger.InternalLogger.WriteLine("WritingSC03item"+item.Name);
117. //fs.Seek(item.Offset,SeekOrigin.Begin);
119. intlength=Math.Max(item.N1,1)*Math.Max(item.N2,1)*Math.Max(item.N3,1);
121. intreq_cols=Math.Max(item.N1,1);
122. intreq_rows=Math.Max(item.N2,1);
124. intnbytes=GetNBytesForItemData(item);
125. this.FileRep.WriteNBytes(nbytes);
127. if(item.IsGraphicalItem())
128. {
129. this.WriteGraphicalItem(item);
130. }
131. elseif(item.It==1)
132. {
133. for(inti=0;i
134. {
135. this.FileRep.WriteInt(ItemWriter.FormatI13,item.IData[i]);
136. //determinewhethertowritenewline.
137. if((i+1)%req_cols==0&&!this.FileRep.IsWrapped)
138. {
139. //ifwearenotthelastentry
140. if(i+1!=item.IData.Length)this.FileRep.WriteNewLine();
141. }
142. }
143. }
144. elseif(item.It==4)
145. {
147. for(inti=0;i
148. {
149. this.FileRep.WriteFloat(ItemWriter.FormatD17_9,item.FData[i]);
150. if((i+1)%req_cols==0&&!this.FileRep.IsWrapped)
151. {
152. if(i+1!=item.FData.Length)this.FileRep.WriteNewLine();
153. }
154. }
155. }
156. elseif(item.It==2)
157. {
158. for(inti=0;i
159. {
160. this.FileRep.WriteDouble(ItemWriter.FormatD25_17,item.DData[i]);
161. if((i+1)%req_cols==0&&!this.FileRep.IsWrapped)
162. {
163. if(i+1!=item.DData.Length)this.FileRep.WriteNewLine();
164. }
165. }
166. }
167. elseif(item.It==5)
168. {
169. float[]FData=this.EncodeRLE(item);
171. for(inti=0;i
172. {
173. this.FileRep.WriteFloat(ItemWriter.FormatD17_9,FData[i]);
174. if((i+1)%req_cols==0&&!this.FileRep.IsWrapped)
175. {
176. if(i+1!=FData.Length)this.FileRep.WriteNewLine();
177. }
178. }
179. }
180. this.FileRep.WriteNBytes(nbytes);
181. this.FileRep.WriteNewLine();

Sahil Dev10y ago

Operating system is 64 bit. I'll paste some code.

Tapan Patel10y ago

Having RAM of 48 GB doesn't mean processor is able to use them all. It really depends on the operating system (32 bit or 64 bit).

Like I said in the previous thread you opened, provide some code to understand the issue.

Sahil Dev10y ago

Thanks.

Regarding the first link:

https://bhrnjica.net/2012/07/22/with-net-4-5-10-years-memory-limit-of-2-gb-is-over/

My .NET version is 4.0.30319 NOT 4.5

Does thatmean, I cannot write binary file sizes greater than 2GB?

Please note that I'm not writing in a single go. I'm writing in several chunks of 400 to600 MB each.

Regarding your second link;

http://stackoverflow.com/questions/5654298/filestream-read-write-methods-limitation

It only suggests not to write in single go but write in chunks which I am already doing?

IS the problem related to the .NET version?

Manas Mohapatra10y ago

Below links may help you:

https://bhrnjica.net/2012/07/22/with-net-4-5-10-years-memory-limit-of-2-gb-is-over/

http://stackoverflow.com/questions/5654298/filestream-read-write-methods-limitation

Sahil Dev10y ago

I can read file as large as 8GB.

My problem is writing of the file. When the written size becomes 2GB, the input output stops. The physical emmory consumed is 32% until such time

Manas Mohapatra10y ago

Follow below link that may help you:

https://social.msdn.microsoft.com/Forums/vstudio/en-US/4e200751-bd99-4ecc-a692-13043bee7d42/how-to-readwrite-files-2gb-?forum=netfxbcl

Sahil Dev10y ago

It is working perfectly upto even 1.9 GB. The problem starts when the file size reached a certain limit (exact). Why wouldthe memory problem arise?

Manas Mohapatra10y ago

For cross write data less than 2 GB and see whether it working properly.

If it works then it is memory problem. Secondly share the code how you are writing data to file.

Sahil Dev10y ago

Can someone please help as I have really been struggling with this and its been very long