Writing a binary fikle using C#

Sahil Dev

I'm writing a binary file using C#.

My algorithm, etc are all correct and I have validated using witing of small binary files (when I say amall, I mean of sized 200 to 300 MB)

but when my files size becomes as larghe as 2GB (I want to write a file of size 6GB), the process goes on endlessly.

Any clues, what might be happening?

Thanks a lot.

11 Replies

Know the answer? Post it — somebody with the same question will find it here.

Tapan Patel10y ago
How about RAM size?
Sahil Dev10y ago
Sorry, Tapan, I don't follow this
As you are using byte array, just make sure that byte array is not filling your RAM entirely (observe Task Manager or Diagnostics while running the application). So at the end of each iteration, byte array should be having kind of new reference.
I have 700 gb disk space free
Tapan Patel10y ago
As you are using byte array, just make sure that byte array is not filling your RAM entirely (observe Task Manager or Diagnostics while running the application). So at the end of each iteration, byte array should be having kind of new reference.
Second question is, you are writing the binary file to disk or some place on network, look for the size of the disk where you are writing (as you mentioned nothing gets written after certain file size).
Also, try to wrap your code in Try/Catch/Finally block so that you would know if there is any exception.
As I have no code to look at, these are all assumptions.
Sahil Dev10y ago
Hi Tapan,
1) I'm not flushing. How to do that?
2) Sorry, I do not follow your second questuiion
Tapan Patel10y ago
okay. two things to check then.
1. Are you flushing the data (or array) once your one cycle of writing file is complete?
2. As you are writing file to disk/SAN, how about disk size (it sounds crazy but don't want to miss a chance).
Sahil Dev10y ago
Hi Tapan,
No, I'm not writing in one shot.
I write it inin chunks.
Writing in chunks works until the file size is 2096128 KB but beyond that nothing gets written in the binary file.
Tapan Patel10y ago
okay, this is what I have found till now. As you are writing a binary file, you must be using the byte array to write that data and I believe, you are trying to write a file together, I mean in one shot. Here is the problem.
As it is an array which takes Integer as an index, that index limit depends on the processor you are working with. And that is an answer to your first question that what should be the maximum size of that file.
So I would suggest to write the file in chunks instead of all in one attempt.
It should work for you.
Sahil Dev10y ago
I shall be really grateful if helped.
Sahil Dev10y ago
Can anyone please adevise?
Sahil Dev10y ago
I don't think it will help..but will surely do.
One question:
1)Is there a maximum limit on the binary file size that could be written?
2)Because I have always found problems based on machine configuration when my binary file size exceeds 2.5 GB
Tapan Patel10y ago
It would be good if you can share a little bit of code to understand the problem.