How to store large txt file and covert into binary

onais ahmer

8y1.2kLearn iOS Programming

i am trying to uploading the txt file near 1 GB

i modify the Web.config file but

protected void Upload(object sender, EventArgs e)
{
string filename = Path.GetFileName(FileUpload1.PostedFile.FileName);
string contentType = FileUpload1.PostedFile.ContentType;
using (Stream fs = FileUpload1.PostedFile.InputStream)
{
using (BinaryReader br = new BinaryReader(fs))
{
br.ReadBytes((Int32)fs.Length) );
// At this line i got the errorr msg
byte[] bytes = br.ReadBytes((Int32)fs.Length);
string constr = ConfigurationManager.ConnectionStrings["myConnectionString"].ConnectionString;
using (SqlConnection con = new SqlConnection(constr))
{
string query = "insert into Files values (@Name, @ContentType, @Data)";
using (SqlCommand cmd = new SqlCommand(query))
{
cmd.Connection = con;
cmd.Parameters.AddWithValue("@Name", filename);
cmd.Parameters.AddWithValue("@ContentType", contentType);
cmd.Parameters.AddWithValue("@Data", bytes);
con.Open();
cmd.ExecuteNonQuery();
con.Close();
}
}
}
}
Response.Redirect(Request.Url.AbsoluteUri);
}

8 Replies

Know the answer? Post it — somebody with the same question will find it here.

Jaish Mathews8y ago
Accepted answer
The root cause is that you can't reserve that much of memory using byte[] in a 32 bit application ENV. It can have some MB of size, but can't be a full GB. Its a restriction from Windows side. if you try byte[] fullbuffer = new byte[int.MaxValue];, then also you would get this error as this hasn't related to physical RAM, but more towards virtual memory. So below are the alternatives.
It's not recommanded by any standard to store 1GB+ size directly in a relational database. Better thing that store it in a document database or store it in a physical location and then add it's path Ref. inside database. Relational database not meant to store documents of size GBs
Below code Ref. URL reading your files by chunks and each chunk you need to commit in your database rather than a full single stream of bytes. https://stackoverflow.com/questions/24141948/bytestream-length-out-of-memory-exception-best-way-to-solve
Try making your application and ENV towards 64 bit which may resolve this memory constraint.
Jaish Mathews8y ago
Good to hear it has resolved. I tweaked my answer by adding a scope of "32/64 bit ENV". Cheers
onais ahmer8y ago
Tools --> Option --> Project & Solution
--> WebProjects --> check the Use the 64bit version of IIS

increase the commandtime out issue resolved
onais ahmer8y ago
not any success
Abhishek Mishra8y ago
Change Platform Target as 64 bit and it might do the trick. You can go to Project Properties. Click on Build Tab there and set Platform Target as 64 bit. 32 bit executables may not be able to handle huge files.
Jenith Thakkar8y ago
Might Be There's Some another issue Which is Related to Memory Allocation

Please Restart the PC and then Only Run your Project First and Try to Upload that file Again
onais ahmer8y ago
yes ..
Actually the issue is byte size i think error
Jaish Mathews8y ago
Can you try this full config values?
<system.web>
    <compilation debug="true" targetFramework="4.5" />
    <httpRuntime targetFramework="4.5" maxRequestLength="2147483647" executionTimeout="1600" requestLengthDiskThreshold="2147483647" />
    <security>
      <requestFiltering>
        <requestLimits maxAllowedContentLength="2147483647" />
      requestFiltering>
    security>
    ...
system.web>