Split xml file

darma teja

Hi All,

I would like to split huge xml file. My final splitted files size should be less than 3 mb.
I tried to split xml file based on childnodes. But I don not get xml file with same node every time.

Advance thanks,
Darma

4 Replies

Know the answer? Post it — somebody with the same question will find it here.

Vulpes12y ago
Accepted answer
This is something that you're going to find very difficult to do programatically unless you know exactly what you're going to do to begin with.

It will obviously depend on the structure of the XML file.

For example, if you had something like this with a size of 5MB:

// file.xml

....
....
....
.
.
.
....

....
....
....
.
.
.
....

then an obvious way to split the file into two would be like this:

// subfile1.xml

....
....
....
.
.
.
....

// subfile2.xml

....
....
....
.
.
.
....

Whether both of these files were now under 3MB would depend on the relative number of grandchild nodes in each one and perhaps also the relative complexity of those nodes.

So clearly it's not a simple matter to do this and it might be easier to make the split 'manually' on a 'trial and error' basis.
Vulpes12y ago
Try the following:

using System.IO;

//...

string[] lines1 = File.ReadAllLines("subfile1.xml");
string[] lines2 = File.ReadAllLines("subfile2.xml");
string[] lines3 = File.ReadAllLines("subfile3.xml");

lines1[lines1.Length - 1] += lines2[0];
lines2[lines2.Length - 1] += lines3[0];
lines2 = lines2.ToList().RemoveAt(0).ToArray();
lines3 = lines3.ToList().RemoveAt(0).ToArray();

File.WriteAllLines("subfile1.xml", lines1);
File.WriteAllLines("subfile2.xml", lines2);
File.WriteAllLines("subfile3.xml", lines3);
darma teja12y ago
Hi Vulpes,

I have splitted the xml file by using filestream.

The output is coming like this:

// subfile1.xml

....
....
....
.
.
...test


// subfile2.xml

first
....
....
....
.
.
.
testkajc

// subfile3.xml

grandchild>

....

I want the output like this:

in subfile1.xml, the last line should like this "...testfirst
in subfile2.xml, the last line should like this "testkajc

in subfile1 and subfile2, the first line should be delete.

How can I achive this one.

My code is here:

string SourceFile = blabla;
double xmlSize= blabla;

// To get only 4.7 MB xml files
int nNoofFiles=0;

nNoofFiles = Convert.ToInt32(xmlSize / 4928307.2);


FileStream fs = new FileStream(SourceFile, FileMode.Open, FileAccess.Read);
int SizeofEachFile = (int)Math.Ceiling((double)fs.Length / nNoofFiles);
for (int i = 0; i < nNoofFiles; i++)
{
string baseFileName = Path.GetFileNameWithoutExtension(SourceFile);
string Extension = Path.GetExtension(SourceFile);
FileStream outputFile = new FileStream(Path.GetDirectoryName(SourceFile) + "\\" + baseFileName + "." +
i.ToString().PadLeft(5, Convert.ToChar("0")) + Extension + "", FileMode.Create, FileAccess.Write);
mergeFolder = Path.GetDirectoryName(SourceFile);
int bytesRead = 0;
byte[] buffer = new byte[SizeofEachFile];
if ((bytesRead = fs.Read(buffer, 0, SizeofEachFile)) > 0)
{
outputFile.Write(buffer, 0, bytesRead);
//outp.Write(buffer, 0, BytesRead);
string packet = baseFileName + "." + i.ToString().PadLeft(3, Convert.ToChar("0")) + Extension.ToString();
Packets.Add(packet);
}
outputFile.Close();
}
fs.Close();

Advance thanks,
Darma
darma teja12y ago
Thanks Vulpes!