Find Repeat String in a text file

TAN WhoAMI

I have multiple text files (in a certain directory), and in each text file contains many rows of such numbers as such:

40000038245886S143301588
40000038245893S143301590
40000038245892S143301582
40000038245907S143301583
40000038245908S143301584
40000038245923S143301585
40000038245901S143301593
40000038245915S143301595
40000038245900S143301535
40000038245918S143301594
40000038245910S143301537
40000038245899S143301581
40000038245896S143301538
40000038245925S143301514
40000038245917S143301511
40000038245903S143301579
40000038245924S143301508
40000038245916S143301509
40000038245906S143301512
40000038245902S143301576
40000038245895S143301510
40000038245913S143301515
40000038245921S143301513
40000038245894S143301504
40000038245920S143301580
40000038245919S143301577
40000038245909S143301578
40000038245891S143301501
40000038245912S143301499
40000038245911S143301507
40000038245944S143301500
40000038245943S143301498

I need to automate it for each text file, to find if there is a repeat of the first 14 digit (40000038245943), and also if there is a repeat of last 10 digit (e.g S143301498).

How can I write some C# code for such purpose? Is it also possible to automate it such that it search through all the text files in that certain directory?

I need to find out which file contains such repeats, and if there is such repeats in that file, display those repeats.

PS: the finding of repeats is within its text file itself, and not with the other text files.

thanks.

2 Replies

Know the answer? Post it — somebody with the same question will find it here.

Vulpes12y ago
Accepted answer
Try this:

using System;
using System.Collections.Generic;
using System.IO;

class Program
{
static void Main()
{
string dirPath = @"c:\whatever\";
FindRepeats(dirPath);
Console.ReadKey();
}

static void FindRepeats(string dirPath)
{
string[] files = Directory.GetFiles(dirPath, "*.txt");
var startDict = new Dictionary();
var endDict = new Dictionary();
string line = null;
string start = null;
string end = null;

foreach(string file in files)
{
if (startDict.Count > 0) startDict.Clear();
if (endDict.Count > 0) endDict.Clear();
bool startDuplicatesExist = false;
bool endDuplicatesExist = false;

using(StreamReader sr = new StreamReader(file))
{

while((line = sr.ReadLine()) != null)
{
if(line.Length != 24) continue; // something wrong, ignore line
start = line.Substring(0, 14);
end = line.Substring(line.Length - 10);

if (startDict.ContainsKey(start))
{
startDuplicatesExist = true;
startDict[start]++;
}
else
{
startDict.Add(start, 1);
}

if (endDict.ContainsKey(end))
{
endDuplicatesExist = true;
endDict[end]++;
}
else
{
endDict.Add(end, 1);
}
}
}

Console.WriteLine("For file {0}\n", file);

if(startDuplicatesExist)
{
Console.WriteLine(" The first 14 digits are repeated as follows\n");
foreach(string key in startDict.Keys)
{
if(startDict[key] > 1)
{
Console.WriteLine(" {0} occurs {1} times", key, startDict[key]);
}
}
}
else
{
Console.WriteLine(" The first 14 digits are not repeated");
}

Console.WriteLine();

if(endDuplicatesExist)
{
Console.WriteLine(" The last 10 digits are repeated as follows\n");
foreach(string key in endDict.Keys)
{
if(endDict[key] > 1)
{
Console.WriteLine(" {0} occurs {1} times", key, endDict[key]);
}
}
}
else
{
Console.WriteLine(" The last ten digits are not repeated");
}

Console.WriteLine();
}
}
}
TAN WhoAMI12y ago
BRAVO. Vulpes, THANK YOU VERY MUCH. I hope to learn more from you :)