Copying information from web page

Amaan Merchant

Firstly, I would like to state that I am a newbie at coding C# so if something is not possible please tell me.
Okay so I have been trying to open web pages and copy all the text from it and write it to a text file.
I have got the writing to text file bit, but I want to know if it is possible to copy all the text from a web page into a variable.
If it is possible is it quite difficult or relatively simple? If simple could you please give me an idea about how I would go about achieving this.
If it is any help, I am opening the web page by the following code:

Process proc = new Process();

proc.StartInfo.UseShellExecute = true;

proc.StartInfo.FileName = "";

proc.Start();

2 Replies

Know the answer? Post it — somebody with the same question will find it here.

Amaan Merchant14y ago
It's a website with plain text, there is no image or anything like that. Just about 2 or 3 lines of text. There are multiple websites with the difference being an increase in the number at the end of the URL so I want to write a program to write all the information to a text file. I just need to find a way to copy the text in the webpage to a variable.
And yes, it's data in a web page in a website. Also the program is a simple console one.
Any help would be appreciated.
Sam Hobbs14y ago
Welcome to C# Corner. I here that the ground has been shaky again in your part of the world.

The sample code you show does not help me to understand what data you are processing. Is the data a web page in a web site someplace or is it a document in your local computer? If you can be more specific about what the data is in terms of where you rea getting it from then that will help.

Also, do you need all the text from the web site or do you only peices? You can use something called the DOM to get pecies of a web page, but that can get complicated. Some people use regular expressions but that is something that looks easy at the beginning but then it can get quickly get too complicated.

Also note that some web sites provide a way to get data from them that is easier than other ways. So if the web site is one that has web services or something like that then you should learn about that.