Read from a web page and store in DB !!!

Amal

Hello all.

i have a DB
contains a table with columns
one of those a columns holds a link to webpages that contain an abstract of a book !!

i need to read this abstract only out of the whole web site
and save it to the DB ...

i have some ideas in my mind !!
but get confused how to start !!

3 Replies

Know the answer? Post it — somebody with the same question will find it here.

Kirtan Patel16y ago
You need to Parse the Data From HTML Code of the Webpage using RegEx or HTML Agility Pack Library to get data From HTML tables in Webpage :)
Sam Hobbs16y ago
Actually I probably do know how to read directly from a web page into a HTMLDocument directly, so if you want to do it that way, I need to find the code I have that can get you started with that.
Sam Hobbs16y ago
One way is to create a WebBrowser control, then navigate to the page using WebBrowser.Navigate Method (String). Add a handler for the WebBrowser.DocumentCompleted Event. In the handler, be sure to check that the WebBrowser.Document Property is not null; when it is not null, that property has a reference to the web page's HTML; you can use the DOM to get data from the page.

Alternatively, you could get the raw HTML page and load it into a document and then process the HTML from there, but that is more complicated and I have not figured out the details of how to do that using .Net. The advantage is that you don't need a WebBrowser control for that.