Web Scrapping

Ok I see, but just a little detail about the research. Is your research engine concerning a unique page within a website, an entire web site, a group of web sites or everywhere?

Hi

Well. I need not rip all the data from the web page. The situation is like this. Just imagine a search site. You are searching something and the result set has to be ripped off and and then that data is to be seggregated and stored in the excel file. What I have persued is like, i have done all the seggregation basing on the css class names. Things i could not achieve are

1. I have to get the result set directly. Not like 10 results in one result set and another 10 results in the next page. It will be easy if we get all the result sets in a single shot.

2. Store the seggregated data into excel sheet.

Thanks in advance

Harish

do you need to get all the contents of the web site and put them in an excel sheet? I yes personally I don't advise you do this.

Check whether the targeted website has an rss feed to get a particular info then add this info to an xml structured file, afterward Excel it self provides tools to deal with xml traffic.
http://office.microsoft.com/en-us/excel/HP010423511033.aspx

Web scrapping is used for entirely different purposes

You can create an excel addin  that reads a rss feed and store it within an excel instance