Trying to use RestSharp to pull from API

scott oliver

Hello all, I am trying to learn how to use restsharp to pull information from the OTC website. I cannot figure out the best way to do this. If anyone can give me a recommendation or point me in the right direction I would appreciate it. Thank you and here is the direct page link https://www.otcmarkets.com/research/stock-screener

This is a public page as well and does not have credentials. I also do not have any sort of api key

It is pulling data with the following get request

========================================================================

GET /research/stock-screener/api/downloadCSV?pageSize=20 HTTP/1.1

Host: www.otcmarkets.com

User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:72.0) Gecko/20100101 Firefox/72.0

Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8

Accept-Language: en-US,en;q=0.5

Accept-Encoding: gzip, deflate

Connection: close

Referer: https://www.otcmarkets.com/research/stock-screener

Cookie: _ga=GA1.2.1277172939.1583161227; __gads=ID=256e3a188a72d8ad-22ff653336c300e1:T=1599055247:S=ALNI_Mb_aoACRNxi2POXLuRICB4CByLMIg; _awl=2.1599055289.0.4-184fb53b-1b7cf14c998448930096f9c884514b9b-6763652d75732d7765737431-5f4fa5b9-0; __qca=P0-1517024460-1583161291270

Upgrade-Insecure-Requests: 1

3 Replies

Know the answer? Post it — somebody with the same question will find it here.

Viswanatha Swamy6y ago
Accepted answer
Scott,
Good morning. Below is one of the ways. I have checked in my code into my GitHub repository. Please let me know if you need some more assistance. Many thanks.

GitHub Url: https://github.com/vishipayyallore/speaker_series_2020/tree/master/General/SimpleRestSharpDemo

Regards,
Swamy
static void Main(string[] args)
{
    var restSharpClient = new RestClient("https://www.otcmarkets.com");

    var downloadRequest = new RestRequest("research/stock-screener/api/downloadCSV?pageSize=20",
        Method.GET);

    var fileInBytes = restSharpClient.DownloadData(downloadRequest);

    File.WriteAllBytes(@"D:\LordKrishna\GitHub\speaker_series_2020\General\SimpleRestSharpDemo\SimpleRestSharpDemo\Downloads\StockData.xlxs",
        fileInBytes);

    WriteLine("\n\nPress any key ...");
    ReadKey();
}
scott oliver6y ago
Thank you both. I used Viswanatha's solution. That worked perfectly. I am trying to do the exact same thing but from NASDAQ web site. I cannot get it to work. If one of you might know where I am going wrong. Again I used burp and the get reuest is a lot different. Here is the requst. Again no log in credentials. Does the cookie need to be included? Whats the best way to do this? Cookie Jar?

GET /market-activity/stocks/aapl/historical HTTP/1.1

Host: www.nasdaq.com
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:80.0) Gecko/20100101 Firefox/80.0
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Accept-Language: en-US,en;q=0.5
Accept-Encoding: gzip, deflate
Connection: close
Referer: https://www.nasdaq.com/market-activity/stocks/aapl
Cookie: _gcl_au=1.1.1597736762.1599451515; _ga=GA1.2.360498658.1599451534; _gid=GA1.2.1256195202.1599451534; RT="z=1&dm=nasdaq.com&si=06d424bd-5286-4cc6-a8a2-16b61ea74e58&ss=ket6c0je&sl=1&tt=p4d&nu=e3c3fd4e920420d7e7ce59dc8074d88b&cl=qvo&ld=xy8&r=53ad29b9dbdcfee90c1f4f2ff3927d20&ul=xye"; tc_ptidexpiry=1662523538304; tc_ptid=7Mt2PZyfsnOiafYFuWzasM; tc_q=tcptid%3D7Mt2PZyfsnOiafYFuWzasM%26tcttid%3D54f0AfRPfppa0uQyUXzJ8i%26tcctid%3D3NNwzlbsLS2SgGqKqw8Q0M%26tcvc%3Dquote-view%26tcect%3D1599451538316%26tcvv%3Dhttps%253A%252F%252Fwww.nasdaq.com%252Fmarket-activity%252Fstocks%252Faapl%252Fhistorical%26tcvr%3D%26tcvt%3Dundefined%26tclv%3Dundefined%26tcectz%3D420%26tcep%3DWin32%26site_id%3Dnasdaq_prod%26content_title%3DApple%2520Inc.%2520Common%2520Stock%2520(AAPL)%2520Historical%2520Data%26content_type%3Dpage%26page_type%3Dcontent%2520page%26content_section%3Dmarket-activity%252Fstocks%26engagement_score%3D1%26event_udf12%3DStocks%26event_udf13%3Daapl%26event_udf16%3Dview-quote%26event_udf17%3Dview%26event_udf18%3Dview-quote-aapl%26account_id%3DNASDAQ; _fbp=fb.1.1599451549703.475674028; __gads=ID=a7d6a66268a321c5-221f330645c30035:T=1599451552:S=ALNI_MZmXzqA7yU5kV42BFQ9FSuNXlTS6w; cto_bundle=UPqX5V9ZeVVGWDlRMXhEWkdFUTFhMTRnbzYlMkJwejkycDViSUZncWNWVWxlVXo3M3VGdUkzSG1vaVlZTmlFdVNXZ0V6bEZ3R1V4OExwN1V5Z2tvQUk0SmdheXlveHFhd0NOb0FmUmFHWkFBclglMkI5bzlQMWk0b1oyYnpPU0xIQ1glMkJJTXV3ZmdXMGM5dk1BRURTa2NjRVdNQ24zQmclM0QlM0Q; playwirePageViews=283; pwUID=659214508431526; AKA_A2=A; ak_bmsc=3021173C2BDB0C019608A2B3F2496B3E17240FAF0A6C000017C6565FACF47649~pl8+B3SS3iDdKrESuurj7HukGmaxC6uOS7vKrdHs5L3IASzrS0P7BkFVY8D/Ymlsow4rP6+6ZE6YE/jJCxUyTbSOrrDyTbkmSkih5VK5C4uX8CD9r9jiC3ZHZCONjXQG84j+hPv0/Z3wh1OCPiAsEKvI6UBSRUMuWa5iLsB7yUEslcdGdrqOLxTHrZYq9zR6QwBq5/wqBwDA5Y2BDU2u6Zr5QvkHiIohco3X+rQRG2Yb/17hQ2PNfPpGavKISvNkFP; entryUrl=https://www.nasdaq.com/api/v1/historical/AAPL/stocks/2020-08-06/2020-09-06/AAPL/historical; entryReferringURL=https://www.nasdaq.com/api/v1/historical/; tc_ttid=7GbEPd6EWA2mmUGpoJiyI; _mkto_trk=id:303-QKM-463&token:_mch-nasdaq.com-1599522335777-63949; bm_sv=00C0050649BA0EA70AFD454CDFB3720C~Qp9djXZBsPC/sL9WVr42f99Ovp721xrNTOYq9N+8J9FF5PMJ0pAaZMBtSSHO5e9TssdQO9rtwvR3EQ2FFruLlqHOLnqb9vETVfAkQwlzfHhaGe7BVsEvekVsRz3Oo33DSsN5I5vszsRqze0v9Bf2oveMYdS004mtSQ1FFkeU2Bo=; bm_mi=6ED98A496AD96F45DF75D7C07D4A21C0~4vCjhx6SkdS+Lmn0I8Wo3RQRZQ+O8N/ddM9oS/7ueUF3/WVF2B9s8SbFz5GoKRjORhA038kwKpeFZFNp50iAilaDwbxIlDi+dm4lkdXhKGrs9+f6e10+2OU6ZJrLsYbDIClhO91YqYXcr5p2VTPVjIODj8pzIggFImwe959or55UvyQz8jqDi/E4JewtL503ayLWbl3hN6FyMJle1CZxIc/5jr7ROzyNO5hcU0CC2bkWVnvqXPTa9DlP3jGLDz21n61/K1OUqbC7Q9+jvC/BwciCwifnnfzrfX6m0XzWfu9HBL0urudOdSFa7MZjpLtC; onsiteSearchTerm=aapl; onsiteSearchResults=40780; _uetsid=271a33132e88521ab48568aaccdbde64; _uetvid=2fead10e5be159af1ff16c40cf66cec5; _gat=1; ELOQUA=GUID=D71CB5502D8E4232B807BCBEB9A65915; _dc_gtm_UA-106577912-1=1; _gat_UA-106577912-1=1; OX_plg=swf|shk|pm; _gat_layoutTracker=1; _gat_LcpTracker=1
Upgrade-Insecure-Requests: 1
Jenith Thakkar6y ago
Have a look this link
It will helpful for you
https://visualstudiomagazine.com/articles/2015/10/01/consume-a-webapi.aspx