John Riker

John Riker

  • 1.9k
  • 78
  • 2.5k

How to grab content from webpage source?

Nov 17 2020 4:54 PM
Tried posting this to my other thread but it wouldn't post.
 
I am trying to figure out how to pull content from fox.com and a Comedy Central site and their API's are either protected, or need an API Key but no way to get one, or need some kind of token I don't get so give up. Not enough detail out there to figure them out.  Anyone know say for these two sites how I would pull out a list of shows, their associated metadata info like series and episode number, and also the link to their video page?
 
https://www.fox.com/the-masked-singer/
So the rub on this one, I would want the first four videos but not the stuff below it like the Clips and Extras. And as you can see there is a scroller so any way to get videos on the next "page"?
 
http://www.cc.com/shows/the-daily-show-with-trevor-noah
With this one I'd want the Full Episodes and again the scroller to older content.
 
Thoughts?

Thanks.
JR

Answers (2)