We can implement pagination in SPFX using Rest API it self.
When you use top parameter in rest api, it will give you an API in return for items of next page.
When you hit the URL of next page, it will give you an API for items of previous page as well as next page.