What is the difference between Vertical and Horizontal Scaling?

A previous answer explains the concept pretty well. Still, there is a one important caveat that is worth mentioning. While horizontal scaling is usually preferable across the industry as it offers almost unlimited scaling capabilities, it bears an important limitation that services to-be-scaled should be stateless as sharing state across multiple independent instances would require really complex logic