I have both and the best answer I can give you would be... what kind of games do you enjoy? I mean, PS4 definitely as more to offer. But, as I get older, I find myself being less and less interested in what the PS4 has to offer and more and more interested in the casual gaming that the Switch has to offer.
If you're worried about there being enough games for the Switch, I wouldn't be. I mean, you can easily put hundreds of hours into BOTW. Super Mario Odyssey was a great game. Pokemon: Lets Go is great. I haven't started it yet but Octopath traveler is supposed to be great. World of Final Fantasy: Maxima is a great game (I played the original on the PS4 and it was great). Super Smash will be out soon.
And honestly, the portability aspect is the best part of that console. I am getting ready to go to my in-laws for the next 4 days and after we finish our thanksgiving meal and are caught up, I will now have something to do for the following 3.5 days instead of sitting there doing nothing.
I would give it a shot. I am having an absolute blast with it.