And if you're that good, maybe your team's record should be a little better.
If you're that good you're still 1 man in a lineup of 9 or 1 pitcher in a staff of 4 other starters. This isn't football where all the offence funnels through the QB in some way, shape, or form. Or basketball or hockey where you can tilt the distribution of playing time in favor of your better players to put more of the team's overall output on their shoulders. Every baseball player bats 1 out of every 9 of his team's PAs at most, plays one out of the 8 non-pitching fielding positions on the field. Single, individual players cannot drive a team's record in baseball the way they might in another sport.
Even a pitcher, who is a focal point of one aspect of the team's play, only has 20-30 starts a year, meaning that they help you in no more than 20% of your games. Clayton Kershaw could pitch a perfect game every time out, going 30-0. But if the Dodgers were a pile of burning dumpsters everywhere else and lost every other game, they would finish the year 30-132 and be easily the worst team in baseball. And in that case by your logic Kershaw isn't worthy of MVP consideration (regardless of the whole Cy Young/MVP eligibility divide) because he should've done more to make sure his team was competitive.