Back in 1962 when Gump was playing for the Rangers... he wouldn't wear one because he felt that there was a blind spot when he was looking down for the puck when it was at his feet.
Ya, that was the general reason & feeling amongst most of the goaltending fraternity. Blindspots in the lower peripheral vision regions and yes, it was a problem. Worsley was a semi-standup who's game was patterned after Davey Kerr's & Frankie Brimseks', turned pro in 1948; didnt grow up facing nor did he spend the first 10 or 11 years with Rangers, in the AHL & WHL facing a lot of Slapshots beyond Geoffrion of the Habs, but more importantly by his teammate Andy Bathgate in NY during practices. Eased into it. He was therefore somewhat more prepared for its explosion both in terms of how to stop them & how to deal with them psychologically in the early 60's than most, that new development resulting in everyone donning masks.
So for guys like Worsley in not adopting the mask, it was a trade-off. Rather have full 360 degree vision without any impediments, if you could at least catch a glimpse of the puck you could save it or duck as the case may be. Rather like players not wearing helmets, masks were hot, didnt breathe causing further problems in overheating & tiring one out earlier. Fair amount of hubris involved in refusing to wear one but then thats always been a character trait of most goaltenders and yes, a certain "stigma", that in donning a mask you were a bit of a Wimp. That you shouldnt need one.... Whats little known about Gump is that despite the happy-go-lucky persona he actually suffered from depression & alcoholism during his time in NY and had a real fear, real phobia when it came to flying. So much so that by early 1969, had a bit of a nervous breakdown. Was convinced, talked into coming back at 40 by Minnesota where he went on to play some of the best hockey of his career.