I guess some things to consider would be: does he have sore spots? Is he long-haired or a particularly fanatic cleaner?
Cats are odd. I love them all.
If you can you should maybe feel for some sore spots. Also, ask your vet the next time you're in for a check-up. I don't think it warrants a special visit.
If he is long-haired he may not want to be touched because he has to clean himself with his tongue. If you had to clean yourself with your tongue you'd probably be a lot more careful about what touches you too!!! Ha ha ha. Same goes for fanatical cats.
If he's not neutered... scrolling up...I don't see if you mentioned it... so, he may be protecting his manliness....
Some cats are just moody. They are very independent animals. I have three cats right now and every one is completely different. Mini, my first little baby, is nuts! She's thin, wirey, strung-out and the boss of the dogs, cats and bunnies. She's a tough cat. She hates being cuddled so I call her squirmy wormy or skinny mini.
I don't think she's wired quite right either but I love her to death.
Water bottles are a great tool for cats. They work for mini but my two new cats (from the shelter) don't seem to care. They get wet and don't really react. Sometimes they sit in the tub and let water fill up around them while they lick from the tap. Oddballs.
Moral of story: cats are weird! LOL