When he goes for his nap, put the TV on loud, keep him awake and see how he likes it.
Alternatively, you go to bed at 4pm along side him and toss and turn.
My husband is a chronic snorer so I go to bed around 10pm as he stays up till midnight, by then I am asleep but I do wake up in the early hours and his snoring drives me mad some nights but after 29 years of it, I am kind of used to it