His horse’s name is Sunday – The riddle tricks you into thinking of days of the week. But “Sunday” here is the horse’s name. So the man leaves town riding Sunday, not on the day Sunday. Wordplay and misdirection are key here.