The defender and his teammates who were not called up for international duty were given some time off by Villa over the Easter break.
Richards and Agbonlahor were pictured on holiday in the United Arab Emirates and some fans did not take kindly to the images due to the club's poor season.
According to the Birmingham Mail, a Villa fan tagged Richards in a picture on Instagram, and the defender replied: "Don't tag me in your stupid photos u clown! Excuse us for having a few days away after a long hard season."
Villa have won just three of their 31 league games this season.