Waving to Prisoners

Today on the way to work I waved to a busload of prisoners. To be fair, one of the prisoners waved to me first. Is this ok? I do this kind of thing a lot, second guess my actions. Did I somehow invite prisoners now to break into my home? He waved first, it would be rude not to wave back.