Search for gravitational wave ringdowns from perturbed intermediate mass black holes in LIGO-Virgo data from 2005–2010