Critical properties of a magnetized Bose gas