baxi wm50/4

I wonder if someone could help me. I have a Baxi WM50/4 RS SS based CH system. The boiler has started to ignite when the controller is switched off and the pump is off. Initially I thought it must be a faulty controller, and changed the controller. Unfortunately the same thing happened again...