bad work

I got a new boiler fitted. The plumber, however left the wall behind stripped down to bricks, pieces of old plaster. The issue is - there are dust particles falling off the wall and spreading all over my kitchen with boiler use. The solution I imagine would be to plaster behind the boiler...