I've dug out a concrete hearth down to what looks like hardcore in the brick fender.Do i remove all the infill or leave, if removing will it weaken chimney wall, if I leave will it cause damp Going to be replacing two joist and lay floorboards over. Feel I've made job bigger and should have self levelled over the concrete ?