That could just be your door handle. It looks well used
Often they have spring cassettes in the them to re-centre them.
This type of thing
Replacement handles are not too bad if you wanted to replace £20ish
Replacing the thumb turn would require a new lock I think £20ish
Looks good enough from a distance. Just the close up shows the marks
To fix your problem, I would personally replace the whole mechanism rather than faff with rivets on just the centre.
Often they have spring cassettes in the them to re-centre them.
This type of thing
Replacement handles are not too bad if you wanted to replace £20ish
Replacing the thumb turn would require a new lock I think £20ish
Looks good enough from a distance. Just the close up shows the marks
To fix your problem, I would personally replace the whole mechanism rather than faff with rivets on just the centre.