If that neighbour has a key to your Unit, it’s possible a previous resident gave them a key (in case of being locked out, say), and they may not have returned it.
Aaah, that makes sense. Change the locks, solve the problem. Buy a new lock that fits. Any reasonably handy person in the building could do it for you.