Deleting/merging routes in browser leaves "ghost routes" in the app sometimes

I noticed that sometimes merging or deleting routes in browser leaves the old routes still hanging around in the app without being able to interact with them.