uploads – WordPress append -1 to the image name

For e.g. I deleted apple.jpg. Image is deleted permanently. After a while, I upload apple.jpg. WordPress still append -1 to the image name apple-1.jpg. However, apple.jpg is no where to be found.

I have not encountered this behaviour with previous versions of WordPress. What can I do to stop wordpress to append -1 to the deleted image filename?