This is normal procedure for saved parts. There will be occasions when you will be very thankful that this is the case.
However, periodic maintenance will take care of this. There is a "purge.bat" file that helps clean up folders of the history copies of the file. It is run in the command window from Creo. Sometimes it required some help setting this up to function, but it has been part of Pro|E since the beginning.
You can also delete old versions of your open part directly from Creo. This lets you manage each part individually. And then there are some 3rd party utilities that have even more options.
Welcome to the forum, Moti.