The problem is that the game only load the files named "track.replay" so you can only have one ghost by track. If you want to drive against different replay you will have to change manually the name or the place of the different replay files.
Let's take an example: (in case this post seems obscure to some future reader)
In my replay files library* I have three replay files for the Scottland track:
- mine, "scottland.replay"
- E-Dragon record, "scottland-edragonrecord-thetime.replay"
- one upload by bonnifarz, "scottland-bonnifarz-thetime.replay"
After that, I run supertuxkart in ghost mode (in a linux console supertuxkart --ghost, do not know how to do it on windows) and when I launch the Scottland track I will find on the start line my kart and the kart E-dragon used for his record. Then I just have to beat him to a pulp,to sportly try to overtake him, for my personnal pleasure.

Just be cautious, if you want to save the replay of this run the game will overwrite the actual scottland.replay ie the one of E-Dragon's run, so be sure to have another copy somwhere else. (or upload it once more from the forum ^^)
*Yes it's an idea I found quite interesting: if everyone were to upload their replay files, a newcomer can easily choose among those files the ones closer to his personnal performance, maybe a little faster, and then by trying to overrun them progress at a faster pace that only trying by himself.
I mean now, between the level of an expert IA kart and some record, there is a wide gap which could be difficult to fill if ones doesn't have the motivation induced by a kart running at the same speed as you that you can learn off.