Sounds to me that you want to be able to go anywhere, and have the speed of SS or TP.
Be glad it gets you from point A. to point B, even more safely then others.
With just SS, you're going to have a hell of a time getting around sky, faultline, even parts of Hollows, and 1000 others.
So let Fly be slower then the others. It shouldn't be as fast, because you can do that much more with it.