Yes, you do have to run the RALink utility at least once to get a connection. I haven't had to toggle the radio on/off on my system, though. Once the connection is established, you can close the utility until you restart or log out.
With Realtek drivers, its best to leave the utility running...