As long as you use sys, I agree just use connect / as sysdba
For any other user, and if you use 10g Release 2, you can create an Oracle wallet and store the username/password there. I am just too lazy to search the documentation for details about this feature. Just look at the 10g release 2 new features book if interested

Cheers