I think you are using OS authentication.
On Unix if you are logging in as osuser who is in dba group, you can connect "as sysdba" using any db user.

Try this..
Logout from OS and login as osuser who is not in dba group.
Then try connecting "as sysdba" for the db user. I am sure you will get insufficient privilege error.

Sanjay