Also you can create an AFTER LOGON trigger to issue an:

ALTER SESSION SET NLS_NUMERIC_CHARACTERS=',.';

and see if that fixes the problem.