You can alter the NLS_LANGUAGE and NLS_CHAR_SET at the session level, but I am not sure about the database level.

Character set is important (as you probably know) because for numbers, the comma is equivalent to the decimal point in English, and the decimal point is the thousands separator instead of the comma.

Good luck