Inverted question marks when inserting Single and Doube ' " quotes

Inverted question marks when inserting Single and Doube ' " quotes

I am getting the Inverted question marks when ever we insert ' and " quotes.
select parameter, value from nls_database_parameters where parameter in ('NLS_CHARACTERSET','NLS_NCHAR_CHARACTERSET');
NLS_NCHAR_CHARACTERSET AL16UTF16
NLS_CHARACTERSET WE8ISO8859P1

SQL> select 'DATABASE:' as lvl, value
2 from nls_session_parameters
3 where parameter = 'NLS_LENGTH_SEMANTICS'
4 union
5 select 'SESSION:' as lvl, value
6 from nls_database_parameters
7 where parameter = 'NLS_LENGTH_SEMANTICS'
8 order by 1;

LVL VALUE
--------- -----------------------
DATABASE: BYTE
SESSION: BYTE

SQL> SELECT USERENV ('LANGUAGE') FROM DUAL;

USERENV('LANGUAGE')
----------------------------------------------------
AMERICAN_AMERICA.WE8ISO8859P1

This happens when we Cut and paste from a notepad or a Word Document.
How do we resolve this.