If you are running any Oracle client before 11gR2, then you need to create a new and separate Oracle Home for the 11gR2 Client.
You don't need to remove the current client until you have the new client installed. then you simply need to point to the new client.