You can run different version of Oracle on the same machine. Choose a different Home directory.

You need to increase /etc/system parameters.

Also remember that the combined SGA size of both Instances should be less than avilable physical memory.