The process size on Unix is basically contributed by the SGA size. Check to make sure that your sort retain size had been set appropriately. It should be less than the sort_area_size.

Hope I'm on the same page as you.
Sam