I would say four is plenty enough. If you find the process is chewing the resouces, then you can identify the RMAN session proces and nice them out to a low priority.

Sam