I think you should put that to Oracle support. It could happen some memory leak problems to cause that. The fact that bouncing the database solves the problem for a while, supports that assumtion.
If you do not have configured LARGE POOL, consider configuring it.

Rehards
Boris