I think it is memory issue. decrease the size of following parameters in your init.ora file and try to startup database on svrmgrl> prompt.
shared_pool_size
log_buffer
db_block_buffers
try it. if you still get same error try again and reduce the size of above mentioned parameters.
Thanks
