I am not sure if I am right, but thought of bringing this to forums attention. I saw a lot of activities going on in the view: v$fast_start_transactions. I know this is related to undo segments.
When I stop seeing changes in this view, the query against the table started running normally.