Hi,
Are the size of the dmp file in the same size during the above said time? U shall try generating stats on the table using DBMS_STATS and retry exporting only that table to check the performance.