silly answer really - but it needs to be as big as it needs to be.

best option is to find the queries and fix them so they dont do as much sorting in temp.

also look at your sort area setting - maybe they are too small