What kind of query do you have defining the view? I would expect that it's an aggregation, in which case you might set a large sort_area_size for the session before refreshing.