Then just load all the data and de-dupe the table. No brainer.