There is a way to explictly specify your date format in the control file. After you specify that the column will be a date, include "mm/dd/yyyy". For example:

load data
infile *
append
into table xxx
fields terminated by ","
(my_date date "mm/dd/yyyy")