Looks like I'm going to have to do this as well, very poor user experience so far.
There should be an import template, that allows you to define the fields in the CSV file, so you only need to do it once.
I have to import lots of invoices regularly and having to map them every single time is rather time consuming, and can leads to problems if I don't map them properly.
