There is a way to do it but it is a bit annoying 

1) go to Reports > Sales > Sales by Ship To Address

2) click display > columns should be Ship to City, Address 1, Address 2, State, Zip

(Duplicate addresses will appear)

3) filter customer you want (date MUST be all)

4) export to excel 

5) in excel delete duplicate addresses

This will give you all the customer's ship to addresses that you invoiced to in the past