I use the Quickbook Online version.  When I create invoices using the Modernized Template I had the same problem.  However, when I remove the Modernized Template as default and use the Standard Template, I was able to remove Ship To from my invoices.