This is NOT an option. Here's the error when trying to "delete", which means that if a payroll has been run at all, it's not an option. SO dumb. 

You can't delete this work location

This could be because it's a primary work location, has employees assigned to it, or you've run payroll for it.