No this is not an acceptable solution and you should be ashamed of the company you work for. 

No option to bulk-delete expenses? The only option is to do it one-by-one? Surely you are embarrassed at this level of incompetency of your company?