Thanks for reaching out to the Community, Officeadmin800.

You can delete budgets from your Setup Budgets screen.

Here's how:
 

1. From the Company screen, go to Planning and Budgeting.
2. Click Setup Budgets.
3. Use your available drop-down list and choose a budget.
4. Hit the Edit option.
5. Select Delete Budget, then Yes.

I've also included a detailed resource about working with budgets which may come in handy moving forward: Create & manage budgets or forecasts

I'll be here to help if there's any additional questions. Have a wonderful Tuesday!