Hi Reconcile Bookkeeping, thank you for reaching out to the Community with your concern. I'm here to assist you with navigating your QuickBooks reminders.

If the reminders section you're referring to resembles the one depicted in the image below, there won't be a pencil icon available.

Instead, you'll need to click on View Task, which will direct you to the Tasks page. Here, you can locate the tasks that is in your reminders section. By clicking the drop-down menu next to Send, you will have the option to View/Edit task to review status and make necessary actions needed to your invoice.
 

If the reminder section you're referring to is located in the "Account and Settings" as shown in the image below, please ensure that you are the master admin of the account. Only the master admin has the authority to modify settings.
 
Additionally, you can also customized invoices, estimates, and sales receipts in QuickBooks Online this can help you enhance your business communications.

This article could be useful resource for you in the future on how to Apply late fees to overdue invoices in QBO.

I'm here to help you with managing your reminders in QuickBooks Online. If you have any further questions, you can Reply to this thread. We are happy to help you.