Exactly how do you think the simple upload of data of past transactions from your bank would let them into your bank? You, yourself, cannot from within Quickbooks remove your own money from your bank, other than by cutting a check unless you are using a digital bill pay option and the bookkeeper creates a fake vendor to pay.

But if you do not want your bookkeeper to pay your bills then what exactly do you need a bookkeeper for?

And you never share access, that is actually a violation of the EULA, instead you add them as a user.