RE: As far as I understand, I can only import account list, vendor list, customer list and item list from Excel to QuickBooks

That is not correct.

RE: what about bank transactions?

When using the IIF Transaction Creator you can import most types of financial transactions.

RE: I want to import bank transactions from Excel file (.CSV). Is that possible?

You can start with a CSV file, but the data needs to be converted to an IIF file first.