User Restriction

Is it possible to restrict a user to be able to use only a specific type of Invoicing Template?

Say if I have Custom Invoicing Templates A, B, C, and have Users 1, 2, 3; would it be possible to have User