I just did a tutorial around this directive, you can check it out here: Reference Fields with the snRecordPicker Directive - ServicePortal.io - Service Portal, CMS, and Cus...

You could use the 'default-query' property to limit the results based on your criteria, and in the controller you could dynamically construct the query based on your requirements.