You’ve created a specific filter configuration but the users still get recommended other products? If this is your problem then the personal recommendations of the current user don’t fit to your filter configuration.
If your filter configuration is very restrictive and no matching recommendations are contained in the user’s profile (e.g. the user is only interested in pants but your recommendation is configured to show only products with the category shoes) then the product recommendations of the next matching recommendation are offered. If none of the configured recommendations match for a user then the recommendations are generated by the Recolize Brain.
