My feeling is that this should be closed as won't fix. I think this will introduce a lot of hyperlinks and we will sometimes have a conflict between whether a link maps to a page with more details (e.g. category description page) vs. adding something to the filter. It also may not be the expected behavior that the users have on mind when clicking a link.

Lets see what other feedback we get on this one.