Because downvotes are heavily used to say "I don't like this" rather than "this is not relevant".

I've complained to HN about this and proposed solutions. They don't care.