Training cross-encoders

batuhanguler
Fri, 16 Jan 2026 18:25:21 +0000

Hey, I am using cross-encoders for recommender systems. I am recommending some items (item_name, importance for the user, item_category) to some documents (notes, and categories).

item_name change for users and i want a user-agnostic model. hence using a cross encoder instead a classic recommender approach.

Anybody tried to randomly put some of the features to ““ to force the network to learn from each of them properly. A bit like random sampling of features.

Happy to have any tips on training this kind of model, have some decent results from now but I am still missing some nuances.

Tried “cross-encoder/ms-marco-TinyBERT-L2-v2” and “cross-encoder/ms-marco-MiniLM-L2-v2” for now on 1 million pairs

Read full topic