About Me - NLP Research & Large Language Models
Hi there! I'm Nicolas Boizard, a 2nd-year PhD student at CentraleSupélec (Université Paris-Saclay), diving deep into applied NLP with my supervisor, Pierre Colombo.
My research centers on large-scale training of encoder and decoder models, including multilingual ones such as EuroBERT, EuroLLM, and CroissantLLM. To address the high costs associated with this, I'm also developing efficient techniques like the Universal Logit Distillation Loss, which allows for distillation across different model architectures. These works have led to invited talks at organizations like Meta and Cohere.
My PhD is funded through a CIFRE program with Diabolocom, where I also advise their R&D on various LLM projects. I'm always open to connecting, collaborating, or discussing potential speaking engagements!