Tsinghua University

8 Posts

Fine-Tune Your Fine-Tuning: New method optimizes training for few shot NLP models.
Tsinghua University

Fine-Tune Your Fine-Tuning: New method optimizes training for few shot NLP models.

Let’s say you have a pretrained language model and a small amount of data to fine-tune it to answer yes-or-no questions. Should you fine-tune it to classify yes/no or to fill in missing words — both viable approaches that are likely to yield different results?

February 23, 20223 min read
Fine-Tune Your Fine-Tuning: New method optimizes training for few shot NLP models.
Tsinghua University

Fine-Tune Your Fine-Tuning: New method optimizes training for few shot NLP models.

Let’s say you have a pretrained language model and a small amount of data to fine-tune it to answer yes-or-no questions. Should you fine-tune it to classify yes/no or to fill in missing words — both viable approaches that are likely to yield different results?

February 23, 20223 min read
Harry Shum: Tsinghua University’s Harry Shum on how AI is changing creativity
Tsinghua University

Harry Shum: Tsinghua University’s Harry Shum on how AI is changing creativity

In 2021, I envision that the AI community will create more tools to unleash human creativity. AI will help people across the globe to communicate and express emotions and moods in their own unique ways.

December 30, 20202 min read
Harry Shum: Tsinghua University’s Harry Shum on how AI is changing creativity
Tsinghua University

Harry Shum: Tsinghua University’s Harry Shum on how AI is changing creativity

In 2021, I envision that the AI community will create more tools to unleash human creativity. AI will help people across the globe to communicate and express emotions and moods in their own unique ways.

December 30, 20202 min read
Augmentation for Features: A technique for boosting underrepresented data classes
Tsinghua University

Augmentation for Features: A technique for boosting underrepresented data classes

In any training dataset, some classes may have relatively few examples. A new technique can improve a trained model’s performance on such underrepresented classes. Researchers introduced a method that synthesizes extracted features of underrepresented classes.

June 10, 20202 min read
Augmentation for Features: A technique for boosting underrepresented data classes
Tsinghua University

Augmentation for Features: A technique for boosting underrepresented data classes

In any training dataset, some classes may have relatively few examples. A new technique can improve a trained model’s performance on such underrepresented classes. Researchers introduced a method that synthesizes extracted features of underrepresented classes.

June 10, 20202 min read
Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?
Tsinghua University

Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.

December 18, 20191 min read
Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?
Tsinghua University

Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.

December 18, 20191 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox