Home > Events > CLIP Colloquium: Amr Sharaf (CS)
S M T W T F S
 
 
 
 
 
1
 
2
 
3
 
4
 
5
 
6
 
7
 
8
 
9
 
10
 
11
 
12
 
13
 
14
 
15
 
16
 
17
 
18
 
19
 
20
 
21
 
22
 
23
 
24
 
25
 
26
 
27
 
28
 
29
 
30
 
31
 
 
 
 
 
 
 

CLIP Colloquium: Amr Sharaf (CS)

Time: 
Wednesday, February 05, 2020 - 11:00 AM to 12:00 PM
Location: 
4105 Iribe Center

 

Meta-Learning for Few-Shot NMT Adaptation

Abstract: In this talk I'll present Meta-MT, a meta-learning approach to adapt Neural Machine Translation (NMT) systems in a few-shot setting. Meta-MT provides a new approach to make NMT models  easily adaptable to many target  domains with the minimal  amount of in-domain data. We frame the adaptation of NMT systems as a meta-learning problem, where we learn to adapt to new unseen domains based on simulated offline meta-training domain adaptation tasks. We evaluate the proposed meta-learning strategy on ten domains with general large scale NMT systems. We show that Meta-MT significantly outperforms classical domain adaptation when very few in-domain examples are available. Our experiments shows that Meta-MT can outperform classical fine-tuning by up to 2.5 BLEU points after seeing only 4,000 translated words (300 parallel sentences).

Bio: Amr Sharaf is a PhD candidate in the Computational Linguistics and Information Processing (CLIP) Lab at the University of Maryland, advised by Hal Daumé III. His research focuses on developing meta-learning algorithms in the context of structured prediction for AI and NLP. He is interested in applying reinforcement and imitation learning algorithms for meta-learning and structured prediction problems in weakly supervised settings.