The more NLI pre-training the better

Combining

NLI training datasets helps (also in TACRED)

Is this because of a brilliant domain-expert?

● We gave the task to a computational linguist PhD

● Very similar results across all training regimes

● Replicable, robust to variations in prompts

● She also found writing prompts very friendly: “Writing templates is more natural and rewarding than annotating examples, which is more repetitive, stressful and tiresome.”

“When writing templates, I was thinking in an abstract manner, trying to find generalizations. When doing annotation I was paying attention to concrete cases.”

Is this because of a brilliant domain-expert?

● We gave the task to a computational linguist PhD

● Very similar results across all training regimes

● Replicable, robust to variations in prompts

● She also found writing prompts very friendly: “Writing templates is more natural and rewarding than annotating examples, which is more repetitive, stressful and tiresome.”

“When writing templates, I was thinking in an abstract manner, trying to find generalizations. When doing annotation I was paying attention to concrete cases.”