Adina Williams

RESEARCH SCIENTIST | NEW YORK CITY, UNITED STATES

Adina is a Research Scientist at Facebook AI Research in NYC (started October 2018). Previously, she earned her PhD at New York University in the Department of Linguistics, where she investigated the brain basis of syntactic and semantic processing. Her main research goal is to strengthen the connections between linguistics and cognitive science on the one hand and natural language processing and artificial intelligence on the other. She approaches this process from both directions: she brings linguistic and cognitive scientific insights about human language to bear on training, evaluating, and debiasing NLP systems, and also applies statistical methods and corpus analytic tools from NLP to uncover new quantitative, cross-linguistic facts about particular human languages.

Adina's Work

Adina's Publications

June 14, 2024

COMPUTER VISION

Decomposed evaluations of geographic disparities in text-to-image models

Abhishek Sureddy, Dishant Padalia, Nandhinee Periyakaruppa, Oindrila Saha, Adina Williams, Adriana Romero Soriano, Megan Richards, Polina Kirichenko, Melissa Hall

June 14, 2024

November 06, 2023

CONVERSATIONAL AI

NLP

ROBBIE: Robust Bias Evaluation of Large Generative Language Models

David Esiobu, Ellen Tan, Saghar Hosseini, Megan Ung, Yuchen Zhang, Jude Fernandes, Jane Yu, Eleonora Presani, Adina Williams, Eric Smith

November 06, 2023

November 01, 2023

NLP

The validity of evaluation results: assessing concurrence across compositionality benchmarks

Kaiser Sun, Adina Williams, Dieuwke Hupkes

November 01, 2023

July 18, 2023

CONVERSATIONAL AI

NLP

Llama 2: Open Foundation and Fine-Tuned Chat Models

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Praj Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Andrew Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, Thomas Scialom

July 18, 2023

July 10, 2023

HUMAN & MACHINE INTELLIGENCE

NLP

Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks

Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela

July 10, 2023

June 21, 2023

HUMAN & MACHINE INTELLIGENCE

NLP

Benchmarking Compositionality with Formal Languages

Josef Valvoda, Naomi Saphra, Jonathan Rawski, Adina Williams, Ryan Cotterell

June 21, 2023

December 09, 2022

CONVERSATIONAL AI

NLP

"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset

Eleonora Presani, Adina Williams, Eric Michael Smith, Melanie Kambadur, Melissa Hall

December 09, 2022

December 01, 2022

NLP

CORE MACHINE LEARNING

The Curious Case of Absolute Position Embeddings

Koustuv Sinha, Adina Williams, Dieuwke Hupkes, Joelle Pineau, Amirhossein Kazemnejad, Siva Reddy

December 01, 2022

June 20, 2022

On the Machine Learning of Ethical Judgments from Natural Language

Adina Williams, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, Zeerak Talat

June 20, 2022

June 03, 2022

Based on billions of words on the internet, PEOPLE = MEN

Adina Williams, Andrei Cimpian, April Bailey

June 03, 2022

September 23, 2021

Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little

Koustuv Sinha, Adina Williams, Dieuwke Hupkes, Douwe Kiela, Joelle Pineau, Robin Jia

September 23, 2021

September 19, 2021

Generalising to German Plural Noun Classes, from the Perspective of a Recurrent Neural Network

Dieuwke Hupkes, Adina Williams, Anna Langedijk, Kate McCurdy, Verna Dankers

September 19, 2021

June 29, 2020

RESEARCH

NLP

Adversarial NLI: A New Benchmark for Natural Language Understanding

Douwe Kiela, Adina Williams, Emily Dinan, Jason Weston, Mohit Bansal, Yixin Nie

June 29, 2020

June 26, 2020

NLP

On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs

Adina Williams, Damian Blasi, Hanna Wallach, Lawrence Wolf-Sonkin, Ryan Cotterell

June 26, 2020

June 26, 2020

RESEARCH

NLP

Information-Theoretic Probing for Linguistic Structure

Adina Williams, Joseph Valvoda, Ran Zmigrod, Rowan Hall Maudsley, Ryan Cotterell, Tiago Pimentel

June 26, 2020

June 19, 2020

RESEARCH

NLP

Predicting Declension Class from Form and Meaning

Adina Williams, Arya McCarthy, Eleanor Chodroff, Hagen Blix, Ryan Cotterell, Tiago Pimentel

June 19, 2020

June 19, 2020

RESEARCH

NLP

A Tale of a Probe and a Parser

Adina Williams, Joseph Valvoda, Rowan Hall Maudsley, Ryan Cotterell, Tiago Pimentel

June 19, 2020

June 19, 2020

RESEARCH

NLP

Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition

Adina Williams, Suvrat Bhooshan, Alex Warstadt, Paloma Jeretic

June 19, 2020

October 09, 2019

RESEARCH

NLP

Quantifying the Semantic Core of Gender Systems

Adina Williams, Ryan Cotterell, Damian Blasi, Hanna Wallach, Lawrence Wolf-Sonkin

October 09, 2019