Yonatan Bitton

Yonatan Bitton

CS PhD candidate, Research Intern at Google

The Hebrew University of Jerusalem

Biography

I am a PhD candidate in The Hebrew University of Jerusalem, Israel, advised by Dr. Roy Schwartz and Dr. Gabriel Stanovsky. Additionally, I am a research intern at Google Research in Tel-Aviv.

The goal of my research is to improve vision and language generalization. Specifically, I aim to develop models with better compositionality abilities, less biased and better perform on real-world examples. See my publications for more details.

I did my MSc with Prof. Michael Elhadad and Prof. Eitan Bachmat, at the Ben Gurion University.

Download my complete CV.

Education

  • PhD in Computer Science (Vision-and-Language), 2020

    The Hebrew University of Jerusalem, Israel

  • MSc in Computer Science (Natural Language Processing), Magna cum laude, 2018

    Ben Gurion University of the Negev, Israel

  • BSc in Computer Science, 2015

    Ben Gurion University of the Negev, Israel

Publications

Transferring Visual Attributes from Natural Language to Verified Image Generation
Transferring Visual Attributes from Natural Language to Verified Image Generation
Rodrigo Valerio, Joao Bordalo, Michal Yarom, Yonatan Bitton, Idan Szpektor, Joao Magalhaes
May 2023
arXiv PDF
What You See is What You Read? Improving Text-Image Alignment Evaluation
What You See is What You Read? Improving Text-Image Alignment Evaluation
Michal Yarom*, Yonatan Bitton*, Soravit "Beer" Changpinyo, Roee Aharoni, Jonathan Herzig, Oran Lang Eran Ofek Idan Szpektor
May 2023
arXiv Website PDF Tweet
q2d: Turning Questions into Dialogs to Teach Models How to Search
q2d: Turning Questions into Dialogs to Teach Models How to Search
Yonatan Bitton, Shlomi Cohen-Ganor, Ido Hakimi, Yoad Lewenberg, Roee Aharoni, Enav Weinreb
April 2023
arXiv Website PDF Tweet
DataComp: In search of the next generation of multimodal datasets
DataComp: In search of the next generation of multimodal datasets
Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, Jonathan Hayase, Georgios Smyrnis, Thao Nguyen, Ryan Marten, Mitchell Wortsman, Dhruba Ghosh, Jieyu Zhang, Eyal Orgad, Rahim Entezari, Giannis Daras, Sarah Pratt, Vivek Ramanujan Yonatan Bitton Kalyani Marathe Stephen Mussmann Richard Vencu Mehdi Cherti Ranjay Krishna Pang Wei Koh Olga Saukh Alexander Ratner Shuran Song Hannaneh Hajishirzi Ali Farhadi Romain Beaumont Sewoong Oh Alex Dimakis Jenia Jitsev Yair Carmon Vaishaal Shankar Ludwig Schmidt
April 2023
arXiv PDF Website GitHub LAION Blog Tweet
OpenFlamingo: An open-source framework for training vision-language models with in-context learning
OpenFlamingo: An open-source framework for training vision-language models with in-context learning
Anas Awadalla, Irena Gao, Joshua Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Gadre, Jenia Jitsev, Simon Kornblith, Pang Wei Koh, Gabriel Ilharco, Mitchell Wortsman, Ludwig Schmidt
Mar 2023
Website Code Hugging Face
IRFL: Image Recognition of Figurative Language
IRFL: Image Recognition of Figurative Language
Ron Yosef, Yonatan Bitton, Dafna Shahaf
Mar 2023
arXiv Website PDF Cite Tweet
WHOOPS! A Vision-and-Language Commonsense Benchmark of Heterogeneous Objects and Situations
WHOOPS! A Vision-and-Language Commonsense Benchmark of Heterogeneous Objects and Situations
Nitzan Bitton-Guetta*, Yonatan Bitton*, Jack Hessel, Ludwig Schmidt, Yuval Elovici, Gabriel Stanovsky, Roy Schwartz
Mar 2023
arXiv Website PDF Cite Evaluation Code Hugging Face
VASR: Visual Analogies of Situation Recognition
VASR: Visual Analogies of Situation Recognition
Yonatan Bitton, Ron Yosef, Eli Strugo, Dafna Shahaf, Roy Schwartz, Gabriel Stanovsky
Dec 2022 AAAI 2023
🎉 Selected as Oral Presentation
arXiv Website PDF Cite Code Hugging Face Tweet
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
Yonatan Bitton*, Nitzan Bitton-Guetta*, Ron Yosef, Yuval Elovici, Mohit Bansal, Gabriel Stanovsky, Roy Schwartz
Jul 2022 NeurIPS 2022
🎉 Selected as Featured Presentation
arXiv Website PDF Cite Code Poster Papers With Code Hugging Face Tweet
Data Efficient Masked Language Modeling for Vision and Language
Data Efficient Masked Language Modeling for Vision and Language
Yonatan Bitton, Gabriel Stanovsky, Michael Elhadad, Roy Schwartz
September 2021 Findings of EMNLP 2021
arXiv PDF Cite Code Poster Video Tweet
Data Efficient Masked Language Modeling for Vision and Language
Automatic Generation of Contrast Sets from Scene Graphs
Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad
March 2021 NAACL 2021
arXiv PDF Cite Code Poster Video Tweet
Cross lingual Unified Medical Language System entity linking in online health communities
Cross lingual Unified Medical Language System entity linking in online health communities
Yonatan Bitton, Raphael Cohen, Tamar Schifter, Eitan Bachmat, Michael Elhadad, Noémie Elhadad,
Sep 2020 JAMIA 2020
PDF Cite Code

Work Experience

 
 
 
 
 
Google Research
Research Intern
Google Research
Jul 2022 – Present Israel
Cerebra team, Conversational AI, working with LLMs (LaMDA, PaLM, BARD, etc)
 
 
 
 
 
Amazon Lab126
Applied Scientist Intern
Amazon Lab126
Oct 2019 – July 2022 Israel
Visual Fitness - Halo team
Developed a virtual fitness trainer, specializing in 2D/3D pose estimation, action recognition, error correction, on-device deployment and more.
 
 
 
 
 
IBM Research
Research Student
IBM Research
Jun 2017 – Oct 2019 Israel
Using data-science and machine-learning methods in order to detect frauds

Invited Talks

Bridging Vision and Language with Data: From Perception to Understanding
April-June 2023 Hebrew University of Jerusalem, NLP-IL Reading Group, Microsoft Israel (MSAI-HIVE team), Meta AI Research Tel-Aviv, Technion, Ben Gurion University, Google Tel-Aviv, Bar-Ilan University
Commonsense Benchmarks for Vision and Language
November 2022 NLP Seminar at Cornell Tech, Google Research Israel, the Hebrew University of Jerusalem
q2d: Turning Questions into Dialogs to Teach Models How to Search
September 2022 Conversational applications with LLMs - Summit in Google Zurich
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
June 2022 IBM Research Israel
VASR: Visual Analogies of Situation Recognition
May 2022 Computer Vision Seminar at the Hebrew University of Jerusalem

Others

Managing Research
This talk deals with several research related questions. For example findings new research ideas, choose a research topic, staying updated with new research, working with your supervisors, and more.
Yonatan Bitton
Jan 5, 2022
Managing Research
AirPal
A platform that connects drone pilots with people in need of drone services.
This project participated in Starter - Jump course and won 1st place in the final Demo Day event.
Press coverage: telecomnews, israeldefense, sheva7.
Yonatan Bitton
June, 2018
AirPal