PaLM: Scaling Language Modeling with Pathways
At a glance
Presented PaLM, a large language model demonstrating gains in reasoning, translation and coding.
In one paragraph
Introduced Google's PaLM language model, showing how larger-scale training improved reasoning, translation and coding from just a few examples. It used the Pathways system to train a single model across thousands of specialized chips.
Authors 67
- Aakanksha Chowdhery
- Sharan Narang
- Jacob Devlin
- Maarten Bosma
- Gaurav Mishra
- Adam Roberts
- Paul Barham
- Hyung Won Chung
- Charles Sutton
- Sebastian Gehrmann
- Parker Schuh
- Kensen Shi
- Sasha Tsvyashchenko
- Joshua Maynez
- Abhishek Rao
- Parker Barnes
- Yi Tay
- Noam Shazeer
- Vinodkumar Prabhakaran
- Emily Reif
- Nan Du
- Ben Hutchinson
- Reiner Pope
- James Bradbury
- Jacob Austin
- Michael Isard
- Guy Gur-Ari
- Pengcheng Yin
- Toju Duke
- Anselm Levskaya
- Sanjay Ghemawat
- Sunipa Dev
- Henryk Michalewski
- Xavier Garcia
- Vedant Misra
- Kevin Robinson
- Liam Fedus
- Denny Zhou
- Daphne Ippolito
- David Luan
- Hyeontaek Lim
- Barret Zoph
- Alexander Spiridonov
- Ryan Sepassi
- David Dohan
- Shivani Agrawal
- Mark Omernick
- Andrew M. Dai
- Thanumalayan Sankaranarayana Pillai
- Marie Pellat
- Aitor Lewkowycz
- Erica Moreira
- Rewon Child
- Oleksandr Polozov
- Katherine Lee
- Zongwei Zhou
- Xuezhi Wang
- Brennan Saeta
- Mark Diaz
- Orhan Firat
- Michele Catasta
- Jason Wei
- Kathy Meier-Hellstern
- Douglas Eck
- Jeff Dean
- Slav Petrov
- Noah Fiedel
