Publications
Asterisks (*) denote equal contribution. In mathematics, authors are ordered alphabetically by last name, not by relative contribution to the work.
Preprints
- 2024 Sep 06 How Does Code Pretraining Affect Language Model Task Performance? Jackson Petty, Sjoerd van Steenkiste and Tal Linzen. arXiv • Slides (UT Austin) • Poster (BlackboxNLP) 2024 Sep 06
- 2023 Nov 13 Debate Helps Supervise Unreliable Experts. Julian Michael, Salsabila Mahdi, David Rein, Jackson Petty, Julien Dirani, Vishakh Padmakumar and Samuel R. Bowman. arXiv • GitHub 2023 Nov 13
Published Papers
- 2024 Oct 07 GPQA: A Graduate-Level Google-Proof Q&A Benchmark. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael and Samuel R. Bowman. arXiv • GitHub • COLM 2024 Oct 07
- 2024 Apr 16 The Illusion of State in State-Space Models. William Merrill, Jackson Petty and Ashish Sabharwal. arXiv • GitHub 2024 Apr 16
- 2023 Nov 13 In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax. Aaron Mueller, Albert Webson, Jackson Petty and Tal Linzen. arXiv • GitHub 2023 Nov 13
- 2023 Nov 08 How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure. Michael Wilson, Jackson Petty and Robert Frank. arXiv • TACL • Slides (EMNLP 2023) 2023 Nov 08
- 2023 Oct 30 The Impact of Depth on Compositional Generalization in Transformer Language Models. Jackson Petty, Sjoerd van Steenkiste, Ishita Dasgupta, Fei Sha, Dan Garrette and Tal Linzen. arXiv • Poster • Slides • Presentation 2023 Oct 30
- 2023 Jul 01 (QA)$^2$: Question Answering with Questionable Assumptions. Najoung Kim, Phu Mon Htut, Samuel R. Bowman and Jackson Petty. ACL • arXiv 2023 Jul 01
- 2023 Mar 02 Optimal monohedral tilings of hyperbolic surfaces. Leonardo Di Giosa, Jahangir Habib, Jack Hirsch, Lea Kenigsberg, Kevin Li, Dylanger Pittman, Jackson Petty, Christopher Xue and Weitao Zhu. arXiv • RHUMJ 2023 Mar 02
- 2022 Jun 18 Do Language Models Learn Position-Role Mappings? Jackson Petty, Michael Wilson and Robert Frank. arXiv • BUCLD (PDF) • presentation 2022 Jun 18
- 2022 Apr 28 Characterizing Algebraic Generalization in Linguistic Neural Networks. Jackson Petty. PDF 2022 Apr 28
- 2021 Dec 28 The Optimal Double Bubble for Density $r^p$. Jack Hirsch, Kevin Li, Jackson Petty and Christopher Xue. arXiv • RHUMJ 2021 Dec 28
- 2021 Sep 24 Transformers Generalize Linearly. Jackson Petty and Robert Frank. arXiv 2021 Sep 24
- 2021 Feb 20 Certain hyperbolic regular polygonal tiles are isoperimetric. Jack Hirsch, Kevin Li, Jackson Petty and Christopher Xue. arXiv • Geometriae Dedicata 2021 Feb 20
- 2020 Nov 02 Sequence to sequence networks learn the meaning of reflexive anaphora. Robert Frank* and Jackson Petty*. arXiv • ACL • presentation 2020 Nov 02