Scholar
Jacob Beck
Google Scholar ID: PrS_dHMAAAAJ
Oracle Labs
Citations & Impact
Citations
489
H-index
11
i10-index
11
Publications
20
Co-authors
7
list available
Publications
Browse publications on Google Scholar (top-right) ↗
Resume (English only)
Academic Achievements
- Authored a survey of meta-RL; Developed an RL agent in Minecraft using emotion detection as feedback; Used a GAN to reconstruct corrupted images; Some work in the self-driving car lab gained publicity in New Scientist.
Research Experience
- Research Scientist at Oracle Labs working on coding agents; Research in deep reinforcement learning (RL) at WhiRL lab; Worked on autonomous vehicles in both academia and industry; Pre-doc at Microsoft Research on long-term memory in RL; Developed novel methods for instance segmentation at DeepScale (acquired by Tesla); Designed a framework for sequential decision-making problems at Lyft; Built neural networks to forecast marketing data at Adobe; Researched large language models (LLMs) for proteins at InstaDeep; Worked on software and hardware at a robotics startup.
Education
- Master's and Bachelor's degrees from Brown University, advised by Michael Littman; DPhil (PhD) from the University of Oxford, supervised by Shimon Whiteson, funded by the Oxford-Google DeepMind Doctoral Scholarship.
Background
- Broadly, my interests include generalization, adaptation, and representation. Specifically, topics include learning to learn (in-context), sequence models, and few-shot learning – including intersections with multi-agent RL and offline learning. I am also interested in human (and AI) feedback, vision-language models for environment design, and any challenging problem in ML.
Miscellany
- Co-created Food with Friends (an iOS app); Served as a TA for the first iteration of Brown's graduate-level deep learning course, designed a lab and gave a guest lecture on sequence-to-sequence machine translation.
