Create 1.ai_history_references.md

chapter_1/1.ai_history_references.md

@@ -0,0 +1,53 @@
+## A Brief Guide to AI History and References
+
+We are not experts in AI history, but we think it is important to have context around how AI agents were developed. This page collects references we've found useful in understanding key developments and how we got to the AI agents we use today. 
+
+If you're looking to learn more about the evolution of AI, large language models (LLMs), and their applications in science, the links below may help. Otherwise, we suggest skipping forward to Chapter 2 to the practical applications of AI agents in biology.
+
+## Foundational Papers
+
+These papers mark key developments in modern AI, from the invention of the Transformer to reasoning and agent capabilities.
+
+* [Attention Is All You Need](https://arxiv.org/abs/1706.03762) — Vaswani _et al._ (2017). The Transformer architecture that replaced recurrence with self-attention, becoming the basis for all modern large language models.
+* [Scaling Laws for Neural Language Models](https://arxiv.org/abs/2001.08361) — Kaplan _et al._ (2020). Showed that model performance improves predictably with more parameters, data, and compute. This gave a map for how to improve intelligence of models.
+* [Language Models are Few-Shot Learners](https://arxiv.org/abs/2005.14165) — Brown _et al._ (2020). Demonstrated that large language models can perform a wide range of tasks with only a few examples, without task-specific fine-tuning. Showed transformers have general intelligence.
+* [Chain-of-Thought Prompting](https://arxiv.org/abs/2201.11903) — Wei _et al._ (2022). Showed that prompting models to produce intermediate reasoning steps substantially improves performance on complex tasks. Showed that expending more inference compute and give better answers.
+* [ReAct: Reasoning and Acting in Language Models](https://arxiv.org/abs/2210.03629) — Yao _et al._ (2022). Interleaved reasoning traces with tool use, establishing a pattern for building autonomous agents from LLMs. The foundational agents paper.
+* [DeepSeek-R1](https://arxiv.org/abs/2501.12948) — DeepSeek-AI (2025). Demonstrated the reinforcement learning can break out of the scaling laws and LLMs can improve simply be repeatedly attempting tasks rather than requiring worked-out examples.
+
+## AI Agents in Science
+
+Papers on building and using AI agents for scientific research, including from FutureHouse co-founders Andrew White and Sam Rodriques.
+
+* [ChemCrow: Augmenting large-language models with chemistry tools](https://www.nature.com/articles/s42256-024-00832-8) – Bran, Cox, …, White, Schwaller (2023). Showed that LLMs equipped with chemistry-specific tools can autonomously plan and execute multi-step chemical tasks, establishing a template for tool-augmented scientific agents. (_FutureHouse_)
+* [PaperQA2: Language agents achieve superhuman synthesis of scientific knowledge](https://arxiv.org/abs/2409.13740) – Skarlinski, Cox, …, Rodriques, White (2024). Showed that a language agent optimized for factuality matches or exceeds human subject matter experts on literature research tasks. (_FutureHouse_)
+* [Aviary: Training Language Agents on Challenging Scientific Tasks](https://arxiv.org/abs/2412.21154) — Narayanan, Braza, ..., Rodriques, White (2024). Introduced Aviary, a framework for multi-step reasoning and tool use across scientific tasks for language agents. Showed that language agents backed by open-source, non-frontier LLMs can match and exceed both frontier LLM agents and human experts on domain-specific scientific tasks. (_FutureHouse_)
+* [A Review of Large Language Models and Autonomous Agents in Chemistry](https://pubs.rsc.org/en/content/articlelanding/2025/sc/d4sc03921a) — Ramos, Collison, White (2025). A comprehensive review of how LLMs and autonomous agents are being applied across chemistry. (_FutureHouse_)
+* [ether0: Training a Scientific Reasoning Model for Chemistry](https://arxiv.org/abs/2506.17238) – Narayanan, …, Rodriques, White (2025). Demonstrated that reasoning capabilities can be post-trained into LLMs for chemistry without domain-specific pretraining, achieving strong performance with substantially less data than contemporary domain models. (_FutureHouse_)
+* [Kosmos: An AI Scientist for Autonomous Discovery](https://arxiv.org/abs/2511.02824) — Mitchener, Yiu, …, Rodriques, White (2025). Showed that an AI scientist can autonomously conduct data-driven discovery through iterative cycles of literature search, hypothesis generation, and data analysis, maintaining coherence over extended research trajectories. (_FutureHouse_)
+* [Robin: A multi-agent system for automating scientific discovery](https://www.nature.com/articles/s41586-026-10652-y) — Ghareeb, Chang, …, White, Hinks, Rodriques (2026). A multi-agent system that automates the full cycle of scientific discovery — from hypothesis generation through experimental design to analysis — demonstrated with real biological experiments. (_FutureHouse_; [arxiv](https://arxiv.org/abs/2505.13400))
+* [Accelerating scientific discovery with Co-Scientist](https://www.nature.com/articles/s41586-026-10644-y) – Gottweis et al. (2026). Introduced a multi-agent system built on Gemini that generates and iteratively refines scientific hypotheses using tournament evolution and scaled test-time compute, with experimental validation in drug repurposing for acute myeloid leukemia. (_Google_; [arxiv](https://arxiv.org/abs/2502.18864))
+* [Autonomous biomedical research with an artificial intelligence agent](https://www.science.org/doi/10.1126/science.adz4351) — Huang et al. (2025). Built a general-purpose biomedical agent capable of performing diverse tasks across clinical, genomic, and biomedical domains within a unified framework. (_Stanford/Biomni_; [arxiv](https://www.biorxiv.org/content/10.1101/2025.05.30.656746v1))
+
+## Perspectives on AI History
+
+We're not the only ones to summarize history of AI Agents, check out these other introductions to the history and landmark papers:
+
+* [Ilya Sutskever's Reading List](https://aiconnections.substack.com/p/ilya-sutskevers-reading-list) — A curated set of papers recommended by the OpenAI co-founder for understanding deep learning foundations.
+* [An Interview with Alex Krizhevsky](https://www.youtube.com/watch?v=gwzwkv2hO5k) — Krizhevsky discusses AlexNet and the deep learning revolution in computer vision. (video)
+* [Geoffrey Hinton: The 60 Minutes Interview](https://www.youtube.com/watch?v=Rl9nHNeketE) — The "godfather of deep learning" on the promise and risks of AI. (video)
+* [Andrej Karpathy's Intro to LLMs](https://www.youtube.com/watch?v=zjkBMFhNj_g) — A one-hour talk covering how LLMs work, from tokenization to training to inference. (video)
+
+## Additional Resources on LLMs and Deep Learning
+
+Here are AI for science topics that are good to know, but not directly related to LLMs and their use in AI agents:
+
+* [7 AI Terms You Need to Know](https://www.youtube.com/watch?v=VSFuqMh4hus) — Video primer on common AI terminology. (_IBM_)
+* [Hugging Face LLM Course](https://huggingface.co/learn/llm-course/chapter0/1) — Highly recommended. A hands-on course covering LLM fundamentals, fine-tuning, and deployment. (_Hugging Face_)
+* [LLM Pre-Training and Custom LLMs](https://www.databricks.com/blog/llm-pre-training-and-custom-llms) — How LLMs are pre-trained from scratch and adapted for specific domains. (_Databricks_)
+* [Aligning Language Models to Follow Instructions](https://openai.com/index/instruction-following/) — OpenAI's blog post on instruction-tuning with RLHF (InstructGPT). (_OpenAI_)
+* [A Comprehensive Introduction to Fine-Tuning LLMs](https://medium.com/@sahin.samia/a-comprehensive-introduction-to-fine-tuning-llms-4d1bcc95a83a) — Overview of fine-tuning strategies including LoRA and full fine-tuning. (_Medium_)
+* [What is fine-tuning?](https://www.ibm.com/think/topics/fine-tuning) — IBM's explanation of fine-tuning techniques and when to use them. (_IBM_)
+* [Explaining the Transformer Model](https://www.youtube.com/watch?v=wjZofJX0v4M) — Video with a visual walkthrough of the Transformer architecture. (_Grant Sanderson_)
+* [Attention Mechanism in Transformers](https://www.youtube.com/watch?v=eMlx5fFNoYc) — Video of a detailed explanation of how attention works inside Transformers. (_Grant Sanderson_)
+* [Deep Learning for Molecules & Materials](https://dmol.pub/index.html#) — Andrew White's open textbook on ML for chemistry and materials. (_FutureHouse_)