TEXTGRAD: Automatic Differentiation via Text

This collection of excerpts introduces TEXTGRAD, a novel framework that applies the concept of automatic differentiation to complex AI systems composed of multiple large language models and other components. Instead of using numerical gradients like traditional deep learning, TEXTGRAD employs natural language feedback from LLMs to guide the optimization process. The framework, designed with PyTorch-like syntax for ease of use, transforms AI systems into computation graphs where LLMs provide textual "gradients" suggesting how variables (including code, prompts, molecular structures, and medical plans) should be adjusted to improve an objective function. The paper demonstrates TEXTGRAD's effectiveness across diverse tasks, achieving notable improvements in areas like code optimization, question answering, and even scientific applications such as drug design and radiotherapy planning.