This patent discloses systems and methods developed by OpenAI for automatically generating and editing text using language models (LMs). The core innovation lies in a flexible approach that takes an input text prompt and user instructions to access a language model, generate output text, and then edit the original prompt by replacing portions with the LM's output. The patent also covers systems for automatically generating and inserting text based on prefix and suffix prompts. A key emphasis is placed on iterative refinement of the LM through training and optimization based on user interactions and labeled data.