How does black-box distillation actually work? In our new blog, we break the distillation process down into five steps based on an in-depth review of the published literature: 1️⃣ Define the objective of the distillation and select the student and teacher models. 2️⃣ Collect seed data that will be inputted into the teacher. 3️⃣ Steer the teacher toward desired outputs. 4️⃣ Elicit synthetic data from the steered teacher by prompting it with seed data. 5️⃣ Train the student on the synthetic data through various techniques.