the.ai

Behaviour / Interface

verified

Prompt Engineering

Getting a better answer by asking differently. It sounds like a trick and is really an admission: the model has a capability, the phrasing you reached for did not elicit it, and finding the phrasing that does is work. The word "engineering" is contested precisely because the practice is empirical in a way engineering usually is not.

Viz primitive · budget-splittuning-lost = 6

tuning-lost holds 17% of the budget; rest holds the remaining 83%.

Prompt tuning that stops working after a model upgrade, against the part that survives, in equal units. Drag the lost share up to watch the investment evaporate — which is the case for putting the effort into an evaluation set instead, since that carries over.

6

Reviewed by opendroid · 2026-08-18

  • arXiv:2107.13586 — Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing
  • arXiv:2005.14165 — Language Models are Few-Shot Learners