Definition
Prompt engineering is the deliberate design of the inputs given to a language model so that it produces accurate, relevant, and well-structured outputs. Because it works entirely through the prompt — the instructions, context, and examples you supply — it changes the model's behaviour without modifying any internal parameters. It is the cheapest and fastest lever for improving results, and the first one a self-hoster should reach for before considering fine-tuning.
Core techniques
Several patterns recur. Zero-shot prompting gives the model only instructions and context, relying on its pretrained knowledge with no examples. Few-shot prompting includes a handful of input-output examples (typically three to five) to demonstrate the desired task and format. Chain-of-thought prompting asks the model to reason step by step, improving accuracy on multi-step problems. Clear, precise, unambiguous instructions consistently outperform vague ones.
Why it matters
For sovereign, locally-run AI, prompt engineering is often the difference between an unreliable toy and a dependable tool. Good prompts let a modest open-weight model punch well above its size on focused tasks — summarising a spec sheet, extracting an error code, drafting a diagnostic checklist — all on hardware you control.
Prompt engineering pairs naturally with a strong system prompt to set persistent behaviour, and with retrieval-augmented generation when answers need to be grounded in your own trusted data.
Estimate token usage in the inference cost calculator.
In Simple Terms
Prompt engineering is the deliberate design of the inputs given to a language model so that it produces accurate, relevant, and well-structured outputs. Because it…