Tag: llm
All the articles with the tag "llm".
Your LLM can't hallucinate a number it was never given
Anti-hallucination gets written as a prompt rule. It belongs in the code that builds the prompt, and the sharpest version of it is one line long.
Cache the prompt, not the inputs
The key listed the inputs someone believed mattered. The prompt had grown three fields since, and nothing in the system could have noticed.