Five few-shot examples nearly doubled the cost of my short LLM prompt
Dev Communityvia NewsData.io
You write a prompt that turns messy expense notes into JSON. The model gets the format slightly wrong once, so you add an example of a note and the JSON you expect. Then a second one for euros, a third for dates, and two more for luck. The output looks great and the prompt ships. What doesn't show up in testing is that those five examples get sent and billed again on every call, and in a short prompt they end up costing more than the task itself. What you're paying for Model APIs bill per token, a chunk of text about three-quarters of an English word. Input tokens are everything you send; outp
Headline and summary provided via NewsData.io. The full article and its copyright belong to the original publisher.
