Contrary to the interpretation of implied by the title of the original GPT-3 paper by Brown et al. [3], Language models are few-shot learners, we argue that GPT-3 is often not actually learning the task during run time from few-shot examples.
Prompt Programming is Programming in Natural Language, which avails us of an inexhaustible number of functions we know intimately but don’t have names for.