Inside Phi 2: Microsoft’s small language model
2023 was very much the year of the large language model. OpenAI’s GPT models, Meta’s Llama, Google’s PaLM, and Anthropic’s Claude 2 are all large language models, or LLMs, with many billions of parameters, trained on content from the internet, and used to generate text and code.