They’re suitable for use on phones, and potentially other small devices too.
The 1B and 3B models are purposely smaller to work on phones and can only understand text.
They replace previous generation 8B and 70B models that could only understand text.
They could harness the LLMs to create new user interfaces and ways to interact with devices, Bergey theorizes.
“I think early next year, if not even late this year,” he said.
Conventional LLM logic goes that the more parameters, the more powerful the language model.
Developers want to use smaller models for a vast majority of their roofline or on-equipment tasks, Srinivasan said.
For now, smartphones are suitable because they have both.
