Key Points
The framework has the potential to offer various capabilities, with a ChatGPT-like application, unofficially dubbed "Apple GPT," being just one of the many possibilities..
Recent indications from an Apple research paper suggest that Large Language Models (LLMs) may run on Apple devices, including iPhones and iPads..
Reportedly, the proposed solution in the paper involves on-device execution of LLMs by storing the model parameters in flash memory and retrieving them as needed into DRAM. ..
Keivan Alizadeh, a Machine Learning Engineer at Apple and the primary author of the paper, explained, "Our approach entails developing an inference cost model that aligns with the characteristics of flash memory, directing us to enhance optimization in two crucial aspects: minimizing the amount of data transferred from flash and reading data in larger, more cohesive segments.".
Theoretically, this adaptive loading based on context could enable the execution of Large Language Models (LLMs) on devices with constrained memory, like iPhones and iPads...
You might be interested in
Meta joins AI chatbot race with own large language model for researchers
26, Feb, 23Smaller models trained on more tokens which are pieces of words are easier to retrain and finetune for specific potential product use cases