Craft is a powerful and aesthetically pleasing document application that now integrates AI features primarily utilizing ChatGPT. Recently, Craft has released an update focused on AI capabilities, showcasing the effectiveness of on-device, offline AI…
The app boasts an AI assistant designed to enhance the document experience for users, offering flexibility by allowing selections from various model providers.
Over the weekend, Craft introduced a trial feature, enabling the option to test a local version of DeepSeek’s R1 model within the Craft AI assistant.
Presently, Craft employs the smallest R1 model, which occupies less than 1GB of storage and contains 1.5 billion parameters. Users must manually download this option if they wish to utilize it.
Following initial feedback, Craft is working on an update that will introduce the more advanced R1 model, featuring 7 billion parameters. This model requires approximately 4GB of local storage but significantly enhances accuracy.
Both models can operate completely offline once installed, ensuring that Craft does not transmit your data to Chinese servers. These local models are distinct from the cloud-based options available through the DeepSeek app and website.
The exploration of a local, offline model has pushed Craft in an interesting direction. Consequently, Craft plans to include two additional installable models from Meta: LLaMa models with 1 billion and 3 billion parameters, requiring less than 700MB and 2GB of storage, respectively.
The Craft AI assistant continues to have access to server-connected models like ChatGPT. However, the introduction of new local models hints at a shift toward generative AI capabilities are being integrated into iPhones, iPads, and Macs — including the Apple Vision Pro, which currently lacks Apple Intelligence!
Discover more on Craft’s latest developments by visiting their blog:
By default, the DeepSeek model is not pre-installed in Craft. If users opt to download and activate R1, their data remains solely on their device. This feature is particularly beneficial for everyday tasks that require convenience, such as taking quick notes, organizing to-do lists, or summarizing short texts. It also supports basic reasoning functions without needing an internet connection.
On-device AI models operate somewhat like electric vehicles. They provide immediate responsiveness, eliminating the necessity for frequent stops at filling stations, making them well-suited for shorter tasks. However, for longer journeys through varying environments, a traditional gas engine may still prove more dependable. Notably, some of the fastest sports cars in the world combine electric and gas power for optimal performance.
We believe AI will evolve similarly. On-device models like the smaller R1 and Apple Intelligence can handle routine tasks, while advanced cloud models like ChatGPT are better suited for more demanding cognitive tasks. Our goal is to provide both options, enabling users to effortlessly switch between “engines” in Craft’s AI Assistant.
Learn more about Craft by visiting their website.
Top iPhone Accessories
: . More.
