[Update: Now featuring new models and available on Mac.]
Craft presents an elegant and powerful document application integrated with AI, mainly driven by ChatGPT. Recently, Craft has rolled out an update focusing on AI capabilities, showcasing the strength of on-device, offline AI…
Equipped with an AI assistant, Craft simplifies document management for users. The Craft AI assistant offers flexibility, allowing users to select models from various providers.
Over the past weekend, Craft introduced an experimental feature to try out a local version of DeepSeek’s R1 model for the Craft AI assistant.
The current implementation of Craft utilizes the compact R1 model, requiring under 1GB of storage and featuring 1.5 billion parameters. Utilizing this model is entirely optional, and users must download it manually to begin.
Initial feedback has prompted Craft to prepare an update enabling the use of a more advanced R1 model with 7 billion parameters. This model occupies roughly 4GB of local storage but significantly enhances accuracy.
Both models function entirely offline post-installation; Craft does not transmit your data to servers in China. These local models are distinct from the cloud-based systems operable by the DeepSeek app and website.
Exploring a local, offline model has directed Craft toward fascinating possibilities. Consequently, Craft plans to offer two installable models from Meta: LLaMa models with 1 billion and 3 billion parameters, which consume less than 700MB and 2GB respectively.
The Craft AI assistant continues to leverage cloud-connected AI models like ChatGPT. However, these new local, offline models signal a future where generative AI can operate seamlessly on our iPhones, iPads, and Macs — and even the Apple Vision Pro, which currently lacks Apple Intelligence!
For more information on the latest updates, check Craft’s blog:
By default, Craft does not have the DeepSeek model installed. If you opt to download and activate R1, your data remains on your device. This feature is perfect for daily tasks that require convenience – such as jotting down notes, organizing tasks, or summarizing brief texts. Moreover, it facilitates basic reasoning tasks offline.
On-device AI models operate much like electric vehicles. They provide swift performance, eliminating the need for frequent stops for refueling and are well-suited for short trips. However, for extended travel across diverse terrains, a traditional gasoline engine might still be preferable. Interestingly, some of the fastest cars available today are hybrids, combining electric motors with gasoline engines for optimal performance.
We envision AI following a similar trajectory. On-device models like the smaller R1s and Apple Intelligence can efficiently handle routine tasks, while more sophisticated, cloud-based models like ChatGPT remain the go-to for complex reasoning and extensive workload. Our goal is to provide both options, allowing users to effortlessly switch between “engines” within Craft’s AI Assistant.
Discover more about Craft here.
Best iPhone Accessories
: . More.
