I’ve been utilizing Apple’s new Visual Intelligence feature since iOS 18.2 Developer Beta was introduced a few weeks ago. Initially, I assumed it would be just a flashy addition to showcase to friends, but as days passed, I found myself employing it regularly in various scenarios. Below, I will share some of the best applications for Visual Intelligence, including how to use it on devices without Camera Control. Let’s dive into it.
Don’t forget to check out the video below where you can see all these applications in action, plus an additional five use cases that may resonate with you.
As a final note, keep in mind that this feature is still in development and public beta as of writing. Therefore, if you’re currently on iOS 18.1, you won’t have access to it yet. The public release of iOS 18.2 is expected in mid-December.
How to enable Visual Intelligence
Interestingly, there are no dedicated settings for this feature. Upon updating to iOS 18.2 for the first time, a prompt will guide you on how to enable it. However, this feature primarily functions on iPhone 16 models due to the necessary Camera control button. To activate it, simply long-press the button, and you’ll enter Visual Intelligence.
1. Summarizing & reading books aloud
One of the standout features I’ve discovered is the ability of Visual Intelligence to read text aloud for you, regardless of the content. I found this particularly useful for books, and it could even serve as a substitute for audiobooks in various settings. Here’s how to use it:
- Open Visual Intelligence.
- Point your phone at the text you want to summarize or have read aloud.
- Your iPhone will recognize the text and will ask if you want it summarized or read aloud.
- Select your desired option.
- Relax and enjoy.
As someone who benefits from having both an audiobook and a physical book to follow along with, this feature is remarkable. I can take a picture of a single page and have Siri read it to me. This is incredibly useful for everything from contracts to instructions and books.
2. Reverse Google image search
A core function of Visual Intelligence is its search capability. While this feature has been available with other devices and applications for a while, having it integrated into iOS by default is great. You can capture an image with Visual Intelligence, and it will present you with two options: Ask and Search. To perform a reverse image search, simply select the Search option, and it will find similar items on Google. For example, after taking a picture of an iPhone, I could see nearby options for purchase. This functionality applies to just about anything you search for!
3. ChatGPT Ask feature
As previously noted, Visual Intelligence includes two core functionalities: Ask and Search. We have discussed Search, but what about Ask? This feature leverages ChatGPT. When you capture an image with Visual Intelligence and select the Ask option, the image is uploaded to ChatGPT for interpretation. This works remarkably well with a wide array of subjects, often capturing many intricate details accurately. However, it tends to shy away from specifics regarding genres of intellectual property, such as characters from cartoons, but will still provide descriptions and as much relevant information as possible without naming the character.
4. Real-time business information
With this feature, Apple introduces augmented reality to Visual Intelligence. You can simply activate Visual Intelligence, point it at a business, and receive all necessary information instantly. There’s no need to snap an image; just direct your Visual Intelligence camera, and it works seamlessly. I demonstrated this feature with a local coffee shop. The moment I aimed my phone at it, the business was recognized immediately, displaying my Apple Maps listing along with additional options such as:
- Call
- Menu
- Order
- Hours
- Yelp rating
- Images
This recognition process is intelligent and eliminates the need for tedious navigation through menus. Just point your phone, and everything you need is easily accessible.
5. Problem solving
This feature would have been invaluable during my calculus classes back in 2012! You can take a Visual Intelligence image of any math equation and request ChatGPT to resolve it. You’ll receive a detailed, step-by-step explanation of how to approach these problems. I often spent hours on geometry proofs or showing my work just to arrive at a solution. Now, a simple picture can have Siri take care of it for you.
Final thoughts
As previously mentioned, all these features are still in beta and are evolving continuously. It’s incredible to see this functionality implemented in the native OS, reducing dependence on external applications for similar tasks. My utilization of Visual Intelligence has been growing daily in both personal and professional contexts. The most astonishing aspect is that this is just the beginning; the capabilities will only improve!
Don’t forget to watch our video for even more use cases and a closer look at these new features. What are your thoughts on Visual Intelligence? Is it a feature you’d consider using? Have you tried installing the Beta on your devices? Let’s engage in the comments below!
: . More.
