Integrating ChatGPT, Apple AI releases more features! The latest developer beta system is released

iOS 18 finally comes with ChatGPT.

Just now, Apple released the developer beta versions of iOS 18.2, iPadOS 18.2, and macOS Sequoia 15.2!

Compared to version 18.1, 18.2 introduces more Apple Intelligence AI features. New features include:

1. Image Playground (an AI image generation application)

2. Image Wand (AI tool in iPad note-taking app)

3. Custom Genmoji feature (for creating personalized emojis)

4. Visual Intelligence

5. Enhancements to Writing Tools

6. ChatGPT Integration

Additionally, 18.2 will support other regional Englishes besides American English - English in Australia, Canada, New Zealand, South Africa, and the United Kingdom.

Apple said that they will soon launch support for English in India and Singapore. In 2025, they will also support a variety of other languages, including Chinese, French, German, Italian, Japanese, Korean, Portuguese, Spanish and Vietnamese.

Apple also provides developers with APIs so that they can integrate these features into third-party applications.

Image Playground

Image Playground is an image generation app that can create images based on prompts. Users can enter the desired image description themselves or use the built-in suggestions provided by Apple.

Image Playground can create related images from a single image in your photos. For example, it can generate images about people in your photo album.

Image Playground does not generate realistic photography-style images, only animation or illustration-style images.

Apple also provides suggestions for clothing, places, objects, and other elements that users can add to their images. Elements added to Image Playground works have a preview function and a preview history, so you can undo changes and return to previous versions.

Image Playground isn’t just a standalone app, it’s also integrated into the Messages app so that you can draw inspiration from the content in a message thread or the Notes app.

Image Wand

Image Wand is a feature related to Image Playground and is an AI tool in the iPad note-taking app.

Users can use Apple Pencil to draw a rough sketch, select the Image Wand tool in the tool panel, circle the sketch that needs AI upgrade, and the sketch will be converted into a more detailed image.

Additionally, users can circle key phrases in their notes and have Image Wand generate appropriate images.

Custom Genmoji Features

Similar to Image Playground, users can create Genmoji based on characters in their photo albums.

Based on the character's Genmoji, users can further enter prompt words to create more Genmoji.

In addition, users can also create Genmoji through prompts.

The generated Genmoji can not only be sent as a separate emoticon package, but can also be directly inserted into the message text and sent, or even used as a Tapback (quick reply).

Genmoji currently only supports iOS 18.2 and iPadOS 18.2, and does not yet support macOS Sequoia.

Visual Intelligence

iPhone 16 and iPhone 16 Pro users can use the Visual Intelligence feature by long-pressing the camera control button to activate Visual Intelligence, then pointing the camera at the subject and pressing the button again.

Visual Intelligence lets users query information about what the camera is currently viewing: If you turn on your camera and point it at a restaurant, you'll see hours and reviews.

It can also optionally use ChatGPT and Google Search to find more detailed information about what you are currently viewing. For example, you can use Google Search to see where to buy the item you photographed.

In addition, Visual Intelligence can translate text, read text aloud, copy text, summarize text, detect phone numbers and addresses and add them to the address book, etc.

Apple plans to continue expanding this feature and adding more details in the future.

Writing Tools Enhancements

In iOS 18.1 and its related updates, Writing Tools can only be used to change the tone to be more friendly, professional, or concise. In this version of the function, the text is mainly modified by clicking different buttons.

Now, Writing Tools has added a custom text input box in iOS 18.2, where users can tap to enter a description and tell it how to modify the text, such as making the text more interesting, adding more verbs, or rewriting the email into poetry.

ChatGPT Integration

Siri can integrate ChatGPT to handle certain requests. If Siri cannot answer a question, Siri will forward the request to ChatGPT. Siri will then provide ChatGPT's answer.

Users will not only be prompted to enable the ChatGPT integration when installing the beta, but will also be asked again for each query. The integration can be disabled in settings, or you can choose to opt out of being prompted for each query.

Apple said that by default, requests sent to ChatGPT will not be stored by servers or used for model training, and the user's IP address will be hidden.

A ChatGPT account is not required to use this feature, but users can choose to log in to a ChatGPT account, which allows more stable access to specific models and features. Otherwise, ChatGPT will decide on its own which model to use to respond to the query.

Interestingly, Apple Intelligence users don’t have unlimited access to ChatGPT — if you use it enough, you may run into usage limits.

It’s unclear whether Apple’s partnership with ChatGPT means iOS users will have looser usage restrictions than regular ChatGPT users.