Posts tagged with "Dots"

OpenAI Adds iCloud Calendar and Mail Plugins and Dot Texting→

OpenAI continues to add features to its ChatGPT app on a regular basis, but there are a couple of recent Apple-specific updates worth mentioning.

First, OpenAI created plugins for Calendar and Mail a couple of days ago. Both features use iCloud and require you to set up an app-specific password to use them. Here’s what OpenAI’s in-app documentation says each does:

  • iCloud Calendar: List iCloud calendars, find events, create or change events, and look up iCloud contacts.
  • iCloud Mail: Search and read iCloud Mail, manage messages and drafts, send email, and look up iCloud contacts.

I’ve been using Google Calendar more the past several months primarily because there was too much friction in getting Codex or my Dot to use my iCloud calendars. I’ve never been fond of Google Calendar, so I set up the iCloud Calendar plugin immediately. I don’t use Apple Mail as often, but it’s come a long way with the latest OS updates, so I set up the iCloud Mail plugin too and plan to give it another go.

Setting up your Dot in Messages.

Setting up your Dot in Messages.

Second, you can now text your OpenAI Dot. The setup process is very simple, which anyone who tried to set up Messages with OpenClaw in the early days will appreciate. Go to your iPhone, tap your Dot, select “Set up texting,” add your phone number, paste in the verification code it sends, and you’re all set. It took me less than a minute to do. Your Dot will even send you a contact card to add to the Contacts app, so its profile picture shows up in Messages.

You may be wondering why you’d set up texting when you have the ChatGPT app and a widget that tie directly into your Dot. It’s a fair point, but for me, the more ways I have to easily make requests of my Dot, the better, and texting gives me a low-friction way to do that that takes next to no bandwidth, ensuring that it will work whether I’ve got a strong cellular signal or not. It’s worth noting that although your Dot is assigned a phone number for texting purposes, the number can’t be used to start a voice chat, which I tried of course.

Permalink

ChatGPT Dots Gain Widget and New Shortcuts Actions

Late Friday, OpenAI updated the ChatGPT app on iOS and iPadOS with a new widget for your Dot and Shortcuts actions that let you control it three ways. The implementation is really well done and adds automation options worth considering.

First of all, the Dot widget is about as simple as it gets, but also very useful. I have the ChatGPT app set up to drop me into its Codex view because that’s typically how I use the app. I open Codex, check on a long-running project, and provide whatever input is necessary to keep things moving.

The problem I’ve run into is that I’ve been using my Dot, Puck, more and more to kick off research, ask one-off questions and check in on things like my email. Landing in Codex means tapping around more, which I can avoid now with ChatGPT’s new small-sized widget. The widget has two modes. The first simply shows your Dot’s avatar, and tapping on it opens your Dot’s message thread. However, if you edit the Dot, you can toggle on the “Show shortcut button” to display messaging and voice buttons beneath your Dot, adding the option to start a voice call with your Dot. As simple as this is, it’s been great to have the option to start in Codex via the ChatGPT app or check in with my Dot thread using the widget.

The other interesting feature is a trio of Shortcuts actions to message, dictate, or call your Dot. Each action has two parameters: the name of your Dot and how you want to communicate with it. That first parameter is an interesting one because tapping on it opens a list with your sole Dot in it because currently, you can only have one Dot. However, it also strongly suggests that the ability to set up multiple Dots is on the horizon, which OpenAI clearly telegraphed during its DevDay. After all, why have a parameter that opens a list unless there’s more than one choice?

I've set my Action button up to call my Dot.

I’ve set my Action button up to call my Dot.

The actions can be used in your shortcuts, are accessible from Spotlight Search, and most interestingly can be tied to an iPhone’s Action button, allowing you to visit your Dot’s thread in any of three ways. I’ve set my Action button up to start a Dot call. I often think of tasks and have ideas for research topics when I’m out for a walk, and I want to see if having brief calls with my Dot is an effective way to get a jump on those ideas, so they’re waiting for me in ChatGPT when I get home.

These actions and widgets are an excellent addition to OpenAI’s app and a cut above Anthropic’s more barebones approach to widgets and Shortcuts. I would, however, like to see Dots integrated even deeper into Shortcuts. The Shortcuts actions only open your Dot thread in one of the three modes. I’d love to be able to connect Dots to other apps with actions that accept input from other sources and produce outputs that can be used in other actions.

While I’m making requests, I still think multiple Dots need to be supported sooner rather than later, and OpenAI needs to provide a better mechanism for switching between Macs if you use a Dot with multiple computers. Plus, Dots are still a little buggy, with scheduled tasks failing too often and for reasons that aren’t always clear.

That said, the latest update is worth checking out if you’ve found Dots helpful. The strength of Dots is that they’re everywhere you can access ChatGPT, and now with widgets and Shortcuts actions, getting to your Dot in each of those places is easier than ever.


OpenAI’s Dots: A First Look

Source: OpenAI.

Source: OpenAI.

Earlier this week, I was at OpenAI’s annual DevDay conference where it launched Dots, a personal agent that lives inside the ChatGPT app. I set up my Dot and named it Puck after the mischievous sprite in Shakespeare’s A Midsummer Night’s Dream. In the days since then, I’ve found myself using Puck more and more. There are still rough edges, but I thought I’d share what’s working and what’s not, and how Dots are different from what’s already available in ChatGPT and Codex.

Dots are persistent, cloud-based agents that use the plugins and other tools you’ve connected to ChatGPT, after you allow them to do so. Your Dot has its own virtual Linux computer to assist you with your work. And at first, your Dot, which is depicted by a colorful character you can customize, doesn’t have access to anything else. However, as you give your Dot tasks that need access to other tools, it will ask for your permission to access other tools. The pacing of this initial interaction with your Dot is really well done. The requests felt natural and allowed me to get comfortable with expanding what I let Puck do without feeling like annoying interruptions.

Customizing my Dot.

Customizing my Dot.

Dots are available on mobile and desktop devices, and because they are cloud-based, your Dot’s chat is always synced between devices. But being a cloud-based agent has its downsides, too. Out of the box, your Dot can’t access your computer’s files and apps. That’s easily fixed by clicking or tapping on your Dot and granting it access to your Mac, so it can use the Mac alongside its own VM. As with Codex’s Remote feature, using a remote Mac with your Dot requires the ChatGPT app to be open on that Mac, too.

Read more