Google announced on 10 November that the Gemini feature that orders food, hails rides and books reservations for people inside apps on their phones is expanding to the UK, India and Japan. Add the US and South Korea, where it was already available, and that makes five countries, two of them right next door to Taiwan. AI is already ordering food, hailing rides and making bookings for customers inside apps in Japan and South Korea, and Google says that it is rolling the feature out in stages. Our position is this: what it works from is what’s on the app screen and what it can read on the web, so how your business is described on platforms and on the web needs sorting out now, without waiting for it to reach Taiwan.
What happened
The news comes from a post on Google’s official blog that day by Karthik Thirumalai, Google’s product director for Android AI, and Google calls the feature “task automation”.
Google’s help page goes into more detail on how it works. A customer says one sentence (Gemini may ask for more details first), and Gemini opens the app by itself in the background on the phone and taps through it step by step, going by what’s on the screen; the customer can bring up that screen to see how far it has got, and stop it at any time. Entering a password or payment details, or signing in, is left to the customer; the final tap that confirms a ride or places an order is, by Google’s design, left to the customer as well.
There are still quite a few limits. It’s a beta that Google is rolling out gradually; the only languages are English, Japanese and Korean, and only in some apps; and it only works on a few of the more recent Google Pixel and Samsung Galaxy devices. Taiwan isn’t one of the countries where it’s available, and there’s no Chinese either. When the Taiwanese tech site KoCPC (電腦王阿達) reported on the app list on 13 November, it also summarised where the feature is available, and wrote: “As for when it will launch in Taiwan, that isn’t known yet.”
The task automation described here and the Gemini “Tasks” feature (formerly called Spark) that Google made free on 17 November are two different features. Tasks runs errands for people on a virtual computer in Google’s cloud, such as calling a business or comparing prices and placing an order, and it’s free in the US, Japan, South Korea, Canada, Australia and India; task automation works inside apps on the phone, and it’s available in the US, the UK, India, Japan and South Korea.
When the feature was announced in late February and opened up in March this year, it only worked with six apps, including Uber, DoorDash and Starbucks. On 12 November, the tech site Android Authority found a list of apps, which Google had never published, buried in the software on Android phones; only the apps on that list can be operated by Gemini. In the stable version, the list already ran to 114 apps, and the South Korean ones include the restaurant booking app Catchtable; the code of a test version of Android added another 20, and the names Shopee and LINE are among them. The list could change at any time, and KoCPC’s view is that being on it doesn’t mean an app is really supported, and that “at most, you can say Google is already laying the groundwork for it.”
Why it matters to you
One of the examples on Google’s help page asks Gemini to “order pizza for delivery”, without saying which restaurant, and neither Google’s blog post nor its help page says how Gemini chooses in that case. Gemini works by reading what’s on the app’s screen, so for it to choose you for a customer, at the very least it has to be able to find you in that app and read what’s on your page.
Say, for example, that you run an escape room in Ximending in Taipei, and customers book sessions through a booking platform. One of your customers might hand Gemini a request like this: “Saturday evening, four people, first time playing, nothing too scary.” One of your rooms was designed for beginners from the start, and its description even says “not scary, ideal for first-timers”; but the reviews at the top of your page on the platform are all about a different room: “scared me into screaming”, “not for the faint-hearted”. Your customer asked for “nothing too scary”; whether Gemini would take your whole business for a scary one when it reads that page, Google’s help page doesn’t say.
This hasn’t happened in Taiwan yet, but customers can put the same sentence to ChatGPT or to ordinary chat in Gemini today. When ChatGPT and Gemini look things up on the web, what they read might be your website, or it might be reviews on a platform or write-ups by other people. Whether it’s in an app or on the web, the pages AI reads often contain a lot of words that you didn’t write, like reviews on a platform or write-ups by other people.
What to do about it
Get started now. The conditions that customers use to choose need clear answers everywhere that AI can read them: your business description on the platform should spell out how many people can play, whether it suits first-timers and how scary it gets; your website should say the same thing; and where a review doesn’t match how things are now, set the record straight in your reply. Once this is in order, when customers ask ChatGPT or Gemini today, the AI has a chance of reading the tidied-up version; and if Gemini’s in-app version does reach Taiwan later, the booking-platform page that it looks at is the one you’ve already fixed.
The catch is that not all of the words on that page are yours to manage. Usually the only things that you can change directly are the ones that you filled in yourself: the description, session times and prices. Categories and tags are mostly set by the platform and reviews are written by customers, so they have to be dealt with some other way, and some of it can only be made clear back on your own website. When you open your business page yourself, you see a whole page of “my business”, and it’s hard to tell at a glance who wrote which sentence, and how each one should be fixed.
To find out how AI sees you now, you can arrange a demo with one of our consultants. The part where Gemini operates apps for people isn’t available in Taiwan yet, so the demo uses the ordinary chat that you can use today: the consultant will take the kind of conditions that customers in your line of business set, like “four people, first time playing, nothing too scary” above, put them to Gemini and ChatGPT, and look at which businesses they list and what they say when they mention you, so whether AI knows that you can do all of these is plain to see on the screen. The same session also brings up your website’s GEO audit score: the GEO audit is a free website check on geoweb.tw that scores, across 12 dimensions, whether AI can make sense of your website.
Managed GEO means that we handle how AI describes you on your behalf over the long term, and the work is split like this: we rewrite your website; we list the changes that are needed on booking and delivery platforms and hand them to you, for you or your staff to make; then, at regular intervals, we put the conditions that customers set to ChatGPT, Gemini and other leading AI engines, keep each set of answers and compare them, to see whether AI has started getting you right.
Further reading
- Gemini launches Chinese-language shopping in Taiwan — the part that’s already open in Taiwan: customers describe what they need to Gemini in Chinese, and it recommends products straight away, with prices, reviews and where to buy
- What is an AI agent, and how is it different from asking ChatGPT? — what changes for a business once customers hand the choosing to an agent rather than asking ChatGPT, and why a business that isn’t picked has so little way of finding out why
- Meta’s AI chief has his AI agent order tea from a farm in Taiwan or Japan every week — another company’s agent: Meta’s AI chief says his Muse seeks out ever more obscure tea sellers for him and places a cross-border order for tea every week