He’ll be a part of Google Brain, the company’s artificial intelligence team.
He’ll be a part of Google Brain, the company’s artificial intelligence team.
Mark Gurman, reporting for Bloomberg:
Apple is working on a processor devoted specifically to AI-related tasks, according to a person familiar with the matter. The chip, known internally as the Apple Neural Engine, would improve the way the company’s devices handle tasks that would otherwise require human intelligence — such as facial recognition and speech recognition, said the person, who requested anonymity discussing a product that hasn’t been made public.
Looks like we might be seeing N-series chips in the not-too-distant future.
Stephen Hackett, on Apple’s focus on Siri’s existing feature-set:
I understand Apple wanting to make sure that Siri’s core functionality of controlling your iOS device keeps getting better. That stuff should be bulletproof, but we’re five years into Siri’s life. The company should be moving past these features and making Siri smarter about the world around us.
Here’s the problem with the statement above: it seems to be under the assumption that voice-based AI systems are no longer in their early stages — that five years is long enough to have the core functionality, essentially, finished. But I just don’t think that’s true. This is a complicated feature that may take far longer to perfect than any other computer science problem we’ve seen before. We’re still, very much, in the early days.
Last week, I published my thoughts on watchOS 3, tvOS 10, and macOS Sierra. Today, I’ll be giving my rundown of iOS 10. Conveniently, Apple split their presentation into ten logical chunks and I’ll be tackling each of them individually, in the order they were announced.
Apple made some fairly substantial changes to the user experience in iOS 10. There’s a redesigned lock screen, rich notifications, quick interactions with apps, and expanded 3D Touch capabilities. These changes might take some time to get used to, especially the redesigned lock screen, but I think they’re positive changes overall.
The first noticeable difference on the lock screen is the new Raise to Wake feature. Rather than having to press the home or lock button for your devices’ display to turn on, users can simply raise their device to wake it. This will help alleviate some of the problems associated with the second-generation Touch ID sensors which often unlock the device before you have a chance to see notifications.
And speaking of notifications, they’re far more actionable with iOS 10. Replying to messages, accepting calendar invitations, and more can be done without ever leaving the lock screen.
I’m actually really excited about more interactive notifications. I’d never claim that I get a lot of notifications, but I get enough that acting upon them more quickly will greatly improve my experience on iOS. And for anyone who does get a lot of notifications, clearing them in Notification Center is even easier. Pressing on the clear button gives you the option to clear all notifications at once rather than having to clear each day individually. This has been available on the Apple Watch since launch and it is a great feature.
Apple’s made changes to Control Center, too. You can now swipe to reveal a second pane which houses audio playback controls. I hated this the first time I heard about it — I didn’t like the idea of adding an additional step between me and whatever control I was in search of. But it’s quickly grown on me. Control Center has always been a bit too cluttered for my liking and moving audio controls to a second pane will streamline the design and give Apple a little room to grow if they want to add functionality in the future.
Two changes that I just know will annoy me for a few months after iOS 10’s release is that they’ve moved Today View and the quick access camera gesture on the lock screen. Today View has been moved, spatially, to the left of the lock screen while the camera is to the right of it — swiping from either direction slides the corresponding feature into view. I can already see myself unintentionally accessing Notification Center or Control Center instead of Today View or the camera. Those gestures have become a huge part of the way I interact with my device and it’ll take some time to retrain that muscle memory.
I’m more than happy about the expanding of 3D Touch shortcuts on the home screen, though. I know plenty of users who have already taken to them — even with the relatively limited functionality in iOS 9. It’s never been something that I used regularly, but this added functionality might change that. Pressing an icon on the home screen displays the usual list of shortcuts alongside, what appears to be, the app’s Today View widget. I love Today View widgets and anything that gives me easy access to them is a win in my book.
Apple is giving third-party developers the ability to extend Siri’s functionality. But unfortunately, it isn’t as all-encompassing as we hoped. Third-party developers will only be able to make use of Siri in the following contexts:
That means you’ll be able to initiate a direct message in Tweetbot through Siri, but you won’t be able to start workflows. Apple will undoubtedly continue to expand on the types of third-party apps that can make use of Siri, but for now it’s a bit of a bummer, for users and developers.
I turned off iOS’s predictive typing bar shortly after its release. At the time I was using an iPhone 5s and it just took up too much screen real estate. Of course, I’m no longer using a 4-inch iPhone — I’ve since upgraded to a 4.7-inch iPhone 6s and I might be willing to give it another go when iOS 10 is released this fall.
I’m simply curious to see whether the “more intelligent suggestions” are as useful as Apple makes them out to be. I like that it can offer up your current location and contact information, but I’m not sure if that’s worth the pixels its displayed on. My hunch is that I’d still rather display more content than add an extra row to my keyboard that’s of questionable utility.
With iOS 10, Apple is bringing Places and Faces to Photos. This is a feature that has been available for the Mac since the iPhoto days and I’ve been a huge fan of it. But Apple’s doing much more this time around.
Apple is using, what they’re calling, “Advanced Computer Vision” or “deep learning” to analyze all of your photos and find faces, objects, and scenes within them. It has similar functionality to Google Photos, but all of this work is taking place on your device rather than in the cloud to prevent any potential privacy concerns.
You’ll be able to search your photos for locations, objects, and scenes to find exactly what you’re looking for when you need it. In addition to search, Photos will also help you surface collections of images in the new Memories tab based around a specific date, topic, location, person, or groups of people.
Memories provides similar utility to Google Photos’ Assistant feature. Where Memories really shines, though, is in the suggested videos functionality. Not only does it automatically edit together related photos and videos, it offers two sliders that let you choose the tone and duration of the resulting video. That means you can send a short, epic video of your trip to Tahoe to your sister or a longer, happy video to your grandfather — from the exact same collection of photos and videos.
All of this seems pretty impressive and I can’t wait to see how it compares to Google Photos in real world testing. Unfortunately, I won’t be switching to it anytime soon, though. Not until Apple offers a way to store one, unified family photo library in iCloud that syncs between multiple accounts. My wife and I prefer to store all of our photos in a single library. We don’t think of them as “mine” and “yours,” they belong to both of us and we like having access to the entire lot without any user interaction.
Apple’s mapping app gets a design refresh with iOS 10. The search bar has been moved to the bottom of the display, which is a more substantial change than you’d think given the larger displays of most iPhones sold today. The app now makes proactive suggestions — it might list restaurants around the time you usually have lunch or grocery stores, in the evening, when you usually go shopping.
They’ve also improved the turn-by-turn navigation view with bolder typography and larger icons, making it easier to see at a glance. The biggest change, though, is that developers will be able to build extensions for Maps. Ride sharing and restaurant reservations were the two mentioned by Apple, but I expect we’ll see all kinds of interesting apps once developers get their hands on it.
I don’t use Maps too often, usually just when my wife and I take long road trips to visit family — about two or three times a year. But I’m very happy with the changes Apple has made. I like that Maps will display traffic during navigation and you’ll be able to search along the route for restaurants, gas stations, and so on. In the search results, Maps even tells you how much time will be added to the overall trip with each extra stop. I look forward to using these new features the next time we take the 5-6 hour road trip to visit my sister and her family in Pittsburgh.
The Music app is receiving an “all-new design” in iOS 10. I put that in quotes because the app doesn’t seem all that different to me. I’ll admit that I haven’t used the app for several months — instead, using Ecoute for my music playback. But this looks like nothing more than a new coat of paint rather than improving the app’s usability.
There’s bolder typography and a small handful of items have been moved around in the interface. But beyond these minor changes, it’s still an app that’s focused around renting music rather than playing the music you own. This has been my major complaint about the app since it was redesigned last year and unfortunately, the problem persists.
The one major new feature for Apple Music subscribers will be the addition of lyrics — which is great. A lot of the affection I have for songs comes from the meaning behind the lyrics and my ability to relate to them. I often look up the lyrics when I’m listening to a new album and I’d love to have that information right in my music app.
I will certainly give the new Music app another go when it launches this fall. But from the looks of things, I don’t expect it’ll last more than a few days on my home screen. Until Apple allows me to place the app’s focus back on my music library, I’ll most likely stick to third-party apps like Ecoute and Cesium.
The Apple News announcements were given less time than any of the other tentpole features of iOS 10 and are, what I’d consider to be, the most lackluster as well. There’s an all-new design which, like Apple Music, features bolder typography alongside a reorganization of the For You tab — now organized by section. And Apple’s introduced subscriptions which will allow you to read news from premium sources as well — like The Wall Street Journal and National Geographic.
I won’t spend much time analyzing these announcements. News isn’t really for me and I don’t expect it ever will be. But I suspect these are positive changes for those who use the app daily.
Apple is adding a new application for iOS and watchOS this fall, called “Home.” The app allows you to control all of your HomeKit-enabled devices from a single user interface. The app features what they’re calling “Scenes,” which ties together multiple devices and performs a predetermined set of actions all at once — it reminds me of Activities on Logitech Harmony remotes.
The Home app works with Siri and is capable of controlling your HomeKit devices remotely using the Apple TV as an at-home hub. They’ve also added a third pane to Control Center — beyond the aforementioned audio controls — that lets you quickly control your connected devices.
I don’t currently own any HomeKit-enabled accessories, but I’ve been thinking more seriously about them. Up until now, the entire market has felt splintered between multiple standards. But, at least from my perspective, Apple seems to be emerging as the front runner in this space — working with dozens of manufacturers and a few home builders as well. I don’t expect I’ll be hesitant for too much longer — it’s only a matter of time before I start purchasing devices to automate my home.
There’s some major improvements in store for the Phone app on iOS. I’m most excited about having access to voicemail transcripts. Everyone has that one friend who still calls and leaves voicemails that seem to go on forever. Now, you’ll be able to skim the transcript to get the message rather than listening through two minutes of babbling.
The most far reaching changes, though, involve third-party developers. Apple’s including an extension API in iOS 10 that lets developers build, what amounts to, caller ID apps, VOIP apps that display incoming calls on par with the native phone app, and the ability to integrate into the system’s favorites and recent calls list.
Apple has taken all of the necessary steps to allow users to decide how they prefer to communicate. This means third-party VOIP apps are no longer second-class citizens and, instead, will be treated as peers with Phone.app. This is the first instance in which Apple is allowing users to, for all intents and purpose, fully change the default app for a given function.
This is a major milestone — and leaves me wondering if we’ll see this expanding next year with iOS 11. I’d love to be able to set a default email client so that when I tap on a “mailto” link on a webpage it would open Dispatch rather than Mail.
If there’s an app on iOS that hasn’t received the attention it deserves, it’s Messages. The application is the most used iOS app, but has remained almost entirely unchanged since the launch of iMessages in 2011. Apple has remedied that in a big way with iOS 10.
Apple’s adding rich links with artwork and in-line video, easier access to the camera and photo library, emoji-word swapping, bubble effects, Tapback, handwritten messages, and Digital Touch. That’s an impressive list and will help keep Messages as the primary communication tool in the face of other growing platforms — Facebook Messenger, Snapchat, Telegram, etc.
Rich links is probably my favorite of the bunch. I send a lot of links to my friends in Messages and just a raw URL always felt a little anemic to me. These rich links will give the recipient an indication of where they’re headed when they tap on it. Or in the case of video, they’ll be able to watch without having to visit the webpage at all.
I’m also excited about the addition of Tapback, which lets you attach a heart, thumbs up, thumbs down, “haha”, “!!”, or question mark to another message within the thread. This will help solve the problem of having to reply with an “ok” when you want to let the other person know that you saw their message but don’t really have anything to add.
I love that there’s support for Digital Touch. Now, presumably, I’ll be able to send taps and heartbeats to my wife from my Watch, even though she doesn’t own one.
But I can’t say I’m too excited about the bubble effects and changes to emojis. Bubble effects have the potential to become a bit obnoxious and annoying if used too frequently. I don’t need a complicated animation every time I send a message and I hope everyone I know feels the same way.
As for emoji, I don’t even have the emoji keyboard enabled on any of my iOS devices. The problem, for me, is that I have a really hard time understanding what the person is trying to convey with their emoji. I often end up asking my wife to read the message so that she can confirm whether someone’s being sarcastic or legitimately happy about something. Apple adding emoji predictions and the ability to swap words in an outgoing message for its corresponding emoji might result in me receiving more emoji-containing messages — I can’t say I’m too 😃 about that.
After the above Messages features were demoed, Craig Federighi returned to announce iMessage Apps. With iOS 10, developers will be able to build apps that integrate into Messages for things like stickers, payments, restaurant ordering, animations, and more. Much like third-party keyboards, I don’t expect I’ll ever use these applications. But the idea of building a sticker pack without ever having to write any code — something that Federighi mentioned was possible during the announcement — is intriguing. This opens up a whole new world for artists who might not have considered it because of the barrier to entry.
This year’s WWDC was an overall success. The presentation didn’t feature the spectacle associated with a new hardware announcement, but that was more than made up for by the sheer number of new features that hadn’t been confirmed by rumor sites beforehand.
And it goes without saying, but this year’s event was a massive improvement over last year’s, which featured one of the most awkward announcements I’ve ever seen at a WWDC keynote — Apple Music. This year’s presentation didn’t drag on forever and was packed with announcements to keep viewers’ attention. If I had any complaints at all, it’s that they went a little too fast. Sometimes it was difficult to digest all of the new features and, for me at least, required a second viewing to take it all in.
With plenty of announcements for all four of their major platforms, nearly everyone who owns an Apple product will be receiving a substantial software update this fall. And I look forward to the public beta next month, when I’ll be able to get my hands on this software to try myself.
Steve Kovach, reporting for Tech Insider:
Apple now has the tech in place to give its digital assistant a big boost thanks to a UK-based company called VocalIQ it bought last year.
According to a source familiar with VocalIQ’s product, it’s much more robust and capable than Siri’s biggest competitors like Google Now, Amazon’s Alexa, and Microsoft’s Cortana. In fact, it was so impressive that Apple bought VocalIQ before the company could finish and release its smartphone app. After the acquisition, Apple kept most of the VocalIQ team and let them work out of their Cambridge office and integrate the product into Siri.
I’m starting to get really excited about WWDC.
Today, Amazon, Facebook, and Google are placing large bets on advanced AI, ubiquitous assistants, and voice interfaces, hoping that these will become the next thing that our devices are for.
If they’re right — and that’s a big “if” — I’m worried for Apple.
I have been using Siri a lot more over the past few days — mostly to see how it compares to Google’s offerings. As a general rule, I don’t use Siri for much. Not necessarily because it isn’t good, but because I don’t like to interact with my device in that way. I’d rather type in a quick search query than awkwardly speak out loud to my phone.
Perhaps that will change in time as more people use voice features on their devices — if everyone’s doing it, those who aren’t will seem out of touch. And if that’s the case, then maybe Apple did place the wrong bet on privacy versus big data.
But if Apple’s wrong, couldn’t they eventually partner with Amazon, Google, or some other company to integrate their voice services into iOS? That wouldn’t put them in a perfect situation — not owning a core aspect of their OS. But Apple has something that none of these companies do — incredible hardware. No matter how far behind Apple is in big data-based AI, other smartphone manufacturers are showing very few signs of catching up to Apple’s level in hardware quality. And because of that, I think they’ll always have a place at the table.