15

Google cloned Apple’s 3D Touch for the Pixel using just software - The Verge

 4 years ago
source link: https://www.theverge.com/platform/amp/2020/3/3/21162272/google-pixel-feature-drop-firm-press-3d-touch-card-boarding-pass
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

Google cloned Apple’s 3D Touch for the Pixel using just software

It also finally fixed the boarding pass problem

akrales_191017_3725_0118.0.jpg
Photo by Amelia Holowaty Krales / The Verge

Yesterday, Google announced the latest “feature drop” for its Pixel line of Android phones. It’s part of an effort to get people to realize that the Pixel gets software updates ahead of other Android phones and that some of the features it receives stay exclusive to the Pixel. And yesterday’s “drop” epitomizes so many things that are good (and bad) about Google’s hardware efforts, so I wanted to dwell on it for a moment today.

First and foremost, saying that these features were “released” yesterday is only vaguely accurate. Instead, the rollout began yesterday and should theoretically be completed for all users in a couple of weeks. That’s significantly better than the last (and first) feature drop, which trickled out to Pixel owners much more slowly.

Google has very reasonable reasons for not distributing its updates to everybody on day one, but they undercut whatever excitement people may feel when they hear about them — since there’s an indeterminate wait. I covered all this in the newsletter last December with the first feature drop.

proc_newsletter_header.png

You are reading Processor, a newsletter about computers, software, and tech by Dieter Bohn. Dieter writes about consumer tech, software, and the most important tech news of the day from The Verge. This newsletter delivers “a few times per week,” and many of them include longer columns. You can subscribe to Processor and learn more about it here. Processor is also a YouTube series with the same goal: providing smart and surprising analysis with a bit of humor. Subscribe to all of The Verge’s great videos here!

By subscribing, you are agreeing to receive a daily newsletter from The Verge that highlights top stories of the day, as well as occasional messages from sponsors and / or partners of The Verge.

So let’s look at what’s new in this month’s update, courtesy of this rundown from Chris Welch. There are some basic quality-of-life (to borrow a term from video games) tweaks: dark mode can be scheduled, adaptive brightness has been improved, and you can set up little actions based on which Wi-Fi networks you’re connected to. There’s a new gesture for the Pixel 4’s Motion Sense chip, new emoji, and new AR effects for Duo video chats. All fine.

But there was one line on Google’s support page for the update that caught my eye (emphasis mine): “In addition to long press, you can now firmly press to get more help from your apps more quickly.”

“Firmly press” sets off alarm bells because it sounds a lot like the iPhone’s 3D Touch, which enables different actions depending on how hard you press on the touchscreen. It was a beloved feature for some people because it gave faster access to the cursor mode on the iPhone’s keyboard (I think long-pressing the space bar works fine for that, but I get that people love it). It’s also gone on the latest versions of the iPhone — Apple has seemingly abandoned it because the hardware to support it was too expensive/thick/complex/finicky/whatever.

But now, it seems that Google has done the same thing for the touchscreen that it does with the camera: use its software algorithms to make commodity parts do something special. That is a very Googley thing to do, but not quite as Googley as the fact that there was virtually no information about this feature to be found anywhere on the internet beyond a speculative note over at XDA Developers.

After a few hours of back and forth, I finally got more details from Google. Here’s what this feature does, according to Google:

Long Press currently works in a select set of apps and system user interfaces such as the app Launcher, Photos, and Drive. This update accelerates the press to bring up more options faster. We also plan to expand its applications to more first party apps in the near future.

Essentially, this new feature lets you press harder to bring up long-press menus faster. In fact, Google’s documentation for Android’s Deep Press API explicitly says it should never do a new thing, it should only be a faster way to execute a long press. The answer to why it only works in certain apps is that a lot of Android developers aren’t using standard APIs for long press actions. Because Android.

Okay, but how does it work? It turns out my hunch was correct: Google has figured out how to use machine learning algorithms to detect a firm press, something Apple had to use hardware for.

Tap your screen right now, and think about how much of your fingertip is getting registered by the capacitive sensors. Then press hard and note how your finger smushes down on the screen — more gets registered. The machine learning comes in because Google needs to model thousands of finger sizes and shapes and it also measures how much changes over a short period of time to determine how hard you’re pressing. The rate of smush, if you will.

I have no idea if Google’s machine-learning smush detection algorithms are as precise as 3D Touch on the iPhone, but since they’re just being used for faster detection of long presses I guess it doesn’t matter too much yet. Someday, though, maybe the Pixel could start doing things that the iPhone used to be able to do.

(For the record, Apple’s GarageBand has a sort of software-based detector for how hard you are pressing, but it uses the accelerometer.)

Loading video

So Google made long pressing take not so long. It also finally brought some updates to Google Pay — specifically, it finally figured out that people might want to switch between cards in Google Pay more easily, so it added a shortcut to get to them by long-pressing the power button. It’s a little catch-up to Apple Wallet.

Getting passes of all kinds into Apple Wallet is easy and common — essentially every airline gives you a button to do so. It’s so much better than Android’s method, which requires opening the app or saving a screenshot and then hoping you can find it quickly later. But integration with Google Pay has been lacking. Google announced boarding pass support a year and a half ago and virtually no airline uses it. (As an aside, I’d prefer it be called Google Wallet, but that brand was already used up so they call it Google Pay, because Google).

This annoyance has been going on for years, but now there’s finally an answer for Pixel users that is very Google. Instead of convincing partners to also add a Google Pay button, Google lets you take a screenshot of your boarding pass in your airline’s app. When the screenshot system sees a QR code, the notification gives you a button to save the boarding pass in your Google Pay wallet. It also lets the Google Assistant know you care about that flight so it will send you updates.

Both the screenshot boarding pass and the firm press detectors share a common bond: they are very clever software solutions that take unique advantage of Google’s machine learning strengths to solve problems. They are also problems that, bluntly, Apple solved via more traditional methods before Google.

Still, credit where it’s due, Google is catching up and, in some cases, innovating. The automatic car crash detection looks like it could be a literal lifesaver, for example. And in everyday things, Google is making progress on fixing Android’s little annoyances piece by piece and doing so throughout the entire year instead of in one giant operating system update. Now if it could just do a better job distributing both kinds of updates to non-Pixel owners, we’d be cooking with gas.


Verge Deal of the day

Save $250 on the OnePlus 7 Pro at Daily Steals

Daily Steals is offering this phone for $450, which matches the lowest price that we’ve seen yet. To get this price, enter the code VERGEONEP in at the checkout page after you add one to your cart. This configuration of the 7 Pro, which features 8GB of RAM and 256GB of fast UFS 3.0 storage, was originally priced at $699, so you’re saving 35 percent.

This particular device supports GSM carriers only, including T-Mobile and AT&T, but excluding Verizon.

Vox Media has affiliate partnerships. These do not influence editorial content, though Vox Media may earn commissions for products purchased via affiliate links. For more information, see our ethics policy. Prices displayed are based on the MSRP at time of posting.

Coronavirus

Cancelled conferences or conference appearances:

Big tech responses:

Other coronavirus news:

Under the best of circumstances, testing would lag anyway — because most people don’t show symptoms of COVID-19 for a few days. So positive tests are essentially snapshots of where the virus was several days ago. But by keeping the test criteria narrow, the CDC lost valuable time to prevent outbreaks like the one at Life Care. Now health officials are scrambling to catch up.

Reviews

The two big reviews (and one big video) yesterday were Nilay Patel’s look at the Mac Pro and the Apple Pro Display XDR. I think both of them fall in a kind of Pro Uncanny Valley. They’re wildly more powerful than what’s been available to Mac users before, sure. But unless you are a specific kind of user, it’s unlikely you’ll get the full value out of their price. They’re too expensive to be aspirational purchases for most semi-pro users and yet the software isn’t quite ready for full-on pro users (at least in the media creation space).

This is a situation that will either resolve itself to the relief of everybody as software catches up... or it won’t. The latter option is a bit of a worst case scenario, coming on the heels of the bad Trashcan Mac years and the years waiting for this new modular design.

I’ll just say it again: there’s a version of this Mac Pro that starts at, say, $2,500 — albeit with more consumer-grade components. Apple clearly doesn’t believe that it’s worth making that kind of tower computer anymore.

Mac Pro review: power, if you can use it.

Like so many things Apple, it’s a bit of a walled garden: if you live in Apple’s pro apps, and use Apple’s preferred formats, the Mac Pro will be very fast. But step outside Apple’s ecosystem, and things revert to more familiar territory. The good news is that this Mac Pro seems likely to inspire some optimizations, but it’s hard to say how long those will take.

Apple Pro Display XDR review: category of one.

So this is a puzzle: Apple has to convince all of the people who gasped at the idea of a $5,000 monitor and $1,000 stand that the upgrade to the Pro Display XDR is worth it and convince the people picky enough to spend $43,000 on a reference monitor simply for color use that this display can hit the marks. To be completely honest with you, I have no idea how that’s going to go.

The Vaio SX12 offers too little for too much.

1More True Wireless ANC headphones review: great features, not-so-great fit.

More from The Verge

The Verge tech survey 2020. Casey Newton will have more to say in his newsletter, The Interface. I’ll just note that I think people overestimate how beloved Apple is and underestimate how beloved Amazon and Google are.

Apple agrees to $500 million settlement for throttling older iPhones.

By default, Apple will offer $25 to any current or former owner of a covered iPhone. Named class members will receive $1,500 or $3,500, and around $90 million will go toward attorneys.

A Final Fantasy VII Remake demo is out now for PS4. Here are looks at what’s new in the remake from Megan Farokmanesh and Nick Statt.

Imagine a world without YouTube. Incredible piece of writing by Adi Robertson. YouTube seems like a piece of the internet that’s always been there, been the way it is. But the reality is that it could have gone many other ways.

AT&T TV now available nationwide with Android TV set-top box — and a two-year contract. How many ways is this ridiculous? The two-year contract. The price hikes after a year. The $120 price of a second box. The confusing name. That’s four off the top of my head. If this service is any kind of success, I think it makes the case for AT&T having too much market power. In no sane marketplace does this thing even get off the ground.

Nvidia’s GeForce Now is becoming an important test for the future of cloud gaming. In earlier newsletters I’ve presented this as analogous to the channel carriage fits we see on cable TV. That’s still true, but it leaves out the fact that in gaming there are lots of smaller developers who also have concerns. Nick Statt’s evenhanded look at all of the controversy is the definitive take on the subject right now.

Comments

What they didn’t fix is that you have to surrender your location privacy to get the damn weather and calendar notifications to appear in widgets. Is my word not enough?

https://support.google.com/pixelphone/thread/4052343?hl=en

By Inactive User 852709 on 03.03.20 7:18am

Maybe I’m missing something here, but how would you get localized weather unless your phone knows where you are?

By Ms. Kwotr on 03.03.20 10:33am

not everyone is in a different city everyday…you manually put in your location

By j3oomerang on 03.03.20 10:10pm

by telling it my location once and not having it geo-track my every move? The supermarket down the street doesn’t have dramatically different weather than my house. I don’t need it tracking me is the point

By Inactive User 852709 on 03.10.20 4:37am

How is this different from Apple’s 3D Touch replacement, Haptic Touch?

By Kyleh on 03.03.20 7:40am

Haptic Touch is a long press, it doesn’t go any faster if you press harder

By feschiquetti on 03.03.20 7:54am

Yes, but Google’s version isn’t detecting whether you press harder- merely whether more of your fingertip makes contact.

The answer could have been as simple as "make long press take less time", seeing as it doesn’t bring up different options.

This is a nothing-burger.

By indignantgoat on 03.03.20 9:58am

It’s using AI to tell if more of your fingertip is making contact. Works pretty well from me trying it out. Seems like exactly the type of thing we would read about on a tech blog.

By Stone Cold Dan Quinn on 03.03.20 10:26am

Google’s version isn’t detecting whether you press harder- merely whether more of your fingertip makes contact.

Which, combined with deep learning, is a pretty good approximation of a harder press, apparently. I’d be happy if Apple did the same.

By tipoo on 03.03.20 10:28am

Do you have an android phone? If you try to long press the clock app, for example, it brings up the long press menu much faster now. As it can detect you’re pressing down harder and doesn’t need to wait anymore. It’s not life changing, but it is impressive.

By Stone Cold Dan Quinn on 03.03.20 9:38am

If you have an iPhone still capable of 3D touch, you can see the difference for yourself all on one device since it will do both. Haptic touch is slower, 3D touch is faster.

By Ry L on 03.03.20 9:49am

So basically Google just improved a feature they already had for years.
Yeah, "nice" clickbait title.

By Orion4tech on 03.03.20 7:54am

If Google manage to emulate the most useful (IMHO) 3D Touch action (firm press anywhere on the on-screen keyboard to freely move the text cursor around; firm press again to start selecting text), I’d be more impressed, because the Haptic Touch replacement that Apple created for this particular action is absolute shite.

By trost79muh on 03.03.20 8:28am

That Google Pay feature needs to be added to all Android devices now. As someone who flies pretty frequently, it would make it so much easier if I didn’t have to open up the Delta or JetBlue app and hope that the app was held in RAM instead of being reloaded every single time I was about to board.

By Bryce C on 03.03.20 8:35am

I’ve been a Pixel owner since October 2016 and had an iPhone 4S prior to that – I remember getting my new Pixel, using Android for the first time and thinking, "Well, it doesn’t have all the features of iOS, but it’ll get there." I was thinking 6 months, not 4 years.

It’s nice that Google is getting some support for tickets but this is pretty indicative of where Android is in comparison to iOS, very late to the game and poorly implemented.

By ObjectNull on 03.03.20 3:37pm

Nice. I hope Apple does something similar.
Haptic Touch is NOT good. Especially for the flash light and camera buttons on the lock screen.
With 3D Touch and sound enabled those buttons felt like actual buttons.
On iPhone 11, it feels akward to touch them :D.

By poehler on 03.03.20 8:40am

I’m always accidentally turning my flashlight on, i hate that

By thisismyusername12334 on 03.03.20 8:44am

Ooh. Now can Apple clone Apples 3D Touch just using software? That would be great, going back to long press is a definite downgrade, if they can do it without bringing back the added space and pliable glass needed for 3D Touch that would be awesome.

By tipoo on 03.03.20 10:26am

A similar Android hack for 3d touch has existed for years.

By Forbius on 03.03.20 10:45am

It’s called a hack for a reason. Wouldn’t it be great to be a standard API included with the OS? (Hint hint, it is since Android 10)

By Jnss98b on 03.03.20 11:51am

That’s complete apple fanboy nonsense. Apple had zero interactivity with long pressing. It was Apple who copied Android. But the pretentiously named "3D touch" is a failure anyway… So what’s the point of this article? To make it seem Apple still have an original idea? Lol.

By fredphoesh on 03.03.20 12:26pm

Damn dude, what rock have you been living under?

Long press has always been a part of the iPhone’s actions, from editing the home screen icons to many in-app actions and sub-menus.
3D Touch was an additional action that did a different set of actions.

By urname on 03.03.20 11:06pm

3D touch was different, since it required additional hardware. This achieves that same result without the additional hardware that simply wasn’t worth it for Apple as most consumers had no clue what 3D touch was or why they should care about it. It was a good idea by Apple that nobody cared about, and Google deserves props for achieving the same thing in a much cheaper way.

By Stone Cold Dan Quinn on 03.04.20 8:42am

The API to do this has been in Android for years, around the time of Lollipop and the Nexus 6 I believe, but it was never implemented. Sounds like they jazzed up the accuracy with some fancy pants ML… But it’s been in there forever in any case.

When Apple announced 3D Touch, an app (that only worked on Nexus phones) made the rounds that demo’d that you didn’t need special hardware to do it.

By LeoRex on 03.03.20 12:51pm

View All Comments

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK