Advertise here with Carbon Ads

This site is made possible by member support. โค๏ธ

Big thanks to Arcustech for hosting the site and offering amazing tech support.

When you buy through links on kottke.org, I may earn an affiliate commission. Thanks for supporting the site!

kottke.org. home of fine hypertext products since 1998.

๐Ÿ”  ๐Ÿ’€  ๐Ÿ“ธ  ๐Ÿ˜ญ  ๐Ÿ•ณ๏ธ  ๐Ÿค   ๐ŸŽฌ  ๐Ÿฅ”

kottke.org posts about augmented reality

Augmented Reality Ski Goggles

The other day on the chair lift, my kids and I were talking about our top skiing speeds (me: low 40s, them: 50+) and one of us mentioned that it would be cool if your current speed was shown on a heads-up display in your goggles. So this morning I went looking for AR ski goggles and of course they exist. Here are a pair of demo videos from Sirius (made by Oostloong) and Rekkie.

These googles include features like real-time speed, clock, temperature, friend finding/tracking, wayfinding (directions, compass, elevation), HD recording, and phone notifications. Skiing is a natural use for AR โ€” you’re wearing the bulky goggles for safety anyway, so you can hide all the necessary tech in there without looking ridiculous, and taking your mittens on and off to check the time or send/read texts is annoying.

I’d love to try some of these, to see how the interface and notifications work โ€” I worry that it would be unsafe because it requires too much of the skier’s attention. Being on anything but the bunniest slopes with people who are reading text messages and clocking their speed as they’re skiing is not something I’d be into โ€” the idiots with the GoPros on selfie sticks are bad enough. I’m also skeptical that the electronics and control buttons on these devices will be able to withstand the beating that ski goggles undergo over the course of a season, especially if they’re subjected to any skiing in the woods. If they could get it right though, I could see these being fun and useful.


Mario Kart Live: Home Circuit

As a huge fan of Mario Kart (and a relatively recent owner of a Switch), this looks absolutely amazing (if it works smoothly). In Mario Kart Live: Home Circuit, you race a physical kart (against other peoples’ physical karts if you want) through your actual house, controlling it via onscreen AR on your Nintendo Switch (the onscreen view comes from a tiny camera mounted on the kart). Here’s what Nintendo says about it:

Created in partnership with Velan Studios, Mario Kart Live: Home Circuit brings the fun of the Mario Kart series into the real world by using a Nintendo Switch or Nintendo Switch Lite system to race against opponents using a physical Kart. The physical Kart responds to boosts in-game and in the real world, stops when hit with an item and can be affected in different ways depending on the race. Players place gates to create a custom course layout in their home, where the only limit is their imagination. Race against Koopalings in Grand Prix, unlock a variety of course customizations and costumes for Mario or Luigi, and play with up to four players in local multiplayer mode.

Watch the trailer above…it does look totally cool.


Copy & Paste Your Surroundings into Photoshop with a Magical AR App

Designer Cyril Diagne has developed a prototype of an augmented reality app that can copy objects from the real world and paste them into a Photoshop document. Here’s how it works: you point your phone at a book sitting on your desk, the software produces an image of just the book on your phone screen, you point the phone at your computer, and the book image gets pasted into the Photoshop document. It looks like straight-up magic (or at least like a scene from Minority Report or something):

Diagne wrote a thread on Twitter with more technical details. The code is available on Github if you’d like to give it a try. (via colossal)


AirPods, an Augmented-Reality Wearable Computer

For Real Life magazine, Drew Austin writes about wireless headphones and their potential effect on the public sphere if many people start wearing them. The bit that particularly caught my eye was the subtitle of the piece:

Wireless headphones are augmented reality devices.

And further down the page:

Much as phones have enabled and concretized the always-on nature of everyday life, introducing the constant interpenetration of physical and digital space to individual experience, wireless earbuds facilitate a deeper integration, an “always in” existence that we need never interrupt by looking down at a screen. Their aural interface means we don’t have to awkwardly switch attention back and forth between IRL and a screen as though the two are starkly separated. Instead, we can seem to occupy both seamlessly, an experience that other augmented-reality devices, like Google Glass, have promised with varying degrees of success.

I bought some AirPods several months ago thinking I was getting wireless headphones, but very quickly realized they were actually an augmented-reality wearable computer. In my media diet post from May, I called them “the first real VR/AR device that feels seamless”. Like regular wired earbuds or even over-the-ear Bluetooth headphones, AirPods provide an audio track layered over the real world, but they’re so light and let just the right amount of ambient sound in that you barely notice you’re wearing them โ€” it just sounds like whatever you’re listening to is playing in your head, automagically. It feels, at least to me, like a totally different and far more immersive experience. Wearable computing still seems like a futuristic thing a few years away, but with AirPods and the Apple Watch, it’s solidly here right now.

P.S. In Dan Hon’s latest newsletter, he writes:

Given current phone/camera trends (or, I should say, current camera/phone trends), the Star Trek: TNG combadge is unrealistic because by the 24th century it’d be more like 99.9998% camera and 0.0002% phone.

The natural ancestor of the combadge seems more like AirPods than the iPhone. But the likelihood of AirPods 6.0 having a tiny camera embedded in it for, say, the facial recognition of whoever you’re speaking with (a la Miranda Priestly’s assistants in The Devil Wears Prada) or text-to-speech for whatever you’re looking at (signs, books, menus) seems quite high.


Photo Wake-Up

Photo Wake Up

Researchers at the University of Washington and Facebook have developed an algorithm that can “wake up” people depicted in still images (photos, drawings, paintings) and create 3D characters than can “walk out” of their images. Check out some examples and their methods here (full paper):

The AR implementation of their technique is especially impressive…a figure in a Picasso painting just comes alive and starts running around the room. (thx nick, who accurately notes the Young Sherlock Holmes vibe)


The Augmented Reality Sandbox

Inspired by a Czech project, a team at UC Davis is building an Augmented Reality Sandbox that lets you create & study different landscapes by moving real sand around in a real sandbox. Check this out โ€” the topographic lines and colors change in realtime as you move the sand around:

As part of this project, we are primarily developing 3D visualization applications to teach earth science concepts, but we also built a hands-on exhibit combining a real sandbox, and virtual topography and water created using a closed loop of a Microsoft Kinect 3D camera, powerful simulation and visualization software, and a data projector. The resulting augmented reality (AR) sandbox allows users to create topography models by shaping real sand, which is then augmented in real time by an elevation color map, topographic contour lines, and simulated water. The system teaches geographic, geologic, and hydrologic concepts such as how to read a topography map, the meaning of contour lines, watersheds, catchment areas, levees, etc.

That video is from several years ago…here’s a more recent video showing a hybrid AR/VR sandbox setup:

The software is available to download so if you want to build your own, go for it. (via a map a day)


Notable Women

As Treasurer of the United States in the Obama administration, Rosie Rios pushed hard for the inclusion of more women on US currency, culminating in the selection of Harriet Tubman for the new $20 bill. But with many more amazing women left on the list for inclusion on currency, Rios partnered with Google to create Notable Women, an augmented reality app that puts an historic American women on any US bill you hold up to your phone’s camera. Here’s how it works:

The app’s tagline is “swapping out the faces we all know for the faces we all should” and is available on iOS and Android. You can also view the modified notes on the website, like Sojourner Truth, Madam C.J. Walker, Margaret Bourke-White, and Maria Mitchell.

Notable Women

Notable Women

Notable Women

See also The Harriet Tubman Stamp.