spatialcomputing.info

Despite running Road to VR for 14 years, I’ve rarely had the opportunity to talk behind-the-scenes about the publication and my philosophy for covering this fascinating industry. Luckily I recently sat down with industry fellow Tony Vitillo to do just that.

Through his blog The Ghost Howls, Vitillo has been sharing news and observations from inside the industry as a developer and enthusiast. He’s also the creator of one of the most important VR apps ever made.

After crossing paths at industry events over many years, Vitillo recently invited me to sit down for the inside scoop on Road to VR and my take on this moment in the industry.

You can watch, listen, or reach the full interview below.

Introduction

Tony: Hello everyone from Tony the Skarred Ghost. Today I’m super excited to hear some a person of the XR space team a lot which is Benjamin Lang from Road to VR and we’re going to spend some time together talking about a lot of cool things. Hey Ben, thanks for joining me.

Ben: Thanks for having me Tony. It’s nice to finally have a kind of formal conversation here after we’ve interacted for so many years in the industry.

Tony: Yeah, I mean it’s been a long time for both of us, even much longer for you. So, but we’ll talk about this, but let’s start by, I guess maybe there are still a couple of people, I guess maybe just a couple that still don’t know you. So, can you introduce yourself?

The Origins of Road to VR

Ben: Sure. So I’m Ben Lang. I am the co-founder and executive editor of Roadtovr.com. I started this back in 2011, so we’re coming up on 15 years, next month I think. Yeah, I just I was really curious about virtual reality and augmented reality technology kind of in the early days actually before Oculus was founded. Oculus was founded like late 2011, maybe early 2012 or at least the the Kickstarter was 2012 for the original Oculus Rift. So I was a little bit before that and nothing was really happening in the space at the time.

My curiosity was really: where did virtual reality go? A lot of people are familiar with the fact that in the late 80s, early 90s, there was VR kind of had a moment in the spotlight there. There were things happening, but it kind of just completely petered out. And by the time that I had started Road to VR in 2011, there was no real such thing as like a consumer VR product on the market that you could just go buy. It was all like the the stuff that did still exist was all medical, high-end military. it just it wasn’t it never happened for consumers. So I was like what happened to that? So I got really curious about where the technology was then and where might it go 15 years later and hence hence “Road to” VR. So I wanted to sort of chart where we were and where things might go in the future. And now here we are.

We went from when I was writing about kind of just scraps of information to a couple years later we had the Oculus Rift Kickstarter and what we started to call the VR community starting to come along. Now everybody says the VR industry or the XR industry. This is a whole multi-billion dollar industry that’s happened that’s grown up and I’ve watched it from the beginning to today. So, I have luckily a lot of context for what’s going on and I’ve been reporting on all of that as we’ve gone along and hoping to try to help people understand where where we’re at and again, where we’re where it’s all heading.

What Led You to Start Road to VR Before Oculus was on the Scene?

Tony: Yeah, that’s that’s pretty fascinating story because you started before the Kickstarter campaign and I always wondered if you had like the feeling that something was happening or it was just luck. I mean, you just had this passion and then the after something happened. Did you start Road To VR because you felt Oculus was coming?

Ben: Yeah, I mean I’d love to say I just, it was total prophecy, but let’s be honest, it was some luck. But I will say there was a the thesis behind it was at the time in 2010-2011 I was actually doing tech journalism prior to Road to VR. I was writing about smartphones and tablets and pocket computers and all these things. So I was immersed sort of in the tech space and I was seeing that we were having things like touchscreens, like Siri, like Kinect, and Wii and what I was seeing in those things was that computing was moving away from a keyboard and a mouse or a controller and it was starting to become more human-centric. The way that we were interacting with our devices was starting to become more natural.

And so I started to think about from that like where does this go as it becomes more and more natural? It sort of it feels like that ultimate destination is not only are you like touching the digital content, you’re actually looking at it it’s actually surrounding you or it lives in your environment, hence the ‘I wonder what happened to VR and where might it go in the future’; so yeah that was it was a bit of a hunch and it was a bit of right time right place.

I started road to VR when I was in college really as a total side hobby project. Just to learn for myself what was going on. And by the time I graduated college, it was like, okay, people are actually interested and things are starting to happen. Should I go full-time with this? And 15 years later or so, apparently I made a career out of it.

Philosophy on Writing VR Product Reviews

Tony: Well, I think you deserve the success you have. I mean, I always mention you and my blog as my “review hero”. I think you’re a great journalist. I want to steal something of your knowledge. Before getting back to talking about VR, I want to talk about the intersection of VR and journalism and ask you for instance, how do you approach writing a good review? What are the criteria to write a good review? Maybe about a game or about a hardware.

Ben: I try my hardest to not get wrapped up in the hype of stuff. And this isn’t even purely a professional thing. I’m a pretty avid gamer. I like movies. We see trailers for games and movies and, they all look awesome. I just, for whatever reason, I’m pretty good at not letting my hype levels build something up. And I’m also not particularly forgiving about the circumstance of the thing’s creation. And that’s not to say I don’t appreciate all the hard work and the struggle that goes into making things, even if they don’t turn out amazing.

But the way that I tend to approach reviews is a pretty pragmatic thing as someone who does this as a job. My thought is my audience is the audience of readers. My job is to help them understand if the thing that I’m reviewing is worth their time and their money. If I’m serving any other purpose other than that, I don’t think I’m doing them justice. I don’t think I am giving my audience what I hope they get out of the site. So I do my best to really ask myself (for a game review), am I having fun? You can talk about the graphics and you talk about all this and all that, but like if I’m not compelled to be going through this game, if I’m just not enjoying it, then I’m not going to get distracted by those other factors —like, oh, it took five years to make and it was a miracle that it got off the ground or whatever. Again, appreciate all that, but when it comes to answering the question for my audience, is this worth your time and money? That’s really where my focus is.

I don’t want it to like come off sounding like I don’t care about developers. That’s actually completely not the truth at all. That’s just my kind of take on reviews. When it comes to developers, I mean, ask around the industry. Like, I’ve been hands-on with a lot of projects before they were ever announced, giving people advice on marketing and design and comfort. There’s a lot of stuff that I do because I want to see great content. I want to see developers succeed. That’s all really important for keeping VR growing.

But I do occasionally get comments on like a review where I’m like “I didn’t think this game really pulled it off.” We didn’t give it the best score in the world. And I’ll get a comment that’s like, “you’re you’re destroying the VR industry. You are ruining this by giving this game a bad score.”

And I understand that reaction, but it kind of blows my mind because I think if you take, more than 10 seconds to come up with that knee-jerk reaction, you realize that if I’m artificially inflating a score of a of a game that I didn’t really think I liked, but I thought, “Oh, this is going to hurt the the industry.” All I would be doing is setting an incorrect expectation for people.

If I say “this is a great game” and really it was down here, but I was sort of fluffing it for the sake of the industry or the developer or something, all I’m doing is having people think, “okay, the VR people are saying this game is great, but I don’t think it’s very good. So, if this is what they’re calling a great VR game, then there must not be very many good great VR games.”

So, I really think that honesty is actually in the industry’s long-term interest. I think it is the healthiest thing you can do. For me it’s not about cheerleading. It is about trying to give constructive honest feedback and help people understand is this product or game for them? And hopefully that honest feedback means that developers can change and see what needs to be tweaked instead of just saying like “this game is amazing” when it’s just not. So yeah that is my approach to reviews. But again, it’s not that I don’t care about the industry. It’s that I genuinely think that this approach to honest, objective, and trying to keep everybody like on the same page and not being super promotional; I think that is in the industry’s interest in the long term.

Principles of Good VR Journalism

Tony: I think that’s that’s very wise. I totally agree with you also because anyway, people then play the game if this is not good, they immediately comment saying that it’s bad. So it’s makes no sense to to lie about stuff and this is a very good way of working. Do you think there are also some rules that a good VR journalist should follow more in general not only about reviews about sources about rumors we have a lot of them? Do you have some let’s say lessons to share about how to be a good VR journalist?

Ben: I don’t think it’s even unique to VR, I mean there’s a lot of basic stuff. As any journalist, you should be you should be confident in the information. If you’re not confident in the information, you should say, “This is a rumor. We haven’t verified it.”

I would say are fairly unique in this sort of day and age of media in general, which has become very influencer heavy. I wouldn’t call myself an influencer. Not in the way that most marketing or PR people use the term. We kind of live in this world where influencers are sort of an outgrowth of marketing and so they’re many of them—not all of them—are kind of the hype people for some of these products and services and whatever. They form a close relationship with some company or many companies to get products and they know in the back of their head “if I’m not saying good things about this about this product then I’m not going to be on this company’s good terms anymore. I’m not going to get the cool freebies blah blah blah.”

So we really try to from the very beginning to have steered Road to VR toward more journalism and reporting versus influencer marketing. People approach us all the time with the same kinds of deals and perks and things that they offer to influencer type people and we just have a pretty hard line and set of rules to guide how we’re going to handle that stuff.

So, for instance, many games will send influencers like a ‘swag kit’ with all kinds of cool stuff, statues or memorabilia from the game. And they expect influencers to, post coverage on this and say, “This is so cool. I got this figurine from the game. I can’t wait to play it. It’s awesome. Look how cool it is.” And our stance is when people come to us asking if we want that swag kit, we just say, “We appreciate the offer, but if it’s not directly related or necessary to our coverage of the thing, then we would politely decline.” And it’s just it’s a lot of little details like that we really try our best to keep in place and stay truthful to make our reporting good.

I will say, for a lot of people, this doesn’t matter one bit. We have passed up tons of money over the years in deals and offers to do this stuff, because I personally think it’s important and it is the kind of reporting and information that I would like to read from sources that do these kinds of things. Most people don’t really care. So it is an unfortunate reality of the media landscape that we live in that by doing these things you actually make it harder for yourself in terms of running a sustainable business. We’ve managed to get by because we’re a scrappy team and we know what we’re doing. But it is the harder path for sure. But I wouldn’t I wouldn’t do it any other way. It’s just so important to me. And I hope that maybe one day people will be a little more willing to support people who operate in this way in their interest, not in the interest of advertisers or marketers or these other kind of parties that are behind them.

Getting Featured on Road to VR

Tony: Well, that’s very interesting. By the way, if I can tell you an opinion from outside actually you are at very high reputation because people can feel that you are very serious and not appreciate that both by gifts or other stuff like that. So it will pay in the long run. I’m pretty sure about that but in the short run it’s it’s problem for the money. I mean we all we all know that we are not in the best moment for the ecosystem.

But compliments of what you’re doing and since we all love your magazine actually many people me included in the past for some things I did try to get coverage on your magazine but you’re mostly two people, you and Scott, that write most of the articles and of course you cannot write 50 articles per day so you have to be very selective. How can people let’s say be chosen as the as the topic of some articles you’re writing on your blog, your magazine?

Ben: It’s a good question. And yes, I’ve definitely fielded incoming, things from you and cool stuff that you’ve done and we’ve also reported on some news that you’ve broken and stuff like that. So, we do source you. But, to be to go back to what I was talking about, we try to be kind of objective with our coverage.

We love you and the stuff that you do. But when you came out and have asked us in the past to maybe cover something that you were working on, it’s not a guaranteed thing just because we have some kind of relationship. And that’s important to us. So, it comes down to two things. I mean, the primary one is a bandwidth. As you said, we can’t write 50 articles a day. I would love to. There are a lot of things that I have to pass on that I think are really interesting, but we simply don’t have the time for it, unfortunately. That is the that is kind of the number one thing that stops us from covering stuff. If I could cover everything that I found interesting, we’d have a lot more stuff going out the door. But you’re right, we have to be selective about it. And what that ends up coming down to is usually just kind of a priority list.

So something like what you were working on may have started at the top of the list. And I’m just using as an example. This wouldn’t be exactly how it happened, but it might; I might be going through my inbox and through my feeds and looking for what I’m going to cover in a given period. And that thing might have been at the top of my list and then maybe I get through and there’s some other thing up here and another thing and I start on that list and I just don’t always make it to the bottom of that list unfortunately.

We really do our best but we’re trying to we’re trying to balance solid reporting and giving a lot of context and analysis in our articles compared to just repeating what a company has said that you could just go read what they already said. So, we spend a lot of time trying to make sure that our reporting is adding some value as opposed to just sort of rehashing the facts out there. And unfortunately, that takes quite a bit more time.

So, I would say, in terms of like, okay, “we want to pitch road to VR, how do we do it the best way?” Please email us or reach out. Like, I read all of it. I can’t always respond to all of it, but I read all of it. I appreciate it. I appreciate seeing what people are working on and what they’re doing. And I would say I’ve covered some really small projects that maybe somebody thought “it’s not worth the pitch” but I just thought was really unique and interesting and for whatever reason I wanted to highlight this thing. For me it comes down to a lot of like interesting design and interaction and development stuff I find particularly intriguing. But of course we have to cover the major news stuff anyway.

So I would say comes down sometimes to individual sort of reporter interest. So we have me and Scott who are doing the vast majority of the content on Road of VR and as two different people we have different interests and things that are going to pique our interest and that we’re going to want to write about. I think if you want to pitch us or really any other publication rather than just throwing something at the publication as a whole, go to some authors that have written about similar things that you’re working on and get an idea of, okay, this person tends to cover, let’s say new launch trailers for games. If there’s one person that really focuses on that, try to reach out to them specifically and say, “Hey, I’ve read your reporting. I see what you do. I love that you keep me up to date.” Make make an effort to understand who you’re actually talking to in the first place. I think that goes quite a long way. Compared to just sending a generic pitch out the door.

And yes, that’s more work. Of course, but in the day and age of AI, you can get a real leg up on that by getting some information and maybe using it to write more custom prompts faster than you would have been able to do it by hand. So there’s a lot of different things out there, but for us in particular, definitely reach out. You never know what really might pique our interest. And keep us up to date. There have been some projects where somebody has written and we read it and we just didn’t have the time to do it. And then on the third time that they sent us information and they reach a certain milestone, we said, “Oh, this has reached a point where we think we’d like to cover it now.” So, it’s not like, “Oh, we just want one and done, get out of there.” It’s really sort of a combination of our bandwidth, our interest, and again, we love to stay up to date even if we’re not necessarily able to write about everything people send us. Like, please keep it coming. We like to be in the loop and seeing what’s happening.

Marketing Advice for Indie VR Studios

Tony: Well, that’s a very good suggestion to all the people outside there and especially some category of people I’m interested into is the VR indie game studios because there are many people with the small studios that try to succeed in this space where it’s very hard to be noticed by magazines to be featured on the stores because that’s a huge problem since you work anyway between you are an expert of the of our ecosystem, you have knowledge about marketing, about journalism, etc.

In general, what suggestion do you want to give maybe to these people to try to be noticed and be successful in general? So, not only talking about feature being featured on your magazine.

Ben: So, similar thing it is definitely making sure that you understand your audience. And that’s both who you’re developing for and then who you are sort of pitching to try to find coverage. So let’s just say there’s other outlets out there. You should really spend, do your 30 minutes of basic research to understand what are like my top five targets that I would love to be able to be covered in and go understand a little bit or learn a little bit, research a little bit about what is it that they do. Understand their mission.

The closer you get to understanding who you’re actually pitching to, the easier it’s going to be. And again, like I say, I find it, tends to be very valuable to go find a specific person rather than just the name of the organization and send it to some generic, inbox. If you can find a specific person and reach out to that specific person and they’ve covered stuff that you’ve done before or I’m sorry, covered things that are similar to what you’re working on, they’re probably interested in what you’re working on, too. And you can you know make that pitch to them.

I think also there is a I would say a minimum bar of polish that is somewhat important. Ideally when you’re sort of pitching your game or app or whatever it is, you should think about how do I make this how do I make this as easy as possible for the person to cover me? In many cases, one of the biggest things to do for that is help them approach them with a thesis. Don’t just say, “I’m making a game.” Look at it. It’s fun. Approach them with a thesis.

It’s, “I’m making a game. It has this particularly unique feature that I’ve spent a lot of time on that does X, Y, and Z better than, any other game in its genre. Help them have an angle. They don’t necessarily have to take your angle, but if you approach them with an angle for what makes your thing unique, that is going to get you so much farther than just coming and saying, “I’m working on a thing. Please look at it and figure out what’s interesting about it and write and do that work for me to figure out what’s interesting to tell your audience about.”

Much more much more effective if you have inside your own head an idea of what makes your game unique and stand out, what you’re especially proud of with this thing. And I think that’s not even just for marketing. Like, if you’re building something, you can’t just build like a similarly good version of another thing that’s very similar. Otherwise, why would people who are already using that go to another thing? There’s got to be a standout feature. There’s got to be a hook that really makes people want to try your experience.

So, you should know that from the beginning how and be building actively building your app to foster this hook that you’re creating. And then that all ends up, that doing that basic groundwork of knowing what is my hook, what is what am I trying to do to make this game stand out? Like a very specific thing, not just like I’m making a great shooter. It’s like a very it should be a very specific thing. I’m making a shooter which has the best weapon handling or the best weapon customization ever seen in VR. You got to you got to believe that you’re building that and deliver it. Otherwise, you’re just making a shooter. And there’s lots of them out there.

So, yeah. It’s be specific about sort of your vision. And once you do that work to know what you’re building in the first place, it’s going to be so much easier to pitch your thing. Because if you started with that thesis and building the product, you’re not inventing a story out of out of thin air from what you made, you are sort of, staying true to what you’re what you’re actually working on in the first place. And that’ll make everything else easier. It’ll make trailers easier. It’ll make pitching easier. It’ll make selling easier.

Design Tips for VR Experiences

Tony: So yeah, that’s a very it’s a great advice. I think it’s a very good advice for all the indie developers out there. And I want to ask you another advice about another topic because one of the columns I like the most from you delving into VR design. So interaction design of VR experiences etc. And I know you wrote quite a good number of articles about that so you cannot summarize them in five minutes now, but if you can choose maybe a couple of suggestions you want to give people in general about how to design their experience. So, it’s good to use and maybe also manageable.

Ben: Yeah, that’s definitely a tough one. Because it is a huge area. And so, yeah, I try my best in my coverage to help sort of raise up and highlight the design side of VR development. I think there and AR, XR, all of it really. I think there are there is a huge emphasis on the sort of coding or programming side of development and I don’t see nearly as many resources on the design side which I think for VR is extremely important because on the one hand it’s more challenging because it’s 3D and on the other hand it well it’s multi-dimensional. It’s not your mouse and keyboard input. But on the other hand it’s newer.

We can’t carry over so many of the paradigms that have, come up over the last 25 years of gaming of flat screen gaming design. They just don’t translate. I see I see this mistake happen a lot. Like you’ll have someone who says, “Okay, I want to make an RPG.” So, they take what a flat screen RPG looks like and kind of bring it into VR, but they don’t do the the heavy design work. So, you’ll have like a VR RPG with a with like a laser pointer inventory management. And there’s like a lot of inventory management and like pointing with a laser pointer and dragging and dropping and put equipping my stuff by dragging a square picture onto a picture of my guy. It does not necessarily fun in VR.

And so if you don’t do the it’s the difference between taking a concept and taking a feature. So, if UI management with a big grid and a bunch of icons is a feature, you don’t want the feature, you want the concept. In RPGs, it is fun to get equipment. It is fun to equip new stuff. It is fun to get those upgrades. But the fun part is not using the laser pointer, using your mouse, and dragging it around, at least not in VR. So you need to think about how do I bring how do I bring inventory management to VR in a way that is native and enjoyable to VR instead of just bringing the feature as it was built on flat screen.

And you can say this about so many things and it’s hard to completely like the way that flat screen inventory management works. There’s a there’s a common set of ideas now that most people understand and when a new game comes up they pretty much bring those ideas over maybe little tweaks here and there but for VR you’re in fairly uncharted territory. And so I think the best way to approach this, is actually not invent it from scratch if you don’t have to. Because there are a lot of VR games out there and there is a lot of really smart design out there that if you have a wide enough knowledge of having played enough VR content, you will see some really smart little things that people have done.

Inventory management, weapon management, how a door works, like all this stuff is out there, and it pains me to see VR developers spend a ton of time reinventing them when another developer has already showed a pretty darn good shot at it, like a good starting point that could be brought over and adopted, save you a bunch of time, and let you work on your actual unique thing that no one else has done yet.

So that’s the whole reason why you mentioned I have this video series and article series called Inside XR Design. I’m sure you can find, if anyone’s interested, find the, just search it on YouTube. It’s all there. In those videos, I’m trying my hardest to find games that are doing things uniquely well that have not been recognized or re, we haven’t seen that their what they their contribution to the design repeated anywhere. It hasn’t made its way into the design language of VR for a million reasons. Sometimes the game is not popular enough or it’s hard to people don’t want to put on the headset and look at it and say, “Okay, I’m going to recreate it and I’m going to take off the headset and jump into my game.” It’s difficult.

So, I’m trying to get those ideas out of the headset for people so they don’t have to go in themselves and look at it. Put them in a video, make it accessible. I want everybody to learn from this stuff. Maybe even learn what people have done wrong, that’s important, too. And I want people to be able to build on this. Why I would hate to see developer waste time, trying to rethink about again, how exactly should a door open when there’s great examples of the best way to do that out there already. Or how do we how do we spawn people? How do we move people comfortably? Like there’s all these what I think of in my head as lessons out here where I’ve played these games and said, “Wow, that is look at that. They did an awesome job with that.”

For instance, the cover system in Synapse comes to mind. You can like grab any wall with your hand and you can move your body around with it and it makes this really natural peaking, cover system that I haven’t seen replicated in a lot of places. And then you’ll have games where it’s a functionally a cover shooter, but they don’t give you that tool. They just expect you to be crouching down and it’s a sort of a worse experience for it. Why not attach that feature? Like there’s so many of these little lessons.

So, inside XR design is there to try to highlight some of these interesting design contributions. Less development, more on the design, the why behind how it works as opposed to the how it works like coding and programming. And yeah, it’s there’s a thousand things and it’s tough for VR developers. I absolutely understand that. And that’s sort of why I think trying to build upon the base foundation of what’s been done already gets you so much further than going in and saying I have to make every single system and feature from scratch as if I as if no one else has done it before.

So yeah, it’s sometimes people are trying to carry over features from the flat screen stuff which is not good and other times people are trying to recreate VR native features from scratch which is also it’s not the worst thing but it’s going to take you a lot more time and effort. So finding the VR version of the flat screen feature and going from there I think is tends to elevate VR games to be more immersive and more interesting. And frankly, a VR game needs to be more fun to play in a headset than it would be on a flat screen. That’s like a critical bar. Otherwise, why would I put on the headset in the first place?

The Evolution of XR Over the Last 15 Years

Tony: Oh, that’s amazing. So, now I want to get back, let’s say, to the origins. You said you started in 2011 and now it’s almost 15 years, etc. So, how have you seen the evolution of the XR ecosystem? I mean what has remained the same? What has changed? What has gone in a different ways from the original plan? I mean what’s your perception of the evolution of the space in the last 15 years?

Ben: I think the thing that stands out to me probably is that I think hardware like headsets, let’s talk about VR in particular, has evolved more slowly than I would have expected. I mean yes let’s go back 14 years to the Rift DK1 we have come a long way since then but since let’s say the Oculus Rift CV1 the first Oculus headset it had six degrees of tracking and not too long after launch it had full motion controllers—things are not fundamentally different today, the headsets are functionally in the same class of size and weight we have the same tracking features for six DoF on head and hands.

There’s definitely improvements to the experience generally. Standalone is a big help. Wireless is a big help. Inside out tracking is huge. But like the box that we were in our head, I still would have forecasted or at least hoped would change faster, become smaller, more comfortable, but we’re still kind of in the same place.

My hope is that once we sort of reach all the good enough levels of things like field of view and resolution, then the size will start coming down. Cuz we exist in this space where at the beginning resolution had to be like the most important thing. It was just screen door effect and all of that was really rough. It was distracting. It reduced immersion. So, we had to get that up. So, in order to increase the resolution, it’d be very difficult to both increase the number of pixels on the screen while also shrinking the size of the screen. That’s like doing, double the work all at once.

So, the headsets have, I think, stayed the same largely because we’ve wanted to get like the baseline like the tracking and the resolution and the various features up to where it’s like we’re good enough and we don’t have to go any further. I’m in a Vision Pro right now and the resolution on this thing I would be fine if it stayed this way forever. It there’s diminishing returns. It could get a little bit better. But it’s really quite good. And if I was given a choice between double the resolution on the next version of this headset or half the size of the headset, I would 100% go half the size on the headset.

So, I think we are just hitting this peak hopefully where we’re where we’re kind of maxing out on the features that we even want in the form factor. And then hopefully from there the emphasis becomes smaller, more comfortable, etc.

On the software side of things, I still sort of I’m still waiting patiently for something like Vision Pro to become closer in cost to Quest because that competition is extremely healthy and it’s been missing in the VR industry for a long long time. So Facebook at Meta has been here for since the beginning essentially and their approach from the very start has been let’s aggressively subsidize these devices to make them affordable and get them in the hands of people and that’s nice for consumers in the short term no doubt but it’s made it extremely difficult for real competition.

So, you had companies like HTC and Valve and even, Microsoft and some of their partners making headsets, but it was extremely hard for any company to make a headset that was even if it was comparable in quality to what Facebook was making, it was extremely hard for them to make it cost the same. It would just inevitably be more expensive. And that sort of makes the that makes the competitive landscape extremely difficult to break into which means the kind of leading player which has been meta for the longest time kind of just doesn’t need to respond too much to what other headsets are doing well because they know like yeah you might have a cool new feature or better resolution or wider field of view or whatever but our headset is half the price of what you’re charging that just makes it really hard for anyone out there doing something better to really influence and push meta to be more aggressive or more innovative.

And this is just the nature this isn’t unique to the VR situation. This is the nature of competition in general. So now that Vision Pro is on the market and it has been for almost 2 years now. We are starting to see some real competition, which is weird because this headset is way more expensive, but Apple has done whether it’s their brand or just the work that they’re doing. Whatever it is, Meta has been a lot more responsive to what Apple has done. I think because Meta understands that Apple is a true competitor at their scale.

Even though this headset is so much more expensive than the Quest headsets today, Meta has made a lot of changes that are improvements or features that have been added, from Vision Pro. It’s not to say that they’re not doing other cool stuff on their own and have other features that Vision Pro doesn’t have. But it is the first time that we’re really seeing them respond. And that’s making headsets and VR better for everybody. If one company comes up with a really cool idea that just works really well, the others hopefully should adopt it and give that to their users, too.

So, I’m really looking forward to this headset or future versions of this headset to come down much closer in price to where Quest is at cuz it’s going to amplify that competition. It’s going to make Meta respond faster and be more innovative to retain customers who might otherwise say, “hm, yes, the Vision Pro 3 is twice as expensive, but it’s got a lot of great stuff.” As opposed to just being just as good, but still twice as expensive.

So I’m really looking forward to that and I think that’s going to ex if we look at if I look back over the last 15 years and then ahead to the next 15 years I think the next 15 years are going to show a much faster pace of improvement compared to what we’ve seen over the previous 15. Again we you form factor look back at DK1 I’m in a vision pro functionally we’re still in the same class size class and even weight class so yeah I’m really looking forward to that competition really finally coming online I hoped years ago Apple would have jumped in to make this happen sooner but things take a little longer than they than they seem but I think once that happens it’s going to be a really good thing all around and going to lead to better products more adoption lower costs.

The Current State of XR

Tony: Well that’s been great summary about the past 15 years and maybe accuse some cues about what is going to happen in the future. But what about the present? Because we are in a bit of a transition phase like where mixed reality didn’t really take off. Meta is changing its priorities. I mean connect most of the talks were about smart glasses and horizon worlds. I mean there was some mention of the Quest but it seems not to be the top priority. The Apple and Google are coming but are still in another category. So how do you see the current situation? How would you describe it?

Ben: It is a really interesting time. I think Meta I don’t think it’s their official slogan anymore but move fast break things was for a long time their ethos and it I think it kind of continues to be. And for web development and app development, maybe that worked really well. I don’t think it works great, or at least we haven’t seen it work particularly great when it comes to like a brand new medium like VR.

I think when you’re if you’re just building and iterating on apps, that’s good and great. Go for it. Go to town. But when you’re like making fundamentally new like interfaces and paradigms for how people are going to interact with this stuff, I think it really benefits from having a strong foundation and a strong vision for how it should work and how it should feel as opposed to saying let’s just keep keep making stuff and then see if people like it and then try to make it more. It’s like they’ve meandered a lot.

I see this particularly in their in the software. I think Meta’s hardware is really great. Their hardware team has always been good. They’ve delivered some of the best, consistently some of the best headsets on the market from a hardware standpoint. But on the software, it just feels like there’s not a whole lot of just feels very scattered. It feels like there’s a lot of people who want the headset to do a lot of different things and it ends up not being particularly cohesive.

And now I think we’re seeing that sort of scatteredness of just kind of wanting to chase after what looks like it is doing well. As it as it happens. We’re seeing that sort of now with the headsets too. So I think Meta saw that their smart glasses did well and so of course they want to pursue that.

My my hope is that what looks in the near term right now like in the next one to two years what looks like a distraction for Meta is actually part of a longer plan that actually plays out in the long run. And I don’t think that’s impossible. I think Zuck actually does have a very long-term outlook as he claims to. I mean, he was the one, starting this stuff up back when they acquired when they acquired Oculus. I think it was 2014 if I recall correctly. He did it thinking 10 years later, we want to have something. And we need to start that project now in order to in order to be there before other people are.

So, I do think he has a genuinely long-term view. And so I’m hoping that this, distraction from VR or immersive immersive XR is actually just two things happening from two different sides. So right now, of course, they need to deliver on a product that they see as working. It’s just they’re not not going to work on that, which is trying to expand the glasses. But I do think that while the glasses are like starting small and with the minimum features and then trying to add more as you go and then you’ve got the, VR headsets or AR headsets, XR headsets, whatever you want to call them, mixed reality, whatever meta is calling them now. Is like starting with the maximal feature set and then trying to make it smaller.

And I don’t think those things can’t happen and exist simultaneously and eventually hopefully meet in the middle. Ideally, we’re we’re trying to make the headsets smaller and more comfortable. And Ideally, we’re trying to load the what is today smart glasses with just an AI chat assistant or a tiny static display. Hopefully, we’re trying to get more wider fields of view, more tracking, more immersive features in there.

So, I empathize with the feeling of it being like, “Oh, no. It feels like they’re like forgetting about VR because in this last connect, we didn’t hear a lot about it because, I’m a I’m a I’m a player. I’m a user of the headset. Obviously, I’m very immersed in the in the technology.” But looking at this longer term, I don’t think I hope it’s not going to turn out to actually be a distraction, but it’s actually sort of two parallel tracks that are hopefully going to converge at some point.

And again, I think this will all the pace of this will all be dictated based on what the competition looks like. So, Apple is probably doing something very similar. They’re probably in the, in their labs working on something that again is more like focuses heavily on form factor at the cost of some features, whereas Vision Pro is like heavily features and it costs some form factor. I think they’re going to do the same thing. And depending upon who hits the market at at what time and what the response is, that’s going to drive the pace of which one gets pushed faster at any given moment.

But in the end, I think they do all sort of converge. We want to be able to wear something that is comfortable that can be immersive, but can also be like get out of the way and not annoy us. It would be great to be able to walk out the door and see nothing on my display except for floating turn by turn directions when I want them. And then when I walk back in my door, have a whole room full of, virtual apps pinned to my walls, the weather, my mail, my calendar, and then hit another button on the same headset that takes me to a fully immersive social space to hang out with some friends or play games.

We want that all-in-one headset. What we’re seeing right now is the very beginning of, the head the little glasses headset on this side and we’re seeing the larger headsets on this side. We we want them we want all that to be in one. All the features, tiny tiny package. I think that’s where Meta is heading. So what might seem like a distraction I think is actually burning the candle from both ends.

Recent XR Excitement: Neural Band Input

Tony: Well, I agree with you. And by the way, since there is one thing that we have in common that as you said in the beginning, we both you and me are not easy to get excited about something. We don’t fall much for the hype. And I want to ask you is there something that you have tried maybe in the last 12 months or whatever that instead you said oh this is really cool I mean whatever can be software can be hardware one thing that you really said okay this can be can have interesting ripple effects for the future.

Ben: I would say actually most recently it would be the neural band that is shipping with the the Ray-Ban Display. So from the perspective of an XR person who a 20° static HUD display in glasses doesn’t excite me too much. The neural band that comes with the glasses which is used for the input. It’s basically like pinching, looking and pinching with with Vision Pro, which works really well, but without needing to have your hands within the frame of view, field of view of the camera, which is a big benefit because if you’re going to be walking around outside and you want to interact with your headset, like start a music track, you don’t want to talk to your headset in public. It’s just it’s just weird and it’s probably not ever going to seem normal if you’re in a crowded space and you start talking to your device.

But being able to have a wristband that can be down at your side and you can make really subtle pinch and swipe gestures to be navigating what’s on the screen. I think that is a I think that’s the future of input for sort of all day devices for a long time. For for immersive games, we’re going to want the full hand tracking, the full controller tracking. But if you just need to be able to navigate a menu and, hit thumbs up a message or start a song or what have you, being able to do it in a very tiny, like with really little motions, I think for AR glasses and stuff where you want to be outside, that’s going to be the way to go for a long time.

I think it’s very smart because it’s already functionally a device people wear. They could easily make it a watch. They could easily make it a smartwatch, health tracker kind of thing. And so it’s not like something brand new. It’s not like telling people, hey, wear like a special backpack or wear like a like a heavy necklace that has this technology in it. It’s just something people are many people are already wearing. And would make sense like even if you only used it to control your glasses 5% of the time, if you’re still getting watch and alarms and health tracking out of it, it’s already a good product.

I’m wearing a smartwatch right now. You can’t see it cuz this isn’t my real hand. But I’m already getting all that value out of it. So, if you can take all that value that people already know in a smartwatch and then add the technology that you need to be able to do these like really subtle inputs, I think that’s just like an obvious it’s like a pure win. There’s really minimal downside to it. And so why it’s exciting is not just because it’s a good idea, but what they showed works really well. At least in, the 15 to 30 minutes that I had to test it myself. Zero calibration. Just it, swipe, tap, pinch, pinch different fingers, it’s all working.

So, that’s the thing that’s exciting me going forward. I would actually So, I’m in Vision Pro. Great headset for a lot of reasons. The pinching works great. The one problem with it is when your hand is out of the field of view of the camera and it can’t see it, which is rare because they have the downward facing cameras, but it does happen. If Apple said, “Hey, we could instead of watching your hands with the cameras, we could just do the sensing with the watch and do exactly the same look and pinch for the interface, but we’re going to sense it with the watch.” I would say yes, please do it. I think it would make it more consistent.

And I think it’s it’s better for that particular for the basic need of pointing and clicking on a thing or making selections. I think that is the better approach. Again, obviously you want full hand tracking for different reasons, controller tracking, all that stuff. But yeah, so that is what I think is sort of the wow like ripple effect in the next couple years. I think this is going to become the way for a lot of outdoor devices. Whereas I think just like on this headset, we’ll see an Android XR and probably future Quest headsets that the camera-based look to pinch with eye-tracking will probably be the way for for devices like this in the near future and then again hopefully we have some convergence eventually.

A Fun Story from the Early Days of XR

Tony: I hope so. So luckily we are getting towards the end of this interview and I want to ask you as let’s say the final question since you have been in the space for a lot of time do you have a fun story maybe from the early days that you want to share with us?

Ben: I have a few but I will share one for now maybe maybe more another time. One that comes to mind is I think it was one of the early Connect conferences back when it was still Oculus Connect back when Palmer [Luckey] was still with the company. So I was there attending the event to cover it for press at some point. I can’t remember the exact circumstances, but I think I was invited back to the house where Palmer and like some of the early like Oculus people I think they were living there at the time. It was in the Bay Area. I think they had like 10 people living in one house in the Bay Area cuz they were like, they they were pretty young at the time and they were just like, let’s all crash and jam and they were having fun and hacking, stuff together and they’re hardware and, software nerds together basically hanging out.

So, somebody invited me to come back and be like hang out after the conference for a little bit. People are from the industry are coming back and hanging out. So, I went and was chatting with Palmer there and some of his friends and people he was working with and at some point they were like I was like, “What is that thing? What is that big metal thing right there? Why is it in your kitchen or wherever?” It wasn’t it wasn’t like in a workshop, I don’t think. It was just like on their kitchen table or something crazy. I was like, “What is that?” And Palmer’s like, “Oh, it’s a ramjet.” And I was like, “What is what is a ramjet?”

And he explained that this was some, novel type of engine that has particular pros for I don’t I can’t remember the exact explanation, but it was this like it was a funny moment for me to realize that like Palmer’s friends were such nerds that they were like working on this completely other technology other than like other than VR after having just been acquired by this company. They’re still nerding out and working on like other crazy projects.

And why this is funny to me is not just that, but this interest in like ramjets, which I think they’re reasoning for like launching, like basically launching miniature rockets and just figuring out how to do that better and better. It was the earliest glimpse that I have looking back that foretold where Palmer ended up where he is now, which is after getting kicked out of Facebook or Meta, he founded a military contracting company and basically started building this kind of technology as a full full-time thing.

So it was like that was like a little hint that he had this other interest in him that so many years later I saw translate into him getting super serious about it and saying we can build this stuff like I can build a headset I can build this stuff and obviously the company Anduril has become really successful raised a ton of money big valuation so pretty funny like so on the one hand you have a guy who had a huge as far as startups go, huge acquisition on a thing that he built and then had this middle time where he eventually got kicked out and then over here founded another company and had another not an acquisition but huge valuation.

And but at the same time it’s like it’s this guy who was like had a ramjet in his kitchen and was like, “Yo, come hang out and like have some beers or whatever after the conference back at like our our tech frat house essentially.” So, it’s just funny. It’s just funny to see the the through line there after so many years. And Palmer remains a really interesting character. He always kind of has been. He hasn’t not exactly been the typical typical tech guy. So it’s been cool to see.

Closing Remarks and Promotion

Tony: Well, that’s amazing. The final final question is always the same. Is there anything else you want to say? The mic is yours.

Ben: Please check out Inside XR Design. I really put my my heart into the episodes that I’m making. And then again, the goal is really to share with people what I think is design that is worth knowing about. There are some hidden gems in there. There’s some details from from bigger games. I really hope that I can save people time and give you the lesson without having to put on a headset and play through the full game.

This is just, this is stuff that this is stuff that I’ve seen from playing games over the last decade in VR and finding where stuff works so well that is memorable, really memorable to me. I’ve gone back to some older games that are still doing things better than, than we ever see in new content today. And for the most part, I think the reason we’re not seeing that is simply because these are sort of hidden things. It’s not obvious to know where to go to find these little smart designs when it comes to, VR interaction and such.

So, if you’re interested in development design, check that out. I hope you learned something maybe that you hadn’t seen before or inspired by something. And again, hopefully I would love to see people see something that inspires them, build upon it, and show everybody how to do that thing even better. It’s sort of the on the shoulders of giants kind of situation and we need that to be happening more in VR I think than it is. So yeah hopefully there’s some value there to be had for people. I think we’re up to like almost 2 hours of content on that series and more to come.

Tony: That’s amazing. So thanks man for being part of this interview. Thanks for sharing your knowledge. You know I have to say you’re public you’re amazing. One of the best journalists we have in our space. Thank you. And thank you also for everyone who watching or reading this interview. Have everyone a good day next. Thank you.

Ben: Thank you Tony. I appreciate it.