Categories
Blog

Jaymis on Triple J Hack: Music Video VR

Australia is lucky to have one of the greatest youth-oriented national broadcasters on the planet – Triple J. Their weekly current affairs show Hack covers a huge variety of topics, and an excellent example of this is my interview about working on VR and music performance being introduced by 10 minutes of Tinder Date Murder Trial coverage. [Skip to 11:25 to avoid murders]


Listen: music video and VR on Triple J Hack

Broadcast 18 October 2016. Reporter Stephen Stockwell visited my place to experience Ball Park Music’s Whipping Boy VR video, then we talked about Tilt Brush, Reggie Watts playing AltspaceVR, and what virtual gigs might mean for Australian bands.

In brief: Sam Cromack painted the clip in Tilt Brush; I directed and built the technical rig; the conversation moves from turning a room-scale work into a 2D music video to performing live inside VR.

“If you can put on a show that people from all around the world can come to—without having to physically move around a lot—that’s a pretty magical thing.”

Jaymis Loveday, Triple J Hack, 18 October 2016

Archive update, 2026: This 3:47 Jay-focused excerpt uses 11:25–14:40, 16:22–16:48 and 17:03–17:10 of the preserved 29:45 broadcast. The intervening interview with Lincoln Savage and brief headset-removal chatter are omitted; the full source recording remains preserved offline. Audio: Triple J Hack / Australian Broadcasting Corporation.

Transcript

Speaker-labelled transcript generated from the preserved broadcast with Whisper (medium), checked against the source timings, and lightly edited for names, punctuation and readability. The audio remains the authority.

TOM TILLEY: Now, when you think about virtual reality, you probably think about it in porn or the gaming context. And in just a moment, we’ll take you inside a virtual reality game so real that some players even vomit. But what about music? Some virtual reality developers say we could be going to virtual reality gigs within months. There’s already some serious movement in the virtual reality video clip space. Stephen Stockwell went inside the first video clip ever created in virtual reality to find out what’s in store.

STEPHEN STOCKWELL: I’ve never been in virtual reality before, so I’m trying to figure out how I actually describe this place. I’ve never had to sit in a galaxy looking at a volcano erupting from a man’s chest through a spiral rainbow. That’s all part of a film clip. This is a piece of art painted inside virtual reality—which is the music video for Ball Park Music’s Whipping Boy. The world I’m standing in was drawn by Sam from Ball Park Music. And Jaymis, whose house we’re sitting in right now, was the director and provided the technical gear to make it all happen.

JAYMIS LOVEDAY: The best way to experience this is to own a VR rig and walk around inside it with the song playing. But most people can’t do that, so we sort of tried to figure out how we could show it to people on a 2D screen and have it still be exciting.

STOCKWELL: It’s really hard to describe, but the light painting that Sam has created in virtual reality is really immersive. And you put on the headset and you put on the headphones and it really feels like you’re in another world. Now, there are still limitations with the cost of virtual reality. The headset I’ve been wearing is about $1,500. And then you need a pretty pricey computer to run all the software—probably a couple of grand there as well. I don’t want to tell you that it’s worth it, but I did have an incredible time in virtual reality.

JAYMIS: VR itself—it is actual virtual reality. That’s the weird thing. People will not walk off a cliff in VR because that’s scary. And being inside these psychedelic scrawlings of Sam’s, you get in the mindset of someone who’s sitting inside this crazy piece of artwork floating in a galaxy. While you’re in there, it’s entirely convincing.

STOCKWELL: While the Whipping Boy video was the first film clip made in virtual reality, it’s really just the first step.

JAYMIS: From here, we’re going to start seeing a lot more of this kind of stuff—interactive music experiences, and even virtual reality gigs. Altspace put on a show with the comedian and musician Reggie Watts a couple of months ago. They basically put him in a full motion-capture suit, built him a custom avatar that looks like Reggie—with the amazing afro and beautiful kind of suspenders that he always tends to wear—and he put on a live comedy show in a virtual comedy club. But that’s comedy, not music. There are some electronic gigs that are happening in virtual reality already, but there’s a bit more technical work that needs to be done before you can get really sweaty to Violent Soho in your living room. Electronic music is much easier because it’s mostly about hand movements, which are already tracked. To get live rock bands with people playing guitars and things like that is going to take a little bit more time because generally there are more people. So there are a little bit more technical hurdles to get—for instance, a Ball Park Music set live in VR—but it’s not out of reach at the moment.

STOCKWELL: Jaymis isn’t the only person doing this kind of thing. He’s not even the only person in Brisbane working in this space.

[The broadcast’s separate interview with Lincoln Savage is omitted from this Jay-focused excerpt.]

STOCKWELL: Being able to go to a variety of live performances in VR is something that’s going to be happening inside of a year. While the idea of strapping on a VR headset to check out a band might sound pretty futuristic, Jaymis says it’s not far off at all.

JAYMIS: Touring for a band in Australia is really hard because it’s such a big country with such a small, relatively, number of people. If you can put on a show that people from all around the world can come to—without having to physically move around a lot—that’s a pretty magical thing.

TOM TILLEY: Welcome back, Stocky. That was Jaymis he was speaking to there, who directed the first film clip created in virtual reality.

Contemporary article snapshot: Triple J Music News via the Wayback Machine.

Categories
Music Video Projects VR/Mixed Reality

Ball Park Music – Whipping Boy: Music Video created in Tilt Brush/Virtual Reality

After completing the Nihilist Party Album video, the Ball Park guys spent a couple of hours trying my Vive VR rig, and they were quickly on board with the idea that their next video should be produced in VR.

Categories
Electronics/Development Music Video Projects

Ball Park Music – Bad Taste Blues Part II: Music Video

Another collaboration between Graetzmedia and the amazing humans of Ball Park Music.

The “house” and “science lab” scenes of this piece were all shot at my home, I invented the ejector-pants, and shot B-cam angles for the performance scenes. (Also: Sneaky bus stop cameo, so I could be on hand to reset the ejector pants between takes.)

Categories
Motion Control Projects Timelapse/Slow Motion

Ball Park Music – Surrender: Music Video

As soon as my producer friend Matt Redlich moved his recording studio into the spectacularly beautiful wooden building he dubbed Grandma’s Place, I wanted to film a music video there. Matt had just finished recording Ball Park Music’s new album, so I organised a meeting between the band and the Graetzmedia crew to see what would come.

The challenge: Reinvigorate an old-style “random stuff happening in various places” music video concept with some next-level VFX and motion control.

In collaboration with director Dan Graetz, I did a bunch of science, taught the Motion Control robot to pull perfect Hitchcock Zooms time after time, shot some crazy multi-pass performance shots to create virtual choirs, and came up with a plant-growing timelapse/realtime “seed charmer” shot which blows minds on the reg.