So I just watched Birds of Prey, it was amazing.
I wish the movie is in VR180.
Well, today.
We are going to remake the Harley Quinn movie
in VR 180 with DaVinci Resolve and Fusion
16, with a VR headset like Oculus Rift S here
or Oculus Quest with Link.
Okay for real, we are not gonna remake Birds
of Prey.
But I am going to teach you everything you
need to know to work with VR180 video.
The best part is, you can follow along with
this video with the FREE version of DaVinci
Resolve.
If you are interested in creating 3D immersive
videos for VR headsets, this is a good tutorial
to start to get your hand dirty.
VR headset is not required for this video.
BUT, to see the trust power why I love Fusion
16 in VR production, you do need at least
an Oculus Quest with Link.
We have a lot to cover today.
This tutorial is almost movie length.
So let's Hit it!
Edit VR180
Premiere VS DaVinci Resolve
If you are a long time followers of this channel,
you know I teach how to edit VR180 video in
Adobe Premiere, right here on this playlist.
So why bother DaVinci Resolve if Premiere
works so well?
Well, in fact, Premiere does not work that
well - there are things - like I show you
later in this tutorial - Premiere just can't
do it.
The most obvious thing is, DaVinci Resolve
lets you do most of the works FREE - and Adobe
costs a fortune.
Well, there is a catch.
If you follow along my first DaVinci Resolve
tutorial on 360 reframe, you know the output
quality is not that good.
Why?
Because the free version limits your input
quality to 4K instead of 5.7K or whatever
high-quality RAW footage you have.
So your final output is very compressed.
It is okay for social media - but if you are
looking for VR headset delivery, you will
need to buy the Studio version.
I will let you in on a little secret if you
want to save $300: If you purchase the USB
Dongle version of the DaVinci Resolve Studio
using the link down below - or any link as
long as it is USB dongle, not paper licenses
- you get a complimentary license of Fusion
Studio as well, which cost another $300.
Fusion Studio is a lot more stable when you
are dealing with 11K or 32K stereoscopic 360
videos for the Pros.
So I just save you $300 bucks, hit the like
button to thank me!
VR180 camera
Which one should you get?
Well, it has been a hot minute here on CreatorUp
regarding VR180 cameras.
So to refresh your memory, I will highly recommand
to rewatch this video right here in your VR
headset.
So you can compare all the available VR180
cameras right now on the market, including
Insta360 EVO, Vuze XR, Z Cam K1Pro, the Qoocam,
and the Lenovo Mirage.
In 2020, there are 2 new VR180 cameras announced.
For consumers, the Insta360 ONE R will be
a successor of the popular Insta360 EVO.
It has H.265 compression with higher bitrate
video capture and better stabilization.
For professionals, if you have the cash, Z
Cam K2Pro, with the KC Lai's new fisheye lenses,
will be a great choice.
Check the first look video here and a detailed
review will come soon on CreatorUp.
So hit the bell and stay up-to-date.
Edit VR180 Video in DaVinci Resolve
Now it is the fun part.
Let's talking about how to set up your project
and get ready to cut some Harley Quinn VR180
videos in DaVinci Resolve.
Click untitled project and start a new Project.
So DaVinci Resolve does crash, especially
if you are on the free version working on
VR footage.
Here are some tips works for me and hope it
helps you too not to become an angry panda
-
meme time :P
Go to preferences, Memory and GPU.
Under memory configuration, make sure your
Resolve memory usage is not 100% of your system
memory.
Most of the crashes are because you are running
out of system memory.
So keep it around 70% to 80% should be good.
Uncheck use GPU Scope too.
Next, go to User tap, under Project save and
load, make sure save setting use Live Save
and Project backups.
So if it crashes, you don't need to worry.
You get right back before you crash.
I wish Premiere has this feature as well.
Now go to Project settings, Timeline resolution
is Custom in 5.7K.
If you are on the Free version, then set it
to 4K - which is 3840 x 1920.
Set the framerate to 29.97 as we are going
to use Insta360 EVO footage.
Also, set the optimized media settings as
what I show you in my last video right here.
Hit Save, and let's import some footage.
Go to Edit page.
Create a 5.7K or 4K timeline with 2 by 1 ratio.
Drop-in our comic con footage into the newly
created timeline.
So edit VR180 footage is exactly the same
as edit 2D footage inside Davinci Resolve.
If you come from Premiere, Final Cut Pro,
or Avid Media Composer - this is no new for
you.
I will just show you here the absolute minimum.
Click B on your keyboard to bring up CUT tool.
Cut in the timeline.
Click A on your keyboard to bring back up
the select tool.
Select the session you don't want, tap the
small delete key to perform a ripple edit.
I want to keep this video short.
But if you want to learn more about the basic
or advanced techniques in editing, I am making
an advanced course on Linkedin Learning.
So when it is ready, I will post the link
down below.
See the undistorted view with Continuum VR
One thing is missing in the edit page, and
the color page of DaVinci Resolve is to see
the final 2D view like what you used to in
Premiere toggle VR display.
Here is my workflow to do exactly that and
more, with BorisFX Continuum VR units.
This is not a FREE plugin that comes with
your DaVinci Resolve, and it is optional.
You don't need that to edit VR180.
BUT, it is really nice to have.
If you want to save time, I will highly recommand
checking it out.
Let me show you.
Go to OpenFX, search VR.
Drop in the BCC VR reorient.
Open up inspector, go to OpenFX.
In Source, tell BCC the input format is Stereo
Left and Right, Input FOV is 180 degrees and
Output Format is Stereo Left and Right.
Go down to Reorient, pick the View Mode to
Preview.
Now you see an undistorted left and right
eye view on your preview windows.
So that is what your viewers will see in a
VR headset but now, you don't need a VR headset
to see that view.
So it is a lot more convenient to do story
edit in this view.
You can pan your view left and right, up and
down with the control right here.
The black bar is because this is VR180 not
360.
So the back is black.
Continuum VR allows you to turn VR180 footage
into VR360 and vice versa.
If you want to learn more, comment below,
and I will make an in-depth tutorial on all
the BCC VR plugins - which is very powerful.
One more trick.
If you hate panning during editing but still
want to see the original view, you can have
an Overlays like so - so you can see the best
of both worlds.
Now, moving on to the best part - insert 3D
graphics, texts, other videos with VR180 video
in a 3D environment.
The BEST way to position and animate Graphics
in VR180
So the biggest challenge in any VR180 production
is inserting texts, logos, 2D videos (aka
PiP - Picture in Picture) and 3D elements.
You can kinda do this with Premiere but if
you have any experience editing VR180 in Premiere,
you know that it is very hard.
Most of the VR180 video I saw on YouTube get
me cross eyes immediately because of that.
Adobe Premiere is not a 3D application, so
you really need to do that in After Effects.
But After Effects is NOT a 3D application
neither.
It is more like a 2.5D. So you will need a
third party plugin like Canvas STK to properly
position your graphics in 3D space.
Canvas 360 and Canvas STK are very powerful
and I have a tutorial on that.
But you need to pay for it.
And your footage has to round trips three
software just to do a simple insert, that
is just not practical.
And this the biggest reason why I switch to
DaVinci Resolve Fusion.
BTW, you don't need the Paid version of the
Studio to do all these.
Yes, this is crazy.
The free version and the Studio version has
the exact same workflow.
Let me now show you.
Head over to Fusion Page, this is the 3D text
we are going to build on top of my Z Cam K1Pro
Footage.
As you see the measuring tape right here in
my footage, The 3D environment we are going
to create has really close distance measuring
with the real world.
So you know exactly where you should place
your graphics to NOT has stereo conflicts
- the bad way that makes people cross-eye
to watch your content, or hate your content.
And I made those mistakes as well, so don't
think this is just for beginners.
Okay, start flesh, we are first going to bring
in all the necessary elements in creating
3D in Fusion.
Don't worry if you are new to this, same as
everyone else, including your boy.
So just follow along.
Go up in the 3D menu, and click this to insert
a merge3D and this to insert a Render3D.
Now we need a camera.
Another quick way to insert elements in Fusion
is to hold down Shift and Spacebar and bring
up the search menu.
We need a camera, so type in camera in the
search bar and we see the spherical camera.
So for anything mono or VR360 or VR180, we
are going to use this special spherical camera.
We have a lot more in-depth tutorials coming
just about this spherical camera.
So let's add it.
We also need something to insert.
In Premiere, you can only insert flat 2D Text,
which is boring.
Since we are in DaVinci Resolve, let's make
this more challenge and insert a 3D Text.
Sometimes, the best way to learn a new skill
is to rollerblade before walk, Haley Quinn
style.
So again, shift space, search Text, and add
the Text 3D.
If you just want to the boring text, that
it's Text+.
Now connect everything to merge 3D.
Merge 3D allow you to connect multiple elements,
so it is very convenient.
Render3D is used to render everything 3D into
a flat format so you can upload onto YouTube.
So the flow is from merge 3D to Render3D.
Now go to Text3D and type in something.
You don't see anything yet.
Let assign the #2 View Window to merge3D.
Now you see the text.
It is sitting right on top of my camera.
So you push it in the Z space to back it off.
Make sure you are on the Text3D before you
do that, so you don't accidentally push the
camera instead.
So some basic operations within Resolve 3D
envirnment.
If you hold down your middle mouse button,
you can shift left and right, up and down
in the 3D space.
Again make sure you are on Merge3D node.
Hold down Alt or Option on a Mac to rotate
around in 3D space.
Hold down ctrl and scroll your mouse wheel
will dolly in and out of the 3D space.
Create a Virtual Camera to match your physical
camera
Now, let's match your virtual spherical camera
to your Insta360 EVO, ONE R or your K1Pro.
Go to your Spherical camera, in the Inspector
window there is an stereo option.
Open it up, keep Off Axis and Center b/c the
footage is shot on a K1pro.
The Eye separation, I will set it to the normal
IPD - which is 64mm, commonly used as human
average.
BTW, in Resolve, we use meter system.
So 0.064 is 64mm.
We will come back to Convergence Distance
when we connect the 3D text to the actual
K1 Pro footage.
Most of these cameras use infinite focus,
so usually, we just set the Convergence Distance
super large, so the furthest distance is in
the Zero Sphere.
Wow Zero What?!
Okay don't worry, if you are new to stereoscopic
in Virtual Reality Capture - I will highly
recommand watching this video many, many times
to get the Zero Sphere and parallax concept.
If you zoom in now, you see TWO virtual cameras
side by side, just like your Insta360 EVO
or K1Pro.
Very cool, huh?
So no more guessing and cross eyes in Premiere.
There is one more step you need to do to convert
the 3D environment in Fusion back to 2D so
you can merge the 3D Text with your camera
footage.
Go to Render3D.
In the Inspector window, choose the SphericalCamera1
as your main camera and Stack as your eye
setting.
The default is side by side stack.
If you are filming VR360 with cameras like
Insta360 Pro 2, you check vertical stack here
as they are top and bottom.
That tutorial is coming next.
So I will save it for next time.
To speed up the render, choose render type
to OpenCL to use some GPU goodies.
Be careful of checking the swap button here.
If you check it, you will flip left and right
eye.
The best way to get people to hate your 3D
content.
That is also why it is so important later
on to check your final render in VR headset
- in case somewhere along the pipeline, you
accidentally swap the left and right eyes.
It happens to all of us.
We are human - we make mistakes.
Now, let merge the 3D text with the VR180
video.
Go ahead and add a normal merge by clicking
this button.
Make sure the MediaIn is the background and
the 3D text is the foreground.
Before we preview it, there is 1 more thing
we need to do.
This VR180 video is shot on Z Cam K1Pro in
6K instead of 5.7K.
If you have the free version of Resolve, you
actually need to transform it into 4K.
So let's do that.
Right click, add tool, transform, and select
resize.
This is the 3rd way to add nodes.
I am purposefully showing you all the ways
to add a node on Resolve - so you can find
the best way that works for you.
Another power user tip is to hold down shift
and drag the node onto the pipe to automatically
put the node within the pipe like so, instead
of doing it like that.
If I save you coupled mouse clicks, please
hit the like button and share this video on
your social media.
On the Resize node - if you are on the Free
version, change it to 4K.
For everyone else, resize to comp size which
is 5760 by 2880.
Now connect the 3D text to the Merge and hit
2 on your keyboard to bring the Merg on the
Preview window.
And ... you can not see the text.
Wait, what happens?
Okay, if you take a look at your Render3D
output and loading it up on #2, you see the
comp size of render3D is huge.
I don't know if this is a bug in Resolve or
what.
If anyone knows a better way to fix that,
please comment below.
The way I found work is to resize it.
Go back to Render3D, click this button to
go image size.
Uncheck Auto Resolution and manually resize
width and height to 2880.
This is the size of each eye of your comp
- which is based on the size of Insta360 EVO.
If you look at the output size of Render3D,
it is still not right.
The width of 2 eyes should be 5760 instead
of 11520.
Because all VR180 output has an anamorphic
squeeze to fit into a VR headset.
So we just need to crop out the extra blank
space as we don't need it.
Again, if you know a better way to do this,
please let the community know.
For me, I will split the output into left
and right eye.
So add a stereo splitter.
I like the shift and spacebar search as it
has a little icon to remind you of what each
node does.
We also need a combiner to combine the stereo
back again.
So add a combinter as well.
Connect render3D to the splitter to get left
and right eye individual output.
Now we just need to crop out the extra pixels.
Add a crop.
Connect left eye to the crop.
Make sure the comp size is 2880 by 2880.
Put the Crop output on to the Preview window
like so.
Offset Z by 1440 - half of the comp size of
2880 will put the text right back in the middle.
Since left and right eye is the same, we copy
the left eye with ctrl C, paste it with ctrl
V. Connect the right eye to the new crop and
connect both crops to the combiner.
Now look at the combiner output - 5760 by
2880 - prefect.
It is exactly the same as Evo.
You won't have this issue if you just using
EVO footage or K1Pro footage.
This nightmare is created by mixing cameras.
But, it is a good way to show you how to troubleshoot
and handle problems.
As a wise girl once said "If you know how
to rollerblaze and dump by joker, you better
know how to walk or rob a bank".
NOT by Harley Quinn.
Now go ahead to connect the combiner output
to the merge and pipe to MediaOut.
Show it on Preview - the text is way too close
to the camera.
Go back to the 3D Text, go there in the trasnform
tap and push the Z in translation back so
it is now further away from the camera.
Put 1 on to Merge3D - so you know what I am
talking about.
So now, how do I know the stereo is correct.
Well, if you do not have a VR headset or do
not have the paid version of resolve, you
can use anaglyph and a cheap pair of 3D glasses
like right here.
Add Anaglyph node like so, shift drag to merge
it before mediaOut.
Look like you just got killed in a videogame.
Well, in the inspector, make sure method is
color and the stack is Horizontal.
If you did everything correctly, now you should
see 3D.
Very cool.
But, let's face it.
It is really hard to see the correct 3D with
a cheap pair of 3D glasses.
And we have not even found out the best convergence
distance yet.
So the final delivery is on a VR headset,
we should really exam the 3D on Oculus Quest
or Oculus Rift S.
And that is exactly what we are going to do
Connect Oculus Quest / Rift S with Davinci
Resolve Fusion
Connect a VR headset to Davinci Resolve is
surprisingly easy.
You don't need to use StreamVR and jump tho
all the hoops like Premiere.
Plug your VR headset in your computer.
For PC, you can use Oculus Rift S, Oculus
Quest with Link or Windows Mix Reality headsets.
On Mac, you use HTC Vive.
After you connect your VR headset, go to Fusion,
Fusion settings, VR headsets - here you can
fine tune your settings.
But usually, you don't need to touch this
at all.
Unfortutenly, at the time of recording, the
VR headset feature does not natively support
VR180 just yet.
So you need to do some modification to turn
it into VR360.
If you want to turn any VR180 video into VR360,
this is the exact same workflow.
So go ahead and add a splitter to split left
and right eye.
Next we are going to add crop to make the
180 into 360.
So we can eventually convert a side by side
VR180 into top and bottom VR360.
That is the goal.
In the crop, make the X size to 5760 and Y
size to 2880.
And we check the keep centered to make sure
the 180 is in the center, so it is facing
us.
Go ahead and copy the exact same Crop node
to the right eye.
Combine them with a stereo combiner.
The combine way will be vertical top and bottom
right here.
To make sure we did not accidentally swap
left and right eye, put the mediaIn on #1
and combiner result on #2.
The Top should match the left eye.
And it does here.
Now let's see the final result in a VR headset.
As you see the third dot right here, that
is #3 display.
If you click 3 on your keyboard, it will load
the preview onto whatever VR headset you have
connected.
Here is a Fusion OpenVR windows, you can see
what I am watching right now in my VR headset.
Don't worry, I am not watching anything weird.
Now, go back to Convergence Distance and fine
tune the number until you see a comfortable
image in your VR headset.
Special shoutout to Frédérick Destrem from
France figuring out the best Distance for
EVO and most of the side by side VR180 camera
is 250 - basically, is infinite.
So you actually have to type in 250 in the
box to get that value.
That is how infinite that is.
So now, if you wear the VR headset, grab the
Z vaule of the 3D Text and move it along on
the Z axis, you see the Text fly in and out
in 3D space with perfect disparity.
It feels like the text is part of the video
which is exactly what we want.
You simply can't do this in Premiere.
So there you go, if you need a reason to switch
to Resolve Fusion 16.
I know right now, you feel like you are a
superhero or a super bad girl, so why not
go crazy.
Let's make a real 3D text, do some advanced
composition, and animate the text from me
toward the camera.
Yes, let's do this.
Why not?
This is a free YouTube video, let's just learn
as much as you can before your brain explored.
Animate 3D text in VR180
So, go back to the Text 3D, add some Extrusion
Depth and Bevel.
Let's make the text to my favorite color - PINK.
I mean, why not?
You don't really see 3D.
Because we need light.
Let's go to Render3D and right here, turn
on light and shadow.
Now shift and space bar, search Light and
add a spot light.
Connect that to merge3D.
You see the 3D now.
Let's position the light as where it supposed
to be - which is behind your VR180 camera.
Right now, it is sitting on top of your camera.
You can move the light just like any 3D object.
So I move it over here where my actual production
light is.
The good thing about this system is we recreate
the entire set in 3D space - So you can place
objects accordingly.
You can click this icon to rotate an object
in 3D space.
So we point the light to the text like so
- very nice.
Now let's animate this.
Go to the start of the timeline, move the
text to the beginning.
Wear your headset and make sure the 3D text
is not overlap with the object in Scene.
Basically, it is not cover object support
to be in front of the text.
If so, you need to roto the text part-out.
Let's save that for the next crazy tutorial
by your boy Hugh.
Insert a keyframe on the Z vaule.
Now move forward, move the Z value to insert
another keyframe.
And we slowly move the second part of the
text in a longer timeframe.
You see it here in the 3D graph.
Now let's add some ease easy to smooth out
the animation.
Open the Spline panel, right-click scale to
fit.
Select each keyframe and add an animation
curve.
Now, the animation is really smooth.
Look at that.
Before we add motion blur, let's add some
film grain to blend the 3D text into your
scene, so it does not look too CG.
Now go to Render3D, go to the last tap and
right here, we check Motion Blur.
Increase the quality if you want better looking
more blur.
So for render, as we are going to color grade
in color page.
So we do not need to convert VR180 to VR360.
So no need to connect the combiner output
to the MediaOut1.
Remove the anaglyph as we don't need it anymore.
Now we can go to Color page and color this.
And here is the final result.
EPIC.
Paint Fixes in VR180
Another common task in any VR video is to
remove unwanted objects or people.
If you watch my second Davinci Resolve tutorial,
you already familiar with paint fixes with
LatLongPatcher.
If you don't, watch that first.
I am assuming you already watched how to use
LatLongPatcher many times, so now let me walk
you tho how to do it in stereoscopic.
On Preview window #1, we loaded the before
video from MediaIn.
In the Preview window #2, we have the final
result.
As you see, I have my shotgun Mic in the frame.
And I remove it using paint fixes.
Because the shotgun mic looks different from
left to right eyes, we need to separate them
with stereo splitter.
As you see right here.
Latlong patcher only work in monoscopic 360
video.
So we are using Crop again to turn the 180
videos of each eye into 360 videos.
As you see right here.
Basically we just turn the canvas into 5.7K
and then center the 180 video.
Now it is the exact same workflow as you already
know from my previous 360 tutorial.
We add LatlongPatcher - move the rotation
to make the shotgun mic in the frame.
Use the Paint Tool to clone it out.
Revert the latlongpatcher, and merge it back
from the crop output.
Easy.
Do the exact same thing to the right eye.
Now use the Crop tool again to revert what
you crop orginally.
Basically, crop it back to 2880 by 2880.
Combine it with Stereo combiner and bang!!
The shotgun mic is gone like Magic.
Do some color grading in your color page,
then you are ready to go.
How to render VR180 video for YouTube and
Facebook
After color page, we move onto the Deliver
page.
I use Quicktime and H.265 as render codec.
Again, if you are on the Free version, use
4K.
Quality, as we are targeting Oculus Go and
Oculus Quest, so we restrict to 80Mbps.
Again force sizing and debayer to the highest
quality.
And then render.
If you have a good GPU, the render should
go really fast, faster than Premiere.
Now, let's get it ready for YouTube VR.
If you have not already, go ahead and download
the official YouTube VR180 Creator Tool.
Open it.
Choose Prepare for publishing.
Drop in the video file, hit export.
And then upload the exported file onto YouTube,
and you should be good to go.
For sideloading on to Oculus Quest or Go,
just rename your file into _180_3D at the
end of your file name.
Transfer the file onto your VR headset, and
you can enjoy them locally with high quality.
Check out this video for more info.
If you have ambisonic audio, you need to merge
them with the Facebook Spatial Workstation.
I have a tutorial already, so follow this
one right here.
Thank you so much for sticking around.
This is not an easy tutorial, I know.
But now, you are smarter than most of the
people in the VR180 industry.
And you have the tool and knowledge to create
great content that does not make people cross
eyes.
Please share this tutorial to anyone who decides
to create VR180 content.
Even they are using Adobe Premiere, they should
at least know how to do things correctly in
a 3D application or inside Davinci Resolve
Fusion 16.
Creating bad content will hurt the industry
and give people a bad impression of VR180
- don't be that guy or gal.
The next video, we will go to an even deeper
discussion in Stereo 3D 360 VR.
Make sure you master the VR180 skill first
before moving forward.
I build this series basic on a learning path.
If you skip, like episode 1 or 2, you will
get lost in the learning.
If you are new to this channel, please consider
subscribing and hit the notification bell
to stay ahead of the curve in Virtual Reality
filmmaking.
And I will see you next week.
Keep creating my friends.
