With the ever-increasing number of digital photos and videos being recorded these days, many of us have gained experience in framing and shooting media. However, the jump to immersive 360-degree media brings a new set of possibilities, challenges, and other things to keep in mind.
Everything Is in the ShotThere is no "behind the camera." When shooting any scene, you need to either leave the room or make yourself part of the shot. Most of the cameras that are available today work with a companion smartphone app that allows you to remotely take a photo or video, giving you the opportunity to hide close by, out of sight. Recently, I did a shoot of the front of our office and used a pole in the front of the building to remove myself from the scene.
Limit Movement of the CameraWhen planning your shoot, try to let the person viewing the experience choose where they go. Use hotspots to allow for "teleporting" around an area or between scenes in a first-person perspective. Any disconnect between the camera's movements and the viewer's body movements can be disorienting at best and nauseating at worst. We've seen enough YouTube videos of grandma riding a roller coaster in VR to know that camera movement can be problematic in an immersive situation.
Camera PositioningThe camera should be four to five feet away from the subject. That same experience you get when someone is "in your personal space" is easy to achieve and generally not what you want in VR. Conversely, objects too far away from the camera quickly fade out of view, so if detail is important, it needs to be close.
Be aware of where stitch lines will fall in the final shot. If your camera has two fisheye lenses, objects that lie along the "prime meridian" between the lenses can be subject to distortion from the stitching process, so limit the movement that is visible to the camera in these areas.
Finally, even though it is capturing a full 360 degrees, the front of the camera is important. It is what will be the initial view that a person sees.
LightingOften, for standard photography, you will use additional lighting or a flash to illuminate an area that doesn't have good natural light.
The best solution is to have natural lighting in the scene but that's not always possible. If there is an area that’s important to have light on, try using extra lighting behind other objects in the scene, or small directional spotlights pointing toward the subject and away from the camera.
ResolutionAlways capture your source material in 4K resolution or higher. Remember that 4K resolution is split between multiple lenses and spread over a full 360 degrees, so 4K images and video only give you HD in each hemisphere. If the resulting video is too large or requires too much bandwidth, you can lower the resolution to HD if the subject matter doesn’t need it, but you can't go the other way.
After the ShotOne thing that most new 360 videographers don’t realize is, unlike 360 images, the raw video that comes off the camera isn’t ready to be used. When the initial video is taken from the camera, the video looks like this:
Video Compression4K video can generate incredibly large files that are hard to work with on your local machine, much less able to be streamed over the Internet or transferred to a phone.
Let's examine the case of uncompressed 4K video. To be considered 4K, each frame should be a minimum of 3840 by 1920 pixels. Each pixel requires 24 bits to represent its color, and for 30 frames a second, you would get:
Fortunately, the cameras do some compression before storing it. For example, a Ricoh Theta V produces approximately 430MB of 4K video for each minute recorded, which is about one-third of the size of the raw footage.
This is helpful for manipulating the files themselves, but it is still a large file. Consider the bandwidth that would be required to view this file over the Internet, keeping in mind:
The answer to the problem is video compression. Experiment a bit with high, medium, and adaptive bit rates to see if you can achieve a good balance between file size and quality. There are also free options available to handle video compression that works very well. Give HandBrake a try.
Want to learn more? Join me at the ATD 2020 International Conference & EXPO for the session, Virtual Reality in Real Life: A Case Study in Ultrasound Training.