Creating 3D content in VR
In addition to traditional 3D modeling software like Blender (and ZBrush, 3D Studio Max, Maya, and so on) there is a new generation of 3D design apps that let you to directly create inside VR. After all, it's pretty awkward trying to use an inherently 2D desktop screen with a 2D mouse to form, sculpt, assemble, and manipulate 3D models. If only it could be more like real-life sculpture and construction. So, why not just do it directly in 3D? In VR!
Like other digital platforms, we can categorize VR apps into ones that present an experience, ones where you interact to engage with the environment, and ones where you actually create content, for yourself or for sharing. An example of the latter and one of the first to be widely successful is Google Tilt Brush (https://www.tiltbrush.com/) where you paint in 3D. This is one my favorite go-to apps when introducing VR to family and friends. Tilt Brush lets you paint in 3D in virtual reality.
Other VR 3D with sculpting and painting tools, to name just a few, include:
- Google Blocks: Low poly modeling (https://vr.google.com/blocks/)
- Oculus Medium: Sculpt, model, paint in VR (https://www.oculus.com/medium/)
- Oculus Quill: A VR illustration tool (https://www.facebook.com/QuillApp/)
- Kudon: Surface and volume sculpting (http://store.steampowered.com/app/479010/Kodon/)
- MasterpieceVR: VR sculpting and painting (https://www.masterpiecevr.com/)
- Microsoft Paint 3D: Easy 3D sculpting and painting bundled free with Windows (https://www.microsoft.com/en-us/store/p/paint-3d/9nblggh5fv99)
Making stuff and playing with it in VR is creative and fun, but to be useful and productive, you need to be able to share your creations outside of the app. Most VR sculpting tools let you export the models to share on the Internet, export in FBX file format, for example, and import them into Unity. There are two different workflows to do this:
- Export/Import: In the first workflow you make a model and export it to a compatible format, like FBX. This is akin to traditional 3D software like we did with Blender.
- Publish/Import: The second workflow is to upload it to a sharing service and subsequently download and install it into your Unity project.
In this section, we will use Tilt Brush as an example. Suppose you have Google Tilt Brush and a compatible VR rig. Further, suppose you have a creation you'd like to integrate with your VR app with Unity. Let's walk through each workflow process.
I opened Tilt Brush in VR and created a masterpiece using the Paper ribbon brush. I call it TiltBox, consistent with the cube theme we're using in this chapter. I know, it's beautiful.
The Tilt Brush features and user interface presented here (at the time of writing) are considered by Google to be in beta or experimental and are subject to change by the time you read this.