【Unite Tokyo 2019】Unity映像制作パイプライン完全マスター

Ron Martin Strategic Development Manager M&E, Unity Generative Art — Made with Unity Super-Charging Your Pipeline

Generative Art — Made with Unity Pipeline PRODUCTION PIPELINE Python

Pipeline OpenTimelineIO FBX/USD/Alembic Video Editing / Storyboard DCCs Python PRODUCTION PIPELINE Shotgun integration (private alpha) 4

Architecture 5

Architecture Shotgun Shotgun toolkit Python Python for Unity Shotgun for Unity Interface between Shotgun and Unity: ● Python to access Shotgun ● Launch tk-apps from C# menus, using a Python helper class ● C# or Python to call into Unity from toolkit 6

Features 7

Launching Unity 8

Loading Assets (tk-multi-loader2) 9

Updating Assets (tk-multi-breakdown) 10

Publishing Versions with Unity Recorder integration (tk-multi-publish2) 11

Work Area Info (tk-multi-about) 12

Task Management (tk-multi-shotgunpanel) 13

Rapid Prototyping (tk-multi-pythonconsole) 14

post_init_hook Useful callback to start populating the Unity Editor 15

Workflows 16

Seamless experience for artists between DCCs and Unity DCC (e.g.: Maya, 3dsMax, Mobu, ...) 17

Open Unity from a Shotgun task 18

Jump to the right frame in Unity from a Note 19

Add Notes from Unity into Shotgun 20

Publish Video Recordings from Unity to Shotgun 21

Levels of integration 22

Default Config — Up-to-date with tk-config-default2: latest fixes and features from the Shotgun team — Simply add tk-config-unity as a pipeline configuration Shotgun Shotgun toolkit Python Python for Unity Shotgun for Unity tk-config-unity 23

Custom Shotgun Config — Add the tk-unity engine to your own config — tk-unity follows standards and is easy to integrate — Integration steps are documented in the Shotgun for Unity package docs Shotgun Shotgun toolkit Python Python for Unity Shotgun for Unity custom config 24

Shotgun API — Simply use the Python for Unity package Shotgun Shotgun API Python Python for Unity Custom Shotgun For Unity 25

26

Roadmap 27

Roadmap — Public release 2019.3 2020 TBD: — Integration with source control (sample) — Publish from Unity (Camera, Set,... as USD, FBX, Alembic) — Publish validation (check that only the right assets have been published) — Turntable sample in Unity 28

Install Private Alpha 29

Install Unity Package manager 3. 2. Shotgun package Python Interpreter (2.7) com.unity.integrations.shotgun 1. Python package com.unity.scripting.python 30 4. tk-config-unity

Extending the Pipeline FBX/USD/Alembic roundtrip DCCs (Maya, Max, Blender, Houdini, Motion Builder, Substance, Photoshop,…) Python (Mesh, Material, Stingray/Interactive PBR material, Camera, Animation, Custom attributes, Lights) MeshSync (polygon meshes, blendshapes, light, cameras, bones) Python PRODUCTION PIPELINE 31

Extensibility of Timeline 32

Assembling and rendering Shots with Timeline A Recorder track in Timeline renders a sequential image for film 33

Storyboard to blockout or layout in Unity Layout or mocap in Unity Rough Storyboard OpenTimelineIO: Eg: Import from Toonboom Storyboard Pro to Unity Blocking out / Grey boxing in Unity Storyboard (eg: Toonboom Storyboard Pro) 34

Unity to Animatic Rough Storyboard Moodboard OpenTimelineIO: Eg: Export from Unity to Adobe Premiere Block and first editorial exploration directly in Unity (eg: with Mocap) Animatic 35

Iterate OpenTimelineIO ... Storyboard, Editorial Set (Concept art, block out, final, lighting) OpenTimelineIO Iterate on storyboard (eg: animation), editorial, photography, set design,... Character (Concept, Model, Rig, Pose, Mocap, Anim) 36

Unity to Production management Populate to and from Unity, Auto-Dailies, update edits... Production Management OpenTimelineIO Eg: Export shots + CSV ... Export videos Unity timeline Unity recorder 37

Example of Editorial Pipeline in Unity Sequence01 EDITORIAL Shot10 Shot20 Sequence02 Shot30 Shot40 Shot50 Baked Video Take01 MEDIA01 Snapshot Video Take02 Video Take03 Video Real-time Real-time REAL-TIME MEDIA Camera Anim ACTOR1 Photography PHOTOGRAPHY Dolly, crane,... Body Animation Actors Facial Animation Set, FX, Crowd,... ACTORS Actor1 Actor2, ... 38 Cloth cache,...

Features 39

Features — — — — — Storyboard to Editorial: Edits wherever it makes sense Timeline Integration: MetaData, Markers, MediaLinker & Gaps Scripted Importer; native asset type Rendering Shot Media via Unity Recorder Import/Export To OTIO, EDL, XML and others… — Customizable using Python and C# 40

Add video here 41

Future work... — We’re building a roadmap, come and see us... – Multi-takes – Audio Edit – Transitions – Linking Shots to Real-Time Media – More publish...conform..repeat... – More editorial tools… 42

USD for Unity. Generative Art — Made with Unity

Pipeline USD/FBX/Alembic (import/export) OpenTimelineIO + USD? Video Editing / Storyboard DCCs MeshSync (polygon mesh, blenshapes, light, Camera, bones) Python PRODUCTION PIPELINE ... 44

Architecture USD SDK USD for Unity Import and export USD USD API accessible from C# 45

Install 46

Import & Export Components

Simple Import/Export Menu

Import as Prefab: Lightweight USD-Prefab “Hooks”

USD Preview Surface Export Standard, HD Render Pipeline, & Custom Shader Support

UsdSkel Export Vertex Skinning Rigs & Animation from Unity to USD

USD Preview Surface Import Textures, Vertex Color, & Shader Parameters

Preview Surface Display Color

UsdSkel & Vertex Streaming 4-Bone skinning in 2018.x 255 Bones in 2019.1

Rig + Skeletal animation

Baked vertex cache

Timeline Integration

USD Recorder Track

C# Job System Integration

Camera Import & Export

usdview Unity

USD Data Inspector

Access to large USD data, “out-of-core”

Composition Initial Prototypes

Payload Support

Variant Selection

Filter By Variant Set

Parallel Unity Scene Editing USD layered / department-based workflow prototype

Automatic Lightmap UV Unwrapping

usdview

Unity w/Minimal Shading

HD Render Pipeline (HDRP) Lighting & shading by Laurent Harduin

88

Roadmap 89

Conclusion Python and Shotgun enhances productivity. Editorial wherever it makes sense. USD Provides flexibility and collaboration 90

Thank You Generative Art — Made with Unity

Generative Art — Made with Unity