Advances in Real-Time Rendering. Currently working on: The Witcher 3: Wild Hunt

Июль 21, 2022

Главная
Информатика
Advances in Real-Time Rendering. Currently working on: The Witcher 3: Wild Hunt

Содержание

2. Over 5,5 million units sold! Advances in Real-Time Rendering course, Siggraph 2013
3. Advances in Real-Time Rendering course, Siggraph 2013
4. Currently working on: The Witcher 3: Wild Hunt (PC, Xbox One, PS4, ~2014) mature story driven
5. Advances in Real-Time Rendering course, Siggraph 2013 Why characters are important for us? storytelling believable universe
6. Advances in Real-Time Rendering course, Siggraph 2013 Character creation pipeline lots of information lately on how
7. Aurora engine (2004 – 2007) (Bioware - Neverwinter Nights, The Witcher) main tool for artists /
8. Aurora engine Advances in Real-Time Rendering course, Siggraph 2013 The Witcher (2007)
9. RED engine new era, full control renderer written from scratch it was meant to be used
10. RED engine (2011, W2) Resources moved character setup from 3ds max into the proper engine tools
11. RED engine (2011, W2) Customization modular character design vertex collapsing for hats and tight clothes embedded
12. RED engine (2011, W2) Initial character production scope - The Witcher 2 common NPCs: 42, each
13. Advances in Real-Time Rendering course, Siggraph 2013 Modular Design Face is the most significant part of
14. separate pipeline for the heads common topology allows for pose morphing face rig setup - motion
15. Advances in Real-Time Rendering course, Siggraph 2013 Face rig setup
16. Advances in Real-Time Rendering course, Siggraph 2013
17. ...and guess what, different heads are not good enough if you want diverse world Advances in
18. Advances in Real-Time Rendering course, Siggraph 2013 Modular Design fits the universe underlaying history best possible
19. Advances in Real-Time Rendering course, Siggraph 2013 Modular Design we had to spread the apparances idea
20. Advances in Real-Time Rendering course, Siggraph 2013 Modular Design
21. Advances in Real-Time Rendering course, Siggraph 2013 Shaders created visual shader editor but only the pixel
22. simple shader albedo shift +brightness done in a special shader block brute force, additive fresnel for
23. Advances in Real-Time Rendering course, Siggraph 2013 Geometry components On average: 3 chests 4 head covers
24. Advances in Real-Time Rendering course, Siggraph 2013 Recycling hi-poly models parts of hi-poly models (ropes, sword
25. Advances in Real-Time Rendering course, Siggraph 2013
26. Advances in Real-Time Rendering course, Siggraph 2013
27. Advances in Real-Time Rendering course, Siggraph 2013
28. Advances in Real-Time Rendering course, Siggraph 2013
29. Advances in Real-Time Rendering course, Siggraph 2013
30. Advances in Real-Time Rendering course, Siggraph 2013
31. Advances in Real-Time Rendering course, Siggraph 2013
32. Advances in Real-Time Rendering course, Siggraph 2013
33. RED engine (2011, W2) Rigs & Animation hardware texture skinning (GPU) using 4x3 matrices (not quaternion),
34. RED engine (2011, W2) Level of detail special detail level for cutscenes most meshes 3 LOD
35. RED engine 2 motion extraction loading time issues (appearances, animations, meshes, textures) ...and the optical drive
36. Advances in Real-Time Rendering course, Siggraph 2013 RED engine 2 (W2 Xbox360) CPU usage main consumer
37. RED engine 3 dynamic cloth physics new mimics system appearances dynamically loaded, no need to load
38. Current character pipeline: ~22 work-days per character for a single artist concept art sketch model, pose
39. Advances in Real-Time Rendering course, Siggraph 2013 character builder tool allows for quick character setup character
40. Generalized normal blend feature normal blend component the shader has special block that deals with the
41. Head pipeline merged previously the head component dealt with everything now it’s a specialized animated component
42. Tessellation attempts We tried: PN Triangles Doesn’t really add that much detail (characters are already very
43. Advances in Real-Time Rendering course, Siggraph 2013 Advances in Real-Time Rendering course, Siggraph 2013
44. Advances in Real-Time Rendering course, Siggraph 2013 Advances in Real-Time Rendering course, Siggraph 2013
45. Advances in Real-Time Rendering course, Siggraph 2013 Advances in Real-Time Rendering course, Siggraph 2013
46. Advances in Real-Time Rendering course, Siggraph 2013 Advances in Real-Time Rendering course, Siggraph 2013
47. Fur feature still in development compute shader update for the fur pixel shader is customizeable fixed
48. Advances in Real-Time Rendering course, Siggraph 2013
49. Advances in Real-Time Rendering course, Siggraph 2013
50. Advances in Real-Time Rendering course, Siggraph 2013
51. Advances in Real-Time Rendering course, Siggraph 2013
52. Advances in Real-Time Rendering course, Siggraph 2013
54. Скачать презентацию

Слайд 2

Over 5,5 million units sold!
Advances in Real-Time Rendering course, Siggraph 2013

Слайд 3

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 4

Currently working on:
The Witcher 3: Wild Hunt
(PC, Xbox One, PS4,

~2014)
mature story driven TPP RPG set in a fantasy universe
jaw-dropping story spanning over 100 hours of gameplay (50h main story arc) that will pull in newcomers and longtime fans alike
vast, borderless open world with various ways of exploration (sailing, horseback)
Cyberpunk 2077 (PC, next-gen platforms)
futuristic story driven RPG + open world
dense city environment + surrounding wastelands
tons of customization, mixed TPP/FPP

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 5

Advances in Real-Time Rendering course, Siggraph 2013
Why characters are important for

us?
storytelling
believable universe
expressing and increasing overall emotive response when (and after) playing the game
our games are story driven
quality

Слайд 6

Advances in Real-Time Rendering course, Siggraph 2013
Character creation pipeline
lots of information

lately on how to render characters
no information how to get them in the game
you have to think about animations, AI, mimics, etc…
how do we get all that information in a consistent way from the content creation tools to the game

Слайд 7

Aurora engine (2004 – 2007)
(Bioware - Neverwinter Nights, The Witcher)
main tool

for artists / level designers = 3ds max
slow iteration times
characters exported as hierarchy based dummies with one common skeleton containing all the possible animations
hand painted textures (even normal maps!)
triangle count: 800 (!)
character main texture map: 1x 512x512 (!)

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 8

Aurora engine
Advances in Real-Time Rendering course, Siggraph 2013
The Witcher (2007)

Слайд 9

RED engine
new era, full control
renderer written from scratch
it was meant to

be used for the Witcher 3 but at the end it was used for Witcher 2
developed to render characters beautifully
special shaders, rendering, lighting
multiple appearances per entity
underlying technology is pretty simple
texture skinning with 4 weights per vertex
animated component using Havok animation
many hours spent on these special steps

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 10

RED engine (2011, W2)
Resources
moved character setup from 3ds max into

the proper engine tools
export into our own mesh format, extended over the years
separate resources for textures, meshes, animations, heads
custom character shaders
LODs created by hand
triangle count: ~20k
typical texture set: 2k head, 2k body (diff, spec, amb, spec2, norm, detail/pattern)

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 11

RED engine (2011, W2)
Customization
modular character design
vertex collapsing for hats and

tight clothes
embedded tools for patterns / colors / cloth customization
tools for communities management (spawning NPCs, randomize clothing and coloring)

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 12

RED engine (2011, W2)
Initial character production scope - The Witcher

2
common NPCs: 42, each type have ~5 variants
main NPCs: 38
monsters: 17
main character different armor sets: 15
42 x 5 + 38 + 17 + 15 = 280
during Witcher 2 production character team = 5 people!
pre-production estimations = 27 work days per single character
280 x 27 = 7560 days = 32,9 years = 6,6 years of work for 5 artists*

Advances in Real-Time Rendering course, Siggraph 2013

*assuming E3, GDC, and any other marketing request doesn’t even exists!

Слайд 13

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design
Face is the most

significant part of the human body
and it defines identity

Слайд 14

separate pipeline for the heads
common topology allows for pose morphing
face rig

setup - motion builder
teeth + eyes as a separate model

Advances in Real-Time Rendering course, Siggraph 2013

Modular Design

Слайд 15

Advances in Real-Time Rendering course, Siggraph 2013
Face rig setup

Слайд 16

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 17

...and guess what, different heads are not good enough if you

want diverse world

Advances in Real-Time Rendering course, Siggraph 2013

Modular Design

Слайд 18

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design
fits the universe
underlaying history
best

possible quality

Слайд 19

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design
we had to spread

the apparances idea to the concept artists
they’ve done great job

Слайд 20

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design

Слайд 21

Advances in Real-Time Rendering course, Siggraph 2013
Shaders
created visual shader editor
but only

the pixel shader
generated on the fly
fast iterations

Слайд 22

simple shader albedo shift +brightness
done in a special shader block
brute force,

additive fresnel for cloth shaders

Advances in Real-Time Rendering course, Siggraph 2013

Shaders

Слайд 23

Advances in Real-Time Rendering course, Siggraph 2013
Geometry components
On average:
3 chests
4 head

covers
3 arms
...and lots of misc stuff

Слайд 24

Advances in Real-Time Rendering course, Siggraph 2013
Recycling
hi-poly models
parts of hi-poly models

(ropes, sword tilts)
use the same asset – add a pattern shader
eventually mixing geometry, patterns and colors gives you a lot of new appearances

Слайд 25

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 26

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 27

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 28

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 29

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 30

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 31

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 32

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 33

RED engine (2011, W2)
Rigs & Animation
hardware texture skinning (GPU)
using 4x3

matrices (not quaternion), non uniform scaling (dragon)
1 vertex 4 bones maximum
custom pipeline for sound analysis and head/eyes tracking
using graphs (state machines) for all the animation blending
supports slots for additional props (bags, weapons, hats, etc.)
used Havok for animations
trick for the clothes: rotated bones
since 2012 we have our own mocap studio!

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 34

RED engine (2011, W2)
Level of detail
special detail level for cutscenes
most

meshes 3 LOD levels + optional billboard
more detailed
animations (more bones updated and more sophisticated algorithms)
meshes
mimics

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 35

RED engine 2
motion extraction
loading time issues (appearances, animations, meshes, textures)
...and the

optical drive seek times
animation streaming
events, motion and key pose is always loaded
streamed animations are always blended in
tons of optimizations
background NPCs – lightweight
triangle count & typical texture set: basically downscaled 2x

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 36

Advances in Real-Time Rendering course, Siggraph 2013
RED engine 2 (W2 Xbox360)

CPU usage
main consumer is the animation
updates separated into 2 groups
regular animations and background animations
background animation are 5 ms sized jobs based on last update time, do as many as possible with priorities
regular animations are updated in a fork – gather manner on 4 threads (3 jobs + main) with 5 ms budget each

Слайд 37

RED engine 3
dynamic cloth physics
new mimics system
appearances dynamically loaded, no need

to load all and then choose
our own animation system
using just 1 - common rig matrix
“failed” tessellation attempts
fur solution
currently testing PBR + IBL
triangle count: up to 40k
typical texture set: 2k for the head, 2k body + 1k misc.

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 38

Current character pipeline:
~22 work-days per character for a single artist
concept art
sketch

model, pose setup
pre-export (extremely hi poly just to verify that it looks good in the engine)
retopology (hi-poly split)
extraction of hi-poly mimical poses (normal blends)
hi to low poly projection
texturing (Photoshop – diffuse, specular)
skinning
engine export, appearance setup
shaders, templates, slots, animation behaviors, AI

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 39

Advances in Real-Time Rendering course, Siggraph 2013
character builder tool allows for

quick character setup
character parts are stored based on game specific areas

Слайд 40

Generalized normal blend feature
normal blend component
the shader has special block that

deals with the blending
16 areas on a texture
blend weights per area in constant buffer
driven by animation component or procedurally

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 41

Head pipeline merged
previously the head component dealt with everything
now it’s a

specialized animated component that deals with the mimics and lipsync
still needs a bit different handling but much simpler
mimics have 2 levels, one for general gameplay and one for cutscenes
tip: animated components can modify the base pose

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 42

Tessellation attempts
We tried:
PN Triangles
Doesn’t really add that much detail (characters are

already very detailed)
It’s hard to deal with the holes
Displacement mapping
Could add more detail to the mesh if the pipeline would be changed
Even harder to deal with holes
Swimming effect

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 43

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Siggraph 2013

Слайд 44

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Siggraph 2013

Слайд 45

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Siggraph 2013

Слайд 46

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Siggraph 2013

Слайд 47

Fur feature
still in development
compute shader update for the fur
pixel shader is

customizeable
fixed PS input structure
fur component and fur resource to be able to add it separately
fur is grown from the original mesh

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 48

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 49

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 50

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 51

Advances in Real-Time Rendering course, Siggraph 2013

Слайд 52

Advances in Real-Time Rendering. Currently working on: The Witcher 3: Wild Hunt

Содержание

Over 5,5 million units sold!Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Currently working on:The Witcher 3: Wild Hunt (PC, Xbox One, PS4,

Advances in Real-Time Rendering course, Siggraph 2013Why characters are important for

Advances in Real-Time Rendering course, Siggraph 2013Character creation pipelinelots of information

Aurora engine (2004 – 2007)(Bioware - Neverwinter Nights, The Witcher)main tool

Aurora engine Advances in Real-Time Rendering course, Siggraph 2013The Witcher (2007)

RED enginenew era, full controlrenderer written from scratchit was meant to

RED engine (2011, W2) Resourcesmoved character setup from 3ds max into

RED engine (2011, W2) Customizationmodular character designvertex collapsing for hats and

RED engine (2011, W2) Initial character production scope - The Witcher

Advances in Real-Time Rendering course, Siggraph 2013Modular DesignFace is the most

separate pipeline for the headscommon topology allows for pose morphingface rig

Advances in Real-Time Rendering course, Siggraph 2013Face rig setup

Advances in Real-Time Rendering course, Siggraph 2013

...and guess what, different heads are not good enough if you

Advances in Real-Time Rendering course, Siggraph 2013Modular Designfits the universeunderlaying historybest

Advances in Real-Time Rendering course, Siggraph 2013Modular Designwe had to spread

Advances in Real-Time Rendering course, Siggraph 2013Modular Design

Advances in Real-Time Rendering course, Siggraph 2013Shaderscreated visual shader editorbut only

simple shader albedo shift +brightnessdone in a special shader blockbrute force,

Advances in Real-Time Rendering course, Siggraph 2013Geometry componentsOn average:3 chests4 head

Advances in Real-Time Rendering course, Siggraph 2013Recyclinghi-poly modelsparts of hi-poly models

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

RED engine (2011, W2) Rigs & Animationhardware texture skinning (GPU)using 4x3

RED engine (2011, W2) Level of detailspecial detail level for cutscenesmost

RED engine 2motion extractionloading time issues (appearances, animations, meshes, textures)...and the

Advances in Real-Time Rendering course, Siggraph 2013RED engine 2 (W2 Xbox360)

RED engine 3dynamic cloth physicsnew mimics systemappearances dynamically loaded, no need

Current character pipeline:~22 work-days per character for a single artistconcept artsketch

Advances in Real-Time Rendering course, Siggraph 2013character builder tool allows for

Generalized normal blend featurenormal blend componentthe shader has special block that

Head pipeline mergedpreviously the head component dealt with everythingnow it’s a

Tessellation attemptsWe tried:PN TrianglesDoesn’t really add that much detail (characters are

Advances in Real-Time Rendering course, Siggraph 2013Advances in Real-Time Rendering course,

Advances in Real-Time Rendering course, Siggraph 2013Advances in Real-Time Rendering course,

Advances in Real-Time Rendering course, Siggraph 2013Advances in Real-Time Rendering course,

Advances in Real-Time Rendering course, Siggraph 2013Advances in Real-Time Rendering course,

Fur featurestill in developmentcompute shader update for the furpixel shader is

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Advances in Real-Time Rendering course, Siggraph 2013

Похожие презентации

Over 5,5 million units sold!
Advances in Real-Time Rendering course, Siggraph 2013

Currently working on:
The Witcher 3: Wild Hunt
(PC, Xbox One, PS4,

Advances in Real-Time Rendering course, Siggraph 2013
Why characters are important for

Advances in Real-Time Rendering course, Siggraph 2013
Character creation pipeline
lots of information

Aurora engine (2004 – 2007)
(Bioware - Neverwinter Nights, The Witcher)
main tool

Aurora engine
Advances in Real-Time Rendering course, Siggraph 2013
The Witcher (2007)

RED engine
new era, full control
renderer written from scratch
it was meant to

RED engine (2011, W2)
Resources
moved character setup from 3ds max into

RED engine (2011, W2)
Customization
modular character design
vertex collapsing for hats and

RED engine (2011, W2)
Initial character production scope - The Witcher

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design
Face is the most

separate pipeline for the heads
common topology allows for pose morphing
face rig

Advances in Real-Time Rendering course, Siggraph 2013
Face rig setup

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design
fits the universe
underlaying history
best

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design
we had to spread

Advances in Real-Time Rendering course, Siggraph 2013
Modular Design

Advances in Real-Time Rendering course, Siggraph 2013
Shaders
created visual shader editor
but only

simple shader albedo shift +brightness
done in a special shader block
brute force,

Advances in Real-Time Rendering course, Siggraph 2013
Geometry components
On average:
3 chests
4 head

Advances in Real-Time Rendering course, Siggraph 2013
Recycling
hi-poly models
parts of hi-poly models

RED engine (2011, W2)
Rigs & Animation
hardware texture skinning (GPU)
using 4x3

RED engine (2011, W2)
Level of detail
special detail level for cutscenes
most

RED engine 2
motion extraction
loading time issues (appearances, animations, meshes, textures)
...and the

Advances in Real-Time Rendering course, Siggraph 2013
RED engine 2 (W2 Xbox360)

RED engine 3
dynamic cloth physics
new mimics system
appearances dynamically loaded, no need

Current character pipeline:
~22 work-days per character for a single artist
concept art
sketch

Advances in Real-Time Rendering course, Siggraph 2013
character builder tool allows for

Generalized normal blend feature
normal blend component
the shader has special block that

Head pipeline merged
previously the head component dealt with everything
now it’s a

Tessellation attempts
We tried:
PN Triangles
Doesn’t really add that much detail (characters are

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Advances in Real-Time Rendering course, Siggraph 2013
Advances in Real-Time Rendering course,

Fur feature
still in development
compute shader update for the fur
pixel shader is