Digital contents technology now

What is digital contents?

1. Digital Content Creation denotes the

creation and modification of digital content, such as animation, audio, graphics, images or video, as part of the production process.
2. This large field encompasses many

segments such as 3D graphics, audio editing, compositing, authoring etc

2

What is digital contents?

Digital Vision
The Voyage to the moon VFX < 1902>
VFX < 1977> TV VFX < 1980> VFX < 2005>

Game

Monopoly()

Space War (1962)

ATARI (1972)

Sony Playstation2

NCsoft AION

Information

<>

Web2.0 ()

U- IT839
Service Product

8 Services
HSDPA/W-CDMA Service WiBro Service Broadband Convergence DMB/DTV Service u-Home Service Telematics/ Location-based Service RFID/USN Application IT Service

9 Products
Mobile Telecom/Telematics Devices

Broadband/Home NW Devices Digital TV/Broadcasting Devices

NG Computing/Peripherals
Intelligent Service Robot IT SoC/Convergence/Parts RFID/USN Devices

Infrastructure
Broadband Convergence Network u-Sensor Network Software Framework

Embedded SW
Digital Contents/SW Solution

3 Infrastructure
4

22

Paradigm Shift in IT
Content is King
Network Contents

Personal Computer
Digital Contents DC NW SW HW

Mainframe
Internet OS
Mainframe

Ubiquitous Platorm
HDTV, PDA, Post PC

Web Browser
Notebook Mobile

Desktop PC

64-80

81-94

95-05

06-15

Contents Market(2006) World

Contents Market(2006) Korea

Total = 7.3 B$

1. Large Game market 2. Emerging e-learning market 3. Relatively small digital cinema market
8

Game Market World & Korea

Good positioning in online and mobile game
World CAGR
30.5 %

Online: 20.4% Mobile: 14.6% Overall: 5.4%

Compound Annual Growth Rate

Korean Market share (5.6%)

2.0% 6.4% 3.0%

1.4%

Korean Digital Contents Industry

Company : 1,927 Employee: 53,000 employee
NCSoft 1,000 Daum NHN

Neowiz 500 Webzen 300 KTH CJ Internet Hanbit edubox Megastudy

Nexon

empas

50

Actozsoft

Small Industry - Under 50: 88.8% - Under 300 : 99.2%

Revenue
5 30 50 100 200 300
www.dpc.or.kr(2006.5) (M$)
10

Korean Digital Content Research Strategy

1. Digital Content Area Digital Cinema/Animation Keep traditional culture value e-Learning CG Large worldwide market High Definition Game Keep lead position in online game Support game industry for future e-Book DRM market Copyright Protection Strategically important Web VR Relatively small market

Game

2.

Digital Music

3.

11

Trend of Digital Cinema and Game

Warcraft 1994

Starcraft 1998

Lineage2 2003

Crysis 2007

Findin Nemo 2003 Monster Inc. 2001 Toy Story 1995 Beauty &Beast 1991 Old Disney

Shrek 2 2004

Digital
King Kong 2005

Analog

Jurassic Park 1993

Matrix 1999

Lord of the Rings 2003

12

CG (Computer Graphics) Technology

3D model

Lighting & Shadow

Texture

Transformation & Camera

13

Digital Contents Research

Digital Actor

Non-Photorealistic Animation
Fluid Simulation High Definition Game Digital Right Management

14

Digital Actor Technology

Digital Actor
Hair

Crowd

Face

Muscle

Movie

Skin

Building

Terrain

Clothes

15

Digital Actor Technology

1. Expression of main actor
Muscle based facial animation Facial expression capture
(0:40)

Realistic skin rendering

16

Digital actor
Movie : Jungcheon

17

Digital Actor Technology

2. Hair/Clothes Expression
Various hairstyle Natural hair and cloth simulation Collision between hair and body
(1:27)

18

Digital Actor Technology

3. Skin deformation
Muscle based skin deformation Collision between skins Skin wrinkle expression
(1:07)

19

Digital Actor Technology

4. Facial skin rendering
Camera using polarized filter Create texture map for skin rendering

<Analysis of skin color>

<Image pair using polarized filter>

<Texture map>

20

Digital Actor Technology

5. Intelligent crowd behavior
Motion creation using motion capture data
(1:24)

Smooth transition between motions using motion graph

Intelligent behavior & interaction between characters Collision is big task

21

Digital Actor Technology

6. Dynamic simulation of actor
Rigid body simulation using dynamics
(0:52)

Behavior creation using dynamics

Smooth transition of simulation result and motion capture data

22

Digital Actor Technology

7. 3D rotoscoping
(0:52)

Object tracing and background restoration Background realization with minimum artifact Alpha channel control of deleted object

alpha compositing is the process of combining an image with a background to create the appearance of partial transparency
23

 Digital Actor

Non-Photorealistic Animation
Fluid Simulation High Definition Game Digital Right Management

24

Non Photorealistic Animation

1. Pen Drawing
Creation of pen drawing from 3D model

Extraction of Line from 3D model

Rendering f different line style
Line extraction Exterior Style visible

NPAR

Interior

Invisible
Hatching

Guideline GuideLine

Hatch : the surface of a map, drawing, engraving, etc: to shade with close parallel or crossed

25

Non Photorealistic Animation

2. Oriental ink painting
Creation of ink painting from 3D model Simulation of ink and water interaction Rendering of Chinese drawing paper texture
Simulation of ink and water Paper texture User interface for rendering

26

Non Photorealistic Animation

3. Cartoon animation
Creation of cartoon from 3D model 3D shading and post-processing Combination of various shading style

3D shading module Shading pipeline

Postprocessing module

Combination of multi-shading

Style expression with texture mapping

Watercolor shading
27

 Digital Actor

Non-Photorealistic Animation
Fluid Simulation High Definition Game Digital Right Management

28

Fluid Simulation
Fluid Simulation SW
Basic Simulation

Wave/Bubble

Smoke
VFX

Fluid mixing

Keyframe animation

Spray
3D Animation

Bubble

Fluid control
CF

Collaboration with CSIRO of Australia

Game

29

Fluid Simulation
1. Basic Simulation
SPH(Smoothed Particle Hydrodynamics) simulation Interaction with rigid object Optimization of Surface mesh Utilization of mesh based boundary
(0:14)

Preprocessing

Simulation

Postprocessing

Rendering
30

Fluid Simulation
2. Mixing Fluid
Mixing of fluid with different characteristics Solved with Internal particle Increase processing speed using different particle size

31

Fluid Simulation
3. Bubble
Mixing of different liquid type Bubble creation using gas percentage information between fluid boundary

32

Fluid Simulation
4. Wave and bubble
Waves are created with wave creator and bubble particles are created when the wave is collided with rigid object

33

Fluid Simulation
5. Keyframe animation
Requirement for commercial and cinema Create a shark made with water and control its movement

34

Fluid Simulation
6. Wet effect
Wet and dry effect Create wet effect on the wall and render the water ball with fluid characteristic

35

Fluid Simulation
7. Smoke
Physically similar to fluid particle Express smoke with fluid particle then move and render the particle with thermodynamics behavior

36

Fluid Simulation
8. Spray
Spary expression with automobile tire Spray creation with surface tension
All
(1:43)

37

 Digital Actor

Non-Photorealistic Animation
Fluid Simulation High Definition Game Digital Right Management

38

Game Technology
Real time rendering
3D model Game environment

Real time animation

Character animation

Game sound
Sound engine

Game server
Distributed server

Light and shadow

Camera

Object animation

Network stability

Game AI
AI engine Special effect Behavior control

AI authoring tool

Physics based simulation

39

High Definition Game

Game Platform/Genre
Home
ATARI Dreamcast PlayStaion PS2 XBOX NDS GBA PSP XBOX36 0 GAMECUBE

Platform Genre

PS 3

Portable
Game Boy

RPG MMORPG RTS Casual Action

Quake WarCraft II Lineage

Diblo2 MU Granado Espada

StarCraft

WarCraft III

Counter Strike

RTS : Real Time Simulation MMORPG : Massively Multi-playing Online Roll Playing Game RPG : Roll Playing Game

40

High Definition Game

HD Game Technology
Real-time

Game Contents

Parallel Processing
Rigid Body Cloth Hair Muscle AI

Game Server

Multi-core Framework Multi-thread Framework

Network Engine

Test Solution

Cross Platform

Game Platform

41

41

High Definition Game

1. Real-time Rigid Body Simulation
Stable collision processing with grouping of object

Minimize CPU load using iterative block matrix solution

Natural rag doll animation

42

High Definition Game

2. Real time cloth simulation
Simulation of cloth colliding with itself

Fast processing of cloth and character collision

Increase processing speed using Multi-core CPU Natural wrinkle expression

43

High Definition Game

3. Real time Hair simulation
Hair animation with body motion

Collision detection between large no. of hairs

Various hairstyle processing (straight, curly)

44

High Definition Game

4. Muscle deformation
Muscle deformation according to impact force

Minimize computation using segment model

Adding reality using stiff spring model on muscle deformation

45

High Definition Game

5. Artificial Intelligence on Game
Control NPC(Non Player Character) Real time control using script language

Can be applied to existing game

Soccer

Basketball

46

High Definition Game

6. Parallel Processing Game Framework
No more speed-up using single thread programming
Multi-core processing for special effect, physics and AI

Cannot use processing power for special effect in single core

Single-Core CPU (Single-Threaded)

Dual-Core CPU (Single-Threaded)

Can use special effect in dual core

Dual-Core CPU (Multi-Threaded)

Game Logic

Game IDLE Logic

Game Particle Logic FX

47

High Definition Game

7. Game server test
(VENUS Blue : Virtual Environment Network User Simulation Blue Edition)

Load test using multi-agent ( ~ 10K user) Multi-platform support (Windows/Linux) Real time monitoring of server and network

Analysis and report tool for diagnosis

<VENUS Studio>

<VENUS Analysis>

48

High Definition Game

8. Game sound
HRTF(Head Related Transfer Function) based 2 channel 3D sound
Minimize CPU load Streaming based 3D sound and Dolby surround 5.1

<Sound Engine>
HRTF based 3D sound Virtual sound effect

49

 Digital Actor

Non-Photorealistic Animation
Fluid Simulation High Definition Game Digital Right Management

50

Digital Right Management

Fingerprinting
Image Fingerprinting

Recognition
Audio recognition

DRM
Multiple DRM

Audio Fingerprinting

Video recognition

Streaming/ Download DRM

Video Fingerprinting
1

51

Digital Right Management

1. Digital Fingerprinting
Insert fingerprint
user1

copy

user1

user2

Extract fingerprint

user3 original

conspire

user2

user3

52

Digital Right Management

2. Image Fingerprinting
Insert unrecognizable personal information into image Robust to A/D and D/A conversion User 1 User 2 User 3 User 4

? ?

53

Digital Right Management

3. Audio Fingerprinting
Insert user information into music file Real time insertion
Insertion Attack
Speed change

Extraction

?
Volume change

X
Analysis auditory system

Loss of sync. point

Loss of signal
54

Digital Right Management

4. Video Fingerprinting
Real time insertion/extraction user information Keep High definition video quality

Real time insertion

Real time Extraction

Size
HDVGA

Cut
16:94:3

Compression
Mpeg, Divx

Noise

Conspiracy

55

Digital Right Management

5. Content identification
Identify content by analyzing the characteristic of each content Used to index and search/retrieval of Audio/video contents

Characteristic value

Artist: Beatles Song: Yesterday

Unknown content
Title: Superman

Analysis

Search

56

Digital Right Management

6. Audio identification
Extract audio characteristic using frequency analysis Used for music identification, commercial monitoring

Identify music id using music characteristic

Unknown audio

Frequency analysis

Extract characteristic from frequency analysis

Characteristic and meta information

57

Digital Right Management

7. Video Identification
Using video signal information Real time comparison
Attribute extraction Scene

Comparator

Edge

Color

Video DBMS

58

Digital Right Management

8. Content distribution
Prevent illegal distribution Protect copyright with reasonable usage fee
Creator Producer Distributor User

Copyright holder

Clearing house
59

Digital Right Management

9. Interoperable DRM
MP3P iPod
FairPlay DRM

iPod

iriver

iriver

MS DRM

Yepp

Netsync DRM

Interoperable DRM

iAudio

MarkAny DRM

Yepp
Different DRM technology for each DRM solution and device

iAudio

Interoperable DRM technology for any DRM solution and device

60

Digital Right Management

10. Streaming and download DRM Technology
Content packaging and distribution using encryption
Illegal copy protection and license management

Copyright holder

Service Provider

User License Content distribution

Packaging
Right description

User

61

Conclusion
1. VFX/Animation for Korean Film 2. Technology support for Future

Games
3. Create healthy contents market by

providing copyright protection technology

* VFX: visual effects

62

Hanbando ()
Composition using Camera tracker for Ocean scene
Tracking the camera motion from the ocean scene and use it for composite with CG generated ships Automatic camera tracker for ocean scene

(0:20)

Real ocean scene (1:19)

After composition
63

For Horowitz
Replacing Real Actor with Digital Actor
her face with actress face
(0:23)

Shooting a scene where professional piano player plays a piano and then replace

Before composition (Note the markers on the face for tracking)

After composition

64

The Restless ()
Digital Actors
Hair, Clothes, Muscle modeling
(0:51)

65

The Restless ()
Representing dangerous scene with digital actors and dynamic simulation

Received Daejong Visual Effect award (2007)

(1:33)

66

A Child who lost a smile (Animation)

Non photorealistic rendering technique (Oriental style)
Won the grand prize in Asian Animation & Comic Contest (2007) (2:14)

67