Computational Photography. Introduction

Содержание

Слайд 2

15-463 (15-862): Computational Photography Staff Prof: Alexei Efros (efros@cs), 225 Smith

15-463 (15-862): Computational Photography

Staff
Prof: Alexei Efros (efros@cs), 225 Smith Hall
TA: Marynel

Vazquez (marynelv@andrew.cmu.edu)
Web Page
http://graphics.cs.cmu.edu/courses/15-463/
Discussion Forum:
Googlegroups ???
Слайд 3

Today Introductions Why Computational Photography? Overview of the course Administrative stuff

Today

Introductions
Why Computational Photography?
Overview of the course
Administrative stuff

Слайд 4

A bit about me Alexei (Alyosha) Efros Associate Professor in Robotics

A bit about me

Alexei (Alyosha) Efros
Associate Professor in Robotics and CSD
also

work with colleagues in Paris and Oxford
Teaching
The plan is to have fun and learn cool things, both you and me!
Social warning: I don’t see well
Research
Graphics, Vision, Computer Graphics, Machine Learning, Visual Perception
Слайд 5

PhD Thesis on Texture and Action Synthesis Antonio’s son cannot walk

PhD Thesis on Texture and Action Synthesis

Antonio’s son cannot walk but

he can fly☺

Smart Erase button in MS Digital Image Pro:

Слайд 6

Automatic Photo Pop-Up (SIGGRAPH 2005) More previous work

Automatic Photo Pop-Up (SIGGRAPH 2005)

More previous work

Слайд 7

Слайд 8

Слайд 9

Слайд 10

Слайд 11

Слайд 12

Amateur Photographer

Amateur Photographer

Слайд 13

What is Computational Photography? Geeky Answer: “computational techniques that enhance or

What is Computational Photography?
Geeky Answer: “computational techniques that enhance or extend

photography”
Artsy Answer: Another medium for visual expression
Слайд 14

Depicting Our World: The Beginning Prehistoric Painting, Lascaux Cave, France ~ 13,000 -- 15,000 B.C.

Depicting Our World: The Beginning

Prehistoric Painting, Lascaux Cave, France
~ 13,000 --

15,000 B.C.
Слайд 15

The Empress Theodora with her court. Ravenna, St. Vitale 6th c. Depicting Our World: Middle Ages

The Empress Theodora with her court.
Ravenna, St. Vitale 6th c.


Depicting Our World: Middle Ages

Слайд 16

Depicting Our World: Middle Ages

Depicting Our World: Middle Ages

Слайд 17

Depicting Our World: Renaissance East Doors (1452) North Doors (1424) Lorenzo Ghiberti (1378-1455)

Depicting Our World: Renaissance

East Doors (1452)

North Doors (1424)

Lorenzo
Ghiberti
(1378-1455)

Слайд 18

Depicting Our World: Renaissance Piero della Francesca, The Flagellation (c.1469)

Depicting Our World: Renaissance

Piero della Francesca,
The Flagellation (c.1469)

Слайд 19

Depicting Our World: Toward Perfection Jan van Eyck, The Arnolfini Marriage (c.1434)

Depicting Our World: Toward Perfection

Jan van Eyck, The Arnolfini Marriage (c.1434)


Слайд 20

Depicting Our World: Toward Perfection Lens Based Camera Obscura, 1568

Depicting Our World: Toward Perfection

Lens Based Camera Obscura, 1568

Слайд 21

Depicting Our World: Perfection! Still Life, Louis Jaques Mande Daguerre, 1837

Depicting Our World: Perfection!

Still Life, Louis Jaques Mande Daguerre, 1837

Слайд 22

Depicting Our World: Realism?

Depicting Our World: Realism?

Слайд 23

Paris, according to Flickr

Paris, according to Flickr

Слайд 24

Paris, according to Google StreetView Knopp, Sivic, Pajdla, ECCV 2010

Paris, according to Google StreetView

Knopp, Sivic, Pajdla, ECCV 2010

Слайд 25

Paris, according to me

Paris, according to me

Слайд 26

After realism… Monet, La rue Montorgueil

After realism…

Monet,
La rue Montorgueil

Слайд 27

Depicting Our World: Ongoing Quest Pablo Picasso David Hockney

Depicting Our World: Ongoing Quest

Pablo Picasso

David Hockney

Слайд 28

Better than realism? David Hockney, Place Furstenberg, (1985)

Better than realism?

David Hockney, Place Furstenberg, (1985)

Слайд 29

Alyosha Efros Place Furstenberg, 2009 Which one is right? Multiple viewpoints

Alyosha Efros
Place Furstenberg, 2009

Which one is right?

Multiple viewpoints

Single viewpoint

David Hockney,


Place Furstenberg, 1985
Слайд 30

Depicting Our World: Ongoing Quest Antonio Torralba & Aude Oliva (2002)

Depicting Our World: Ongoing Quest

Antonio Torralba & Aude Oliva (2002)

Слайд 31

Enter Computer Graphics...

Enter Computer Graphics...

Слайд 32

Traditional Computer Graphics

Traditional Computer Graphics

Слайд 33

State of the Art Amazingly real But so sterile, lifeless, futuristic (why?)

State of the Art

Amazingly real
But so sterile, lifeless, futuristic (why?)

Слайд 34

The richness of our everyday world Photo by Svetlana Lazebnik

The richness of our everyday world

Photo by Svetlana Lazebnik

Слайд 35

Beauty in complexity University Parks, Oxford

Beauty in complexity

University Parks, Oxford

Слайд 36

Which parts are hard to model? Photo by Svetlana Lazebnik

Which parts are hard to model?

Photo by Svetlana Lazebnik

Слайд 37

People From “Final Fantasy” On the Tube, London

People

From “Final Fantasy”

On the Tube, London

Слайд 38

Faces / Hair Photo by Joaquin Rosales Gomez From “Final Fantasy”

Faces / Hair

Photo by Joaquin Rosales Gomez

From “Final Fantasy”

Слайд 39

Hyper-humans

Hyper-humans

Слайд 40

Urban Scenes Virtual LA (SGI) Photo of l LA

Urban Scenes

Virtual LA (SGI)

Photo of l LA

Слайд 41

Nature River Cherwell, Oxford

Nature

River Cherwell, Oxford

Слайд 42

The Realism Spectrum + easy to create new worlds + easy

The Realism Spectrum

+ easy to create new worlds
+ easy to manipulate

objects/viewpoint
- Very hard to look realistic

+ instantly realistic
+ easy to aquire
- very hard to manipulate objects/viewpoint

Computer Graphics

Photography

Computational
Photography

Realism
Manipulation
Ease of capture

Слайд 43

Virtual Real World Campanile Movie http://www.debevec.org/Campanile/

Virtual Real World
Campanile Movie

http://www.debevec.org/Campanile/

Слайд 44

Course Outline (cool) Image Processing Lots of Visual Data Cameras and single-view 3D

Course Outline
(cool) Image Processing
Lots of Visual Data
Cameras and single-view 3D

Слайд 45

Project 1 Images of the Russian Empire -- colorizing the Prokudin-Gorskii photo collection

Project 1

Images of the Russian Empire -- colorizing the Prokudin-Gorskii photo

collection
Слайд 46

Programming Project 2 Image manipulation

Programming Project 2

Image manipulation

Слайд 47

Programming Project 3 Face warping and morphing

Programming Project 3

Face warping and morphing

Слайд 48

Programming Project 4 Photo Mosaics Full screen panoramas (cubic): http://www.panoramas.dk/ Mars:

Programming Project 4

Photo Mosaics

Full screen panoramas (cubic): http://www.panoramas.dk/
Mars: http://www.panoramas.dk/fullscreen3/f2_mars97.html
2003 New

Years Eve: http://www.panoramas.dk/fullscreen3/f1.html
Слайд 49

Programming Project 4 Automatic Mosaic Stitching

Programming Project 4

Automatic Mosaic Stitching

Слайд 50

Programming Project 4+ Tour Into the Picture

Programming Project 4+

Tour Into the Picture

Слайд 51

Final Project Something cool!!!

Final Project

Something cool!!!

Слайд 52

Administrative Stuff Grading Written and Programming Assignments (60%) Exam (20%) Final

Administrative Stuff

Grading
Written and Programming Assignments (60%)
Exam (20%)
Final Project (20%)
Class

Participation: priceless
Late Policy
Five late days total, to be spent wisely
20% off from each extra late day
Cheating
Let’s not embarrass ourselves
Hardware/Software
CMU clusters
MATLAB
Слайд 53

Textbook http://szeliski.org/Book/

Textbook

http://szeliski.org/Book/

Слайд 54

Cameras Really cool Not too expensive nowadays ( e.g. Canon A1100

Cameras

Really cool
Not too expensive nowadays (<$150)

e.g. Canon A1100

Слайд 55

General Comments Prerequisites Linear algebra!!! Some computer graphics, vision, or image

General Comments

Prerequisites
Linear algebra!!!
Some computer graphics, vision, or image processing is useful,

but not required.
Emphasis on programming projects!
Building something from scratch
Graduate Version:
Need to do more on each project, plus a final paper
Misc:
No laptops, no cell phones, smartphones, etc.