Digital Image Stabilization

Содержание

Слайд 2

Outline Introduction Basic architecture of DIS MVI method for DIS Future work

Outline

Introduction
Basic architecture of DIS
MVI method for DIS
Future work

Слайд 3

Introduction An image stabilization system manages to remove unwanted movement form

Introduction

An image stabilization system manages to remove unwanted movement form an

image sequence
Previous image stabilization system
accelerometers, gyros, mechanical dampers ,
angular velocity sensors…………..
We prefer to use DIS
Слайд 4

Basic architecture of DIS Pre-processing Stabilization Video Encoder Video Decoder Input Output Stabilized Input

Basic architecture of DIS

Pre-processing

Stabilization

Video Encoder

Video Decoder

Input

Output

Stabilized Input

Слайд 5

Basic architecture of DIS stabilization-aided encoder Stabilization Video Encoder Video Decoder Input Output

Basic architecture of DIS

stabilization-aided encoder

Stabilization

Video Encoder

Video Decoder

Input

Output

Слайд 6

Basic architecture of DIS stabilization-aided decoder Stabilization Video Encoder Video Decoder Input Output

Basic architecture of DIS

stabilization-aided decoder

Stabilization

Video Encoder

Video Decoder

Input

Output

Слайд 7

MVI Method for DIS MVI : Motion Vector Integration Basic idea

MVI Method for DIS

MVI : Motion Vector Integration
Basic idea :
Using

some propose method to find reliable local motion vector(LMV)
Calculate the global motion vector(GMV) form LMV.
Integrating the previous frame GMV and current frame GMV to calculate AMV.
Using AMV to compensate current frame to be stabilized frame.
Reference paper [1-4]
Слайд 8

New Algorithm and Architecture of Digital Image stabilization System CCD A/D

New Algorithm and Architecture of Digital Image stabilization System

CCD

A/D

DIS for FM

Video Encoder

Block

diagram of a digital video camera with DIS system.
Слайд 9

New Algorithm and Architecture of Digital Image stabilization System Lack of

New Algorithm and Architecture of Digital Image stabilization System

Lack of features
Existence

of moving objects
Intentional panning
Existence of repeated patterns
Intentional zooming
Low signal-to-noise ratio
Large movement out of the searching range of block matching
Complicated Motion (e.g. rotatory motion)
Слайд 10

A general structure of DIS system with frame memory Pre-processing Motion

A general structure of DIS system with frame memory

Pre-processing

Motion Estimation

Frame Register

Motion

Decision

Motion Compensation

Frame Memory

Stabilized images

Слайд 11

Pre-Processing Pre-processing Motion Estimation Frame Register Motion Decision Motion Compensation Frame Memory Stabilized images

Pre-Processing

Pre-processing

Motion Estimation

Frame Register

Motion Decision

Motion Compensation

Frame Memory

Stabilized images

Слайд 12

Pre-Processing Block Matching over Bit-Planes

Pre-Processing

Block Matching over Bit-Planes

Слайд 13

Слайд 14

Pre-Processing Block Matching over Gray-Code Bit-Planes

Pre-Processing

Block Matching over Gray-Code Bit-Planes

Слайд 15

Слайд 16

Motion Estimation Pre-processing Motion Estimation Frame Register Motion Decision Motion Compensation Frame Memory Stabilized images

Motion Estimation

Pre-processing

Motion Estimation

Frame Register

Motion Decision

Motion Compensation

Frame Memory

Stabilized images

Слайд 17

Motion Estimation

Motion Estimation

Слайд 18

Motion Estimation

Motion Estimation

Слайд 19

Motion Decision Pre-processing Motion Estimation Frame Register Motion Decision Motion Compensation Frame Memory Stabilized images

Motion Decision

Pre-processing

Motion Estimation

Frame Register

Motion Decision

Motion Compensation

Frame Memory

Stabilized images

Слайд 20

Motion Decision (Lack-of-Feature Condition)

Motion Decision (Lack-of-Feature Condition)

Слайд 21

Motion Decision (Lack-of-Feature Condition)

Motion Decision (Lack-of-Feature Condition)

Слайд 22

Motion Decision (Lack-of-Feature Condition)

Motion Decision (Lack-of-Feature Condition)

Слайд 23

Motion Decision (Existence of Moving Objects) Random-like motion temporally correlated motion

Motion Decision (Existence of Moving Objects)

Random-like motion

temporally correlated motion

Слайд 24

Motion Decision (Existence of Moving Objects)

Motion Decision (Existence of Moving Objects)

Слайд 25

Motion Decision (Intentional Panning Condition) If 80% of the VALID_LMV are

Motion Decision (Intentional Panning Condition)

If 80% of the VALID_LMV are detected as

temporally correlated motion, we consider that the camera is under a panning condition and no motion compensation is needed Otherwise, we assume that these temporally correlated motion vectors are caused by some moving objects in the image.
Слайд 26

Motion Decision (Optical Zooming Condition)

Motion Decision (Optical Zooming Condition)

Слайд 27

Motion Decision (Spatial Noise Checking of Noise Level)

Motion Decision (Spatial Noise Checking of Noise Level)

Слайд 28

Procedure of Motion Decision

Procedure of Motion Decision

Слайд 29

Procedure of Motion Decision

Procedure of Motion Decision

Слайд 30

Motion Compensation Frame Motion Vector (FMV) Accumulated Motion Vector (AMV) Motion Compensation

Motion Compensation

Frame Motion Vector (FMV)
Accumulated Motion Vector (AMV)
Motion Compensation

Слайд 31

Simulation Result

Simulation Result