Touchscreen implementation for multi-touch

Содержание

Слайд 2

Touchscreens & Graphical User Interface Guiding principles behind GUI Displays relevant

Touchscreens & Graphical User Interface

Guiding principles behind GUI
Displays relevant information
Intuitive technology
Touchscreen
Electronic

Display
Recognizes presence of user’s touch
Provides GUI and user control
Слайд 3

Touchscreen Technologies Resistive Capacitive Surface Projected Optical imaging Infrared

Touchscreen Technologies
Resistive
Capacitive
Surface
Projected
Optical imaging
Infrared

Слайд 4

Resistive Touchscreen Composed of multiple layers separated by thin spaces Using

Resistive Touchscreen

Composed of multiple layers separated by thin spaces
Using indium tin

oxide (ITO) layers
Different standards
4, 5, and 8 wire types
Each have advantages
Слайд 5

Resistive Touchscreen User Presses Down Contact is Made Uniform Voltage on

Resistive Touchscreen

User Presses Down
Contact is Made
Uniform Voltage on First Screen for

X
Same on Second screen for Y
Happens instantaneously
Слайд 6

4-Wire design One screen for X Another screen for Y Both

4-Wire design

One screen for X
Another screen for Y
Both create voltage gradient.
Uses

voltage divider
Слайд 7

Advantages Works well with fingertip or stylus input Generally most affordable

Advantages

Works well with fingertip or stylus input
Generally most affordable touchscreen technology
Rugged/Durable
Has

multi-touch input capabilities
Stantum
Touchco
Слайд 8

Disadvantages Not as accurate Multi-touch much more complex Usually no discretion

Disadvantages

Not as accurate
Multi-touch much more complex
Usually no discretion between stylus and

hand
More pressure needed
Слайд 9

Capacitive Touch Technology Consists of: Insulator (glass or Air) Conductive coating (ITO) Two types: Surface projected

Capacitive Touch Technology

Consists of:
Insulator (glass or Air)
Conductive coating (ITO)
Two types:
Surface
projected

Слайд 10

Surface Capacitance Only one side is coated Electrodes at the edges Distribute voltage

Surface Capacitance

Only one side is coated
Electrodes at the edges
Distribute voltage

Слайд 11

Surface Capacitance Cont. Before

Surface Capacitance Cont.

Before

Слайд 12

After Capacitor forms Current flows Determine location Controller Ratio of currents , XY coordinates R

After

Capacitor forms
Current flows

Determine location
Controller
Ratio of currents
,
XY coordinates

R

Слайд 13

Projected Capacitance Two parallel ITO layers Two sheets of glass

Projected Capacitance

Two parallel ITO layers
Two sheets of glass

Слайд 14

Projected Capacitance Capacitor at each point on the surface

Projected Capacitance

Capacitor at each point on the surface

Слайд 15

Projected Capacitance Cont. E Field is projected through glass Finger couples with E field Capacitance changes

Projected Capacitance Cont.

E Field is projected through glass
Finger couples with E

field
Capacitance changes
Слайд 16

Surface vs. Projected Limited resolution Single touch Operation with direct contact

Surface vs. Projected

Limited resolution
Single touch
Operation with direct contact

High resolution
Multi

touch
Operation with indirect contact
Слайд 17

Multi-Touch Using Infrared

Multi-Touch Using Infrared

Слайд 18

Frustrated Total Internal Reflection A process by which light is trapped

Frustrated Total Internal Reflection

A process by which light is trapped within

a medium and can be interrupted by a third medium of higher reflective index to cause light to escape.

http://cs.nyu.edu/~jhan/ftirsense/ftirschematic.gif

Слайд 19

Rear Projection Hardware Infrared LED’s or lasers with line generator for

Rear Projection

Hardware
Infrared LED’s or lasers with line generator for optical

dispersion
Glass surface or plexi-glass
Infrared Camera
Projector
Cost
Scalability

http://reactivision.sourceforge.net/images/reactivision03.png

Слайд 20

Alternative Single-Unit Design Eliminates rear projection Expensive Robustness http://wiki.fluidproject.org/display/fluid/Benchmarking+-+Touch+Screen+Options

Alternative Single-Unit Design

Eliminates rear projection
Expensive
Robustness

http://wiki.fluidproject.org/display/fluid/Benchmarking+-+Touch+Screen+Options

Слайд 21

Software Surface Capture via Detector Digitized View

Software

Surface Capture via Detector

Digitized View

Слайд 22

Software Cont. Interpret and Relay Information Assign Objects or gestures with

Software Cont.

Interpret and Relay Information
Assign Objects or gestures with Unique ID#

and location
Compare and Execute

Raw Data

Feedback to User

Слайд 23

Improving Accessibility? Universal Design Principles Utility for all users Simple and

Improving Accessibility?

Universal Design Principles
Utility for all users
Simple and intuitive
Touchscreens depend on

visual feedback in order to use
Слайд 24

Pointing Device Gestures Cursor movements as command shortcuts Takes place of

Pointing Device Gestures

Cursor movements as command shortcuts
Takes place of keyboard shortcuts
Useful

in applications where keyboard use is less prominent or undesirable

Above: Some possible cursor movement patterns for use in gesture support.

Слайд 25

Implementation: Step 1 Filter Input Sampling rate Smooth out input data,

Implementation: Step 1

Filter Input
Sampling rate
Smooth out input data, get rid of

unnecessary “noise”
Simplify data analysis
Слайд 26

Implementation: Step 2 Vectorize Separate x- and y-component Compute dominant component

Implementation: Step 2

Vectorize
Separate x- and y-component
Compute dominant component and ignore smaller

one
Store in array
Слайд 27

Implementation: Step 3 Matching Match captured vector array to pre-defined gesture

Implementation: Step 3

Matching
Match captured vector array to pre-defined gesture library
If no

match, pop smallest vector from array and repeat matching process
Слайд 28

Example Fig. 1 – User input Fig. 2 – Captured/filtered pointer

Example

Fig. 1 – User input

Fig. 2 – Captured/filtered pointer data

Fig. 3

– After vectorization

Fig. 4 – Final matching result

Слайд 29

Goal Allows for a quicker and more efficient UI Universal Design

Goal

Allows for a quicker and more efficient UI
Universal Design
Enhances usability for

visually-impaired as well as non-impaired
Easily added to existing touchscreen devices, no additional hardware required