Ece551 Notes Chapter 5
Ece551 Notes Chapter 5
ECE551
Objectives
Consider
Considerthe
theimplications
implicationsof
ofusing
usingdigital
digital
video
videoin
inmultimedia.
multimedia.
Discuss
Discussvideo
videorecording
recordingand
andhow
howititrelates
relatesto
to
multimedia
multimediaproduction.
production.
Discuss
Discussdigital
digitalvideo
videoand
andimages
imagesfor
for
conversion
conversionto
totelevision.
television.
Discuss
Discussshooting
shootingand
andediting
editingvideo
videofor
foruse
usein
in
multimedia.
multimedia.
Select
Selectthe
thebest
bestvideo
videorecording
recordingformats
formatsfor
for
your
yourmultimedia
multimediaproject.
project.
Outline
Guidelines
Analog Video
Digital Video for Using
Video Quality
Video
Video
Video File Video Video
Capture
Size Compression Streaming
Card
Video Broadcast
Digital Video
Editing Video
File Formats
Software Standard
Introduction
Video
Videoimages
imagesare
arecombined
combinedtotoconvey
conveyaadesired
desired
message
messagejust
justas
aswords
wordsare
areused
usedtotocreate
createsentences,
sentences,
paragraphs,
paragraphs,and
andstories.
stories.
Video
Videoprovides
providesaalevel
levelof
ofrealism
realismnot
notpossible
possiblewith
with
animation
animationor
orstill
stillimages.
images.
With
Withdesktop
desktoptools,
tools,high-quality
high-qualityvideo
videocan
canbe
becreated
created
and
andmanipulated
manipulatedatataafraction
fractionof
ofthe
thecost
costof
of
professional
professionalequipment.
equipment.
Introduction
The
The inclusion
inclusion of
of video
video in
in online
online multimedia
multimedia
applications
applications // web
web pages
pages requires
requires broader
broader
bandwidth,
bandwidth, powerful
powerful processors,
processors, and
and large
large
amounts
amounts ofof storage.
storage.
As
As bandwidth
bandwidth continues
continues to
to become
become less
less of
of aa
concern
concern and
and compression
compression techniques
techniques
continue
continue to
to improve,
improve, video
video will
will become
become aa
more
more common
common multimedia
multimedia element
element onon web
web
sites.
sites. 55
Introduction
Web
Web sites
sites designed
designed toto entertain
entertain
are
are more
more likely
likely to
to include
include video
video
clips
clips than
than the
the other
other types
types of
of sites.
sites.
• Games distributed via the Web often
include short video clips that describe the
purpose or mission of the game before the
user begins.
• Movie trailers are prolific on the Web.
66
How Video Works
Light
Light reflected
reflected from
from an
an object
object through
through the
the
camera’s
camera’s lens
lens is
is converted
converted into
into electronic
electronic signal
signal
by
by charge-coupled
charge-coupled device
device (CCD).
(CCD).
This
This electronic
electronic signal
signal contains
contains three
three channels
channels
of
of color
color information
information and
and synchronization
synchronization
pulses
pulses (sync).
(sync).
Several
Several video
video standards
standards exist
exist that
that deal
deal with
with the
the
amount
amount of of separation
separation between
between the
the components
components
of
of the
the signal.
signal.
Each frame is
Stored using television represented by a
video signals, film, fluctuating voltage
videotape signal
Analog
video
Composite analogue Brightness, colour and
video has all the video synchronization is
components: combined into one
brightness, colour and signal for delivery
synchronization
8
Hard to store and Quality degrade after
easily damaged by dust several tape dubbing.
and humidity
Analog
video
Problems: colour Still in use - Existing
blending, low clarity, source , Existing
high generation lost, Equipment
difficult to edit.
Linear (fast-forward or Video capture cards are
rewind it to get to the video used to convert analog
segment we are interested in video to a digital format
viewing or digitizing)
Analog video
Digital Video
Video captured using a DV
DV cameras use tapes or camera can be transferred
other storage media to to the computer by using
store the video and sound USB or FireWire
in digital format
Digital Video
Devices
Digital
Digitalvideo
videoisisoften
oftenused
usedto
tocapture
capturecontent
contentfrom
frommovies
moviesand
and
television
televisionto
tobe
beused
usedin
inmultimedia.
multimedia.
AAvideo
videosource
source(video
(videocamera
camera,VCR,
,VCR,TV
TVor
orvideodisc)
videodisc)isisconnected
connected
to
toaavideo
videocapture
capturecard
cardin
inaacomputer.
computer.
As
Asthe
thevideo
videosource
sourceisisplayed,
played,the
theanalog
analogsignal
signalisissent
sentto
tothe
thevideo
video
card
cardand
andconverted
convertedinto
intoaadigital
digitalfile
file(including
(includingsound
soundfrom
fromthe
the
video).
video).
VCR
VCR
The converted
signal is
entered inside a
computer
Video is edited
Signal is processed using video editing
software software
USB
• stands for Universal Serial Bus
• is used for connecting external peripherals to a computer
• USB 1.1 has a maximum data rate at 12 Mbps (Mbps –
megabits per second)
• USB 2.0 has a data rate at 480 Mbps
• USB 3.0 has a data rate up to 4.8 Gbps
(Gbps – gigabits per second)
FireWire
• is also known as IEEE 1394
• is well suited to demanding activities such as uploading
video to computer
• has a data rate at 400 Mbps
• only high-bandwidth devices, such as digital video
cameras and external storage devices, have adopted the
standard
• vendors have been slow to implement the technology
DVD (Digital Versatile Disc)
• Can be used to store computer data, digital audio and
digital video
• Capacity:
• 4.7 GB (single layer, single side)
• 9.4 GB (single layer, double sides)
• 8.5 GB (double layers, single side)
• 17 GB (double layers, double sides)
• Can store up to hours of digital video
Use
Use video
video when
when itit is
is appropriate
appropriate
Keep
Keep the
the target
target audience
audience and
and delivery
delivery method
method in
in
mind
mind when
when designing
designing video
video for
for aa multimedia
multimedia
product
product
Keep
Keep video
video files
files at
at an
an appropriate
appropriate size
size so
so they
they can
can
be
be played
played smoothly
smoothly on on standard
standard equipments
equipments to to
reach
reach aa wider
wider audience
audience
17
17
Guidelines for Using Video
Audio
Audio and
and video
video clips
clips should
should
match
match or
or complement
complement one one another
another
Do
Do not
not overuse
overuse transitions
transitions
Users
Users should
should be
be allowed
allowed toto decide
decide
whether
whether they
they wish
wish to
to view
view the
the
video
video 18
18
Video
Quality
Video
Frame
resolutio
Rate
n
Frame Rate
Video
Video is
is aa sequence
sequence of
of individual
individual images
images or
or
frames
frames displayed
displayed fast
fast enough
enough toto create
create the
the
illusion
illusion of
of motion.
motion.
Source
Source frame
frame rate:
rate: Speed
Speed at
at which
which the
the video
video is
is
recorded
recorded
Playback
Playback frame
frame rate:
rate: Speed
Speed at
at which
which
individual
individual frames
frames are
are displayed
displayed
Frame Rate
For
For smooth
smooth and
and consistent
consistent playback,
playback, source
source
frame
frame rate
rate and
and playback
playback frame
frame rate
rate should
should be
be
identical.
identical.
The
The frame
frame rates
rates should
should be
be between
between 15
15 to
to 30
30
fps
fps (frames
(frames per
per second).
second).
Frames
Frames displayed
displayed at
at aa slower
slower rate
rate appear
appear
choppy.
choppy.
Aspect Ratio, Frame Size and Bit
Depth
Aspect
Aspectratio:
ratio:Ratio
Ratioof
ofwidth
widthto
toheight
heightin
inthe
thedimensions
dimensions
of
ofaavideo
videoframe
frame
• Example: 4:3
The
Theframe
framesize
sizeof
ofaavideo
videoframe
frameis
isexpressed
expressedin
in
horizontal
horizontaland
andvertical
verticalpixel
pixeldimensions
dimensions
• Example: 800 by 600 pixels
Bit
Bitdepth:
depth:Number
Numberof ofbits
bitsused
usedtotorepresent
representthethecolor
colorof
of
aasingle
singlepixel
pixel(recall
(recallthe
thedefinition
definitionofof color
colorresolution
resolution
from
fromUnit
Unit5)
5)
Video Resolution
Video
Videoresolution
resolutionrefers
refersto
tothe
theimage
imageresolution
resolutionof
ofthe
theframes
framesin
inthe
thevideo.
video.
Video
Videoresolution
resolutionisismeasured
measuredin
inpixels
pixelsper
perinch
inch(PPI).
(PPI).
Provided
Providedthat
thatthe
theframe
framesize
sizeremains
remainsunchanged,
unchanged,thethehigher
higherthe
thevideo
video
resolution,
resolution,the
thebetter
betterthe
thequality
qualityand
andthe
thelarger
largerthe
thefile
filesize.
size.
In
Inaddition
additionto
tothe
theframe
framerate,
rate,frame
framesize
sizeand
andvideo
videoresolution,
resolution,the
the
bandwidth,
bandwidth,processor
processorspeed,
speed,memory,
memory,and
andmonitor
monitorsize
sizeare
areimportant
important
considerations
considerationsfor
forvideo
videodelivery.
delivery.
Video File Size
Size of One Video Frame (in bytes):
(Assume that there is no image compression)
24
Data Transfer Rate
Data
Data transfer
transfer rate
rate is
is the
the amount
amount ofof
video
video data
data transferred
transferred per per second
second from
from
the
the processor
processor for
for display
display onon the
the
monitor.
monitor.
If
If the
the data
data transfer
transfer rate
rate is
is too
too low,
low, the
the
video
video will
will be
be choppy.
choppy.
25
25
Video Compression
To
To reduce
reduce the
the amount
amount of
of storage
storage
space,
space, video
video files
files need
need to
to be
be
compressed.
compressed.
When
When thethe video
video is
is played
played back,
back, the
the
file
file will
will be
be decompressed.
decompressed.
Video Compression
Similar
Similarto
toimage
imagecompression
compressionand
andaudio
audiocompression,
compression,
mathematical
mathematicalalgorithms
algorithmsare
areused
usedtotoreduce
reducefile
filesizes.
sizes.
Intra-frame
Intra-framecompression
compression
• Is applicable on an individual video frame (just like image compression)
Inter-frame
Inter-framecompression
compression
• Is applicable on a sequence of video frames
• redundancies occur when subsequent frames are identical or similar to one
another
27
27
Video Compression
The
Thecompression
compression//decompression
decompressionalgorithms
algorithmsused
usedto
tocompress
compressdata
dataare
are
called
calledcodecs.
codecs.
Since
Sinceaacertain
certainamount
amountofofdata
dataloss
lossisisusually
usuallyacceptable
acceptablefor
forvideo
video
compression,
compression,codecs
codecsusually
usuallyemploy
employlossy
lossycompressions
compressionsinstead
insteadof
oflossless
lossless
compressions.
compressions.
Some
Somecodecs
codecsare
arehardware-based
hardware-basedand
andsome
somecodecs
codecsare
aresoftware-based.
software-based.
Examples:
Examples:MPEG-4
MPEG-4ASP,
ASP,RealVideo,
RealVideo,Sorenson
SorensonVideo,
Video,Indeo
Indeo
28
28
Video Compression
Lossless compression:
• Preserves the exact image throughout the compression
and decompression process. E.g: text images is to
identify repeating words and assign them a code.
Lossy compression
• Eliminates some of the data in the image and therefore
provides greater compression ratios than lossless
compression.
• Applied to video because some drop in the quality is not
noticeable in moving images.
Video Streaming
Video
Videoon
onthe
theWeb
Webcan
caneither
eitherbe
be downloaded
downloaded or
or
streamed.
streamed.
Streaming:
Streaming:aamoremoreadvanced
advancedprocess
processthat
thatallows
allows
video
videofile
fileto
tobebeplayed
playedas
asititis
isdownloading
downloading(i.e.
(i.e.before
before
the
theentire
entirefile
fileis
istransferred
transferredto tothe
theuser’s
user’scomputer)
computer)
If
Ifwe
wewant
wantourourvideo
videofiles
filesto
tobe
bestreamed
streamedover
overthe
the
Internet,
Internet,the
theweb-hosting
web-hostingservice
servicemust
mustsupport
support
streaming.
streaming.
30
30
Video Streaming
If
If the
the user’s
user’s computer
computer receives
receives streaming
streaming video
video
data
data more
more quickly
quickly than
than required,
required, the
the excess
excess
data
data will
will be
be stored
stored in
in aa buffer.
buffer.
If
If the
the user’s
user’s computer
computer receives
receives streaming
streaming video
video
data
data slower
slower than
than required,
required, the
the data
data stored
stored in
in
the
the buffer
buffer will
will be
be used.
used. If
If the
the buffer
buffer becomes
becomes
empty,
empty, thethe user
user will
will experience
experience aa break.
break.
31
31
Video Streaming
On
On demand
demand -- Streamed
Streamed video
video is is stored
stored on
on aa
server
server for
for aa long
long period
period of
of time,
time, and
and is
is
available
available for
for transmission
transmission atat aa user’s
user’s request
request
Live
Live -- Live
Live streams
streams are
are only
only available
available at
at one
one
particular
particular time
time
• Examples: live soccer match, live press conference
32
32
Video Capture Card
Is
Isan
anexpansion
expansioncard
cardwhose
whosefunction
functionisisto
toget
getthe
thepictures
pictures
or
orvideos
videosfrom
fromthe
thecable
cableor
ortelevision
televisionsource
sourceinto
intothe
the
computer
computer
Main
Maincomponents
componentsinclude:
include:
Multimedia
Multimedia designers
designers and
and developers
developers can
can
use
use video
video editing
editing tools
tools to
to digitize
digitize motion
motion
graphics
graphics and
and put
put messages
messages and and stories
stories on
on
the
the product.
product.
Adobe
Adobe and
and Apple
Apple are
are two
two well-known
well-known
companies
companies offering
offering mid-range
mid-range andand high-end
high-end
desktop
desktop video
video editing
editing packages.
packages.
Video Editing Software
Examples:
Examples:
• Adobe Premiere
• Adobe After Effects
• Apple QuickTime Pro
• Windows Movie Maker
• Can be downloaded for free from Microsoft
Video
Video editing
editing software:
software:
• Should be compatible with different video formats
• Should be able to import image and audio files of
various file formats.
• Is better to be cross-platform
36
36
Example
AVI (Audio
Video
Interleave)
MPEG
RM (Moving
(RealMedia Picture
) Digital Experts
Group)
Video
File
ASF
(Advanced
Systems
Format WMV
(Windows
Media
Format) Video)
MOV
(QuickTime
)
Broadcast Video Standards
• http://countrycode.org/tv-standards
Shooting and Editing Video
Import
Import video
video and
and sound
sound at at the
the highest
highest
resolution
resolution and
and with
with the
the least
least amount
amount of
of
compression
compression possible.
possible.
Resolution
Resolution should
should be
be reduced
reduced and
and footage
footage must
must
be
be compressed
compressed later
later according
according to
to the
the
requirements.
requirements.
AA steady
steady shooting
shooting platform
platform should
should always
always be
be
used.
used.
Shooting and Editing Video
Good
Good and
and even
even lighting
lighting is
is extremely
extremely important.
important.
Blue
Blue screen
screen in
in digital
digital video
video editing
editing applications
applications
is
is aa popular
popular technique
technique forfor making
making multimedia.
multimedia.
Wide
Wide panoramic
panoramic shots
shots and
and camera
camera motion
motion
should
should be
be avoided
avoided when
when shooting
shooting for
for aa small
small
computer
computer window
window on
on CD-ROM
CD-ROM or or the
the Web.
Web.
Shooting and Editing Video
Shooting and Editing Video
Video Editing Terminology
Non-linear
• Refers to the editing of disk-based digital video.
• The software provides an on screen map of what
the final video sequences should look like
incorporating the edits, splices, special effects,
transitions and sound tracks.
Linear
• It plays end to end in one direction, usually
pertains to videotape editing specifically the
editing of linear tape segments into one final
master tape.
Special Effects
Transitions
• Such as fading, wiping, splatters, scrolling, stipple and
many more are available by simply dragging and
dropping that transition between the two video clips.
Superimposing
• The ability to superimpose one clip over another is a
valuable technique.
• The technique of green screening is identical except
that the color green is used for the screen and later
digitally removed.
• The blue screen and green screen superimposing are
just two of the superimposing technique available.
Activity- Simple Editing using MMM