AUDIO IN MULTIMEDIA

MPT 1203: TECNOLOGY & MEDIA DESIGN

AUDIO IN MULTIMEDIA
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
CONTENT OUTLINE
Digital Audio in Multimedia
1
Analog Audio vs Digital Audio
2
Digital Audio Quality
3
Digital Audio File Size & Compression
4
Digital Audio File Formats
5
Di it l A di Editi T l
6
Faculty of Education, UTM
2
Digital Audio Editing Tools
6
INTRODUCTION
MPT 1203: TECNOLOGY & MEDIA DESIGN
INTRODUCTION
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
INTRODUCTION
Are any of you planning to use simple digitized
sound effects in your multimedia projects?
How so?
Where are you getting your sound effects?
Faculty of Education, UTM
4
INTRODUCTION
Without a doubt, audio or sound is the best way to
tt t tt ti attract attention.
Often audio provides the only effective way to Often audio provides the only effective way to
convey an idea, elicit an emotion, or dramatize
point.
Simple sound effects can easily be used to draw
attention to various aspects of your electronic attention to various aspects of your electronic
presentation.
Faculty of Education, UTM
5
INTRODUCTION
Audio is one of the most appealing elements of
iti d f l lti di any exciting and successful multimedia
presentation.
Audio establishes the aural dimension, setting the
mood, establishing the ambiance of your
t ti presentation.
Faculty of Education, UTM
6
HOW AUDIO CAN BE USED EFFECTIVELY
Examples of uses of audio:
Cautions and warnings
It i d di f l ti t iti l It is a good medium for alerting users to critical
information. Some uses include:
Sounding an alarm when a limit is reached Sounding an alarm when a limit is reached
Alerting users when data is entered incorrectly
Faculty of Education, UTM
7
HOW AUDIO CAN BE USED EFFECTIVELY
Examples of uses of audio:
Music and Sound Effects
These make multimedia interaction more real.
Some uses include:
i f i Musical background for a video segment
Birds songs accompanying photographs in
biological field training biological field training.
Faculty of Education, UTM
8
HOW AUDIO CAN BE USED EFFECTIVELY
Examples of uses of audio:
Sound-related data.
Some uses include:
Helping mechanics diagnose engine trouble.
Training medical students to recognize different
breathing sounds.
Faculty of Education, UTM
9
HOW AUDIO CAN BE USED EFFECTIVELY
Examples of uses of audio:
Direct voice communication.
Some uses include:
Leaving a voice message for other users of an
i i application
Consulting with an expert during a
troubleshooting procedure troubleshooting procedure.
Faculty of Education, UTM
10
ADVANTAGES AND DISADVANTAGES
OF USING AUDIO
Sound adds life to any multimedia application
d l i t t l i ff ti k ti and plays important role in effective marketing
presentations.
Advantages
Ensure important information is noticed
Add interest
Can communicate more directly than other
media media
Faculty of Education, UTM
11
ADVANTAGES AND DISADVANTAGES
OF USING AUDIO
Disadvantages
Easily overused
R i i l i t f lit Requires special equipment for quality
production
Not as memorable as visual media Not as memorable as visual media
Faculty of Education, UTM
12
AUDIO ANALOG VS DIGITAL
MPT 1203: TECNOLOGY & MEDIA DESIGN
AUDIO: ANALOG VS DIGITAL
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
ANALOG VS. DIGITAL SIGNALS
Sound produced by variations in air pressure.
C t k ti l Can take any continuous value
Analog component
Computers work with
digital.
Must convert analog
to digital.
U li t t Use sampling to get
discrete values.
Faculty of Education, UTM
14
ANALOG VS. DIGITAL SIGNALS
Digital audio is created when you convert a sound
wave into numbers - a process referred to as
digitizing.
You can digitize sound from a microphone, a
synthesizer existing tape recordings live radio and synthesizer, existing tape recordings, live radio and
television broadcasts and popular CDs.
Digitized sound is sampled sound.
Faculty of Education, UTM
15
SAMPLING
In order for a computer to work with audio waves,
th t b t d f l t di it l they must be converted from analog to digital
form.
This is done through a process called sampling, in
which every fraction of a second a sample of the
di i d d i di it l bit audio is recorded in digital bits.
Faculty of Education, UTM
16
DIGITAL AUDIO QUALITY
MPT 1203: TECNOLOGY & MEDIA DESIGN
DIGITAL AUDIO QUALITY
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
DIGITAL AUDIO QUALITY
There are three factors that affect the quality of the
di iti d di digitized audio.
How many samples? OR sampling rate
How much data per sample? OR sample size How much data per sample? OR sample size
OR bit depth
How many channels sampled?
Screen from audio editor software.
You can choose the right quality
for your audio recording.
Faculty of Education, UTM
18
DIGITAL AUDIO QUALITY: SAMPLE RATE
Sample rate the number of times the sample is
taken.
Measure in Hertz (Hz).
Most common sampling rates are:
11.025 kHz
2205 kH 22.05 kHz
44.1 kHz
Faculty of Education, UTM
19
AUDIO QUALITY
Faculty of Education, UTM
20
AUDIO QUALITY: SAMPLE RATE
The higher the sample rate, the more samples that
are taken and, thus, the better the quality of the
digitized audio.
44.100 kHz sample is CD quality. 22.050 kHz
sample suitable for multimedia applications sample suitable for multimedia applications.
Whereas the 11.025 kHz sample would be
marginal quality (radio quality).
Faculty of Education, UTM
21
AUDIO QUALITY: SAMPLE SIZE
Sample size the amount of information stored
about the sample.
Most common sampling sizes are: 8 bit and 16 bit
The greater the sample size, the better the quality
of the audio.
In summary: Sample rate is how many samples
you take; sample size is how good each sample you take; sample size is how good each sample
is.
Faculty of Education, UTM
22
AUDIO QUALITY: CHANNELS
How Many Channels Sampled? How Many Channels Sampled?
Number of Channels
St (2 h l ) Stereo (2 channels)
Mono (1 channel)
Multiple tracks Multiple tracks
Stereo or mono has better quality. WHY ? Stereo or mono has better quality. WHY ?
Faculty of Education, UTM
23
AUDIO QUALITY VS FILE SIZE
R d
Sample Rate
Record
Settings
Sample Size
Number of Channels
Sound
i Quality
Balance
File
Size
Faculty of Education, UTM
24
AUDIO FILE SIZE & AUDIO
MPT 1203: TECNOLOGY & MEDIA DESIGN
AUDIO FILE SIZE & AUDIO
COMPRESSIONS
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
AUDIO FILE SIZE
Audio Record Rate Audio Record Rate
More Larger
Audio
Samples
g
Audio
Files p
Faculty of Education, UTM
26
AUDIO FILE SIZE
Audio f Audio file size is determined by a combination of:
Sample Rate
Sample Size
No of Channels
Length in Minutes Length in Minutes
Faculty of Education, UTM
27
AUDIO FILE SIZE
Table below shows the file size for 10 seconds of
digital audio given various sample rates and
sample size.
Sample Rate Sample Size Size of File
44.1 kHz 16 1.76 MB
44.1 kHz 8 882 KB
22.05 kHz 16 882 KB
22.05 kHz 8 440 KB
11.025 kHz 8 220 KB
Faculty of Education, UTM
28
File size of 10 seconds of digitized audio in stereo
AUDIO FILE SIZE
The formula for determining the size of a mono
di it l di (i b t ) digital recording (in bytes):
Sample rate (in Hz) x Sample Size (in bit) / 8 x Sample rate (in Hz) x Sample Size (in bit) / 8 x
duration of recording (in seconds)
Thus a 1 second recording at a sample rate of 44.1
kHz and 16 bits would be 88, 200 bytes (44 100 x 16
/ 8 X 1) / 8 X 1).
multiply the result by 2 for a stereo recording.
Faculty of Education, UTM
29
py y g
AUDIO FILE SIZE
1 second recording at a sample rate of 44.1 kHz
and 16 bits (mono) would be 88, 200 bytes ????
60 seconds ??? more than 5 MB.
If stereo more than 10 MB.
i f i i i This means that the use of digital audio has one
technical barrier: storage capacity.
This problem is being tackled by data compression
techniques and improved hardware and software.
Faculty of Education, UTM
30
techniques and improved hardware and software.
AUDIO COMPRESSION
Why Compression?
All media, be it text, audio, graphics or video has
redundancy. Compression attempts to eliminate
this redundancy.
Human ear not keen at very loud or very quiet Human ear not keen at very loud or very quiet.
Audio compression can be one of two categories,
lossless or lossy lossless or lossy.
Faculty of Education, UTM
31
AUDIO COMPRESSION
Lossless Compression
An intermediate representation of the audio data is
created where, in most cases, redundant
i f ti i d information is removed.
There is no loss of data when we decode it at the
other end other end.
Lossless compression is great because it makes
perfect copies but it doesn't yield very high p p y y g
compression ratios. That means it doesn't save
huge amounts of disk storage space.
Faculty of Education, UTM
32
AUDIO COMPRESSION
Lossy Compression
Data which is not deemed to be audibly significant
is removed. Then, redundant data is removed.
Data are only encoded if the volume level
exceeds a certain threshold.
Lossy compression algorithms offers much higher Lossy compression algorithms offers much higher
compression ratios than lossless algorithms but in
order to achieve this they need to discard some of y
the original data.
Impact : Low quality of audio. For example MP3
Faculty of Education, UTM
33
and Real Audio.
AUDIO COMPRESSION
Review:
What is the relationship between samples and
fidelity?
Why not always have a high sample rate?
i ? Why not always have a large sample size?
Lossless compression vs Lossy compression ?
Faculty of Education, UTM
34
AUDIO FILE FORMATS
MPT 1203: TECNOLOGY & MEDIA DESIGN
AUDIO FILE FORMATS
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
AUDIO FILE FORMATS
Audio files can be either uncompressed or
d compressed.
Most of the early audio formats were Most of the early audio formats were
uncompressed which means that sound files are
bigger and take longer to download.
Common uncompressed audio formats include
WAV the native audio format for Windows and WAV, the native audio format for Windows, and
AIFF (Audio Interchange File Format), the native
format for Macintosh.
Faculty of Education, UTM
36
AUDIO FILE FORMATS
MP3 is short for MPEG-1 Audio Layer 3. The higher
the audio layer the more complex the encoding the audio layer, the more complex the encoding
which leads to better sound at higher
compression.
MP3s can be encoded at varying bit rates (KB per
second). The higher the bit rate, the better the
i ffi fi sound quality. But the trade-off is a larger file.
MP3s can be encoded at bit rates from 8 kbps to MP3s can be encoded at bit rates from 8 kbps to
over 1000 kbps. The usual standard is 128 kbps
which provides CD like playback. At this rate,
about a minute of music is 1 MB in size.
Faculty of Education, UTM
37
about a minute of music is 1 MB in size.
AUDIO FILE FORMATS
WAV format filename.wav
AIFF (Audio Interchange File Format)
RealAudio filename.ra
MP3 (MPEG l 3) MP3 (MPEG layer 3)
MIDI filename.mid OR filename.midi
Faculty of Education, UTM
38
AUDIO EDITING TOOLS
MPT 1203: TECNOLOGY & MEDIA DESIGN
AUDIO EDITING TOOLS
Department of Educational Multimedia Department of Educational Multimedia
Faculty of Education, UTM Faculty of Education, UTM
AUDIO SOFTWARE
One of the most powerful and professional PC-
b d di diti ft i S S d based audio editing software is Sony Sound
Forge.
Faculty of Education, UTM
40
AUDIO SOFTWARE
Audio editing software allows:
Sound recording
Sound editing (copy,
Resampling or
downsampling
cut, paste, etc.)
Trimming
Audio effects (Fade
ins, fade outs, etc.)
Ti St t hi
Splicing and
assembly
Volume adjustments
Time Stretching
Digital Signal
processing
Volume adjustments
Format conversion or
compression
processing
Reversing Sounds
Faculty of Education, UTM
41
compression