data dan teknologi multimedia sesi 05 nofriyadi nurdam
TRANSCRIPT
![Page 1: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/1.jpg)
Digital AudioData dan Teknologi Multimedia
Sesi 05Nofriyadi Nurdam
![Page 2: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/2.jpg)
Learning Outcomes
At the end of this session, the students will be able to:
Show how to use sound on multimedia application.
![Page 3: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/3.jpg)
Course Outlines Sound Definition Analogue to Digital Converter (ADC) Digital Audio MIDI (Musical Instrument Digital Interface) Working with Sound
![Page 4: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/4.jpg)
Sound
Sound are rapid vibrations that are transmitted as variations in air pressure
Sound comprises the spoken word, voices, music and even noise.
![Page 5: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/5.jpg)
Bina Nusantara
Sound As the sound vibrates it
bumps into molecules of the surrounding medium causing pressure waves to travel away from the source in all directions
Types of Sound in Multimedia:◦ Speech◦ Music◦ Sound Effect
![Page 6: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/6.jpg)
Waveforms Sound waves are manifest as waveforms
◦ A waveform that repeats itself at regular intervals is called a periodic waveform
◦ Waveforms that do not exhibit regularity are called noise
The unit of regularity is called a cycle◦ This is known as Hertz (or Hz) after Heinrich
Hertz One cycle = 1 Hz Sometimes written as kHz or kiloHertz (1 kHz = 1000
Hz)
![Page 7: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/7.jpg)
Waveforms
distancealong wave
Cycle
Time for one cycle
![Page 8: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/8.jpg)
The characteristics of sound waves
Sound waves
Amplitude
Frequency
![Page 9: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/9.jpg)
The characteristics of sound waves
Frequency ◦ the rate at which sound is measured◦ Number of cycles per second or Hertz (Hz)◦ Determines the pitch of the sound as heard by our ears◦ The higher frequency, the clearer and sharper the sound the
higher pitch of sound
Amplitude◦ Sound’s intensity or loudness◦ The louder the sound, the larger amplitude.
In addition, all sounds have a duration and successive musical sounds is called rhythm
![Page 10: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/10.jpg)
The characteristics of sound waves
distancealong wave
Cycle
Time for one cycleAmplitude
pitch
![Page 11: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/11.jpg)
Example waveforms
Bina Nusantara
Piano
Pan flute
Snare drum
![Page 12: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/12.jpg)
Capture and playback of digital audioAir pressurevariations
Captured viamicrophone
Air pressurevariations
ADC
Signal isconverted into
binary(discrete form)01010011010110101111
Analogueto DigitalConverter
DAC
Converts back
into voltage
Digital toAnalogueConverter
![Page 13: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/13.jpg)
The Analogue to Digital Converter (ADC) An ADC is a device that converts analogue
signals into digital signals
An analogue signal is a continuous value◦ It can have any single value on an infinite
scale A digital signal is a discrete value
◦ It has a finite value (usually an integer)
An ADC is synchronised to some clock It will monitor the continuous analogue
signal at a set rate and convert what it sees into a discrete value at that specific moment in time
The process to convert the analogue to digital sound is called Sampling. Use PCM (Pulse Code Modulation)
When you present the sound wave as numbers, the process is called digitizing and the result will become digital audio
![Page 14: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/14.jpg)
Digitized Sound Is a sampled sound. Every nth fraction of a second, a sample of
sound is taken and stored as digital information
011010111011011010110110110111011011110110111011011011101111011011010101000101101101101011011010011011011011011011011010101010100110011001001001100110011010011010111011011010110110110111011011110110111011011011101111011011010
1010001011
![Page 15: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/15.jpg)
Digital Sound Quality
Sampling Rate (Frequency)
• How often the samples are taken
Sample Size (Bitdepth)
• How many numbers are used to represent the value of each sample
Quality of digital sound depends
on
![Page 16: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/16.jpg)
Digital sampling - Sampling Rate
![Page 17: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/17.jpg)
Digital sampling - Sampling Rate
![Page 18: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/18.jpg)
Sampling Parameters
Sampling Rate◦Frequency of sampling◦Measure in Hertz◦The higher sampling rate, higher quality
sound but size storage is big.◦Standard Sampling rate:
48.000 kHz (DAT) - Digital Audio Tape, also DVD 44.100 kHz (CD) - Compact Disk - typical
quality of most sound cards 22.255 kHz - Medium quality 11.025 kHz - Low quality (frequently used for
speech)
![Page 19: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/19.jpg)
Sampling Parameters
Size sample◦The resolution of a sample is the number
of bits it uses to store a given amplitude value, e.g. 8 bits (256 different values) 16 bits (65536 different values)
◦A higher resolution will give higher quality but will require more memory (or disk storage)
![Page 20: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/20.jpg)
Size sample
![Page 21: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/21.jpg)
Quantisation Samples are usually represented the audio
sample as a integers(discrete number) or digital
S am ple po in ts
0
15
![Page 22: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/22.jpg)
Calculating the size of digital audio The formula is as follows:
The answer will be in bytes Where:
◦ sampling rate is in Hz◦ Duration/time is in seconds◦ resolution is in bits (1 for 8 bits, 2 for 16 bits) ◦ number of channels = 1 for mono, 2 for stereo, etc.
8
channelsofnumberresolutiondurationrate
![Page 23: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/23.jpg)
Calculating the size of digital audio
Example:◦ Calculate the file size for 1 minute, 44.1 KHz, 16
bits, stereo sound◦ Where:
sampling rate is 44,100 Hz duration/time is 60 seconds resolution is 16 bits number of channels for stereo is 2
8
channelsofnumberresolutiondurationrate
44100 * 60 * 16 *2
8
![Page 24: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/24.jpg)
Digital audio editing software One of the most powerful and professional PC-based software is
previously known as Cool Edit. It’s now known as Adobe Audition. Same program, new company.
![Page 25: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/25.jpg)
![Page 26: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/26.jpg)
Editing Digital Audio
Simple audio editing software allows:◦ Recording of digital audio segments◦ Trimming◦ Splicing and assembly◦ Volume adjustments of the entire segment◦ Reversing Sounds ◦ Copy, cut, paste and delete segments of digital audio
Others audio editing software:◦ Sound Forge◦ Gold Wave ◦ PROSONIQ SonicWORX◦ Samplitude Studio
![Page 27: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/27.jpg)
Audio formats .WAV (Developed by IBM and Microsoft) .AU (UNIX) .AIFF (Audio Interchange File Format) .MP3 (MPEG layer 3) .SND (Mac) .RA (RealAudio) .WMA (Windows Media Audio) .VOC (SoundBlaster)
![Page 28: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/28.jpg)
MIDI (Musical Instrument Digital Interface)
MIDI is a standard for specifying a musical performance
It allows different electronic devices to communicate together – Rather than send raw digital audio, it sends instructions to musical instruments telling them what note to play, at what volume, using what sound, etc.
The synthesiser that receives the MIDI events is responsible for generating the actual sounds. Example: Keyboard Piano
MIDI data is not digitized sound: it is a shorthand representation of music stored in numeric form
![Page 29: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/29.jpg)
MIDI Setup
![Page 30: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/30.jpg)
MIDI sequencers
A MIDI sequencer allows musicians to edit and create musical compositions like a word processor◦ Cut and paste◦ Insert / delete
![Page 31: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/31.jpg)
Advantages of MIDI MIDI files are compact; the size of the file is
completely independent of playback quality
In some cases MIDI may sound better than digital audio (if the MIDI sound source is of high quality)
MIDI data is completely editable: you can change the length of a MIDI file by varying its tempo without changing the pitch
Still used a lot in studio environment to connect synthesizers and other equipment
![Page 32: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/32.jpg)
Disadvantages of MIDI MIDI does not represent sound but musical
instruments, so playback is very rarely accurate (usually same score, wrong instrument)
MIDI cannot easily be used to play spoken dialog
An old format, people have already begun forgetting it
![Page 33: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/33.jpg)
MIDI VS Wav
Comparison
Size storage
Creation
Modification
Playback Hardware
Knowledge in music theory
MIDI
Small
More Difficult
Easier
Dependent
Required
WAV
Big size
Easier
More Difficult
Independent
Not required
![Page 34: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/34.jpg)
How audio can be used effectively Cautions and warnings
◦ It is a good medium for alerting users to critical information. Some uses include: Sounding an alarm when a limit is reached Alerting users when data is entered incorrectly
Music and Sound Effects◦ These make multimedia interaction more real.
Some uses include: Musical background for a video segment Birds Songs accompanying photographs in biological
field training
![Page 35: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/35.jpg)
How audio can be used effectively Sound-related data.
◦ Some uses include: Helping mechanics diagnose engine trouble Training medical students to recognize different
breathing sounds
Direct voice communication. ◦ Some uses include:
Leaving a voice message for other users of an application
Consulting with an expert during a troubleshooting procedure.
![Page 36: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/36.jpg)
Advantages and Disadvantages of using audio
Sound adds life to any multimedia application and plays important role in effective marketing presentations
Advantages◦ Ensure important information is noticed◦ Add interest ◦ Can communicate more directly than other medi
Disadvantages◦ Easily overused◦ Requires special equipment for quality production◦ Not as memorable as visual media
![Page 37: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/37.jpg)
Adding Sound to Multimedia Project
Determine the sound playback capabilities that the end user’s system offers
Decide what kind of sound is needed and where you’ll use them
Decide when to use midi and when to use digital audio
Acquire source material Edit the sounds to fit your project Test the sounds to be sure they
are timed properly
![Page 38: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/38.jpg)
Adding Sound to Multimedia Project Decide what kind of sound is needed and
where you’ll use them
Decide when to use midi and when to use digital audio
Acquire source material
Edit the sounds to fit your project
Test the sounds to be sure they are timed properly
![Page 39: Data dan Teknologi Multimedia Sesi 05 Nofriyadi Nurdam](https://reader038.vdocuments.net/reader038/viewer/2022102911/5697c01f1a28abf838cd1ac6/html5/thumbnails/39.jpg)
Q & A