Upload File

core audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › lecture20.pdfcore audio clock...

  • Home
  • Documents
  • Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to
51
Core Audio MSDOSX : Lecture 20

Upload: others

Post on 29-May-2020

13 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core AudioMSDOSX : Lecture 20

Page 2: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Overview

•What is Core Audio?

•Core Audio Programming Interfaces

•Common Tasks With Core Audio

•Core Audio Frameworks

•What’s Been Shipping Since 10.4?

•Supported Audio and Data Formats

•Resources

Page 3: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

Page 4: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

Plug-in interfaces for audio synthesis and audio digital signal processing (DSP)

Page 5: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

Built in support for reading and writing a wide variety of audio file and data formats

Page 6: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

Plug-in interfaces for handling custom file and data formats

Page 7: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

A modular approach for constructing signal chains

Page 8: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

Scalable multichannel input and output

Page 9: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

Easy synchronization of audio and MIDI data during recording or

Page 10: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

What is Core Audio?

A standardized interface to all built-in and external hardware devices, regardless of connection type (USB,

Firewire, PCI, and so on)

Page 11: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

A standardized interface to all built-in and external hardware devices, regardless of

connection type (USB, Firewire, PCI, and so on)

Page 12: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

A standardized interface to all built-in and external hardware devices, regardless of

connection type (USB, Firewire, PCI, and so on)

Page 13: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

A standardized interface to all built-in and external hardware devices, regardless of

connection type (USB, Firewire, PCI, and so on)

Page 14: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

InterfacesAudio Unit Services

• Audio Processing Graph API

• Audio File and Converter Services

• Hardware Abstraction Layer (HAL) Services

• Music Player API

• Core MIDI Services and MIDI Server Services

• Core Audio Clock API

• OpenAL (Open Audio Library)

• System Sound API

Page 15: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Audio Unit Services

Allows you to create and manipulate audio units.

Page 16: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Audio ProcessingGraph API

Page 17: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Audio ProcessingGraph API

Page 18: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Audio File andConverter Services

• Audio Converters and Codecs

• File Format Information

• Audio Metadata

• Core Audio File Format

Page 19: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Hardware Abstraction Layer (HAL) Services

“Core Audio uses a hardware abstraction layer (HAL) to provide a consistent and predictable interface for applications to deal with hardware.”

Page 20: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Hardware Abstraction Layer (HAL) Services

Page 21: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Music Player API

“The Music Player API allows you to arrange and play a collection of music tracks.”

MIDI

Page 22: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core MIDI Services and MIDI Server Services

“Core MIDI Services defines an interface that applications and audio units can use to communicate with MIDI devices. It uses a number of abstractions that allow an application to interact with a MIDI network.”

Page 23: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core MIDI Services and MIDI Server Services

Page 24: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core MIDI Services and MIDI Server Services

Page 25: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core Audio Clock APIThe Core Audio Clock API provides:

• A reference clock that you can use to synchronize applications or devices.

• A standalone timing source, or...

• A synchronized timer with an external trigger, such as a MIDI beat clock or MIDI time code.

• You can start and stop the clock yourself, or...

• You can set the clock to activate or deactivate in response to certain events.

Page 26: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core Audio Clock API

Page 27: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

OpenAL(Open Audio Library)

“OpenAL is a cross-platform API used to position and manipulate sounds in a simulated three-dimensional space.”

Page 28: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System Sound API

“The System Sound API provides a simple way to play standard system sounds in your application.”

Page 29: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Common Tasksin Core Audio

•Reading and Writing Audio Data

•Interfacing with Hardware Devices

•The AUHAL

•Using Aggregate Devices

•Creating Audio Units & Hosting Audio Units

•Handling MIDI Data

Page 30: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Reading and Writing Audio Data

Page 31: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Interfacing with Hardware Devices

Operations must go through the hardware abstraction layer (HAL).

Page 32: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

The AUHAL

“If you need to connect to an input device, or a hardware device other than the default output device, you need to use the AUHAL.”

Page 33: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

The AUHAL

“If you need to connect to an input device, or a hardware device other than the default output device, you need to use the AUHAL.”

Page 34: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Using Aggregate Devices

“When interfacing with hardware audio devices, Core Audio allows you to add an additional level of abstraction, creating aggregate devices which combine the inputs and outputs of multiple devices to appear as a single device.”

Page 35: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Creating Audio Units & Hosting Audio Units

...probably read the documentation. :-)

Page 36: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Handling MIDI Data

MIDI File Read

Page 37: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Handling MIDI Data

MIDI Sequence Playback

Page 38: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Handling MIDI Data

MIDI Device Play-through

Page 39: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Handling MIDI Data

MIDI File Recording

Page 40: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Handling MIDI Data

Mixing Audio Sources

Page 41: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Handling MIDI Data

“Big Picture”

Page 42: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Core Audio Frameworks

•AudioToolbox.framework

•AudioUnit.framework

•CoreAudioKit.framework

•CoreAudio.framework

•CoreMIDI.framework

•CoreMIDIServer.framework

•OpenAL.framework

Page 43: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System SuppliedAudio Units

System-supplied effect units (kAudioUnitType_Effect)

AUHiPass

kAudioUnitSubType_HighPassFilter

A high-pass filter with an adjustable resonance peak.

Page 44: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System SuppliedAudio Units

 System-supplied instrument unit

DLSMusicDevice

kAudioUnitSubType_DLSSynth

A virtual instrument unit that lets you play MIDI data using sound banks

Page 45: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System SuppliedAudio Units

 System-supplied mixer units (kAudioUnitType_Mixer)

AUMixer3D

kAudioUnitSubType_3DMixer

...can take several different signals and mix them so they appear to be positioned in a three-dimensional space.

Page 46: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System SuppliedAudio Units

System-supplied converter units (kAudioUnitType_FormatConverter)

AUTimePitch

kAudioUnitSubType_TimePitch

A unit that lets you change the speed of playback without altering the pitch, or vice versa.

Page 47: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System SuppliedAudio Units

 System-supplied output units (kAudioUnitType_Output)

AudioDeviceOutput

kAudioUnitSubType_HALOutput

A unit that interfaces with an audio device using the hardware abstraction layer. Also called the AUHAL.

Page 48: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

System SuppliedAudio Units

System-supplied generator units (kAudioUnitType_Generator)

AUNetReceive

kAudioUnitSubType_NetReceive

A unit that receives streamed audio data from a network.

Page 49: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Supported Audio andData File Formats

AAC (.aac, .adts)

AC3 (.ac3)

AIFC (.aif, .aiff,.aifc)

AIFF (.aiff)

Apple Core Audio Format (.caf)

MPEG Layer 3 (.mp3)

MPEG 4 Audio (.mp4)

MPEG 4 Audio (.m4a)

NeXT/Sun Audio (.snd, .au)

Sound Designer II (.sd2)

WAVE (.wav)

Audio File Formats

Page 50: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Supported Audio andData File Formats

Data File Formats

MPEG Layer 3 ('.mp3') Apple DRM Audio Decoder ('drms')

MACE 3:1 ('MAC3') AC-3

MACE 6:1 ('MAC6') DVI 4:1 ('dvi ')

QDesign Music 2 ('QDM2') Apple IMA 4:1 ('ima4')

QDesign ('QDMC') LPC 23:1 ('lpc ')

Qualcomm PureVoice ('Qclp') Microsoft ADPCM

Qualcomm QCELP ('qclq') DVI ADPCM

AAC ('aac ') GSM610

Apple Lossless ('alac') AMR Narrowband ('samr')

Apple GSM 10:1 ('agsm') µLaw 2:1 ('ulaw')

ALaw 2:1 'alaw')

Page 51: Core Audioinst.cs.berkeley.edu › ~msdosx › fa11 › lectures › Lecture20.pdfCore Audio Clock API The Core Audio Clock API provides: • A reference clock that you can use to

Resources•Overview• http://developer.apple.com/library/mac/#documentation/MusicAudio/

Conceptual/CoreAudioOverview/Introduction/Introduction.html

•Core Audio Frameworks• http://developer.apple.com/library/mac/#documentation/MusicAudio/

Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html

•System Supplied Audio Units• http://developer.apple.com/library/mac/#documentation/MusicAudio/

Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html

•"iPhone Core Audio Brain Dump"• http://www.subfurther.com/blog/2009/04/28/an-iphone-core-audio-brain-

dump/

http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/Introduction/Introduction.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/Introduction/Introduction.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/Introduction/Introduction.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/Introduction/Introduction.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/CoreAudioFrameworks/CoreAudioFrameworks.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html
http://developer.apple.com/library/mac/#documentation/MusicAudio/Conceptual/CoreAudioOverview/SystemAudioUnits/SystemAudioUnits.html
http://www.subfurther.com/blog/2009/04/28/an-iphone-core-audio-brain-dump/
http://www.subfurther.com/blog/2009/04/28/an-iphone-core-audio-brain-dump/
http://www.subfurther.com/blog/2009/04/28/an-iphone-core-audio-brain-dump/
http://www.subfurther.com/blog/2009/04/28/an-iphone-core-audio-brain-dump/

Web audio api TDC

제2회 hello world 오픈세미나 Web Audio API-가능성엿보기

Orchestrating the Web Audio API - sriku.orgsriku.org/talks/jsfoo2015-webaudioapi-srikumarks.pdf · • The Web Audio API is sweet for music and synthesis work … with some care …

Guitar Effects with the HTML5 Audio API

Developing game audio with the Web Audio API

The Vamp Audio Analysis Plugin API: A - Vamp Plugins

Audio Conferencing API for Linux and Windows Operating .../media/manuals/docs/audio_conf_api_v1.pdf · Audio Conferencing API for Linux ... This Audio Conferencing API for Linux and

"Web Audio Api", Анатолий Найда, MoscowJS 27

Audio Device API Audio Device Stereo Pair 01020 Sample

Web Audio API とモールス信号

Web Audio API + AngularJS

A HIGH LEVEL AUDIO COMMUNICATIONS API FOR THE UNICON ...cve.sourceforge.net/papers/zsharif-voip.pdf · “ A High Level Audio Communications API For the Unicon Language ,” a thesis

Low Power Audio CODEC - Everest SemiLow Power Audio CODEC FEATURES . ... record . APPLICATIONS ... The device can work either in master clock mode or slave clock mode.everest-semi.com/pdf/ES8316

Hotel Clock Radio with Wireless Audio and Universal Chargingsecure.voxxintl.com/docs/common/ARC290/ARC290_specs.pdf · Hotel Clock Radio with Wireless Audio and Universal Charging

Let's Make Some Noise with Web Audio API

Web Audio APIの初歩

Conversation Clock: Visualizing audio patterns in co ...social.cs.uiuc.edu/papers/pdfs/bergstrom-810.pdfConversation Clock: Visualizing audio patterns in co-located groups Tony Bergstrom

How to provide Qualitelis with your Clock PMS credential ...€¦ · clock-softwarecom/pms api/2011/936 httpsTsky-eu1 clock-sonware nttps: //sky 1 com/zapier_api.'20111936 API access

7. the Real-Time Clock API

Practical Web Audio API Programming

Audio Data API - MozillaWiki

PRE BOX S2 DIGITAL - Pro-Ject Audio Systems · 2019. 7. 8. · Filter und unserer proprietären Clock Schaltung. Digitale Audio ist die Kunst der Zeit, mit unserem proprietären Clock

i.MX 6 Audio Clock Configuration Options Application · PDF fileThe initial plan of the clock jitter test was to: • Measure jitter from a 24.576 MHz clock • Generate the clock

Web Audio API, Web MIDI API - 2015 html5 conference

Mac OS X 與 iOS 的 Audio API

Las nuevas API de audio en HTML5

Web Audio API: brief introduction

EFECTOS DIGITALES DE AUDIO CON WEB AUDIO API

WebRTC + Web Audio API = スーパーサイヤ人

Skype Cert Desktop API Spec Audio Draft

Audio & Video · 19.11.2010  · Core Audio •High level, easy to use •System Sound API — short sounds •AVAudioPlayer class — ObjC, simple API •Lower level, takes more

Web Audio API in 15 min

Mozilla Audio Data API

Serial real-time clock (RTC) with audio · February 2012 Doc ID 13480 Rev 5 1/42 1 M41T00AUD Serial real-time clock (RTC) with audio Features Combination real-time clock with audio

R32AN0004: API Register Specification (D2 Audio DSP Sound