software integration for applications with audio stream intelligent information hiding and...
TRANSCRIPT
Software Integration for Applications with Audio Stream
Intelligent Information Hiding and Multimedia Signal Processing, 2008.International Conference on 15-17 Aug. 2008 ,pp1126-1129
Advisor : Lian-Jou TsaiStudent : Bing-Fen HuangPPT Production : 100%Data : 2011/12/21
Outline Abstract
Introduction
Software integration through wrapper
Wrapper for stream-based multimedia applications
An example
Conclusion
2
Abstract
We have successfully intercepting/redirecting the data :
Files
Characters
Audio data are a huge number of multimedia applications
today.
Try to build a wrapper module that redirects the audio data.
3
Introduction(1/2)
Commercial Off-The-Shelf (COTS)
For integrating MS-Windows COTS applications into
software systems :
I/O interception/redirection techniques
A programmable interfaces
Message queue and clipboard space techniques.
MS-Windows application GUIs
4
The approach can handle only input/output data in forms of
files and character strings.
The video/audio streams are not able to be dealt with.
In order to successfully integrate stream-based applications,
some issues must be considered :
Input and output data
Data stream synchronization
Introduction(2/2)
5
Software integration through wrapper(1/2)
The Windows applications are firstly encapsulated by a
wrapper program.
Hides the operation details
A programmable interface(COTS)
Responsible to convert the requests
Gets the output results
Windows applications can exchange data simply through the
Windows Clipboard mechanism.
6
Interception and redirection through a Wrapper
Software integration through wrapper(2/2)
7
multimedia applications (1/6)
ALSA (Advanced Linux Sound Architecture) is a popular
sound driver/subsystem in Linux 2.6.
In ALSA modules, the playback and capture functions are
already included in its PCM (Pulse Code Modulation)
component.
Wrapper for stream-based
8
multimedia applications (2/6)
Wrapper for stream-based
The system structure of ALSA for Linux
9
multimedia applications (3/6)
Wrapper for stream-based
Working of ALSA sound driver in Linux(Output)
10
multimedia applications (4/6)
Wrapper for stream-based
Working of ALSA sound driver in Linux(Input)
11
multimedia applications (5/6)
Wrapper for stream-based
Integration between two audio applications through Wrapper
12
multimedia applications (6/6)
Spinlock scheme
ALSA sound modules use the function:
interrupt_handle()
spinlock_irq()
spinunlock_irq()
Wrapper for stream-based
13
An example(1/4)
Voice Flight Status Information System (VFSIS)
Integration Skype and ShinxIII
It is composed of a database server and multiple clients distributed on the Internet.
14
An example(2/4)
The system structure of VFSIS
15
An example(3/4)The command word analysis and information inquiry
MySQL database
Airlines
Flight Code
Scheduled Arrival Time
Actual Arrival Time
Assigned Gate
Delay Status
VFSIS GUI
16
An example(4/4)
The server side VFSIS GUI
17
Conclusion(1/2)
The gluing of stream based software applications is a critical technique in
the software integration of multimedia software applications.
We have successfully achieved the goal of intercepting / redirecting the
audio stream data by adopting the wrapper technique.
VFSIS is used to demonstrate the feasibility of our proposed approach.
18
Future works
In addition to the issue of video data stream interception
The synchronization issue between image and voice of the video data stream is also a critical issue.
Conclusion(2/2)
19
Thank for your attention !