may-june 2016, asilomar openvibe workshop © mensia...
TRANSCRIPT
••••••
••••••••
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
•
••
••
••
•
•
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
•
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Acquisition Server
External Application
Designer
EEG
TCP IP
TCP IP
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Start the Designer :• From Start menu (Start OpenViBE OpenViBE designer)
• From the file explorer, directly execute openvibe-designer.cmd in the OpenViBE folder
Main applications :Acquisition Server or Designer
Sample scenarios :Basic tutorials (box-tutorials) and advanced scenarios(bci-examples ), plus signal files and format conversion scenarios
2D/3D Demo applications for advanced scenarios :Handball, tie-fighter, ssvep shooter
Developers and contributors tools
or
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Create new scenario, open
existing scenario, etc…
Player controls
Edition area for the current scenario
Available OpenViBE boxes
sorted by categories for convenience
Status bar
7
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
File reading and writingboxes
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Basic visualisationboxes
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Drag & Drop the GDF File Readerand Signal Displayboxes in the edition area
You can also look for a specific box from the search bar if you know itsname and do not remember the category
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Boxes outputs
Boxes inputs
I/O types are organized in a hierarchy and coded with specific colors as follows :
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Connect the inputs of the signal displaybox to the outputs of the GDF file reader box by clicking an input and dragging / releasing on the corresponding output
- Inputs can receive connections from any outputs withcompatible type (same type or derived type)
- You can connect an output to multiple inputs but you can’tconnect multiple outputs to a single input.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Double click on the GDF file reader box to open its configuration dialog
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
This file contains 9 minutes of signal sampled at 512 Hz. The box will split these signalsin blocks of 32 samples, which represents a 16th of second per block
Select a GDF file
Then click on Apply
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Start the scenario clicking the Playbutton
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Current time
The file is read and displayed in real-time: signal and stimulations (event).
Processor load
Options and information are available whenclicking on the signal display toolbar (scales, channel selection, colorcodes, etc.)
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Stop the scenario by clicking the Stopbutton
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
You can save the scenario on the disk for later use
Good practice: save yourscenarios on a regularbasis
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Categories> signal processing
> Filtering
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Drag & Drop a Temporal Filter box
You can access online documentation of individual boxes by selecting box of interestand pressing F1.This requires a connection to the Internet.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Copy / Paste a new Signal Display box
Copy / Paste can bedone through threedifferent pathways :- Edit Menu- Right click- Ctrl-c/Ctrl-x/Ctrl-v
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Connect the input of the Temporal Filterbox to the output of the GDF file readerbox
Connect the output of the Temporal Filterbox to the input of the Signal Display box
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Configure the Temporal Filter box:- Band-pass- Low-cut : 8 Hz- High-cut : 12 Hz
The signal is filtered in the alpha band (8 to 12 Hz)
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The raw signal (unfiltered) is still displayed
The filtered signal is displayed in a new window
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The windows have the same title…
Their (automatic) placement is not very convenient…
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Stop the scenario by clicking the Stopbutton
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Right click on the visualisation box that receives raw signals and rename it to “unfiltered” using the rename box option
Rename the othervisualisation box to “alpha ”
You can rename a selected box by pressing F2
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
We now have « unfiltered » and « alpha » visualisation boxes
The original name of the box is still visible on top of the new name
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Now open the « Window Manager »
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Widget arrangement area
Treeview of configuredwidgets
List of unconfiguredwidgets
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Drag & Drop the widgets in the arrangement area to place the alpha widget under the unfilteredwidget
You can create tabs and windows and name themat will. Just right click on the tree view for more actions.
Close the WindowManager to applychanges.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Start the scenario…
The widgets are nowarranged in a more convenient way !
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
••••
•••
•••
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
••
•
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Chunk 1 Chunk 2 Chunk 3 Chunk 4 Chunk 5 Chunk 6
Time
••
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Time
Chunk 1 Chunk 2 Chunk 3 Chunk 4 Chunk 5 Chunk 6
Chunk 1 Chunk 2 Chunk 3
••
•
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Time
Chunk 1 Chunk 2 Chunk 3 Chunk 4 Chunk 5 Chunk 6
Chunk 1 Chunk 2 Chunk 3
••
•
•
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Time
Chunk 1 Chunk 2 Chunk 3 Chunk 4 Chunk 5 Chunk 6
Chunk 1
Chunk 2
Chunk 4
Chunk 3
••
•
•
•
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Time
Chunk 1 Chunk 2 Chunk 3 Chunk 4 Chunk 5 Chunk 6
Chunk 1 Chunk 2
T1 T2
Event of interest such as P300
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Categorysignal processing, epoching
TheTime based epochingbox allows to resize the epochs of the datastream.
The Stimulation basedepoching box allows to select signal around an event of interest (alsocalled Stimulation in OpenViBE).
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Drag & drop a Time based epoching box and a new Signal Display box. Thenrename the Signal Display box in a convenient way.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Configure the Time based epoching box to build epochs of half a second everyhalf a second.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The refresh rate isnow lower in the new widget than in the first because the epochscover a bigger amountof time. The content however is visuallyidentical.
With a sampling rate of 512 Hz, half a second represents 256 samples, thus exactly8 chunks of 32 samples each, as weconfigured in the file reading box.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Edit theTime BasedEpoching box settings to generateepochs of 1 second every 16th of second (0.0625sec)
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The epoched signal appears to tohave16 times more samples withduplicated samples.Visualisation of thisis not very useful…
… however, we cannow process theseepochs to grabinterestinginformation !
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Remove the unfilteredpipeline then drag & drop a Simple DSP box and a Signal Averagebox (found in Signal Processing / Basic and Signal Processing / Averaging respectively).
Connect them to theTemporal Filter box and add a new Signal Display box.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Configure the Simple DSP box sothat it computes the square of eachsample.
The power of a signal in a given frequency band canbe computed as the average of the square of the samples in the givenfrequency band. The Simple DSP box computesthe square of the samples and the Signal Average box computesthe average of the values for each chunk.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Arrange the widgetsso that the Alphawidget is on top of the Alpha Powerwidget.Then close the Window Manager.
Open the WindowManager
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The bottom widget shows the alpha band power
A burst of activity in the alpha band translates into a peak in the alpha power that can beeasily visualized.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Add a Time BasedEpoching box beforethe Simple DSP box.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Edit theTime BasedEpoching box settings to generateepochs of 1 second every 16th of second (that is0.0625 sec)
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Configure the Alpha visualization box sothat it shows 160 seconds of signal.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The power in the alpha band isextracted fromlarger epochs, thusis smoother thanthe previous one.
As soon as non continuous epochs are concerned, the Signal Display is usuallyunable to display time scales correctly.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Remove the Alphavisualization box. Then copy & pastethe entire signal processing pipeline 3 times.
Configure the Temporal Filterboxes as follows :- Alpha : [8,12] Hz- Beta : [12,24] Hz- Delta : [1,4] Hz- Theta : [4,8] Hz
Rename the Signal Display boxes accordingly.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Arrange the widgetsin a convenient wayusing the WindowManager.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The 4 powers are computed and displayed in real time
These frequency bands are related to specificbrain activity. Alpha isinvolved in attention and relaxation for instance. Beta is involved in sensorimotor processes (as for instance real or imaginedhand or foot movements)
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Add a newSimpleDSP box.
Right click on the box and add a new Input of type Signal.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Connect the Simple DSP as follows :- Input A to alpha- Input B to theta
Configure the box settings with the following equationA/B.This will computeAlpha / Theta power ratio
Then add a new Signal Display box
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Different band powerscan be used at the sametime. For example, mostof the neurofeedback protocols are based on band powers and ratios.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
OpenViBE saves the scenarios in a dedicatedXML file format describing the boxes involved, their graphicallocation, their settings and connections etc…
Now save the scenario.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Copy and paste the GDF File Reader, a Temporal Filter and a Time Based Epochingfrom the previousscenario. Then add a Spectral Analysis box and a Power Spectrum Display box and connect them to the rest of the pipeline
Configure the filter :- Type : High-pass- Low-cut : 1 Hz
Create a new scenario (this creates a new tab)
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The power spectrum iscomputed in real time. The amplitude of eachband between 0 and 40 Hz is shownindependently
Default settings of the Power Spectrum Displayautomatically update the datascale to fit the widget height. This issometimes not convenient and can bechanged.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Click on the title bar of the Power Spectrum Displaywidget to configure the visualisation settings
Change the vertical scale to custom and set the scale to 1000
You can also change the Min and Max frequenciesto display in this toolbar
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
In order to start the acquisition server, proceed as follows :In the Windows shortcut list :(Start OpenViBE OpenViBE Acquisition Server)
Directly start the openvibe-acquisition-server.cmd script
in the OpenViBE installation folder
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Drop down list withall supportedacquisition devices
Configuration of the driver for a specificacquisition device
Configuration of the acquisition server itself
TCP port to use so thatother applications canreceive the acquired data
Sample count per chunk of data
Control buttons to connect / disconnect the device and start / stop the acquisition process
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Let’s configure the Generic Oscillator
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Id information about the acquisition. These information will be sent to the client application and can be stored in files
Configuration of the signal that will begenerated: numberof channels, sampling rate
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Let’s change the channel names
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Select a name in the left panel
Select a channel in the right panel
Click on the green arrow to apply the chosen name to the correspondingchannel.
Now applythe changes
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The international10-20 system normalizes the electrodenames and locations.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Click on Connect thenPlay to start readingdata.
The acquisition reflects in realtime the device drift. The drift is the difference betweenthe number of samples the driver sent to the acquistion server as compared to the number of samples it should have sent based on the elapsed time.
If the drift is too important, this can cause some timing and tagging issues, mostparticularly when it comes to ERPs such as P300, which requires a perfect match between the EEG stream and the event tagging. In this case, the server will apply a correction by removing or adding samples.
The data stream can be readby an acquisition client fromthe address hostname:1024on the same computer, itwould be localhost:1024
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Drag & drop an Acquisition Clientbox and a Signal Display box.
Create a new scenario
Default settings will look for the acquisition server at localhost:1024
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Press the Playbutton to see what’sin the Acquisition Server stream
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Start the Designer :• From Start menu (Start OpenViBE OpenViBE designer)
• From the file explorer, directly execute openvibe-designer.cmd in the OpenViBE folder
Main applications :Acquisition Server or Designer
Sample scenarios :Basic tutorials (box-tutorials) and advanced scenarios(bci-examples ), plus signal files and format conversion scenarios
2D/3D Demo applications for advanced scenarios :Handball, tie-fighter, ssvep shooter
Developers and contributors tools
or
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The OpenViBE file format (.ov) is simply the binarydata stream written in a file, same format as whatgoes between boxes
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
A very useful box to select or exclude specificchannels based on theirname or index
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Can display feedback, rewards, or instructions for example.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
This box is able to runany system command, as you would do in a command prompt on Windows or Linux. For example, you canautomatically start an external application thatwill connect to OpenViBE to display feedback
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
A very versatile box for basic mathematicaloperations on signals. See the box documentation for the complete syntax of the equation to set
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Can be used to detect if a signal is above a specificthreshold for example
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
The Sound Player isbased on the OpenALlibrary and can read files in .ogg and .wav formats
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Can be used to redirectan input signal to one or another processingpipeline depending on the context.
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies
Real time, quantitative EEG solutions
May-June 2016, Asilomar OpenViBE workshop © Mensia Technologies