ios + neuroscience : braine-iphone interfaces
DESCRIPTION
Intro to Brain–computer interfaces for iOS developers.TRANSCRIPT
iOS + Neuroscience
Brain-iPhone interfaces
Imagine
• Cocoa• Cocoa Touch• Cocoa Thought
Biology
Connectome
Open Worm Project
Neurointerfaces
Backyard Brain
Roboroach video
Transcranial direct current stimulation
Foc.Us• Enhance language and mathematical
ability, attention span, problem solving, memory, and coordination.
• accepted maximum 2 mA, usually 1 mA or less
• stimulation time - 20 minutes
• 10 minutes - effects lasting for up to an hour.
• 48 hours to a week before repeating the stimulation.
• Studies indicates SAFETY in a SINGLE session.
• No studies about long-term safety of repeated sessions of stimulation.
Foc.Us API- (void)peripheralDidWriteChracteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)peripheral
withError:(NSError *)error;
- (void)peripheralDidReadChracteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)peripheral
withError:(NSError *)error;
- (void)hardwareDidNotifyBehaviourOnCharacteristic:(CBCharacteristic *)characteristic
withPeripheral:(CBPeripheral *)peripheral
error:(NSError *)error;
http://www.foc.us/bluetoothhttps://github.com/FocusBluetooth/focus-bluetooth-ios/blob/master/CBDemo/ViewController.m
Foc.Us
Electroencephalography
δ <4 Gzslow-wave sleep,
some continuous-attention tasks
θ 4-7 Gz drowsiness,idling,
inhibition of elicited responses
α 7-14 Gz relaxed/reflecting,closing the eyes
β 15-30 Gz active thinking, focus, hi alert, anxious
γ 30-100 Gz cross-modal sensory processing,short-term memory matching of
recognized objects, sounds, or tactile sensations
μ 8-13 GzShows rest-state motor neurons,
mirror neurons activity(?)
σ 10-16 Gz Stage N2 sleep (consciousness shutdown)
MindWave Mobile by NeuroSky2 mind states:
- Attention (0 – 100).
- Meditation (0 – 100).
• Blinking and it’s “power”.- Contact with skin.- Signal quality.
1 electrode
$99.95
API- (void)dataReceived:(NSDictionary *)data {
if([data valueForKey:@"blinkStrength"])
if([data valueForKey:@"raw"]) {
if([data valueForKey:@"heartRate"])
if([data valueForKey:@"poorSignal"]) {
if([data valueForKey:@"respiration"]) {
if([data valueForKey:@"heartRateAverage"]) {
if([data valueForKey:@"heartRateAcceleration"]) {
if([data valueForKey:@"rawCount"]) {
if([data valueForKey:@"eSenseAttention"]){
eSenseValues.attention = [[data valueForKey:@"eSenseAttention"] intValue];
eSenseValues.meditation = [[data valueForKey:@"eSenseMeditation"] intValue];
eegValues.delta = [[data valueForKey:@"eegDelta"] intValue];
eegValues.theta = [[data valueForKey:@"eegTheta"] intValue];
eegValues.lowAlpha = [[data valueForKey:@"eegLowAlpha"] intValue];
eegValues.highAlpha = [[data valueForKey:@"eegHighAlpha"] intValue];
eegValues.lowBeta = [[data valueForKey:@"eegLowBeta"] intValue];
eegValues.highBeta = [[data valueForKey:@"eegHighBeta"] intValue];
eegValues.lowGamma = [[data valueForKey:@"eegLowGamma"] intValue];
eegValues.highGamma = [[data valueForKey:@"eegHighGamma"] intValue];
Reverse-engineering
Tools:• lipo• otool• Hopper Disassembler• MachOView
Results:• Spline interpolation• Spectral density
estimation • Fast Fourier transform• …
Applications
https://github.com/orbotix/Sphero-iOS-SDK
https://github.com/MariaStoica/MindSphero
+
BrainOSC
Converts data from ThinkGear's MindWave to OSC data
AdFenceMood and proximity based advertising using the
MindWave headset by NeuroSky and the Qualcomm Gimbal Proximity chip.
Melon
3 electrodes on the forehead.
Detects focus and meditation.
Detects sleep phases.$149.Uses NeuroSky’s chip.SDK will be available in
summer.
Muse by InteraXon
Muse
6 dry sensors$ 299Sleep, calmness,
attention.Has an iOS app.Native library will be
available “soon”. Right now: console,
sockets, protobuf.
Emotive EPOC
Emotive Insight
iOS SDK will be in summer.C++, really ?$ 229
APIstruct emokit_contact_quality {//values > 4000 are good
short F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5;
};
struct emokit_frame {
unsigned char counter; //loops from 0 to 128 (129 values)
int F3, FC6, P7, T8, F7, F8, T7, P8, AF4, F4, AF3, O2, O1, FC5; //raw data values
struct emokit_contact_quality cq;
char gyroX, gyroY;
unsigned char battery; //percentage of full charge, read on counter=128
};
API
Insight video
Emotive Insight
https://sites.google.com/a/emotiv.com/wiki/documentation
Additional Resources
http://www.openbci.com/ - opensource BCIhttp://personalneuro.com/about.htm - neuro
apps developmenthttp://neurogadget.com/ - bloghttp://www.neurogamingconf.com/ -
conference 2014http://en.wikipedia.org/wiki/Brain
%E2%80%93computer_interfacehttp://neuroscience.uth.tmc.edu/toc.htm
Additional Resources
http://wsyachina.narod.ru/biology/brain_17.html
http://wsyachina.narod.ru/medicine/drug_dependence.html
https://eyewire.org/signup
Thanks for your [[data valueForKey:@"eSenseAttention"]
intValue]