intelligent signal processing - technical university of ...cogsys.imm.dtu.dk › presentation ›...
TRANSCRIPT
Informatics and Mathematical Modelling / Intelligent Signal Processing
1Jan Larsen
Intelligent Signal ProcessingJan LarsenInformatics and Mathematical ModellingTechnical University of DenmarkWeb: isp.imm.dtu.dk
Jan Larsen 2
Informatics and Mathematical Modelling / Intelligent Signal Processing
DTU FactsIndependent state university since January 1st, 2001Annual budget 1382 million DKK or 186 million EuroExternal research finances account for 35%1027 faculty/academic staff members, 948 technical and administrative staffOrganized in 15 departments1500 B.Sc., 4300 M.Sc., 500 Ph.D., and 500 international students380 courses in English, 10 international M.Sc. programs
Jan Larsen 3
Informatics and Mathematical Modelling / Intelligent Signal Processing
DTU FactsLocated in Lyngby 10km (6.3miles) north of CopenhagenMore than 80 buildingsTotal floorage of about 375,000 m2 (3.3million ft2)Campus size 1500m from North to South, 850m from East to West (0.9 by 0.5 miles)
Jan Larsen 4
Informatics and Mathematical Modelling / Intelligent Signal Processing
IMM86 faculty members32 administrative staff members60 Ph.D. students70 M.Sc. students annually6000 students follow an IMM course annually
Jan Larsen 5
Informatics and Mathematical Modelling / Intelligent Signal Processing
Competences and Research at IMM
image processing and graphical communication
software engineering
data safety
knowledge-based systems
networks and distributed systems
embedded systemsmathematical physics
mathematical statistics
geoinformatics
operations research
intelligent signal processing integrated circuits and digital system
numerical analysis
programming languages
Jan Larsen 6
Informatics and Mathematical Modelling / Intelligent Signal Processing
ISP Group Activities
HumanitarianDemining
Monitor Systems
Biomedical
Neuroscience
Multimedia
MethodsAlgorithms
•3 faculty•3 post docs•11 Ph.D. students•10 M.Sc. students
•3 faculty•3 post docs•11 Ph.D. students•10 M.Sc. students
Jan Larsen 7
Informatics and Mathematical Modelling / Intelligent Signal Processing
Research Projects1991-2001 CONNECT: fundamental research in neural networks and adaptive systems1997-2001 DMM: Distributed Multi Media research program1998-2001 THOR Center for Neuroinformatics1996-1999 Interdisciplinary Neuroscience Initiative - neuroimagingcollaboration in Copenhagen1999-2002 SITE: signal and image processing methods for telemedicine2002-2006 International Center for Biomedical Research, minor contribution to EEG/pain studies.1997-2004 HBP: Human Brian Project - tools for analysis of brain scans2000-2003 MAPAWARMO - EU5FP project on mapping visual cortical regions in awake, behaving monkey using functional MRI2002-2005 AE-WATT - EU5FP project on neural network and adaptive processing for monitoring and control of large diesel engines1997- Humanitarian Demining Laboratory (HDL)
Jan Larsen 8
Informatics and Mathematical Modelling / Intelligent Signal Processing
Network
IEEE Neural Networks for Signal Processing technical committeeCopenhagen Signal and Image Processing Graduate school (CISP)Copenhagen Brain Research CenterNordic Demining Research ForumEuropean partners through more 6th EU FP LoI’s
Jan Larsen 9
Informatics and Mathematical Modelling / Intelligent Signal Processing
How do we colaborate
Master thesis projectsPh.D. projects funded by DTUIndustrial Ph.D. projectsResearch projects funded by Danish research councils / EUCommissioned research and developmentSpecial designed competence development courses
Jan Larsen 10
Informatics and Mathematical Modelling / Intelligent Signal Processing
Competences in signal processing
adaptive
statistical
nonlinear
machine learning bayesian
pattern recognition
data and webmining
Learning
Jan Larsen 11
Informatics and Mathematical Modelling / Intelligent Signal Processing
Methods and AlgorithmsTheory
Bayesian learningMean field methodsUnsupervised/supervised and combined learningClassification/regressionModel selectionNonstationary modelingDatafusionGeneralization Outlier detectionRobust modelingActive learning
ModelsNeural networksRelevance vector machinesIndependent Component AnalysisTime-series modelsGraphical ModelsGaussian ProcessesMixture models
Jan Larsen 12
Informatics and Mathematical Modelling / Intelligent Signal Processing
Our modeling approach
Model Selection
Validation Learning
Prior knowledgeand data
Jan Larsen 13
Informatics and Mathematical Modelling / Intelligent Signal Processing
Learning Based Modeling
⋅| , )up(y x w ( | )up x w
Measurements
Parameters
Labels
Unsupervised
Learning
Supervised
LearningLearning joint probability
Jan Larsen 14
Informatics and Mathematical Modelling / Intelligent Signal Processing
Supervised LearningSelection of model familyPreprocessingA priori knowledge constraints/probabilisticLearning (ML,MAP,Bayes)Active learning Outlier detection– Erroneous label– Unknown label
Model structure optimizationPerformance issues– Generalization– Confidence– ROC curves– Confusion matrices– Reproducibility
Visualization/interpretation– Importance analysis
( | , )sp y x w
Jan Larsen 15
Informatics and Mathematical Modelling / Intelligent Signal Processing
Unsupervised LearningIdentification of structure, e.g. clustersCan be used as preprocessing in combination with supervised learningMethods– ICA– Probabilistic clustering using
RBF neural networks
Novelty detection –identification of new clustersHierarchical clustering
( | )up x w
Jan Larsen 16
Informatics and Mathematical Modelling / Intelligent Signal Processing
NeuroscienceAnalysis of EEG, PET, MRI, fMRI imagesLyngby ToolboxWeb repository hendrix.imm.dtu.dk
Programs: CBRC, HBP, EU-BIOMED II, EU-TMR, EU, Res.Counc., INC, NIH
Jan Larsen 17
Informatics and Mathematical Modelling / Intelligent Signal Processing
MultimediaAdaptive tools for sharedvirtual environmentsReal time multi-modal communicationTools for intelligent mobile phones (CDMA)Sound processingWebmining(content,structure,usage)
Programs: Center for Multimedia, DMM
Jan Larsen 18
Informatics and Mathematical Modelling / Intelligent Signal Processing
Humanitarian DeminingHumanitarian Demining Lab (Ørsted•DTU,IMM,FOFT)– Detection and clearance of
mines– Quality control and clearance
validation– Socio-economical decision
support systems– Resource management systems
Nordic Demining Research ForumNew EU 6FP EoIs
Jan Larsen 19
Informatics and Mathematical Modelling / Intelligent Signal Processing
Monitor SystemsSupervision and fault-diagnosis of marine enginesNeural optimization of pulse plating in print circuit boardsMonitoring of power distribution networksMulti-channel adaptive analysis of revolving machinesAdaptation of mobile base station filters
Program: AE-WATT
Jan Larsen 20
Informatics and Mathematical Modelling / Intelligent Signal Processing
BiomedicalSun exposure modelingSkin cancer diagnosisBioinformatics
5001000150020002500300035000.01
0.015
0.02
0.025
0.03
0.035
0.04
0.045
A B
B
C
DE
F
G
Sensitivity
wavenumber/cm-1
Program: Signal and Image Processing for Telemedicine