Upload File

integration ii prediction. kernel-based data integration svms and the kernel “trick”...

  • Home
  • Documents
  • Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction
23
Integration II Prediction

Upload: barry-mcbride

Post on 12-Jan-2016

225 views

Category:

Documents


0 download

Report

Tags:

TRANSCRIPT

Page 1: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Integration II

Prediction

Page 2: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data integration

• SVMs and the kernel “trick”• Multiple-kernel learning• Applications– Protein function prediction– Clinical prognosis

Page 3: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

These are expression measurements from two genes for two populations(cancer types)

The goal is to define a cancer type classifier...

[Noble, Nat. Biotechnology, 2006]

Page 4: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

These are expression measurements from two genes for two populations(cancer types)

The goal is to define a cancer type classifier...

One type of classifier is a “hyper-plane”that separates measurements fromtwo cancer types

[Noble, Nat. Biotechnology, 2006]

Page 5: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

These are expression measurements from two genes for two populations(cancer types)

The goal is to define a cancer type classifier...

One type of classifier is a “hyper-plane”that separates measurements fromtwo cancer types

E.g.: a one-dimensional hyper-plane

[Noble, Nat. Biotechnology, 2006]

Page 6: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

These are expression measurements from two genes for two populations(cancer types)

The goal is to define a cancer type classifier...

One type of classifier is a “hyper-plane”that separates measurements fromtwo cancer types

E.g.: a two-dimensional hyper-plane

[Noble, Nat. Biotechnology, 2006]

Page 7: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

Suppose that measurements are separable:there exists a hyperplane thatseparates two types

Then there are an infinite number ofseparating hyperplanes

Which to use?

[Noble, Nat. Biotechnology, 2006]

Page 8: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

Suppose that measurements are separable:there exists a hyperplane thatseparates two types

Then there are an infinite number ofseparating hyperplanes

Which to use?

The maximum-margin hyperplane

Equivalently: minimizer of

[Noble, Nat. Biotechnology, 2006]

Page 9: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

Which hyper-plane to use?

In reality: minimizer of trade-off between1. classification error, and2. margin size

loss penalty

Page 10: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

This is the primal problem

This is the dual problem

Page 11: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

What is K?

The kernel matrix:each entry is sample inner productone interpretation: sample similaritymeasurements completely described by K

Page 12: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

Implication:Non-linearity is obtained byappropriately defining kernelmatrix K

E.g. quadratic kernel:

Page 13: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

SVMs

Another implication:No need for measurement vectorsall that is required is similarity between samples

E.g. string kernels

Page 14: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Protein Structure PredictionProtein structure

Protein sequence

Sequence similarity

Page 15: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Protein Structure Prediction

Page 16: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

Core idea: use different kernels for different genomic data sources a linear combination of kernel matrices is a kernel (under certain conditions)

Page 17: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

Kernel to use in prediction:

Page 18: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

In general, the task is to estimateSVM function along withcoefficients of the kernelmatrix combination

This is a type of well-studiedoptimization problem(semi-definite program)

Page 19: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

Page 20: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

Page 21: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

Same idea applied to cancer classification from expression and proteomic data

Page 22: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion

• Prostate cancer dataset– 55 samples– Expression from microarray– Copy number variants

• Outcomes predicted:– Grade, stage, metastasis, recurrence

Page 23: Integration II Prediction. Kernel-based data integration SVMs and the kernel “trick” Multiple-kernel learning Applications – Protein function prediction

Kernel-based data fusion


Network integration and function prediction: Putting it all together

Integration of Pavement Cracking Prediction Model with ... · Integration of Pavement Cracking Prediction Model with Asset ... 14 Table 3.2 MEPDG ... forms of deterioration begin

Interaction networks - Prediction, data integration and text mining

Prediction of protein networks through data integration

Comparison and integration of deleteriousness prediction methods

Optimization Algorithm with Kernel PCA to Support …...Optimization Algorithm with Kernel PCA to Support Vector Machines for Time Series Prediction Qisong Chen College of Computer

Transfer String Kernel for Cross-Context Sequence Specific ... · 10/6/2016  · Transfer String Kernel for Cross-Context Sequence Specific DNA-Protein Binding Prediction by Ritambhara

kernel methods for land cover classification and prediction

Kernel based approaches in drug target interaction prediction

Kernel density estimation-based real-time prediction …druan.bol.ucla.edu/papers/files/jour/ruan_09_kde.pdfKernel density estimation-based real-time prediction for respiratory motion

Initial Integration of Noise Prediction Tools for Acoustic

KELM-CPPpred: Kernel Extreme Learning Machine Based ...sairam.people.iitgn.ac.in/manuscript-KELM-CPPpred.pdf · KELM-CPPpred: Kernel Extreme Learning Machine Based Prediction Model

Neural integration of stimulus history underlies prediction for ......2018/01/08  · í í Neural integration of stimulus history underlies prediction for naturalistically î evolving

Build Failure Prediction in Continuous Integration Workflows

Time-Accuracy Tradeo s in Kernel Prediction: Controlling

Integration of Seismic Inversion, Pore Pressure Prediction, and TOC Prediction in Preliminary Study of Shale Gas Exploration

Integration of Neonatal Mortality Prediction Models into a … … · Integration of Neonatal Mortality Prediction Models into a Clinical Decision Support System by Hasmik Martirosyan,

"Biomolecular annotation prediction through information integration" - Davide Chicco (PoliMi) @ CIBB 2011

ICML2013読み会 Local Deep Kernel Learning for Efficient Non-linear SVM Prediction

Fractional integration and interval prediction

Guide to Kernel Driver Integration in Android for Huawei ... · PDF fileGuide to Kernel Driver Integration in Android for Huawei Modules ... To enable this feature, ... Guide to Kernel

Accent: A communication oriented network operating system kernel ·  · 2008-02-01The integration of virtual memory support, file ... Even though the IPC facility of the Accent kernel

Free and Open Source Software at CERN: Integration of ... · Free and Open Source Software at CERN: Integration of Drivers in The Linux Kernel ... acceptance in the Linux kernel main

Multiple kernel learning applied to the integration of Tara oceans datasets

Highly Accurate Cancer Phenotype Prediction with AKLIMATE ... · 7/15/2020  · Highly Accurate Cancer Phenotype Prediction with AKLIMATE, a Stacked Kernel Learner Integrating Multimodal

Storm Surge Prediction with Integration of Physical …...Department of Homeland Security Summer Research Team Final Faculty Report 2020 3 Storm Surge Prediction with Integration of

INTEGRATION BY PARTS FOR HEAT KERNEL MEASURES REVISITED · INTEGRATION BY PARTS FOR HEAT KERNEL MEASURES 705 In order to explain the relationship of Eq. (1.1) to the current literature

Prediction of protein-small molecule networks through large-scale data integration

Computer Architecture: A Constructive Approach Branch Direction Prediction – Pipeline Integration

Drag and Lift Prediction Based on a Wake Integration

Integration by Parts and Quasi-Invariance for Heat Kernel ...bdriver//DRIVER/Papers/Drivers_Papers/A19a-… · motion’’ and the heat kernel measures are time t, t>0, distributions

Protein Functional Site Prediction Using the Shortest-Path Graph Kernel Method

Guide to Kernel Driver Integration in Android for Huawei ... · Huawei LTE, WCDMA and CDMA Modules [1]: ... Huawei Modules Overview ... Guide to Kernel Driver Integration in Android

Cross-Version Defect Prediction via Hybrid Active …csxluo/CVDPSANER18.pdfTitle Cross-Version Defect Prediction via Hybrid Active Learning with Kernel Principal Component Analysis

A Filtering Laplace Transform Integration Scheme For Numerical Weather Prediction