Specialized systems are

Inevitable

Already the norm

Practical

Heterogeneous parallelism

4

Virtual Worlds Personal RoboticsData

informaticsScientific

EngineeringApplications

Heterogeneous

Hardware

New Arch.

Programming Heterogeneous Parallelism

MPIHadoop

VerilogVHDL

CUDAOpenCL

ThreadsOpenMP

Architecture Specific Programming Models

High Performance But Low Productivity

Virtual Worlds Personal RoboticsData

informaticsScientific

EngineeringApplications

Heterogeneous

Hardware

New Arch.

Scala Jav

aPython

Ruby

C++ Clojur

e

Not enough semantic knowledge to compile

automatically

No restrictions

General-Purpose Languages

Make Specialized PL Practical

Inevitable

Already the norm

Practical

Domain Specific Languages Domain Specific Languages (DSLs)

Programming language with restricted expressiveness for a particular domain

High-level, usually declarative, and deterministic

Most popular parallel PL

Most Science apps start with this PL

Enabled GPU innovation

Virtual Worlds Personal RoboticsData

informaticsScientific

Engineering

Physics(Liszt)

Data Analytics (OptiQL)

Graph Alg.(Green Marl)

Machine Learning(OptiML)

Statistics(R)

Applications

Domain- Specific

Languages

Heterogeneous

Hardware

DSLCompiler

DSLCompiler

DSLCompiler

DSLCompiler

DSLCompiler

New Arch.

High Performance Domain-Specific Languages

HP DSLs Will Be Practical

Embedded DSLsFlexible embedding languages: Scala, F#

Metaprogramming (aka staging)

Blurring line between libraries and languages

DSL FrameworksSupport domain specific optimizations

Support parallelism and locality optimizations

Multiple backends

e.g. Spoofax, Rose, Delite, Terra/Lua