bring out the best in embedded computing

Bring Out the Best in Embedded Computing

Leon Farasati Staff Product Manager Qualcomm Technologies, Inc.


Modem

GPU

CPU

DSP

Position location

Multimedia Power

management RF

Software/ HLOS

Connectivity

Memory

The Smartphone integrated many mobile technologies

Source: GSMA Intelligence, Apr. ’14; UN, Apr. ’14


Looking beyond the CPU


A heterogeneous computing approach for mobile

Qualcomm Adreno, Qualcomm Gobi and Qualcomm RF360 are products of Qualcomm Technologies, Inc.

CPU Up to 2.3Ghz/core

Location Glonass, Beidou Satellites

Qualcomm® Adreno™ GPU Open GL ES 2.0/3.0

Open CL RenderScript

Display Processing 4k (external), 1080p, Miracast, picture enhancement

Bluetooth 4.0

ISP (Camera)

Dual ISPs@42Mpix

Digital Camera SW

USB 3.0, 5Gbps

Wi-Fi 802.11ac

Sensor Processing

Multimedia Processing

Audio Adv Voice Clarity Voice Activation

Gestures Studio Access Security

Memory 2MB L2 Cache

LPDDR2/3

Qualcomm® Gobi™ Modem

3G/4G Baseband Qualcomm® RF 360 front end

solution Transceiver

DSP Ultra Low Pwr


Applying mobile technologies to everything Making them more aware, connected, intelligent and interactive

Machines

Devices

Places

Objects

People


Why Qualcomm® Snapdragon™ processors for embedded computing? • Industry leading energy efficiency

− No fans, no noise

− Reduced thermal constraints rendering smaller industrial design

− Portability, mobility, battery operated

− Lower cost power supplies

• Feature rich, new capabilities − Industry leading CPU, GPU, DSP performance

− Rich multimedia capabilities

− Multiple HD cameras and microphone arrays

− Video / Audio / Graphics

− Multiple HD displays

− Sensors

− Wi-Fi, Bluetooth, location services

− Computer vision

Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.


Exposed board development platforms

DragonBoard™development kit is a powerful, feature-rich, versatile, and easy-to-use exposed board platform for component vendors, software and embedded developers. It consists of a comprehensive System on Module (SoM) with a Snapdragon processor, a mini-ITX carrier board and a peripheral kit.


DragonBoard A building block for innovation and development around Snapdragon

processors

HW component vendors Develop drivers on Snapdragon platform

Embedded customers Build product/project on Snapdragon platform

Communities Research & teach on Snapdragon platform

• Sensors • Memory • Display/touch • Camera • Projectors

• Robotics • Digital signage • Video surveillance • Medical/industrial • Government

SW technology vendors Port SW on Snapdragon platform

• Video • Audio • Graphics • Computer vision • Speech

DragonBoard development kit

DragonBoard based on

Snapdragon 800

Single Board Computer based on Snapdragon

600

• Universities • Makers • Linux developers • Research organizations • Startups/accelerators


Snapdragon based SoM for embedded applications

System on Module (SoM)

Carrier Board

Digital Signage

Video Surveillance

Ruggedized Handhelds

Robotics

Kiosks

High Tech Toys

Arcade Machine


Snapdragon for embedded computing enablement model

Embedded computing developers and

customers

Embedded solutions providers

Snapdragon application processor

Qualcomm Technologies, Inc.

Intrinsyc Technologies

InForce Computing

CE

Supp

ort

Des

ign

Serv

ices

/

Supp

ort


DragonBoard Development Kit based on Snapdragon 800 processor From Intrinsyc Technologies

• DragonBoard Development Kit from Intrinsyc Technologies is a powerful, feature-rich, versatile, and easy-to-use exposed board platform

• Includes the software tools and accessories required to immediately begin development work.

• The DragonBoard Development Kit: − Production ready Snapdragon-based SoM

− Carrier board

− Android OS pre-loaded

− Accessories kit

− Quick start guide

− Registered access to web site for SW Updates and extended technical documentation DragonBoard based on Snapdragon 800

Processor available via Intrinsyc

www.intrinsyc.com/products/qualcomm/dragonboard.aspx


• Carrier panel interfaces − 2 x USB 3.0 Type A, 2 x USB 2.0 Type A − Gigabit Ethernet, RS-232 − DC-IN Port − HDMI, DisplayPort outputs − 6-port audio jack & ANC 3.5mm headset jack − USB 2.0 OTG micro AB − 3 x optional SMA connectors

• Carrier board interfaces − Dual MIPI DSI + touch panel 60-pin connector − Additional MIPI CSI connector − 2 x SATA headers − ITX headers for USB, Audio, front panel switch,

LEDs, and power − JTAG header

DragonBoard Development Kit based on Snapdragon 800 processor From Intrinsyc Technologies

• Snapdragon 800 (APQ8074) processor − Open-Q Qseven SoM (System on Module)

− 2GB LPDDR3 RAM

− 16GB eMMC

− 2 x MIPI CSI connectors

• Wi-Fi 2.4GHz/5GHz, Bluetooth 4.1, GPS, NFC

• Audio expansion header w/ 6 digital MICs

• Far-field speaker connector

• Sensors expansion header

• Education expansion header

• Micro SD card slot

• Hard keys & indicating LEDs


Android development on DragonBoard

Android Apps

Application Libraries

Android SW Platform

Snapdragon Based Dev Kit

• Android user applications

− Vertical specific applications

− Differentiated user experiences

• Application libraries − Snapdragon SDKs & APIs

− Optimized for Snapdragon HW

• Android SW platform − Bootloader, Kernel & Drivers

− Android framework

− Android services

• Snapdragon based Development Kits − Hardware layer

− CPU, memory & peripherals


Android software platform

Android Apps


Android SW Platform

Exposed Board Dev Kit

• Two main sources: − Code Aurora Forum (CAF)

− Intrinsyc support site

• The CAF open source site: − Hosts the open source community for

Snapdragon processors

• Intrinsyc customer site: − Hosts Intrinsyc’s bootloader and

platform specific patches to support the DragonBoard Development Kit

− Hosts licenced firmware and HW acceleration libraries (DSP/Codecs/GPU/WLAN)


Building the Android software platform

• There are four major steps for building the Android software platform for the Development Kit: − Get open source for the processor

− Get platform specific patches, plus firmware libraries

− Build code

− Load image onto platform

• The process is documented in detail in release notes and Development Kit Programming Guide

1. Get Open Source SW for the processor

2. Get platform specific patches

3. Build code

4. Load image onto platform

Step by step overview



• Make sure that the build environment has been completely and correctly set up as described by the Android Open Source Project instructions: − http://source.android.com/source/download.html

• Download the kernel and Android framework code for the Snapdragon processor from CAF (codeaurora.org) using Repo:

− Example: repo init -u git: //codeaurora.org/platform/manifest.git -b ics_chocolate -m M8960AAAAANLYA1050.xml –repo-url=git://codeaurora.org/tools/repo.git

− repo sync

− The Wiki support site for Snapdragon chipsets can be found here: − https://www.codeaurora.org/xwiki/bin/QAEP/

1. Get open source SW for the processor


3. Build code


http://source.android.com/source/download.html

https://www.codeaurora.org/xwiki/bin/QAEP/



• Download the platform specific release from: http://dragonboardsupport.intrinsyc.com/ − manually download patches

− apply_patch.sh <workdir>

− include Qualcomm Lib in the build

− The Intrinsyc customer site contains more detail:

− The Dragonboard Development Kit Programming Guide



3. Build code


http://dragonboardsupport.intrinsyc.com/



• Build the source tree as follows: − cd <android-source-tree>

− $build/environmentsetup.sh

− $choosecombo 1 msm8960 eng

− $Make –j8

• Running “launch” with no arguments will prompt for Android build options and targets



3. Build code




• Fastboot is used to install an Android image from a development PC over USB using the Android Debug Bridge (ADB)

• The board will be pre-programmed with a bootloader and an Android image

• Each binary can also be flashed selectively through the following Fastboot command options:

− fastboot flash aboot <path to emmc_appsboot.mbn >

− fastboot flash boot <path to boot.img>

− fastboot flash system <path to system.img.ext4>

− fastboot flash userdata <path to userdata.img.ext4>

− or use flashall.sh



3. Build code



Application libraries

• Qualcomm Technologies, Inc. and its affiliates offer a variety of technologies to make it easier for developers to create applications based upon a host of next-generation technologies: − Technologies built for the Snapdragon

− Snapdragon SDK for Android

− Mobile gaming & graphics optimization (Adreno)

− Technologies tuned for Snapdragon − Augmented reality (Qualcomm® Vuforia™ mobile vision

platform)

− Computer vision (FastCV™ software development kit)

− Technologies enhanced for Snapdragon − Peer-to-peer (AllJoyn™ framework)

− Context aware (Gimbal)

− HTML5 mobile device APIs

Android Apps


Android SW Platform

Exposed Board Dev Kit

Qualcomm Vuforia is a product of Qualcomm Connected Experiences, Inc. FastCV is a product of Qualcomm Technologies, Inc. AllJoyn is a collaborative open source project of the AllSeen Alliance.


DragonBoard connects to “Thing” Hardware

Internet of Things (IoT) Development Kit Enabling smartphones & tablets to control “Things” via apps based on AllJoyn

• The IoT Development Kit includes an adapter board that connects to the DragonBoard Development Kit, extending the functionalities to Arduino shields or other accessories such as LEDs, motors etc.

• Users can then control them remotely from a smartphone or tablet via the AllJoyn service.

• The IoT Development Kit includes several sample applications with source code, and documentation to help users quickly assemble circuits and create their own applications.

AllJoyn-based application controls the DragonBoard-based “Thing”

Available via Intrinsyc Technologies at www.intrinsyc.com/iot


Single board computer based on Snapdragon 600 IFC6410 from Inforce Computing

• Snapdragon 600 Processor − Quad core Qualcomm® Krait™, 1.7GHz, 2MB L2 cache, Adreno 320 GPU

− 2GB Onboard PCDDR3

• Storage − uSD connector, SATA, 4GB eMMC

• Video, audio & I/O − uHDMI, LVDS, MIPI-CSI2

− HD Audio and mic-in

− 2x USB 2.0, 1xUSB OTG, Serial Console 3-pin header

− 1xI2C, 1xSPI, 1xUART, UIM, 8xGPIO

• Connectivity: − 802.11 b/g/n Wifi 2x2 + Bluetooth 4.0

− 10/100/1000 Ethernet

• Power/Mechanical: − Pico-ITX form factor (100mm x 70mm)

− +5V Input Socket (5A type)

IFC6410: Pico ITX form factor www.inforcecomputing.com/product/6400series.html

Qualcomm Krait is a product of Qualcomm Technologies, Inc.


Snapdragon 600 processor for embedded computing • Key benefits

− Superior energy efficiency

− Superior CPU & GPU performance

− Rich multimedia capabilities

− Programmable DSP

• Key features − Processor Subsystem

− Up to 1.7GHz quad core Krait 300

− 128bit SIMD Neon FPU

− 2MB L2 Cache

− Multimedia Subsystem − Adreno 320 GPU

− 1080p HD video multi-format encode and decode

− Feature-rich ISP with support for 3 cameras inputsup to 20MP with HW JPEG encode with

− Up to three concurrent displays WQXGA (2560 x 1600) 60Hz, MIPI/LVDS/HDMI with post processing

− 500MHZ Qualcomm® Hexagon™ DSP for low-power processing

− Connectivity − Expansion port support via PCIe 2.0

− Hard drive support via SATA

− GPS/GLONSS location support

− 802.11n 2x2 Wi-Fi and BT 4.0

Connectivity

PCIe 2.0 x1

SATA 1.0

USB HS w/ PHY x3

USB (UICC x1)

MIPI SLIMbus

MI2S (7.1 spkr / 5.1 mic)

I2S x2 in

I2S x2 out

PCM Audio

General Serial Bus Interface x7

UART

SPI I2C

UIM/SIM

HSIC

TSIF x2

GPIOs

GPU 2D/3D Adreno 320, 3200 Mpixels/sec

Memory Subsystem EBI0 32bit 533MHz EBI1 32bit 533MHz PCDDR3/LPDDR2

eMMC SD/MMC x3

Multimedia Subsystem

CPU Subsystem

Hexagon DSP 500MHz Voice/Audio processing

Video Processor Multi-format VideoCodecs 1080p30

Camera Subsystem ISP, 20Mp JPEG encode

MIPI CSI 4-lane/2-lane/1-lane

Mobile Display Processor Video/Display Post Processing

HDMI, LVDS, MIPI DSI 4-lane x2

Location Subsystem

GNSS Processor GPS/GLONASS

GNSS ADC

Wireless Connectivity Subsystem

WLAN/BT/FM WLAN DACs WLAN ADCs

Sensor Processor System

RPM Processor Security/Crypto

JTAG/Trace Thermal Sensors Clock Generators Watchdog timer

Sleep timer

128bit Neon

Krait

1.7GHz

2MB L2 Cache

128bit Neon

Krait

1.7GHz

128bit Neon

Krait

1.7GHz

128bit Neon

Krait

1.7GHz

Qualcomm Hexagon is a product of Qualcomm Technologies, Inc.


Linux enablement for Snapdragon processors

• Linaro Linux release for Snapdragon 600 processor based on Ubuntu 14.04 available now

− Capable of running the Gnome Shell desktop

− Powered by freedreno graphics driver − OpenGL 2.1

− Mesa 10.2.1

− XA support enabled

− 720p video playback Enabled

− Wi-Fi connectivity, Ethernet, SATA and USB support

• On the Linaro Roadmap:

− HW accelerated video decode and playback

− Camera, Bluetooth, MIPI and LVDS display, thermal management

− Upstream Kernel support

− Adreno driver (enables support for OpenGL 3.0, OpenCL and enhanced GPU performance)

• http://releases.linaro.org/14.05/ubuntu/ifc6410


Documentation Via registered docs & downloads site

• Development Kit Documentation − Quick start guide

− User guide

− Programming guide

− Release notes

• Chipset data sheet

• Chipset software interface guide (TRM)

• Software document set (app notes)

• Schematics & BOM

IFC6410: Single Board Computer based on Snapdragon 600 processor http://www.inforcecomputing.com/techweb

http://www.inforcecomputing.com/techweb


Introducing SBC based on Snapdragon 805 processor IFC6540 from Inforce Computing

• High performance Snapdragon SoC with robust multitasking capabilities − CPU: Up to 2.7GHz quad core Krait 450

− GPU: 9.6 Gpix/sec, OpenGL ES 3.1* + Google Extension Pack, decreased power consumption for UI and games

− Programmable Hexagon DSP at 600MHz for low-power processing

− Memory Bandwidth: 25.6-30GB/s Bandwidth (800/933MHz LPDDR3 memory)

• High quality mobile video, gaming, and camera experiences − New 420 GPU, support for Hollywood Quality Video™ (HQV) technology, hardware

HEVC decode, and enhanced Imaging

− Display: 4096x2160 primary DSI display + concurrent 4Kx2K@24Hz external

− Camera: ~1GPixel/s dual ISP with temporal noise reduction & HW post processing with support for up to 3 cameras up to 55MP

• Fast, seamless connected mobile experiences − WiFi: 2x2 .11ac WiFi support via QCA6174 with full bandwidth via PCIe

• Android 4.4 Board Support Package − Android 4.4 is currently available on the Snapdragon 805 SBC

Hollywood Quality Video is a product of Qualcomm Technologies, Inc.


myDragonBoard.org community support

Go to the website 1

Register 2

Get support and contribute 3


For more information on Qualcomm, visit us at: www.qualcomm.com & www.qualcomm.com/blog

©2013-2014 Qualcomm Technologies, Inc. and/or its affiliated companies. All Rights Reserved. Qualcomm, Adreno, Gobi, Snapdragon, DragonBoard, Vuforia, and Hexagon are trademarks of Qualcomm Incorporated, registered in the United States and other countries. Qualcomm RF360, Uplinq, FastCV, Krait, and Hollywood Quality Video are trademarks of Qualcomm Incorporated. All trademarks of Qualcomm Incorporated are used with permission. Other products and brand names may be trademarks or registered trademarks of their respective owners. References in this presentation to “Qualcomm” may mean Qualcomm Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries or business units within the Qualcomm corporate structure, as applicable. Qualcomm Incorporated includes Qualcomm’s licensing business, QTL, and the vast majority of its patent portfolio. Qualcomm Technologies, Inc., a wholly-owned subsidiary of Qualcomm Incorporated, operates, along with its subsidiaries, substantially all of Qualcomm’s engineering, research and development functions, and substantially all of its product and services businesses, including its semiconductor business, QCT.

Thank you FOLLOW US ON:

bring out the best in embedded computing

Technology

qualcomm snapdragon

qualcomm rf360

affiliated companies

mobile qualcomm adreno

mobile technologies

embedded developers

peripheral kit

development work