tdc: intel perceptual computing sdk
DESCRIPTION
Apresentação do Intel Perceptual Computing SDK, que permite que os desenvolvedores criar aplicações que percebam as ações do usuário e proporcionem interfaces naturais, intuitivas e imersivasTRANSCRIPT
![Page 1: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/1.jpg)
Intel Perceptual Computing SDK
Felipe Pedroso
![Page 2: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/2.jpg)
22Software and Services Group
Felipe Pedroso
• Gerente da Comunidade de Ultrabooks/Windows no grupo de Software da Intel
• Nascido em Sorocaba/SP
• Formado em Engenharia da Computação na FACENS
• Desenvolvedor nas horas vagas (se é que elas existem...)
• Gosta de C, C++, C#, Java, Python, HTML5, Férias ou qualquer coisa que seja programavel.
![Page 3: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/3.jpg)
33Software and Services Group
O que é Perceptual Computing?
![Page 4: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/4.jpg)
44Software and Services Group
• Forma de interação homem-máquina−Ações do usuário são sentidas/percebidas
−Proporciona uma interface natural, imersiva e intuitiva
• Como prover essa interface?−Gestos com as mãos/dedos
−Rastreamento/Análise da face
−Reconhecimento de voz
−Realidade aumentada
O que é Perceptual Computing?
![Page 5: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/5.jpg)
55Software and Services Group
![Page 6: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/6.jpg)
66Software and Services Group
• Biblioteca de detecção de padrões e implementações de algoritmos de reconhecimento (áudio e imagem)
• Muda o foco do desenvolvedor na implementação dos algoritmos para inovações no desenvolvimento das aplicações
• Flexibilidade: Permite trabalhar em alto e baixo nível
• Extensível: permite a adição de novos modos de utilização
• Aceleração de Hardware em plataformas da Intel®
Intel Perceptual Computing SDK
![Page 7: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/7.jpg)
77Software and Services Group
Casos de uso
•Interface de Usuário Interativa
•Jogos
•Segurança
•Realidade Aumentada
•Auxílio a portadores de deficiência
![Page 8: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/8.jpg)
88Software and Services Group
O que usar para desenvolver?
•Linguagens−C++
−C#
−Java
•Frameworks−Unity3D
−Processing
−openFrameworks
![Page 9: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/9.jpg)
99Software and Services Group
Creative* Camera•Captura de imagem HD (720p)
•Sensor de profundidade
•Array de dois microfones
•Alimentação USB (<2.5W)
•Drivers para Windows 7 e Windows 8 (Desktop)
![Page 10: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/10.jpg)
1010Software and Services Group
Câmeras Integradas aos Ultrabooks!
![Page 11: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/11.jpg)
1111Software and Services Group
• 8-bit RGB in RGBA/RGB24/NV12/YUY2−Creative* camera supports up to 1280x720
• 16-bit depthmap, confidence map and vertices.−Creative camera supports up to QVGA (320x240)
−Depthmap smoothing by default
Captura de Imagem
![Page 12: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/12.jpg)
1212Software and Services Group
•Rastreamento dos “nós”−7 pontos: pontas dos dedos, centro da palma e punho
•Gestos e poses padronizadas−Poses: positivo/negativo, paz
−Gestos: swype, círculo, aceno e High-5
Rastreamento de dedos
![Page 13: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/13.jpg)
1313Software and Services Group
• Detecção/rastreamento de múltiplas faces
• Detecção de 7 pontos de referência: olhos, nariz e boca
• Reconhecimento: semelhanças entre um conjunto de faces
• Detecção de atributos: faixa etária, sexo, sorriso e abertura dos olhos (em desenvolvimento)
Rastreamento e Análise de Faces
![Page 14: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/14.jpg)
1414Software and Services Group
• Desenvolvido pela empresa Nuance
• Reconhecimento de comandos pré-definidos
• Ditado
• Sintetização de frases curtas
Reconhecimento e Síntese de Voz
![Page 15: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/15.jpg)
1515Software and Services Group
• Rastreamento de superfícies planas 2D−Posição e orientação
• Rastreamento de objetos 3D−Baseado em modelos 3D
• Orientação de faces
Rastreamento de objetos 2D/3D
![Page 16: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/16.jpg)
1616Software and Services Group
• Informa ao usuário final toda vez que alguma aplicação ativa a câmera
Notificação de privacidade
![Page 17: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/17.jpg)
1717Software and Services Group
Arquitetura
![Page 18: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/18.jpg)
1818Software and Services Group
Hello World
C++class MyPipeline: public UtilPipeline {
public:
MyPipeline(void):UtilPipeline() {
EnableGesture();
}
virtual void PXCAPI OnGesture
(PXCGesture::Gesture *data) {
printf_s(“%d\n”,data->label);
}
};
int wmain(int argc, WCHAR* argv[]) {
MyPipeline pipeline;
pipeline.LoopFrames();
return 0;
}
C#class MyPipeline: UtilMPipeline {
public MyPipeline():base() {
EnableGesture();
}
public override void OnGesture
(ref PXCMGesture.Gesture data) {
Console.WriteLn(data.label);
}
};
class Program {
static void Main(string[] args) {
MyPipeline pipeline=new MyPipeline();
pipeline.LoopFrames();
pipeline.Dispose();
}
}
![Page 19: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/19.jpg)
1919Software and Services Group
Demos
![Page 20: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/20.jpg)
Mas como conseguir uma câmera?
![Page 21: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/21.jpg)
2121Software and Services Group
Programa de Parcerias: Intel + Smyowl
Mais informações sobre parcerias: http://software.intel.com/pt-br/partner-home
![Page 22: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/22.jpg)
2222Software and Services Group
Para desenvolvedores
• Participar ativamente do IDZ :−Apresentar uma proposta de um bom projeto
−Se comprometer a escrever artigos técnicos com a câmera em mãos
−Depende da disponibilidade e do comprometimento do desenvolvedor
• Comprar a câmera: www.intel.com/software/perceptual−149 dólares (+ impostos)
−Entrega no Brasil
• Ou…
![Page 23: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/23.jpg)
2323Software and Services Group
… Perceptual Challenge Brasil!!!
Saiba mais em: http://software.intel.com/perceptualchallengebrasil
![Page 24: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/24.jpg)
Hands-on: Perceptual Tetris!
![Page 25: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/25.jpg)
Dúvidas?
![Page 26: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/26.jpg)
2626Software and Services Group
http://software.intel.com/pt-br/
Quer saber mais?
![Page 27: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/27.jpg)
2727Software and Services Group
Comunidade Ultrabooks/Windows
![Page 28: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/28.jpg)
2828Software and Services Group
http://software.intel.com/pt-br/
https://www.facebook.com/intelswbrasil
Contatos
Felipe Pedroso
@felipeapedroso
Muito Obrigado!
![Page 29: TDC: Intel Perceptual Computing SDK](https://reader033.vdocuments.net/reader033/viewer/2022061206/5482577cb07959570c8b4768/html5/thumbnails/29.jpg)
2929Software and Services Group
• Intel Perceptual Computing SDK−http://intel.com/software/perceptual
• Documentação−http://software.intel.com/sites/landingpage/perceptual_computing/
documentation/html/
• Guia sobre a interface−http://download-software.intel.com/sites/default/files/article/32594
6/perc-humaninterfaceguidelines.pdf
Referências