integrating rabbitmq with php

Integrating RabbitMQ with PHP

Álvaro Videla

June 2010 - IPC Spring Edition - Berlin

Wednesday, June 2, 2010

About Me

• Lead Developer at TheNetCircle.com

• Writing “RabbitMQ in Action” for Manning

• Twitter: @old_sound

• Blog: http://obvioushints.blogspot.com/


http://twitter.com/old_sound


http://obvioushints.blogspot.com

http://obvioushints.blogspot.com

The Interoperability

Problem


The Problem

MoviePublisher


The Problem

NewMovie

MoviePublisher


The ProblemWebService

XMLJava

NewMovie

MoviePublisher



XML

Image ThumbnailGenerator

C++

Java

NewMovie

MoviePublisher



XML


PHP CacheGenerator

C++

PHP

Java

NewMovie

MoviePublisher



XML


PHP CacheGenerator

StaticHTML

Publisher

C++

PHP

PHP

Java

NewMovie

MoviePublisher



XML


PHP CacheGenerator

StaticHTML

Publisher

C++

PHP

PHP

Java

TrailersGenerator

C++

NewMovie

MoviePublisher


SYSTEMSThe ProblemWebService

XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher



XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher

Written In Different Languages



XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher


Different Operating Systems



XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher



Written By Different People



XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher




They Need To Share Information



XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher





They Need Real Time Data



XML


PHP CacheGenerator

TrailersGenerator

StaticHTML

Publisher





They Need Real Time Data

They Need To Scale


Is There a Solution?


AMQPand

RabbitMQ


AMQP

• Advanced Message Queuing Protocol

• Suits Interoperability

• Completely Open Protocol

• Binary Protocol

• AMQP Model

• AMQP Wire Format


AMQP Model

• Exchanges

• Message Queues

• Bindings

• Rules for binding them


AMQP Wire Protocol

• Functional Layer

• Transport Layer


Message Flow

http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_MRG/1.0/html/Messaging_Tutorial/chap-Messaging_Tutorial-Initial_Concepts.html




Exchange Types

• Fanout

• Direct

• Topic


Default Exchanges

• amqp.fanout

• amqp.direct

• amqp.topic


http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_MRG/1.0/html/Messaging_Tutorial/sect-Messaging_Tutorial-Initial_Concepts-Fanout_Exchange.html






http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_MRG/1.0/html/Messaging_Tutorial/sect-Messaging_Tutorial-Initial_Concepts-Direct_Exchange.html






http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_MRG/1.0/html/Messaging_Tutorial/sect-Messaging_Tutorial-Initial_Concepts-Topic_Exchange.html






Sample usage


Sample Usage II


Other Advantages

• Fire and Forget

• Stop/Start consumers safely (no need for last processed id)

• No need for Cronjobs locks

• Load Distribution

• Transactions


RabbitMQ


RabbitMQ

• Enterprise Messaging System

• Open Source MPL

• Written in Erlang/OTP

• Commercial Support


Features

• Reliable and High Scalable

• Easy To install

• Easy To Cluster

• Runs on: Windows, Solaris, Linux, OSX

• AMQP 0.8


Client Libraries

• Java

• .NET/C#

• Erlang

• Ruby, Python, PHP, Perl, AS3, Lisp, Scala


Docs/Support

• http://www.rabbitmq.com/documentation.html

• http://dev.rabbitmq.com/wiki/

• #rabbitmq at irc.freenode.net

• http://www.rabbitmq.com/email-archive.html


http://www.rabbitmq.com/documentation.html

http://www.rabbitmq.com/documentation.html

http://dev.rabbitmq.com/wiki/

http://dev.rabbitmq.com/wiki/

http://www.rabbitmq.com/email-archive.html

http://www.rabbitmq.com/email-archive.html

Our Setup:

Publishers - 28 PHP Frontend Machines

2 PHP Machinesrunning 24 consumers each


Our Setup

• Deployed in mid 2009

• Reduced site SPOF

• 500.000+ messages routed a day (and increasing)

• Very easy to install/deploy


Easy To Install?


Easy To Install?

http://gist.github.com/334219




PHP Integration

• http://code.google.com/p/php-amqplib/

• http://code.google.com/p/php-amqp/

• http://code.google.com/p/php-rabbit/


http://code.google.com/p/php-amqplib/updates/list

http://code.google.com/p/php-amqplib/updates/list

http://code.google.com/p/php-amqp/

http://code.google.com/p/php-amqp/

Show me the code!


RabbitMQ “Hello World!”


AMQP Producer


AMQP Consumer


RabbitMQ RPC Example


RPC Client


RPC Server


Resources:

• http://www.rabbitmq.com/

• https://www.amqp.org/confluence/display/AMQP/About+AMQP

• http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_MRG/1.0/html/Messaging_Tutorial/index.html

• http://wso2.org/library/articles/using-axis2-c-amqp-transport-part-i

• http://www.skaag.net/2010/03/12/rabbitmq-for-beginners/

• http://github.com/bkw/php-amqp


http://www.rabbitmq.com

http://www.rabbitmq.com

https://www.amqp.org/confluence/display/AMQP/About+AMQP

https://www.amqp.org/confluence/display/AMQP/About+AMQP

http://www.redhat.com/docs/en-US/Red_Hat_Enterprise_MRG/1.0/html/Messaging_Tutorial/index.html




http://wso2.org/library/articles/using-axis2-c-amqp-transport-part-i

http://wso2.org/library/articles/using-axis2-c-amqp-transport-part-i

http://www.skaag.net/2010/03/12/rabbitmq-for-beginners/

http://www.skaag.net/2010/03/12/rabbitmq-for-beginners/

http://github.com/careo/rabbitmq-erlang-client-examples

http://github.com/careo/rabbitmq-erlang-client-examples

Questions?


Thanks!Alvaro Videla


http://www.slideshare.net/old_sound






integrating rabbitmq with php

Technology

problem java webservicexmlc

interoperability problem

fanout amqp

direct amqp

osx amqp

docssupport http

php machinesrunning

default exchanges amqp