Introduction to ZeroMQ

Introduction to ZeroMQ

Howard Lee2013/05/16

113年5月17⽇日星期五

AnnounceØMQ, ZeroMQ, and 0MQ used in this slides are trademarks of iMatix Corporation

ØMQ is copyright (c) Copyright (c) 2007-2012 iMatix Corporation and Contributors. ØMQ is free software licensed under the LGPL.

Above statements are referred from footer of its website


Outline

Concept

Demo

Reference


If you have known these, you will know what I say

Java, Ruby

Network programming

Multithread

Background knowledge


Online chat room is a basic program for beginner of network programming


How do you do when building a program of online chat-room for multi-players?


Centralize-type Server

Client

ClientClient


Good

What if the server broken......?


-- Howard Lee said :p2013.05.16

Everything is important means nothing is important


Everyone is a server means no one is a server


Client

ClientClient De-centralize


Previous page about de-centralize use many sockets

More sockets grow exponential when a client joins!


Here is


Apply scenarios above pages

It can do more!

We only pick up above two scenarios at today’s lightning session


Actor model

De-centralize --> zero broker

Distributed computing

Concept


Actor model in ZeroMQ

REQuest-REPly

PUBlish-SUBcribe

Pipeline


Actor model in ZeroMQ

One machine can play many actors simultaneously

Better scalability than data-centric distributed computing because easier to extend


REQuest-REPly

Reference:https://github.com/imatix/zguide/raw/master/images/fig2.png

After successfully connected,REQ and REP can start to act like

pin-pong


https://github.com/imatix/zguide/raw/master/images/fig2.png




REQuest-REPlyOnly suite for demonstrating simple program of network chatting room to your TA with limited condition: pin-pong action. lol

You can design your own transmit strategy when speed of network aren’t stable for your file-transfer application according the time of response-received from other side.


PUBlish-SUBscribePublisher

PUB

SUBSubscriber

bind

Connect Connect

SUBSubscriber

SUBSubscriber

Connect

update


PUBlish-SUBscribe

Scenario: News feeds

Must explicitly assign subscribe condition: zmq_setsockopt

Auto delivered if they are connected successfully


PipelineAlways synchronize workers to start

load balancing from vent. to worker

fair-queuing: Sink collect data from workers

Reference: https://github.com/imatix/zguide/raw/master/images/fig5.png






Pipeline scenarios

Supercomputing

Wireless sensor network

...etc


Dealer

enhanced REQ

no restrict behaviors of send and receive

Router

Prepend identity of originator to message before passing it to another application


Example of Router and Dealer

Reference: https://github.com/imatix/zguide/raw/master/images/fig17.png


More actors model

Router

Dealer

Push

Pull

Pair

I won’t explain details today


Features2713年5月17⽇日星期五

De-centralized

Reference:https://github.com/imatix/zguide/raw/master/images/fig8.png






DistributedScalability


DistributedScalability


Sockets

IPC

Thread communication

TCP

Multicast

...etc


ZeroMQ CentralizedServer - REPly

Client - REQuest

Client - REQuest


AUto reconnect

First, clients issue request of connection

Later, server binds a port to reply the requests from clients

Centralize


AUto reconnect

First, clients issue request of connection

Later, server binds a port to reply the requests from clients

CentralizeStrange!

Not conventional


Demo


Code of REQ-REP

hwserver.rb

hwclient.rb


Demo REQ-REP


Code of PUB-SUB

wuserver.rb wuclient.rb


Demo PUB-SUB


Demo

Pipeline

taskvent.rb

taskwork.rb

tasksink.rb


More examples are here

https://github.com/imatix/zguide/tree/master/examples/






2011 SERN CERN comment ZeroMQ and other frameworks, which based on COBRA

http://www.zeromq.org/local--files/intro:read-the-manual/Middleware%20Trends%20and%20Market

%20Leaders%202011.pdf


http://www.zeromq.org/local--files/intro:read-the-manual/Middleware%20Trends%20and%20Market%20Leaders%202011.pdf






Reference

Implementing Distributed Application using ZeroMQ http://www.slideshare.net/fcrippa/europycon2011-implementing-distributed-application-using-zeromq

Multithread magic http://www.slideshare.net/pieterh/fosdem-2011-0mq


http://www.slideshare.net/fcrippa/europycon2011-implementing-distributed-application-using-zeromq






http://www.slideshare.net/pieterh/fosdem-2011-0mq






Reference

Overview of ZeroMQ http://www.slideshare.net/pieterh/overview-of-zeromq


http://www.slideshare.net/pieterh/overview-of-zeromq






Question?


Multi-players chat room?

Leave it to you :p


FAQ

Get peer list?

No


Notice

These slides has presented in micro session CNA@CCU 2013

If I forgot to give a credit to you via referring your content, I will append it to reference page as soon as you notify me about that. :)


Education

Introduction to ZeroMQ