Eclipse Mosquitto (Posts about Solutions)

Authentication plugins

Mosquitto Project — Thu, 18 Jul 2013 21:27:45 GMT

There has been some interest in authentication plugins for mosquitto recently. Some examples have appeared:

Authentication based on md5 hashes: mosquitto_auth_plugin_md5

Authentication based on md5 hashed passwords in postgresql: mosquitto_auth_plugin_pg_md5

Authentication and topic ACL with redis and a PBKDF2 hash: mosquitto-redis-auth

I particularly like the redis based plugin for the interesting additions like the "superuser" that is exempt from ACL checks.

If you've written an auth plugin and think it might be useful to others, let me know.

libmosquitto Go bindings

Mosquitto Project — Mon, 24 Dec 2012 00:18:18 GMT

I just discovered that Shane Hanna has written a Go language binding for libmosquitto available at https://bitbucket.org/shanehanna/mosquitto/. Good work Shane! Note that the readme file states:

Doesn't expose all of libmosquitto, just what I've needed so far.

so you shouldn't necessarily expect everything to work.

Making Mosquitto packages for Debian yourself

Mosquitto Project — Tue, 27 Nov 2012 16:26:41 GMT

As Debian has been in feature freeze since before Mosquitto 1.0 was released, it will be a long time until there is an updated version of Mosquitto in Debian. It is, however, fairly straightforward to do the packaging yourself. Here's how to do that from the command line.

Download and unpack the mosquitto source tarball:

wget http://mosquitto.org/files/source/mosquitto-1.1.2.tar.gz
tar -zxf mosquitto-1.1.2.tar.gz

Rename the tarball to match Debian requirements:

mv mosquitto-1.1.2.tar.gz mosquitto_1.1.2.orig.tar.gz

The current mosquitto packaging files are available at https://packages.debian.org/source/stable/mosquitto - you want the .debian.tar.xz.

The next step is to build the package, but you may find that you need to install some packages first:

sudo apt-get install build-essential python quilt libwrap0-dev libssl-dev devscripts python-setuptools

To build the packages do

cd mosquitto-1.1.2/
debuild

You should now have a list of .deb files in the parent directory which you can install with:

sudo dpkg -i &lt;deb file&gt;

Please leave comments if you find this useful or have any problems.

Python client module available for testing

Mosquitto Project — Mon, 07 May 2012 00:17:57 GMT

As part of the ongoing work on mosquitto 0.16, the libmosquitto C client library has been ported to Python. It provides complete MQTTv3.1 support and will eventually remove the need for the current Python wrapper around the C library and will allow it to be used more easily and in more situations.

The interface is largely the same as the existing Python wrapper. The differences are that it uses the current development interface which differs slightly from that in 0.15 (see the Python documentation), not all of the new interface is implemented - there is no threading support and finally some datatypes may be more Python like (e.g. lists in on_subscribe() callback rather than an integer).

The conversion from ~4000 lines C to ~1000 lines Python took just two evenings and is now ready for testing. It is available in the 0.16 branch in the bitbucket repository, or as a single file at http://mosquitto.org/files/python/mosquitto.py

Please give it a try and report any bugs you find using any of the methods on the Support page.

Please note that the new Python module does not currently support Python 3.

Quick start guide for MQTT with Pachube/Cosm/Xively

Mosquitto Project — Sat, 10 Mar 2012 10:32:22 GMT

Pachube (now Cosm) has recently announced beta support for publishing and receiving data to their service using MQTT. This is great news and something I know that a lot of people have been hoping for. Well done Pachube!

Their documentation is at https://xively.com/dev/docs/api/communicating/mqtts/ and provides enough information to get going if you're already familiar with MQTT.

If you aren't familiar with MQTT, here's a few examples of how you can use the new service.

First off, I'm going to use the command line MQTT clients I've created to publish and receive data. You can get these clients as part of the mosquitto download.

Command Line Examples

Publishing Data

mosquitto_pub -h api.xively.com
              -u &lt;your xively api-key&gt;
              -t /v2/feeds/504.csv
              -m "0,29"

In this example we're connecting to host api.xively.com, using our xively api-key as the username, publishing to feed /v2/feeds/504 using the csv format and are updating datastream 0 with the value 29. Another way to achieve the same thing would be to do:

mosquitto_pub -h api.xively.com
              -u &lt;your xively api-key&gt;
              -t /v2/feeds/504/datastreams/0.csv
              -m 29

mosquitto_pub can read data from stdin and publish it, so on Unix type systems the following arrangement is possible:

sensor_read | mosquitto_pub -h api.xively.com
                            -u &lt;api-key&gt;
                            -t /v2/feeds/504/datastreams/0.csv
                            -l

The -l option reads messages from stdin, sending a separate message for each line. This means that our imaginary executable sensor_read that is reading data from a sensor must be printing each reading as a text line.

Retrieving Data

In the MQTT world, retrieving data is done through subscriptions:

mosquitto_sub -h api.xively.com
              -u &lt;api-key&gt;
              -t /v2/feeds/504/datastreams/0.csv

In this example, mosquitto_sub will print a text line containing the csv data for datastream 0 of feed 504 every time it is updated.

Last Will and Testament

The last will and testament or just "will" is a very nice feature of MQTT. When your client connects to the MQTT broker/server, it can give the broker this will, which consists of a topic and a message. If the client is disconnected from the broker unexpectedly, that is to say without sending a disconnect message, then the broker publishes the will message on the will topic.

This provides a very simple mechanism for client connection monitoring. When your client connects it could publish a message "1" to a topic. If it also set a will to send a message "0" to the same topic on unexpected disconnect, then it would be possible to determine whether that client was connected by monitoring the topic.

In the context of Xively, the same approach is possible, but using a trigger to indicate that the client had disconnected.

The mosquitto_sub client provides support for wills as shown in the example below:

mosquitto_sub -h api.xively.com
              -u &lt;api-key&gt;
              -t /v2/feeds/504/datastreams/0.csv
              --will-topic /v2/feeds/12345/datastreams/0.csv
              --will-payload "0"

In this example, the Xively broker would publish the value "0" to datastream 0 of feed 12345 if mosquitto_sub disconnects unexpectedly. This isn't the most useful example because of the limitations of what mosquitto_sub provides.

Writing Your Own Clients

In practice, to get the full benefit of the advantages that MQTT provides you will probably want to write your own MQTT client to connect to Xively for your specific application. The http://mqtt.org/software page lists client implementations for lots of different programming languages including the mosquitto client libraries in C/C++, libraries in Java, Python and also device specific implementations for Arduino and other low power devices.

MQTT Beyond Xively

The Xively offering is a slightly restricted MQTT offering. "Full" MQTT offers a bit more scope for doing fun things using topic wildcards for example, something that wouldn't really make sense for Xively.

There is an overview of MQTT at mqtt man page and examples of some applications at http://mosquitto.org/2012/01/do-you-use-mqtt/.

If you'd like to play on an MQTT broker, try looking at test.mosquitto.org.

If you want some help there are mailing lists and irc channels listed on http://mqtt.org/get-involved.

mqtt2pachube

Mosquitto Project — Mon, 06 Feb 2012 22:41:58 GMT

I've written a tool to help get data from mqtt to pachube. Existing pachube libraries offer good support for updating feeds that have a single datastream or updating all feeds in a datastream, but seem to offer limited support for updating an arbitrary datastream on its own. This can make life difficult when your data is coming in from sensors as individual messages.

mqtt2pachube allows you to choose what mqtt subscriptions to make and then match incoming messages by their topics to a pachube feed and datastream id.

At the moment it is still experimental, but seems to work. It has highlighted a shortcoming in the mosquitto client library, so requires version 0.15.90 (ie. the in-progress work for the next release). There is no Windows support for the moment and no binary packages either. If you are interested in giving it a try, you will have to compile it yourself. If you need help, please get in touch.

There are two examples of feeds created through mqtt2pachube using data from test.mosquitto.org

Challenge: Web based MQTT graphing

Mosquitto Project — Mon, 16 Jan 2012 12:21:06 GMT

Thanks to a data feed courtesy of an IBM broker, test.mosquitto.org now publishes information on energy generation and demand in the UK (in the energy/ topic tree). I think this could be used as a great demonstration for coupling MQTT and the web.

The challenge

Create a web based report that takes energy data from the broker over MQTT and displays it in interesting and useful ways. Alternatively, an Android/iPhone app would be ok, but web based is the preferred option.

The rules

There are no rules really. Having said that, I'd be most pleased if the end result was something that other people could learn from. There are bonus points for solutions that work where a web proxy is the only internet access. If you want to use new or unusual technologies that's fine.

The prize

I'm afraid there is no tangible prize - I hope you'll be content with your work being shown here and the respect of your peers.

Some suggestions

Google charts is definitely worth looking at for generating the actual graphs. Some examples of what you might show are:

Pie chart of generation source
Gauge of current mains frequency
Historical graph of electricity export amount

I look forward to any and all responses!

MQTT on Nanode

Mosquitto Project — Sat, 31 Dec 2011 11:07:48 GMT

Nanode, the popular arduino-with-ethernet board started early in 2011 is ideal for small MQTT based projects but has so far lacked an implementation of MQTT.

Nick O'Leary, the author of the original Arduino MQTT client, has created a Nanode implementation, but it isn't quite ready for the public.

Nicholas Humfrey has made public some code at https://github.com/njh/NanodeMQTT that he says still needs some work but supports publishing QoS 0 messages of up to 127 bytes long and subscribing to topics with QoS 0.

Wireshark MQTT decoder

Mosquitto Project — Tue, 05 Jul 2011 12:23:42 GMT

If you're trying to debug your MQTT connection, you may be interested in something Karl P has written - an MQTT decoder/dissector for Wireshark. It doesn't have complete protocol support yet, but is a good start.

http://false.ekta.is/2011/06/mqtt-dissector-decoder-for-wireshark/

MQTT Ontology

Mosquitto Project — Mon, 02 May 2011 22:11:43 GMT

Mark Hindess has written a blog post titled Home Automation Protocols: MQTT, where he asks for suggestions on how to go forward making "a specification for topic usage and semantics". I think this kind of work is really valuable to make it easy to have different MQTT systems that can interoperate. If you've got any suggestions you can make, please go and leave a comment there.