Awesome

Mqtt To Mqtt

Fully configurable Mqtt to Mqtt gateway.

Backend: NodeJS, Express, Mqttjs, Aedes Mqtt Broker, Webpack
Frontend: Vue, Vuetify

Why

There is almost an MQTT gateway for every protocol out there.

The problem is every gateway maps reads and writes in different ways depending on the protocol used. There isn't a standard way to map a protocol in MQTT topics and also there isn't a standard payload, some sends a JSON payload with different properties (like val or value or data for the value and tms time timestamp for the timestamp/date), others use a payload with just a numeric value.

This gateway inits an MQTT broker that sits between your MQTT gateways (or devices) and your broker to parse incoming/outgoing MQTT messages from/to your broker in the format you need.

Here is an example schema of how it works:

Diagram

Note here there are some bold text GET/SET from/to. More about them in docs

:electric_plug: Installation

# Clone repo
git clone https://github.com/robertsLando/

cd Mqtt2Mqtt

# install dependencies
npm install

# build for production with minification
npm run build

# Start the server
npm start

Usage

Once the app is running open the web browser to http://localhost:8100. Here you need to declare the Broker settings, Mqtt clients, the maps and (optionally) the values.

Broker settings

Used to set up the MQTT Broker. To edit settings click on the fab button in the bottom right corner

Port: The port where the broker will listen for incoming connections
Websocket: Enable this to enable MQTT over websockets
Websocket Port: The port where the websocket server will listen for incoming connections
Require auth: Enable this to enable broker authentication check
Username/Password: If auth is enabled insert here the username and the password to connect to this broker.
SSL: Enable this to enable SSL
Self-Signed Certs: When ssl is enabled, enable to allow self-signed certificates (used to set the flag rejectAnauthorized).
Auto-generate certs: When ssl is enabled, flag this to auto-generate certificates
Key.pem/Cert.pem: If auto-generate is disabled insert here the key and the certs files

MQTT Clients

Used to init a connection to an MQTT broker. To add a new client connection click on the fab button in the bottom right corner

Name: A unique name that identify the Client.
Host: The url to the broker
Port: Broker port
Reconnect period: Milliseconds between two reconnection tries
Store: Enable/Disable persistent storage of packets (QoS > 0). If disabled in memory storage will be used but all packets stored in memory are lost in case of shutdowns or unexpected errors.
Clean: Sets the clean flag when connecting to the broker
Auth: Enable this if broker requires auth. If so you need to enter also a valid username and password.
Maps Get: List of maps to use for value updates coming from other gateways to forward to your broker
Maps Set: List of maps to use for value writes coming from your broker to forward to the gateways.

Maps

Set of rules to use for incoming/outgoing packets. To add a new map click on the fab button in the bottom right corner

Name: A unique name that identify the map.
Custom Topic: Enable this to customize the topic
Use function: Enable this to use a JS function to map topic and payload. The function takes 2 args topic and payload and expects to return an object or an Array of objects like {topic: "theNewTopic", payload: "theNewPayload"}. If you return an Array of objects an MQTT message will be published for each Object in the Array using its payload and topic (qos, and retain flag are taken from map configuration). ATTENTION: Returned topic and payload must be string.

Example code to write inside the function:
```
var parts = topic.split('/');
var sensor = parts.pop();
var data = {}

data[sensor] = JSON.parse(payload).value;

return {topic: topic, payload: JSON.stringify(data)}
```
This function takes last topic level and uses it as a payload attribute and uses the payload value as value for that attribute.

Example that returns an Array.
```
var topic = topic.split('/');

topic[0] = "myPrefix";

topic = topic.join('/')
payload = JSON.parse(payload);

var res = []

for(const k in payload){
    var p = JSON.stringify({value: payload[k]})
    var t = topic + '/' + k
    res.push({topic: t, payload: p})
}

return res
```
This example maps an incoming MQTT payload with a JSON key/value object into one MQTT message for each key of the payload with value the key value and the topic with the prefix changed and the key as suffix

Example of map:

Topic: prefix/multisensor/foo

Payload: {"temp": 10, "air": 20, "pressure": 50}

Result:
- Topic: prefix/multisensor/foo/temp Payload: "{"value": 10}"
- Topic: prefix/multisensor/foo/air Payload: "{"value": 20}"
- Topic: prefix/multisensor/foo/pressure Payload: "{"value": 50}"
Code: If both custom Topic and Use functions flag are enabled this field will contain the JS code of the function used to map the topic
Wildecard From: The topic wildecard to use to identify packets that need to be parsed using this map.
Wildecard To: If custom wildecard is enabled this field is used to specify the wildecard to use to transform the original topic to the destination topic (more about this later).
From suffix: The suffix to add to the from wildecard. If a packet topic matches the wildecard but doesn't have this suffix it is discarded. This filed is needed because wildecards like prefix/#/suffix are not valid wildecards as after a # char the topic cannot have anything.
To suffix: The suffix to add to the destination topic after the wildecards conversion is done.
Retain: Sets the retain flag of the outgoing packet
QoS: Sets the QoS level of the outgoing packet
Payload: The type of payload conversion.
- Keep original: The payload is not changed
- Value --> JSON: The incoming payload is expected to be a raw value and I want to create a JSON object with a Value Property set to that value
- JSON --> Value: The incoming payload is expected to be a JSON Object and I want to send a raw value payload using Value Property of original payload
- JSON --> JSON: The incoming payload is expected to be a JSON Object and I want to map properties to another JSON object. If this option is choosed I will need to add a set of property From and To
Add timestamp: Can be used when destination payload is a JSON object, if enabled I can add a time property (the name of the prioperty needs to be specified in Time property) to outgoing packets and the value will be Date.now(), the timestamp when the original packet is received.

Examples

Wildecards

Topic From	Wildecard From	Wildecard To	Topic To
a/b/c/d/e	a/b/#	myprefix/#	myprefix/c/d/e
a/b/c/d/e	+/b/+/d/e	myprefix/+/+	myprefix/a/c
a/b/c/d/e	+/b/#	+/my/#	a/my/c/d/e

Payload

Payload: Value --> JSON
Value Property: "myvalue"

25 ---> { "myvalue": 25}

Payload: JSON --> Value
Value Property: "myvalue"

{ "myvalue": 25} ---> 25

Payload: JSON --> JSON
Paylod JSON:

From To
val value
tms time

{ "val": 25, "tms": 1556548668373} ---> { "value": 25, "time": 1556548668373}

From	To
val	value
tms	time

Values

If you don't want to map all values coming from the gateway but just some values you can add the values you want here using fixed topics instead of wildecards

Client: The Mqtt client to connect to
Mode: Is this value used to GET updates from a gateway and forwarding them to your broker or is used to SET values? Check the sketch for more info about GET and SET
Custom Topic: Enable this to change the original topic
Topic: The topic where messages come from
Custom Topic: If Custom topic is enabled here you can add the destination topic where the packet received will be forwarded
Retain: Sets the retain flag of the outgoing packet
QoS: Sets the QoS level of the outgoing packet
Payload Map: Select the map to use to use to parse the payload, all other map values like retain, qos and wildecards are ignored

:pencil: TODOs

:camera: Screenshots

Broker status

Broker

Clients table

Clients

Values table

Values

Maps table

Maps

Map Function

Function

:bowtie: Author

Daniel Lando

Support me on Patreon :heart: