Collecting nProbe Flows Using Kafka

Similar to ZMQ, you can use Kafka to collect flows exported by nProbe. In order to do this you can specify kafka://<broker>[;<topic>;<options>] or kafka-ssl://<broker>[;<topic>;<options>] depending if you use plain text or SSL/TLS connections to the Kafka broker. As usual you can specify multiple brokers IP (and ports) by splitting them with a comma (,).

Example

Below you can find some examples:

  • Collect flows sent by nProbe to Kafka broker active on 127.0.0.1 on the default port (9092). Use: -i kafka://127.0.0.1
  • Collect flows sent by nProbe to Kafka brokers 127.0.0.1:7689, 192.168.1.20:9092 and 192.168.1.2:909. Use: -i kafka://127.0.0.1:7689,192.168.1.20:9092,192.168.1.2:9092

Note

Topic names cannot be changed in ntopng/nProbe. Please make sure that the topics are created on the kafka broker before exporting data. See Kafka docs for more information abotu Kafka configuration.