BitSwan Features v1905

BitSwan Features v1905, launched on 1st of June 2019

New features v1905:

Out-of-band module

The new bspump.oob module allows to perform long synchronous operations "out-of-band" e.g. out of the synchronous processing within the pipeline. It uses OOBESink to extract the events from the pipeline and OOBEEngine to process them asynchronously.

File Source Encoding

Encoding of the input file can be specified in all sources based on FileABCSource. It is read by the source from the configuration from encoding option.

Kafka key support in KafkaSink

KafkaSink allows to specify Kafka key when sending the event to the output Kafka system. It can be specified in the context dictionary in kafka_key attribute.


KafkaMultiSink is a sink processor that allows to put events to different Kafka topics based on specification in the context dictionary as kafka_topic attribute.

Matrices are top objects (like pipelines, lookups and connections)

The BSPumpService contains add_matrix and locate_matrix methods, so the matrices can be shared among processors like analyzers.

Name refactoring of "MatrixContainer" objects to "Matrix"

AMQP module compatible with Pika 1.0.0

Fixes in implementation of the Generator

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

You Might Be Interested in Reading These Articles

BitSwan Features v2006

We've just launched new features: BSPump Declarative, HyperLogLog, MySQL improvements, WindowsRM, and more!

Continue reading ...

new release bspump-declarative hyperloglog async pipeline kafka windowsrm

Published on June 18, 2020

BitSwan Features v1912

We've just launched new features: InterProcess Communication, Kafka Source profiling, flake8, etc.

Continue reading ...

new release features ipc datagram stream kafka profiling flake8

Published on December 19, 2019

Data driven road graph enrichment

We've designed and implemented powerful and robust algorithm for incomplete road graph enrichment with GPS positioned telemetry coming from real vehicles.

Continue reading ...

features data science advanced algorithms gps data data annotation map matching road graph enrichment

Published on July 10, 2019