BitSwan Features v1905

BitSwan Features v1905, launched on 1st of June 2019

New features v1905:

Out-of-band module

The new bspump.oob module allows to perform long synchronous operations "out-of-band" e.g. out of the synchronous processing within the pipeline. It uses OOBESink to extract the events from the pipeline and OOBEEngine to process them asynchronously.

File Source Encoding

Encoding of the input file can be specified in all sources based on FileABCSource. It is read by the source from the configuration from encoding option.

Kafka key support in KafkaSink

KafkaSink allows to specify Kafka key when sending the event to the output Kafka system. It can be specified in the context dictionary in kafka_key attribute.

KafkaMultiSink

KafkaMultiSink is a sink processor that allows to put events to different Kafka topics based on specification in the context dictionary as kafka_topic attribute.

Matrices are top objects (like pipelines, lookups and connections)

The BSPumpService contains add_matrix and locate_matrix methods, so the matrices can be shared among processors like analyzers.

Name refactoring of "MatrixContainer" objects to "Matrix"

AMQP module compatible with Pika 1.0.0

Fixes in implementation of the Generator

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

You Might Be Interested in Reading These Articles

BitSwan Features v2111

We've just launched new features: Cysimdjson, documentation, and more!

Continue reading ...

new release cysimdjson kafka documentation fastavro memcached

Published on November 17, 2021

Data driven road graph enrichment

We've designed and implemented powerful and robust algorithm for incomplete road graph enrichment with GPS positioned telemetry coming from real vehicles.

Continue reading ...

features data science advanced algorithms gps data data annotation map matching road graph enrichment

Published on July 10, 2019

BitSwan Features v1903

We've just launched new features: Jupyter server in BitSwan ecosystem, First implementation of pipeline builder, BlankApp for Telco, Open ID connectivity, MySQL Transaction / Binary log, Session Analyzer to hold session data for a specified time, Throttles are now listed when accessing pipelines via REST call, TimeDriftAnalyzer sends fixed zero metrics when there is no history, Kibana Object Library support in bskibana tool. Enjoy and provide us with your feed back.

Continue reading ...

new release features Jupyter pipeline builder BlankApp Open ID MySQL Session Analyzer TimeDriftAnalyzer Kibana

Published on March 11, 2019