BitSwan Features v1905

BitSwan Features v1905, launched on 1st of June 2019

New features v1905:

Out-of-band module

The new bspump.oob module allows to perform long synchronous operations "out-of-band" e.g. out of the synchronous processing within the pipeline. It uses OOBESink to extract the events from the pipeline and OOBEEngine to process them asynchronously.

File Source Encoding

Encoding of the input file can be specified in all sources based on FileABCSource. It is read by the source from the configuration from encoding option.

Kafka key support in KafkaSink

KafkaSink allows to specify Kafka key when sending the event to the output Kafka system. It can be specified in the context dictionary in kafka_key attribute.

KafkaMultiSink

KafkaMultiSink is a sink processor that allows to put events to different Kafka topics based on specification in the context dictionary as kafka_topic attribute.

Matrices are top objects (like pipelines, lookups and connections)

The BSPumpService contains add_matrix and locate_matrix methods, so the matrices can be shared among processors like analyzers.

Name refactoring of "MatrixContainer" objects to "Matrix"

AMQP module compatible with Pika 1.0.0

Fixes in implementation of the Generator

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

You Might Be Interested in Reading These Articles

BitSwan Features v1903

We've just launched new features: Jupyter server in BitSwan ecosystem, First implementation of pipeline builder, BlankApp for Telco, Open ID connectivity, MySQL Transaction / Binary log, Session Analyzer to hold session data for a specified time, Throttles are now listed when accessing pipelines via REST call, TimeDriftAnalyzer sends fixed zero metrics when there is no history, Kibana Object Library support in bskibana tool. Enjoy and provide us with your feed back.

Continue reading ...

new release features Jupyter pipeline builder BlankApp Open ID MySQL Session Analyzer TimeDriftAnalyzer Kibana

Published on March 11, 2019

BitSwan Features v1906

We've just launched new features: KafkaKeyFilter filtering over multiple keys, PostgreSQL sink and connection, Mongo query in LatchProcessor, Idle time in File sources, TimeDriftFilter etc.

Continue reading ...

new release features file encoding mongo asynchronous kafka latch time drift

Published on June 30, 2019

BitSwan Features v1907

We've just launched new features: Google Drive Sink, Tableau Sink, KafkaSink, analyzers and lookup refactoring, LatchAnalyzer etc.

Continue reading ...

new release features file google drive matrix kafka latch

Published on July 31, 2019