BitSwan Features v2003

BitSwan Features v20.03, launched on 16th of March 2020

New features v20.03:

Anomaly module

  • Anomaly module was introduced along with Anomaly object, AnomalyAnalyzer and AnomalyManager.
  • Anomaly modules serves to handle the lifecycle of anomalies linked to symptoms produced by analyzers.
  • Usage in bspump-anomaly example.
  • For more information, refer to the Data Analytics section in BitSwan documentation.

MySQL retryable errors

  • MySQLConnection and lookup does not stop the pipeline, when a retryable error occurs, which is defined in the connection.

InfluxDB retryable errors

  • InfluxDBConnection does not stop the pipeline when a retryable error occurs, if specified in the configuration.
  • The various error codes can be specified in the configuration as well.

SCRAM-SHA-256 support in KafkaConnection

  • KafkaConnection now supports SCRAM-SHA-256 SASL connection mechanism to the bootstrap servers.
  • The work was delivered with cooperation with aiokafka.

KafkaBatchSink

  • Experimental feature that is able to speed up KafkaSink by 10 times, while losing reliability of processed data.

ILM mechanism support in ElasticSearchSink

  • BitSwan now supports ILM rollover mechanisms in ElasticSearch module, using an index alias.

Other changes

  • Index, ID and version can be specified in context for ElasticSearchSink
  • MongoDB connection fixes
  • Code refactoring
Contact us

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

Most Recent Articles

You Might Be Interested in Reading These Articles

BitSwan Features v1905

We've just launched new features: Out-of-band module, File Source Encoding, Kafka key support in KafkaSink, KafkaMultiSink, matrices etc. Enjoy and provide us with your feedback.

Continue reading ...

new release features file encoding oob asynchronous kafka

Published on May 30, 2019

BitSwan Features v1904

We've just launched new features: SMTPSink, GeoAnalyzer, Content Filter, MySQLSink bulk operations, Code documentation, BSKibana index patterns name fix. Enjoy and provide us with your feed back.

Continue reading ...

new release features SMTP Geo Analyzer MySQL documentation Kibana

Published on April 30, 2019

BitSwan Features v1903

We've just launched new features: Jupyter server in BitSwan ecosystem, First implementation of pipeline builder, BlankApp for Telco, Open ID connectivity, MySQL Transaction / Binary log, Session Analyzer to hold session data for a specified time, Throttles are now listed when accessing pipelines via REST call, TimeDriftAnalyzer sends fixed zero metrics when there is no history, Kibana Object Library support in bskibana tool. Enjoy and provide us with your feed back.

Continue reading ...

new release features Jupyter pipeline builder BlankApp Open ID MySQL Session Analyzer TimeDriftAnalyzer Kibana

Published on March 11, 2019

Tags: new release, features, anomaly, async, pipeline, kafka