BitSwan Features v2003

BitSwan Features v20.03, launched on 16th of March 2020

New features v20.03:

Anomaly module

  • Anomaly module was introduced along with Anomaly object, AnomalyAnalyzer and AnomalyManager.
  • Anomaly modules serves to handle the lifecycle of anomalies linked to symptoms produced by analyzers.
  • Usage in bspump-anomaly example.
  • For more information, refer to the Data Analytics section in BitSwan documentation.

MySQL retryable errors

  • MySQLConnection and lookup does not stop the pipeline, when a retryable error occurs, which is defined in the connection.

InfluxDB retryable errors

  • InfluxDBConnection does not stop the pipeline when a retryable error occurs, if specified in the configuration.
  • The various error codes can be specified in the configuration as well.

SCRAM-SHA-256 support in KafkaConnection

  • KafkaConnection now supports SCRAM-SHA-256 SASL connection mechanism to the bootstrap servers.
  • The work was delivered with cooperation with aiokafka.

KafkaBatchSink

  • Experimental feature that is able to speed up KafkaSink by 10 times, while losing reliability of processed data.

ILM mechanism support in ElasticSearchSink

  • BitSwan now supports ILM rollover mechanisms in ElasticSearch module, using an index alias.

Other changes

  • Index, ID and version can be specified in context for ElasticSearchSink
  • MongoDB connection fixes
  • Code refactoring

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

You Might Be Interested in Reading These Articles

BitSwan Features v1907

We've just launched new features: Google Drive Sink, Tableau Sink, KafkaSink, analyzers and lookup refactoring, LatchAnalyzer etc.

Continue reading ...

new release features file google drive matrix kafka latch

Published on July 31, 2019

BitSwan Features v1912

We've just launched new features: InterProcess Communication, Kafka Source profiling, flake8, etc.

Continue reading ...

new release features ipc datagram stream kafka profiling flake8

Published on December 19, 2019

BitSwan Features v1910

We've just launched new features: Analyzer profiling, bspump.lookup.MatrixLookup, bspump.lookup.BitMapIndex, MongoDBSink etc.

Continue reading ...

new release features analyzer profiler mongodb

Published on October 31, 2019