BitSwan Features v2003

BitSwan Features v20.03, launched on 16th of March 2020

New features v20.03:

Anomaly module

  • Anomaly module was introduced along with Anomaly object, AnomalyAnalyzer and AnomalyManager.
  • Anomaly modules serves to handle the lifecycle of anomalies linked to symptoms produced by analyzers.
  • Usage in bspump-anomaly example.
  • For more information, refer to the Data Analytics section in BitSwan documentation.

MySQL retryable errors

  • MySQLConnection and lookup does not stop the pipeline, when a retryable error occurs, which is defined in the connection.

InfluxDB retryable errors

  • InfluxDBConnection does not stop the pipeline when a retryable error occurs, if specified in the configuration.
  • The various error codes can be specified in the configuration as well.

SCRAM-SHA-256 support in KafkaConnection

  • KafkaConnection now supports SCRAM-SHA-256 SASL connection mechanism to the bootstrap servers.
  • The work was delivered with cooperation with aiokafka.

KafkaBatchSink

  • Experimental feature that is able to speed up KafkaSink by 10 times, while losing reliability of processed data.

ILM mechanism support in ElasticSearchSink

  • BitSwan now supports ILM rollover mechanisms in ElasticSearch module, using an index alias.

Other changes

  • Index, ID and version can be specified in context for ElasticSearchSink
  • MongoDB connection fixes
  • Code refactoring

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

You Might Be Interested in Reading These Articles

BitSwan Features v1908

We've just launched new features: PostgreSQLLogicalReplicationSource, ODBC connection, source and sink, asynchronous Generator, etc.

Continue reading ...

new release features odbc postgresql mysql generator matrix kafka latch

Published on September 15, 2019

BitSwan Features v1904

We've just launched new features: SMTPSink, GeoAnalyzer, Content Filter, MySQLSink bulk operations, Code documentation, BSKibana index patterns name fix. Enjoy and provide us with your feed back.

Continue reading ...

new release features SMTP Geo Analyzer MySQL documentation Kibana

Published on April 30, 2019

BitSwan Features v1910

We've just launched new features: Analyzer profiling, bspump.lookup.MatrixLookup, bspump.lookup.BitMapIndex, MongoDBSink etc.

Continue reading ...

new release features analyzer profiler mongodb

Published on October 31, 2019