BitSwan Features v2003

BitSwan Features v20.03, launched on 16th of March 2020

New features v20.03:

Anomaly module

  • Anomaly module was introduced along with Anomaly object, AnomalyAnalyzer and AnomalyManager.
  • Anomaly modules serves to handle the lifecycle of anomalies linked to symptoms produced by analyzers.
  • Usage in bspump-anomaly example.
  • For more information, refer to the Data Analytics section in BitSwan documentation.

MySQL retryable errors

  • MySQLConnection and lookup does not stop the pipeline, when a retryable error occurs, which is defined in the connection.

InfluxDB retryable errors

  • InfluxDBConnection does not stop the pipeline when a retryable error occurs, if specified in the configuration.
  • The various error codes can be specified in the configuration as well.

SCRAM-SHA-256 support in KafkaConnection

  • KafkaConnection now supports SCRAM-SHA-256 SASL connection mechanism to the bootstrap servers.
  • The work was delivered with cooperation with aiokafka.

KafkaBatchSink

  • Experimental feature that is able to speed up KafkaSink by 10 times, while losing reliability of processed data.

ILM mechanism support in ElasticSearchSink

  • BitSwan now supports ILM rollover mechanisms in ElasticSearch module, using an index alias.

Other changes

  • Index, ID and version can be specified in context for ElasticSearchSink
  • MongoDB connection fixes
  • Code refactoring
Contact us

About the Author

Premysl Cerny

Premysl is senior developer in LibertyAces

Most Recent Articles

You Might Be Interested in Reading These Articles

BitSwan Features v1903

We've just launched new features: Jupyter server in BitSwan ecosystem, First implementation of pipeline builder, BlankApp for Telco, Open ID connectivity, MySQL Transaction / Binary log, Session Analyzer to hold session data for a specified time, Throttles are now listed when accessing pipelines via REST call, TimeDriftAnalyzer sends fixed zero metrics when there is no history, Kibana Object Library support in bskibana tool. Enjoy and provide us with your feed back.

Continue reading ...

new release features Jupyter pipeline builder BlankApp Open ID MySQL Session Analyzer TimeDriftAnalyzer Kibana

Published on March 11, 2019

BitSwan Features v1911

We've just launched new features: TreeRangeIndex, SliceIndex, bspump.ssh.SFTPSink, bspump.subprocess.SubProcessSource etc.

Continue reading ...

new release features index ssh subprocess

Published on October 31, 2019

Data driven road graph enrichment

We've designed and implemented powerful and robust algorithm for incomplete road graph enrichment with GPS positioned telemetry coming from real vehicles.

Continue reading ...

features data science advanced algorithms gps data data annotation map matching road graph enrichment

Published on July 10, 2019

Tags: new release, features, anomaly, async, pipeline, kafka