BitSwan Features v2111

BitSwan Features v21.11, launched on 17th of November 2021

New features v21.11:

Kafka

  • Dynamic Kafka topic initializer reads topic configs from file or from Kafka sink/source configs,checks if they exists and creates them if they don't
  • Usage in bspump-kafka-topic-initializer.py example

Lookup

  • Memcached lookup - speed up data enrichers by using in-memory cache
  • Usage in bspump-lookup-memcached.py example

BSPump Declarative language

  • Add simple split expression in BSPump Declarative language

Cysimdjson

  • Switch from simdjson parser to cysimdjson parser
  • Add example for Cysimdjson parser bspump-cysimdjson-parser.py

Documentation

Others changes

  • Performance tests for Fastavro read/write
  • IPC (InterProcess Communication) refactoring

You Might Be Interested in Reading These Articles

BitSwan Features v1908

We've just launched new features: PostgreSQLLogicalReplicationSource, ODBC connection, source and sink, asynchronous Generator, etc.

Continue reading ...

new release features odbc postgresql mysql generator matrix kafka latch

Published on September 15, 2019

BitSwan Features v2006

We've just launched new features: BSPump Declarative, HyperLogLog, MySQL improvements, WindowsRM, and more!

Continue reading ...

new release bspump-declarative hyperloglog async pipeline kafka windowsrm

Published on June 18, 2020

BitSwan Features v1905

We've just launched new features: Out-of-band module, File Source Encoding, Kafka key support in KafkaSink, KafkaMultiSink, matrices etc. Enjoy and provide us with your feedback.

Continue reading ...

new release features file encoding oob asynchronous kafka

Published on May 30, 2019