BitSwan Features v21.11, launched on 17th of November 2021

New features v21.11:

Kafka

• Dynamic Kafka topic initializer reads topic configs from file or from Kafka sink/source configs,checks if they exists and creates them if they don't
• Usage in bspump-kafka-topic-initializer.py example

Lookup

• Memcached lookup - speed up data enrichers by using in-memory cache
• Usage in bspump-lookup-memcached.py example

BSPump Declarative language

• Add simple split expression in BSPump Declarative language

Cysimdjson

• Switch from simdjson parser to cysimdjson parser
• Add example for Cysimdjson parser bspump-cysimdjson-parser.py

Documentation

• bitswanpump.readthedocs.io

Others changes

• Performance tests for Fastavro read/write
• IPC (InterProcess Communication) refactoring