Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://github.com/karafka/waterdrop below:

karafka/waterdrop: Standalone Karafka library for producing Kafka messages

WaterDrop is a standalone gem that sends messages to Kafka easily with an extra validation layer. It is a part of the Karafka ecosystem.

It:

• Is thread-safe
• Supports sync and async producing
• Supports transactions
• Supports buffering
• Supports producing to multiple clusters
• Supports multiple delivery policies
• Supports per-topic configuration alterations (variants)
• Works with async gems ecosystem
• Works with Kafka 1.0+ and Ruby 3.1+
• Works with and without Karafka

Karafka ecosystem components documentation, including WaterDrop, can be found here.

If you want to both produce and consume messages, please use Karafka. It integrates WaterDrop automatically.

To get started with WaterDrop:

1. Add it to your Gemfile:

1. Create and configure a producer:

producer = WaterDrop::Producer.new do |config|
  config.deliver = true
  config.kafka = {
    'bootstrap.servers': 'localhost:9092',
    'request.required.acks': 1
  }
end

1. Use it as follows:

# sync producing
producer.produce_sync(topic: 'my-topic', payload: 'my message')

# or for async
producer.produce_async(topic: 'my-topic', payload: 'my message')

# or in sync batches
producer.produce_many_sync(
  [
    { topic: 'my-topic', payload: 'my message'},
    { topic: 'my-topic', payload: 'my message'}
  ]
)

# and async batches
producer.produce_many_async(
  [
    { topic: 'my-topic', payload: 'my message'},
    { topic: 'my-topic', payload: 'my message'}
  ]
)

# transactions
producer.transaction do
  producer.produce_async(topic: 'my-topic', payload: 'my message')
  producer.produce_async(topic: 'my-topic', payload: 'my message')
end

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4