Abrir Fechadas

Kafka Integration #4548


User avatar
0
tahseelit1 criada

Hi

I have some doubt regarding Kafka integration how the publisher notify if one consumer fail? and how the unitofwork works

ex. **Publisher: ** I want to keep copy of country to all microservice.

Consumer

if consumer fail I want to rollback the transaction in publisher?

Is this possible using the build in distributed events using kafka?

Thanks

Check the docs before asking a question: https://docs.abp.io/en/commercial/latest/ Check the samples, to see the basic tasks: https://docs.abp.io/en/commercial/latest/samples/index The exact solution to your question may have been answered before, please use the search on the homepage.

If you're creating a bug/problem report, please include followings:

  • ABP Framework version: vX.X.X
  • UI type: Angular / MVC / Blazor
  • DB provider: EF Core / MongoDB
  • Tiered (MVC) or Identity Server Separated (Angular): yes / no
  • Exception message and stack trace:
  • Steps to reproduce the issue:"

10 resposta (s)
  • User Avatar
    0
    liangshiwei criada
    Equipe de Apoio Fullstack Developer

    Hi,

    You can see the document: https://docs.abp.io/en/abp/latest/Distributed-Event-Bus#transaction-and-exception-handling

  • User Avatar
    0
    tahseelit1 criada

    I follow and implement the Kafka integration base on document you've send but still rollback is not working. even I manually throw exception to consumer.

    still the behavior is the same once consumer fail my transaction in publisher success.

  • User Avatar
    0
    liangshiwei criada
    Equipe de Apoio Fullstack Developer

    When you switch to an actual distributed event bus provider (e.g. Kafka or RabbitMQ), then the event handlers will be executed in different processes/applications as their purpose is to create distributed systems. In this case, the only way to implement transactional event publishing is to use the outbox/inbox patterns as explained in the Outbox / Inbox for Transactional Events section.

  • User Avatar
    0
    tahseelit1 criada

    Publisher configuration

    Consumer configuration

  • User Avatar
    0
    liangshiwei criada
    Equipe de Apoio Fullstack Developer

    but still rollback is not working. even I manually throw exception to consumer.

    When you successfully publish an event, it's not possible to rollback. you might consider posting a rollback event to rollback your changes

  • User Avatar
    0
    tahseelit1 criada

    it seems this became more complicated and hard to maintain because what if there is cascading events with insert and update.

  • User Avatar
    0
    tahseelit1 criada

    but still rollback is not working. even I manually throw exception to consumer.

    When you successfully publish an event, it's not possible to rollback. you might consider posting a rollback event to rollback your changes

    then how you will notify the UI Realtime if the consumer is fail during rollback event.

  • User Avatar
    0
    liangshiwei criada
    Equipe de Apoio Fullstack Developer

    As you know, Kafka is a distributed message system, and messages can be consumed in parallel. Even if one message fails it will not affect the other.

    You should not throw unhandled exceptions in the event handler, it keeps retrying in the system and blocks your other event handlers(In the outbox/inbox patterns, messages are sequential)

    Your event handlers should be independent of each other, if one fails, you need to roll back all published events, you should place the code logic before publishing the event instead of an event handler

    then how you will notify the UI Realtime if the consumer is fail during rollback event.

    Same, Kafka is a distributed application, it can't show notify the UI in real-time, but you can build a real-time notification system(SignalR)

  • User Avatar
    0
    tahseelit1 criada

    thanks I will consider that.

  • User Avatar
    0
    liangshiwei criada
    Equipe de Apoio Fullstack Developer

    ok

Made with ❤️ on ABP v8.2.0-preview Updated on março 25, 2024, 15:11