Peter. Some months back you were considering re-jigging microbial to emphasise consumer groups as a means of partitioning. Are you any closer in implementing that? I'm trying to get logstash working with Zookeeper/Kafka as an input (https://github.com/joekiller/logstash-kafka) and it appears to rely on having a group_id (consumer group) defined. Does the current version of microbial handle this? In fact, that plugin for logstash to interface with Kafka is now merged into the core as of a few days ago (elastic/logstash#1472). I can't seem to get it to work with request/response pattern the microbial applies to Zookeeper though ... and perhaps this is because no consumer group is set. Would you have any thoughts on a fix? Thanks. Colum
Peter. Some months back you were considering re-jigging microbial to emphasise consumer groups as a means of partitioning. Are you any closer in implementing that? I'm trying to get logstash working with Zookeeper/Kafka as an input (https://github.com/joekiller/logstash-kafka) and it appears to rely on having a group_id (consumer group) defined. Does the current version of microbial handle this? In fact, that plugin for logstash to interface with Kafka is now merged into the core as of a few days ago (elastic/logstash#1472). I can't seem to get it to work with request/response pattern the microbial applies to Zookeeper though ... and perhaps this is because no consumer group is set. Would you have any thoughts on a fix? Thanks. Colum