TransWikia.com

Problem with Geomesa Kafka Consumers

Geographic Information Systems Asked by Timur Kobilov on August 19, 2020

I’m trying Geomesa Kafka and the GeoMesa Kafka Quick Start tutorial.
The producer writes features into Kafka data store and I can see new records in my Kafka topic.
However, my consumer

...
SimpleFeatureSource consumerFS = consumer.getFeatureSource(sft.getTypeName());
...
try (SimpleFeatureIterator iterator = consumerFS.getFeatures().features()) {
                System.out.println("Current consumer state:");
                while (iterator.hasNext()) {
                    System.out.println(DataUtilities.encodeFeature(iterator.next()));
                }
            }

every time returns empty iterator ( iterator.hasNext()=null ).

What could be the reason?

P.S. Writing records to the producer’s datastore, causes following WARN message:

o.l.g.f.k.s.KryoUserDataSerialization$   : Skipping serialization of entry: USE_PROVIDED_FID -> true

One Answer

As noted in the comments, it is important to ensure that the versions of all components are compatible.

Quote @GeoMesaJim:

GeoMesa 3.0 is compiled with Kafka 2.1.1 and Scala 2.11. Kafka 2.5 is the first Kafka version without Scala 2.11 supports.

Answered by underdark on August 19, 2020

Add your own answers!

Ask a Question

Get help from others!

© 2024 TransWikia.com. All rights reserved. Sites we Love: PCI Database, UKBizDB, Menu Kuliner, Sharing RPP