代码之家  ›  专栏  ›  技术社区  ›  xmar

Kafka流:topic.compression.type不是已知配置

  •  0
  • xmar  · 技术社区  · 7 年前

    在kafka流中添加压缩配置,与此类似 link 以下内容:

    properties.put(StreamsConfig.topicPrefix(TopicConfig.COMPRESSION_TYPE_CONFIG), "snappy");
    

    但我在日志中看到以下警告消息:

    [2018-11-19 23:52:10,158] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig)
    [2018-11-19 23:52:10,158] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.admin.AdminClientConfig)
    [2018-11-19 23:52:10,194] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
    [2018-11-19 23:52:10,194] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
    [2018-11-19 23:52:10,209] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig)
    [2018-11-19 23:52:10,209] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.producer.ProducerConfig)
    [2018-11-19 23:52:10,221] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
    [2018-11-19 23:52:10,221] WARN The configuration 'topic.compression.type' was supplied but isn't a known config. (org.apache.kafka.clients.consumer.ConsumerConfig)
    

    此设置不受尊重吗?它表达得不好吗?

    1 回复  |  直到 7 年前
        1
  •  1
  •   Matthias J. Sax    7 年前

    您可以忽略这些警告。“问题”是,topic config参数被复制到内部使用的客户机的配置中,他们不知道参数名,因此会发出警告。但是,必须在客户机上设置这些配置,因为客户机将把这些配置“转发”到代码库中知道如何使用它们的其他部分。

    这是一个有点不幸的已知问题(但不容易解决)。