---
title: Kafka fields
description: Kafka module Broker Consumer Group Information have been read from (Broker handling the consumer group). Broker metrics from Kafka Broker JMX Consumer...
url: https://www.elastic.co/elastic/docs-builder/docs/3028/reference/beats/metricbeat/exported-fields-kafka
products:
  - Beats
  - Metricbeat
applies_to:
  - Elastic Cloud Serverless: Generally available
  - Elastic Stack: Generally available
---

# Kafka fields
Kafka module

## kafka


## broker

Broker Consumer Group Information have been read from (Broker handling the consumer group).
<definitions>
  <definition term="kafka.broker.id">
    Broker id
    type: long
  </definition>
  <definition term="kafka.broker.address">
    Broker advertised address
    type: keyword
  </definition>
  <definition term="kafka.topic.name">
    Topic name
    type: keyword
  </definition>
  <definition term="kafka.topic.error.code">
    Topic error code.
    type: long
  </definition>
  <definition term="kafka.partition.id">
    Partition id.
    type: long
  </definition>
  <definition term="kafka.partition.topic_id">
    Unique id of the partition in the topic.
    type: keyword
  </definition>
  <definition term="kafka.partition.topic_broker_id">
    Unique id of the partition in the topic and the broker.
    type: keyword
  </definition>
</definitions>


## broker

<applies-to>
  - Elastic Stack: Beta
</applies-to>

Broker metrics from Kafka Broker JMX
<definitions>
  <definition term="kafka.broker.mbean">
    Mbean that this event is related to
    type: keyword
  </definition>
  <definition term="kafka.broker.request.channel.queue.size">
    The size of the request queue
    type: long
  </definition>
  <definition term="kafka.broker.request.produce.failed_per_second">
    The rate of failed produce requests per second
    type: float
  </definition>
  <definition term="kafka.broker.request.fetch.failed_per_second">
    The rate of client fetch request failures per second
    type: float
  </definition>
  <definition term="kafka.broker.request.produce.failed">
    The number of failed produce requests
    type: float
  </definition>
  <definition term="kafka.broker.request.fetch.failed">
    The number of client fetch request failures
    type: float
  </definition>
  <definition term="kafka.broker.replication.leader_elections">
    The leader election rate
    type: float
  </definition>
  <definition term="kafka.broker.replication.unclean_leader_elections">
    The unclean leader election rate
    type: float
  </definition>
  <definition term="kafka.broker.session.zookeeper.disconnect">
    The ZooKeeper closed sessions per second
    type: float
  </definition>
  <definition term="kafka.broker.session.zookeeper.expire">
    The ZooKeeper expired sessions per second
    type: float
  </definition>
  <definition term="kafka.broker.session.zookeeper.readonly">
    The ZooKeeper readonly sessions per second
    type: float
  </definition>
  <definition term="kafka.broker.session.zookeeper.sync">
    The ZooKeeper client connections per second
    type: float
  </definition>
  <definition term="kafka.broker.log.flush_rate">
    The log flush rate
    type: float
  </definition>
  <definition term="kafka.broker.topic.net.in.bytes_per_sec">
    The incoming byte rate per topic
    type: float
  </definition>
  <definition term="kafka.broker.topic.net.out.bytes_per_sec">
    The outgoing byte rate per topic
    type: float
  </definition>
  <definition term="kafka.broker.topic.net.rejected.bytes_per_sec">
    The rejected byte rate per topic
    type: float
  </definition>
  <definition term="kafka.broker.topic.messages_in">
    The incoming message rate per topic
    type: float
  </definition>
  <definition term="kafka.broker.net.in.bytes_per_sec">
    The incoming byte rate
    type: float
  </definition>
  <definition term="kafka.broker.net.out.bytes_per_sec">
    The outgoing byte rate
    type: float
  </definition>
  <definition term="kafka.broker.net.rejected.bytes_per_sec">
    The rejected byte rate
    type: float
  </definition>
  <definition term="kafka.broker.messages_in">
    The incoming message rate
    type: float
  </definition>
</definitions>


## consumer

<applies-to>
  - Elastic Stack: Beta
</applies-to>

Consumer metrics from Kafka Consumer JMX
<definitions>
  <definition term="kafka.consumer.mbean">
    Mbean that this event is related to
    type: keyword
  </definition>
  <definition term="kafka.consumer.fetch_rate">
    The minimum rate at which the consumer sends fetch requests to a broker
    type: float
  </definition>
  <definition term="kafka.consumer.bytes_consumed">
    The average number of bytes consumed for a specific topic per second
    type: float
  </definition>
  <definition term="kafka.consumer.records_consumed">
    The average number of records consumed per second for a specific topic
    type: float
  </definition>
  <definition term="kafka.consumer.in.bytes_per_sec">
    The rate of bytes coming in to the consumer
    type: float
  </definition>
  <definition term="kafka.consumer.max_lag">
    The maximum consumer lag
    type: float
  </definition>
  <definition term="kafka.consumer.zookeeper_commits">
    The rate of offset commits to ZooKeeper
    type: float
  </definition>
  <definition term="kafka.consumer.kafka_commits">
    The rate of offset commits to Kafka
    type: float
  </definition>
  <definition term="kafka.consumer.messages_in">
    The rate of consumer message consumption
    type: float
  </definition>
</definitions>


## consumergroup

consumergroup
<definitions>
  <definition term="kafka.consumergroup.id">
    Consumer Group ID
    type: keyword
  </definition>
  <definition term="kafka.consumergroup.offset">
    consumer offset into partition being read
    type: long
  </definition>
  <definition term="kafka.consumergroup.meta">
    custom consumer meta data string
    type: keyword
  </definition>
  <definition term="kafka.consumergroup.consumer_lag">
    consumer lag for partition/topic calculated as the difference between the partition offset and consumer offset
    type: long
  </definition>
  <definition term="kafka.consumergroup.error.code">
    kafka consumer/partition error code.
    type: long
  </definition>
</definitions>


## client

Assigned client reading events from partition
<definitions>
  <definition term="kafka.consumergroup.client.id">
    Client ID (kafka setting client.id)
    type: keyword
  </definition>
  <definition term="kafka.consumergroup.client.host">
    Client host
    type: keyword
  </definition>
  <definition term="kafka.consumergroup.client.member_id">
    internal consumer group member ID
    type: keyword
  </definition>
</definitions>


## partition

partition

## offset

Available offsets of the given partition.
<definitions>
  <definition term="kafka.partition.offset.newest">
    Newest offset of the partition.
    type: long
  </definition>
  <definition term="kafka.partition.offset.oldest">
    Oldest offset of the partition.
    type: long
  </definition>
</definitions>


## partition

Partition data.
<definitions>
  <definition term="kafka.partition.partition.leader">
    Leader id (broker).
    type: long
  </definition>
  <definition term="kafka.partition.partition.replica">
    Replica id (broker).
    type: long
  </definition>
  <definition term="kafka.partition.partition.insync_replica">
    Indicates if replica is included in the in-sync replicate set (ISR).
    type: boolean
  </definition>
  <definition term="kafka.partition.partition.is_leader">
    Indicates if replica is the leader
    type: boolean
  </definition>
  <definition term="kafka.partition.partition.error.code">
    Error code from fetching partition.
    type: long
  </definition>
</definitions>


## producer

<applies-to>
  - Elastic Stack: Beta
</applies-to>

Producer metrics from Kafka Producer JMX
<definitions>
  <definition term="kafka.producer.mbean">
    Mbean that this event is related to
    type: keyword
  </definition>
  <definition term="kafka.producer.available_buffer_bytes">
    The total amount of buffer memory
    type: float
  </definition>
  <definition term="kafka.producer.batch_size_avg">
    The average number of bytes sent
    type: float
  </definition>
  <definition term="kafka.producer.batch_size_max">
    The maximum number of bytes sent
    type: long
  </definition>
  <definition term="kafka.producer.record_send_rate">
    The average number of records sent per second
    type: float
  </definition>
  <definition term="kafka.producer.record_retry_rate">
    The average number of retried record sends per second
    type: float
  </definition>
  <definition term="kafka.producer.record_error_rate">
    The average number of retried record sends per second
    type: float
  </definition>
  <definition term="kafka.producer.records_per_request">
    The average number of records sent per second
    type: float
  </definition>
  <definition term="kafka.producer.record_size_avg">
    The average record size
    type: float
  </definition>
  <definition term="kafka.producer.record_size_max">
    The maximum record size
    type: long
  </definition>
  <definition term="kafka.producer.request_rate">
    The number of producer requests per second
    type: float
  </definition>
  <definition term="kafka.producer.response_rate">
    The number of producer responses per second
    type: float
  </definition>
  <definition term="kafka.producer.io_wait">
    The producer I/O wait time
    type: float
  </definition>
  <definition term="kafka.producer.out.bytes_per_sec">
    The rate of bytes going out for the producer
    type: float
  </definition>
  <definition term="kafka.producer.message_rate">
    The producer message rate
    type: float
  </definition>
</definitions>