Get data streams
- GET /_data_stream/{name}
- GET /_data_stream
Get information about one or more data streams.
- Index privileges:
view_index_metadata
Path Parameters
-
nameDataStreamName | DataStreamNameoptional -
Comma-separated list of data stream names used to limit the request. Wildcard (
*) expressions are supported. If omitted, all data streams are returned.Leave it out to use
/_data_stream.
Query Parameters
-
expand_wildcardsstring ExpandWildcards · default: open Type of data stream that wildcard patterns can match. Supports comma-separated values, such as
open,hidden.Supported values include:
all: Match any data stream or index, including hidden ones.open: Match open, non-hidden indices. Also matches any non-hidden data stream.closed: Match closed, non-hidden indices. Also matches any non-hidden data stream. Data streams cannot be closed.hidden: Match hidden data streams and hidden indices. Must be combined withopen,closed, orboth.none: Wildcard expressions are not accepted.
-
Values:
allopenclosedhiddennone -
include_defaultsboolean · default: false If true, returns all relevant default configurations for the index template.
-
master_timeoutstring Duration · default: 30s Period to wait for a connection to the master node. If no response is received before the timeout expires, the request fails and returns an error.
-
verboseboolean · default: false Whether the maximum timestamp for each data stream should be calculated and returned.
Response
-
data_streamsDataStreamrequired -
_metaMetadata -
Custom metadata for the stream, copied from the
_metaobject of the stream’s matching index template. If empty, the response omits this property. -
allow_custom_routingboolean -
If
true, the data stream allows custom routing on write request. -
failure_storeFailureStore -
Information about failure store backing indices
-
enabledbooleanrequired -
indicesDataStreamIndexrequired -
index_namestring IndexNamerequired -
Name of the backing index.
-
index_uuidstringrequired -
Universally unique identifier (UUID) for the index.
-
ilm_policystring Name -
Name of the current ILM lifecycle policy configured for this backing index.
-
managed_byManagedBy -
Name of the lifecycle system that's currently managing this backing index.
-
Values:
Index Lifecycle ManagementData stream lifecycleUnmanaged -
prefer_ilmboolean -
Indicates if ILM should take precedence over DSL in case both are configured to manage this index.
-
index_modeIndexMode -
The index mode of this backing index of the data stream.
-
Values:
standardtime_serieslogsdblookup -
rollover_on_writebooleanrequired -
generationnumberrequired -
Current generation for the data stream. This number acts as a cumulative count of the stream’s rollovers, starting at 1.
-
If
true, the data stream is hidden. -
ilm_policystring Name -
Name of the current ILM lifecycle policy in the stream’s matching index template. This lifecycle policy is set in the
index.lifecycle.namesetting. If the template does not include a lifecycle policy, this property is not included in the response. NOTE: A data stream’s backing indices may be assigned different lifecycle policies. To retrieve the lifecycle policy for individual backing indices, use the get index settings API. -
next_generation_managed_byManagedByrequired -
Name of the lifecycle system that'll manage the next generation of the data stream.
-
Values:
Index Lifecycle ManagementData stream lifecycleUnmanaged -
prefer_ilmbooleanrequired -
Indicates if ILM should take precedence over DSL in case both are configured to managed this data stream.
-
indicesDataStreamIndexrequired -
Array of objects containing information about the data stream’s backing indices. The last item in this array contains information about the stream’s current write index.
-
index_namestring IndexNamerequired -
Name of the backing index.
-
index_uuidstringrequired -
Universally unique identifier (UUID) for the index.
-
ilm_policystring Name -
Name of the current ILM lifecycle policy configured for this backing index.
-
managed_byManagedBy -
Name of the lifecycle system that's currently managing this backing index.
-
Values:
Index Lifecycle ManagementData stream lifecycleUnmanaged -
prefer_ilmboolean -
Indicates if ILM should take precedence over DSL in case both are configured to manage this index.
-
index_modeIndexMode -
The index mode of this backing index of the data stream.
-
Values:
standardtime_serieslogsdblookup -
lifecycleDataStreamLifecycleWithRollover -
Contains the configuration for the data stream lifecycle of this data stream.
-
data_retentionstring Duration -
If defined, every document added to this data stream will be stored at least for this time frame. Any time after this duration the document could be deleted. When empty, every document in this data stream will be stored indefinitely.
-
effective_retentionstring Duration -
The least amount of time data should be kept by elasticsearch.
-
retention_determined_byRetentionSource -
Configuration source that can influence the retention of a data stream.
-
Values:
data_stream_configurationdefault_global_retentionmax_global_retentiondefault_failures_retention -
downsamplingDownsamplingRound -
The list of downsampling rounds to execute as part of this downsampling configuration
-
afterstring Durationrequired -
The duration since rollover when this downsampling round should execute
-
fixed_intervalstringrequired -
The downsample interval.
-
downsampling_methodSamplingMethod -
The method used to downsample the data. There are two options
aggregateandlast_value. It requiresdownsamplingto be defined. Defaults toaggregate. -
Values:
aggregatelast_value -
enabledboolean · default: true -
If defined, it turns data stream lifecycle on/off (
true/false) for this data stream. A data stream lifecycle that's disabled (enabled:false) will have no effect on the data stream. -
frozen_afterstring Duration -
The period after which data stream backing indices are automatically converted to partially mounted searchable snapshots. This field is valid only on main data stream lifecycles and cannot be set on failure-store lifecycles.
-
rolloverDataStreamLifecycleRolloverConditions -
The conditions which will trigger the rollover of a backing index as configured by the cluster setting
cluster.lifecycle.default.rollover. This property is an implementation detail and it will only be retrieved when the query paraminclude_defaultsis set to true. The contents of this field are subject to change. -
min_agestring Duration -
max_agestring -
min_docsnumber -
max_docsnumber -
min_sizenumber | string ByteSize -
max_sizenumber | string ByteSize -
min_primary_shard_sizenumber | string ByteSize -
max_primary_shard_sizenumber | string ByteSize -
min_primary_shard_docsnumber -
max_primary_shard_docsnumber -
namestringrequired -
Name of the data stream.
-
replicatedboolean -
If
true, the data stream is created and managed by cross-cluster replication and the local cluster can not write into this data stream or change its mappings. -
rollover_on_writebooleanrequired -
If
true, the next write to this data stream will trigger a rollover first and the document will be indexed in the new backing index. If the rollover fails the indexing request will fail too. -
settingsIndexSettingsrequired -
The settings specific to this data stream that will take precedence over the settings in the matching index template.
-
mappingsTypeMapping -
The mappings specific to this data stream that will take precedence over the mappings in the matching index template.
-
all_fieldAllField -
analyzerstringrequired -
enabledbooleanrequired -
omit_normsbooleanrequired -
search_analyzerstringrequired -
similaritystringrequired -
storebooleanrequired -
store_term_vector_offsetsbooleanrequired -
store_term_vector_payloadsbooleanrequired -
store_term_vector_positionsbooleanrequired -
store_term_vectorsbooleanrequired -
date_detectionboolean -
dynamicDynamicMapping -
Values:
strictruntimetruefalse -
dynamic_date_formatsstring -
dynamic_templatesstring to DynamicTemplate -
_field_namesFieldNamesField -
enabledbooleanrequired -
index_fieldIndexField -
enabledbooleanrequired -
_metaMetadata -
numeric_detectionboolean -
propertiesmap string to Property -
_sourceSourceField -
enabledboolean -
excludesstring -
includesstring -
modeSourceFieldMode -
Supported values include:
disabledstoredcolumnar_storedsynthetic: Instead of storing source documents on disk exactly as you send them, Elasticsearch can reconstruct source content on the fly upon retrieval.
-
Values:
disabledstoredcolumnar_storedsynthetic -
runtimemap string to RuntimeField -
<string>RuntimeField -
fieldsmap string to CompositeSubField -
For type
composite -
<string>CompositeSubField -
typeRuntimeFieldTyperequired -
Values:
booleancompositedatedoublegeo_pointgeo_shapeipkeywordlonglookup -
formatstring -
A custom format for
datetype runtime fields. -
input_fieldstring Field -
For type
lookup -
target_fieldstring Field -
For type
lookup -
target_indexstring IndexName -
For type
lookup -
scriptstring Script -
Painless script executed at query time.
-
on_script_errorOnScriptError -
Values:
failcontinue -
typeRuntimeFieldTyperequired -
Field type, which can be:
boolean,composite,date,double,geo_point,ip,keyword,long, orlookup. -
Values:
booleancompositedatedoublegeo_pointgeo_shapeipkeywordlonglookup -
enabledboolean -
subobjectsSubobjects -
Values:
truefalse -
_data_stream_timestampDataStreamTimestamp -
enabledbooleanrequired -
statusHealthStatusrequired -
Health status of the data stream. This health status is based on the state of the primary and replica shards of the stream’s backing indices.
Supported values include:
green(orGREEN): All shards are assigned.yellow(orYELLOW): All primary shards are assigned, but one or more replica shards are unassigned. If a node in the cluster fails, some data could be unavailable until that node is repaired.red(orRED): One or more primary shards are unassigned, so some data is unavailable. This can occur briefly during cluster startup as primary shards are assigned.unknownunavailable
-
Values:
greenGREENyellowYELLOWredREDunknownunavailable -
systemboolean -
If
true, the data stream is created and managed by an Elastic stack component and cannot be modified through normal user interaction. -
templatestring Namerequired -
Name of the index template used to create the data stream’s backing indices. The template’s index pattern must match the name of this data stream.
-
timestamp_fieldDataStreamTimestampFieldrequired -
Information about the
@timestampfield in the data stream. -
namestring Fieldrequired -
Name of the timestamp field for the data stream, which must be
@timestamp. The@timestampfield must be included in every document indexed to the data stream. -
index_modeIndexMode -
The index mode for the data stream that will be used for newly created backing indices.
-
Values:
standardtime_serieslogsdblookup