Ingest processor context

Serverless Stack

Use a Painless script in an ingest processor to modify documents upon insertion.

The ingest processor context enables document transformation during the indexing process, allowing you to enrich, modify, or restructure data before it’s stored in Elasticsearch.
Painless scripts run as script processors within ingest pipelines that support script execution.

Ingest pipelines consist of multiple processors that can transform documents sequentially. The script processor allows Painless scripts to access and modify document fields using the ctx variable during this transformation process.

The pipelines processing proceeds through four steps.

• Documents enter the ingest pipeline.
• Each processor transforms the document according to its configuration.
• Script processors execute Painless code to perform custom transformations.
• Modified documents are indexed into Elasticsearch.

For more information refer to Elasticsearch ingest pipelines. You can also check the troubleshooting guide for help with ingest pipelines failures.

params (Map, read-only)

User-defined parameters passed in as part of the query.

ctx['_index'] (String)

The name of the index.

ctx (Map)

Contains extracted JSON in a Map and List structure for the fields that are part of the document.

ctx['_index']

Modify this to change the destination index for the current document.

ctx (Map)

Modify the values in the Map/List structure to add, modify, or delete the fields of a document.

void

No expected return value.

Both the standard Painless API and specialized Field API are available.

To run the example, first install the eCommerce sample data.

The following example demonstrates how to use a script inside an ingest pipeline to create a new field named custom_region_code. This field combines the geoip.country_iso_code and the first two uppercase letters of geoip.continent_name.

String country = ctx.geoip.country_iso_code;

ctx.custom_region_code = country + '_' + ctx.geoip.continent_name.substring(0,2).toUpperCase();
		

The following request runs during ingestion time and uses the ctx object to access and modify the document fields.

PUT /_ingest/pipeline/kibana_sample_data_ecommerce-custom_region_code
{
  "description": "generate region code from country and continent name for kibana_sample_data_ecommerce dataset",
  "processors": [
    {
      "script": {
        "lang": "painless",
        "source": """
          String country = ctx.geoip.country_iso_code;

          ctx.custom_region_code = country + '_' + ctx.geoip.continent_name.substring(0,2).toUpperCase();
        """
      }
    }
  ]
}