CSV processor
Extracts fields from CSV line out of a single text field within a document. Any empty field in CSV will be skipped.
| Name | Required | Default | Description |
|---|---|---|---|
field |
yes | - | The field to extract data from |
target_fields |
yes | - | The array of fields to assign extracted values to |
separator |
no | , | Separator used in CSV, has to be single character string |
quote |
no | " | Quote used in CSV, has to be single character string |
ignore_missing |
no | false |
If true and field does not exist, the processor quietly exits without modifying the document |
trim |
no | false |
Trim whitespaces in unquoted fields |
empty_value |
no | - | Value used to fill empty fields, empty fields will be skipped if this is not provided. Empty field is one with no value (2 consecutive separators) or empty quotes ("") |
description |
no | - | Description of the processor. Useful for describing the purpose of the processor or its configuration. |
if |
no | - | Conditionally execute the processor. See Conditionally run a processor. |
ignore_failure |
no | false |
Ignore failures for the processor. See Handling pipeline failures. |
on_failure |
no | - | Handle failures for the processor. See Handling pipeline failures. |
tag |
no | - | Identifier for the processor. Useful for debugging and metrics. |
{
"csv": {
"field": "my_field",
"target_fields": ["field1", "field2"]
}
}
If the trim option is enabled then any whitespace in the beginning and in the end of each unquoted field will be trimmed. For example with configuration above, a value of A, B will result in field field2 having value {{nbsp}}B (with space at the beginning). If trim is enabled A, B will result in field field2 having value B (no whitespace). Quoted fields will be left untouched.