> ## Documentation Index
> Fetch the complete documentation index at: https://docs.ocient.com/llms.txt
> Use this file to discover all available pages before exploring further.

# LAT Record Filtering

> (deprecated) Filter records in Ocient LAT pipelines using expression-based rules to drop, route, or accept incoming records before they reach transformation and load stages.

export const Ocient = "Ocient®";

<Warning>
  Data Pipelines are now the preferred method for loading data into the {Ocient} System. For details, see [Load Data](/load-data). The LAT loading functionality will be removed in version 29.0.
</Warning>

You can optionally filter incoming records by a JMESPath expression added with an additional filter key in a pipeline configuration.

```json JSON theme={null}
{
    "transform": {
        "topics": {
            "my_topic": {
                "filter": "<jmespath-expression>",
                "tables": {
                    "my_table": {
                        "filter": "<jmespath-expression>",
                        "columns": {}
                    }
                }
            }
        }
    }
}
```

Records that pass through the filter (the filter expression evaluates to true) are processed as normal, while records that fail the filter (the filter expression evaluates to false) are dropped. Note that you can apply filters at the topic or table levels. A record needs to pass through all configured filters in order to be loaded to a table.

The filter JMESPath expression must evaluate to a `boolean` value. Examples of this are JMESPath comparators or functions that return a `boolean` like `contains`, `starts_with`, and `ends_with`.

## Example

Pipeline:

```json JSON theme={null}
{
    "transform": {
        "topics": {
            "topic0": {
                "filter": "integer0 == `2`",
                "tables": {
                    "table0": {
                        "filter": "integer1 == `3`",
                        "columns": {
                            "col0": "integer0",
                            "col1": "integer1"
                        }
                    }
                }
            }
        }
    }
}
```

Input:

```json JSON theme={null}
[
    {
        "integer0": 0,
        "integer1": 3
    },
    {
        "integer0": 2,
        "integer1": 1
    },
    {
        "integer0": 2,
        "integer1": 3
    }
]
```

Output:

```json JSON theme={null}
[
    {
        "integer0": 2,
        "integer1": 3
    }
]
```

## Related Links

[Ingest Data with Legacy LAT Reference](/ingest-data-with-legacy-lat-reference)
