# Ocient Documentation

> Documentation for setup, integration, administration, querying, loading, and reference material for the OcientAIQ Unified Data Platform.

- [Get Started with the OcientAIQ Unified Data Platform](https://docs.ocient.com/index.md): Welcome to Ocient documentation. Find setup guides, SQL references, machine learning, geospatial features, integrations, and operations for the platform.
- [Key Concepts](https://docs.ocient.com/key-concepts.md): Learn the core concepts behind the Ocient System, including architecture, scalability, and analytics designed for large complex data sets.
- [Load and Analyze Data](https://docs.ocient.com/load-and-analyze-data.md): End-to-end tutorial: connect to Ocient, create a database and table, load sample data with a data pipeline, validate the results, and run analytic queries.
- [Work with AI Prompts](https://docs.ocient.com/work-with-ai-prompts.md): Draft high-quality prompts to help AI tools use Ocient documentation and SQL accurately, with copy-paste templates and guidance on anchoring on sources.
- [Connect to Ocient](https://docs.ocient.com/connect-to-ocient.md): Connect client applications to an Ocient SQL Node using JDBC, pyocient, or REST on the default port 4050 with automatic load balancing across nodes.
- [Ocient Integrations](https://docs.ocient.com/ocient-integrations.md): Explore Ocient integrations with popular analytics tools and platforms to enhance data processing and analysis capabilities across your existing systems.
- [Looker Connector](https://docs.ocient.com/looker-connector.md): Connect Looker Studio to an Ocient System using the Google Apps Script community connector to visualize warehouse data in interactive dashboards and reports.
- [DBeaver Integration](https://docs.ocient.com/dbeaver-integration.md): Learn how to integrate Ocient with DBeaver, enabling a powerful and intuitive interface for managing and analyzing your Ocient data.
- [Metabase Integration](https://docs.ocient.com/metabase-integration.md): Integrate Ocient with Metabase to build dashboards and visualizations using JDBC, including driver setup, connection settings, and example queries.
- [SQLAlchemy Integration](https://docs.ocient.com/sqlalchemy-integration.md): Connect Ocient with SQLAlchemy for efficient data querying and manipulation, enhancing SQL capabilities in your Ocient database environment.
- [Superset Integration](https://docs.ocient.com/superset-integration.md): Integrate Ocient with Apache Superset for dynamic data visualizations and dashboards, empowering data-driven decision-making at scale.
- [Tableau Integration](https://docs.ocient.com/tableau-integration.md): Connect Ocient with Tableau to unlock advanced data visualization and reporting, driving actionable insights from massive data sets.
- [Connect Using JDBC](https://docs.ocient.com/connect-using-jdbc.md): Learn how to set up and configure a JDBC connection to Ocient, ensuring secure and efficient data access for large-scale analytics.
- [Connect Using pyocient](https://docs.ocient.com/connect-using-pyocient.md): Follow this guide to establish a Pyocient connection to the Ocient data warehouse, enabling Python-based data operations and analysis.
- [Load Data](https://docs.ocient.com/load-data.md): Overview of Ocient data pipelines for SQL-based ETL: real-time transformations, deduplication, parallel processing, and support for S3, Kafka, and HDFS sources.
- [Data Pipeline Load of CSV Data from S3](https://docs.ocient.com/data-pipeline-load-of-csv-data-from-s3.md): Load CSV data from AWS S3 into Ocient using a data pipeline. This tutorial covers database, table, and pipeline creation, execution, and monitoring.
- [Data Pipeline Load of JSON Data from Kafka](https://docs.ocient.com/data-pipeline-load-of-json-data-from-kafka.md): Stream JSON data from Kafka topics into Ocient with data pipelines. Set up the database, table, pipeline, and SQL transformations for real-time analytics.
- [Data Pipeline Load of Parquet Data from S3](https://docs.ocient.com/data-pipeline-load-of-parquet-data-from-s3.md): Load time-partitioned Parquet files from AWS S3 into Ocient tables with data pipelines and SQL transformations. Includes setup, execution, and monitoring.
- [Data Pipeline Load of JSON Data from HDFS](https://docs.ocient.com/data-pipeline-load-of-json-data-from-hdfs.md): Load JSON data from HDFS into the Ocient System using a data pipeline. Preview the data load, execute the pipeline, and monitor its progress.
- [Data Types for Data Pipelines](https://docs.ocient.com/data-types-for-data-pipelines.md): Reference for how Ocient data types map to source data formats during data pipeline loads, including conversions, NULL handling, and supported coercions.
- [Data Formats for Data Pipelines](https://docs.ocient.com/data-formats-for-data-pipelines.md): Load JSON, DELIMITED, Avro, Parquet, and other formats into Ocient with data pipelines, including field selectors, type interpretation, and NULL handling.
- [JSON Selectors Examples in Data Pipelines](https://docs.ocient.com/json-selectors-examples-in-data-pipelines.md): Examples for selecting scalar values, arrays, nested fields, and NULL values from JSON records in Ocient data pipelines using field-selector expressions.
- [Parquet Selectors Examples in Data Pipelines](https://docs.ocient.com/parquet-selectors-examples-in-data-pipelines.md): Examples for selecting columns from Parquet files in Ocient data pipelines using the Parquet schema, with SQL-style field references and links to references.
- [Data Pipeline Behavior Considerations](https://docs.ocient.com/data-pipeline-behavior-considerations.md): Understand how Ocient data pipelines handle file resumption, Kafka offsets, exactly-once semantics, deduplication, and database and table dependencies.
- [Transform Data in Data Pipelines](https://docs.ocient.com/transform-data-in-data-pipelines.md): Transform data during loading in Ocient data pipelines using source field references and SQL transformation functions to clean and prepare records.
- [Special Data Pipeline Transformation Functions](https://docs.ocient.com/special-data-pipeline-transformation-functions.md): The Data Pipeline functionality allows data transformation during loading using SQL functions like `EXPLODE_OUTER`, which expands arrays into individual rows.
- [Data Types for User-Defined Data Pipeline Functions](https://docs.ocient.com/data-types-for-user-defined-data-pipeline-functions.md): Reference for Java packages and classes used in Ocient user-defined data pipeline functions, including column type enumerations and array and tuple definitions.
- [Load Geospatial Data in Data Pipelines](https://docs.ocient.com/load-geospatial-data-in-data-pipelines.md): Load geospatial data into Ocient with data pipelines using OcientGeo functions such as ST_POINT, ST_LINESTRING, and ST_POLYGON for spatial analytics.
- [Load Data with a User-Defined Data Pipeline Function](https://docs.ocient.com/load-data-with-a-user-defined-data-pipeline-function.md): Load data into Ocient with user-defined data pipeline functions written in Java to handle custom source formats, transformations, and business logic.
- [Load Data from External Sources in Data Pipelines](https://docs.ocient.com/load-data-from-external-sources-in-data-pipelines.md): Use the LOOKUP keyword and LOOKUP function in CREATE PIPELINE statements to enrich data loads in Ocient by joining records with external source tables.
- [Load Data into Multiple Targets in Data Pipelines](https://docs.ocient.com/load-data-into-multiple-targets-in-data-pipelines.md): Use one Ocient data pipeline to load time-partitioned data from AWS S3 into multiple target tables in batches for parallel ingestion and routing.
- [Load metadata and partitioned data in data pipelines](https://docs.ocient.com/load-metadata-and-file-based-partitioned-data-in-data-pipelines.md): Use the METADATA() function in Ocient data pipelines to extract file metadata such as filenames and creation timestamps from source records during loading.
- [Deduplication in Data Pipelines](https://docs.ocient.com/deduplication-in-data-pipelines.md): Ocient data pipelines deduplicate records by tracking load position and lifecycle, ensuring exactly-once delivery even when pipelines stop, resume, or update.
- [Error Tolerance in Data Pipelines](https://docs.ocient.com/error-tolerance-in-data-pipelines.md): Configure the ERROR LIMIT clause on Ocient data pipelines to set how many record-level errors a batch tolerates before the pipeline enters a FAILED status.
- [Monitor Data Pipelines](https://docs.ocient.com/monitor-data-pipelines.md): Data Pipeline functionality allows for monitoring through system catalog tables, information schema views, and operational metrics endpoints.
- [Manage Errors in Data Pipelines](https://docs.ocient.com/manage-errors-in-data-pipelines.md): Guide to managing errors in Ocient data pipelines using JSON from Kafka, including bad-data handling, record inspection, pipeline status, and error limits.
- [Frequently Asked Questions for Data Pipelines](https://docs.ocient.com/frequently-asked-questions-for-data-pipelines.md): Frequently asked questions about Ocient data pipelines, covering setup, deduplication, error handling, monitoring, performance, and source-format support.
- [Query Ocient](https://docs.ocient.com/query-ocient.md): Master querying techniques in Ocient’s data warehouse, including tips for optimizing performance and handling complex data queries.
- [Quick Start Querying](https://docs.ocient.com/quick-start-querying.md): Quick start tutorial for querying data in Ocient, covering connection setup, basic SELECT statements, filtering, joining, and aggregating sample datasets.
- [Query Performance Tuning](https://docs.ocient.com/query-performance-tuning.md): The Query Performance Tuning page explains how to optimize query execution in Ocient to achieve low latency and high throughput on large, complex workloads.
- [Ocient HTTP Query API](https://docs.ocient.com/ocient-http-query-api.md): The Ocient HTTP Query API lets you execute SQL statements over REST. The API follows the OpenAPI Specification (Swagger) for tooling and client generation.
- [execute](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-execute.md): Executes a SQL statement and returns the results. Supports requests for both regular and streaming responses. With streaming, results return as they become available using the HTTP chunked transfer encoding. Each chunk contains a valid JSON object that you can parse independently. For details on str…
- [execute](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/get-execute.md): Alternative GET method for executing SQL statements. This method passes parameters as URL query parameters. This method does not support the params body parameter. Specify which database to access in the query parameters. If you do not specify a database, the connection defaults to the database from…
- [info](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/get-info.md): Returns basic system version information about the Ocient System and the HTTP Query API server. You can use this endpoint to verify connectivity and to check compatible versions.
- [login](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-login.md): Authenticates a user with a username and password and then returns a token for use in subsequent API calls. This request also sets a session cookie. Include the returned access token in the authorization header for subsequent requests in the format: Authorization: Bearer {token}.
- [logout](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-logout.md): Log out from a SQL session. This clears any associated cookies, but does not invalidate any access tokens. This endpoint terminates only the cookie-based session. Any bearer tokens that were previously issued continue to work until they expire. You must discard any stored bearer tokens to complete t…
- [sso_authentication](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-sso-authentication.md): Initiates the OpenID Connect authentication process by redirecting to the authorization server. This endpoint begins the standard OpenID Connect authentication process: 1. The client calls this endpoint with a callback path. 2. The server responds with a redirect to the identity provider. 3. The use…
- [callback](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/get-callback.md): Provides the authentication token for the OpenID Connect authentication process. The authorization server redirects to callback path after successful authentication. This endpoint receives the authorization code from the OpenID provider and exchanges it for a token. The provider redirects the user t…
- [sso_token](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-sso-token.md): Exchange an OpenID Connect identifier token or access token for an Ocient access token. This endpoint allows clients to directly exchange tokens without following the full browser-based authentication process. This exchange is useful for server-to-server scenarios or when the client already has a va…
- [sso_device_grant](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-sso-device-grant.md): Retrieve an OpenID device grant code that the Ocient System can verify and use with the sso_device_grant_verify endpoint. The device grant process is intended for devices with limited input capabilities or no web browser: 1. Call this endpoint to retrieve a user code and verification URI. 2. Display…
- [sso_device_grant_verify](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-sso-device-grant-verify.md): Verify a previous device grant request and return an authorization token. After initiating a device grant process with the sso_device_grant endpoint, use this endpoint to check if the user has completed the verification process. If the verification is successful, the endpoint returns an authorizatio…
- [token_refresh](https://docs.ocient.com/api-playgrounds/ocient-http-query-api/post-token-refresh.md): Refreshes an existing access token, extending its validity period. Call this endpoint before the current token expires to maintain uninterrupted access. Use the expires_in value from the login or previous refresh response to determine when to refresh the token. A common practice is to refresh when t…
- [Understanding Data Types](https://docs.ocient.com/understanding-data-types.md): Understand how Ocient stores and manipulates supported data types, including precision, range, storage size, and conversion across numeric and text values.
- [Array, Tuple, and Matrix Overview](https://docs.ocient.com/array-tuple-and-matrix-overview.md): Overview of array, tuple, and matrix data structures in Ocient SQL, with guidance on constructing, indexing, and operating on nested or composite values.
- [Functions Overview](https://docs.ocient.com/functions-overview.md): Explore Ocient function library for data analysis, manipulation, and transformations, empowering complex querying and calculations.
- [Text Analysis in Database Queries](https://docs.ocient.com/text-analysis-in-database-queries.md): Use Ocient text analysis SQL functions for tokenization, stemming, search, and pattern matching to extract insights from text columns at large scale.
- [Machine Learning in Ocient](https://docs.ocient.com/machine-learning-in-ocient.md): Integrate machine learning models into Ocient queries with OcientML for advanced data analysis, empowering predictive and classification insights.
- [Regression Analysis](https://docs.ocient.com/regression-analysis.md): Apply regression analysis within Ocient with OcientML to understand relationships in data and make predictions based on historical trends.
- [Classification Analysis](https://docs.ocient.com/classification-analysis.md): Use classification analysis techniques within Ocient with OcientML to categorize data, helping in decision-making and pattern identification.
- [Clustering Analysis and Dimensionality Reduction](https://docs.ocient.com/clustering-analysis-and-dimensionality-reduction.md): Apply clustering and dimensionality reduction in Ocient with OcientML using k-means, PCA, and related algorithms for unsupervised exploration of data.
- [Transactions](https://docs.ocient.com/transactions.md): Learn how the OcientAIQ Unified Data Platform supports transactions in Ocient SQL and in the JDBC and pyocient drivers, including the supported SQL statements.
- [Database Administration](https://docs.ocient.com/database-administration.md): Administer Ocient databases with tasks for user management, permissions, backups, monitoring, performance tuning, and ongoing operational maintenance.
- [Ocient Security Guide](https://docs.ocient.com/ocient-security-guide.md): Enhance Ocient System security with best practices for authentication, network security, encryption, access control, auditing, and regulatory compliance. This page lists ports and protocols needed for internal and external communication.
- [Set Up Data Encryption](https://docs.ocient.com/set-up-data-encryption.md): Set up Ocient data encryption on TCG Opal-compliant drives using the Thales CipherTrust Manager KMS with KMIP to securely manage encryption secrets.
- [Workload Management Walkthrough](https://docs.ocient.com/workload-management-walkthrough.md): Walkthrough for configuring workload management in Ocient with service classes, query priorities, and resource limits to balance interactive and batch loads.
- [Workload Management and Service Classes](https://docs.ocient.com/workload-management-and-service-classes.md): Use Ocient workload management and service classes to prioritize queries, allocate CPU and memory, and enforce concurrency limits across users and applications.
- [Result Set Caching](https://docs.ocient.com/result-set-caching.md): Use result-set caching in Ocient to accelerate repeated queries by returning cached results, with controls for cache invalidation, size, and per-query options.
- [Object-Type Level Privileges Management](https://docs.ocient.com/object-type-level-privileges-management.md): Grant, verify, and revoke object-type level privileges in Ocient with step-by-step SQL workflows for controlling access to views in a database.
- [Manage Users, Groups, and Roles](https://docs.ocient.com/manage-users-groups-and-roles.md): Manage users, groups, and roles in Ocient with SQL DCL statements to enforce role-based access control over databases, tables, views, and other objects.
- [Authentication Methods](https://docs.ocient.com/authentication-methods.md): Overview of authentication methods supported by Ocient, including database password, single sign-on (SSO), OpenID Connect, and token-based access.
- [Database Password Security Settings](https://docs.ocient.com/database-password-security-settings.md): Configure password security in Ocient with controls for expiration, lockout, complexity, history, and user account states to meet compliance requirements.
- [Storage Optimization](https://docs.ocient.com/storage-optimization.md): Reduce storage footprint in an Ocient System using table-level compression, system-level configuration, and data lifecycle management techniques.
- [TimeKeys and Clustering Keys](https://docs.ocient.com/timekeys-and-clustering-keys.md): Use time keys and clustering keys in Ocient to organize table data on disk for fast time-range filtering, efficient pruning, and improved query throughput.
- [Secondary Indexes](https://docs.ocient.com/secondary-indexes.md): Create and use secondary indexes in Ocient to accelerate selective queries on high-cardinality columns, with syntax, constraints, and performance tips.
- [Table Compression Options](https://docs.ocient.com/table-compression-options.md): Configure Ocient table compression options, including dictionary, run-length, and delta encodings, to reduce storage costs and accelerate scan performance.
- [Global Dictionary Compression](https://docs.ocient.com/global-dictionary-compression.md): Use global dictionary compression in Ocient to reduce storage costs on repeated string values and accelerate query performance with dictionary-based filters.
- [Table Retention Policies](https://docs.ocient.com/table-retention-policies.md): Ocient table retention policies automate data lifecycle by deleting aged records based on time-key columns, reducing manual maintenance and optimizing storage.
- [CREATE TABLE SQL Statement Examples](https://docs.ocient.com/create-table-sql-statement-examples.md): Examples of the Ocient CREATE TABLE SQL statement showing time-keyed tables, clustering keys, secondary indexes, partitioning, and supported data types.
- [Manage Distributed Tasks](https://docs.ocient.com/manage-distributed-tasks.md): Distributed tasks run in the background of the Ocient System to keep it running smoothly, with persistent state in the global metadata storage cluster.
- [Remove Records from an Ocient System](https://docs.ocient.com/remove-records-from-an-ocient-system.md): Remove records from an Ocient System safely using DELETE statements, retention policies, and segment-level operations while preserving data consistency.
- [System Administration](https://docs.ocient.com/system-administration.md): Install, configure, and maintain an Ocient System. Covers hardware and software requirements, performance management, monitoring, and ongoing operations.
- [Ocient Management UI Features](https://docs.ocient.com/ocient-management-ui.md): Overview of the Ocient Management UI for monitoring, managing, and interacting with your Ocient System through a web-based interface.
- [Ocient Management UI Configuration](https://docs.ocient.com/ocient-management-ui-configuration.md): Connect to and configure the Ocient Management UI, including login, access control, ocui package management, connection endpoints, and SSL certificates.
- [Install an Ocient System](https://docs.ocient.com/install-an-ocient-system.md): Install an Ocient System with this end-to-end guide covering hardware setup, OS preparation, application installation, node bootstrapping, and validation.
- [Ocient Application Installation](https://docs.ocient.com/ocient-application-installation.md): Install the Ocient application on supported Linux distributions, including package management, prerequisites, and post-install service verification steps.
- [Configure the Operating System](https://docs.ocient.com/configure-the-operating-system.md): Configure the Linux operating system on Ocient nodes, including kernel parameters, NUMA, huge pages, NVMe tuning, and network stack settings for performance.
- [Ocient System Bootstrapping](https://docs.ocient.com/ocient-system-bootstrapping.md): Bootstrap an Ocient System by initializing nodes, configuring storage spaces, and validating cluster membership to prepare for production workloads.
- [Ocient Application Configuration](https://docs.ocient.com/ocient-application-configuration.md): Configure the Ocient application for production deployments, including service settings, storage spaces, network bindings, security, and performance parameters.
- [Installation Reference](https://docs.ocient.com/installation-reference.md): Reference for installing an Ocient System, including supported platforms, hardware checks, package layout, configuration files, and post-install validation.
- [Ocient System Sizing](https://docs.ocient.com/ocient-system-sizing.md): Size an Ocient System for your data and query needs by gathering uncompressed data size, format, compression ratios, load rates, and query types for capacity.
- [Ocient System Requirements](https://docs.ocient.com/ocient-system-requirements.md): Hardware and software requirements for running an Ocient System, including supported CPUs, memory, NVMe storage, networking, and operating system versions.
- [Ocient System Hardware Specifications](https://docs.ocient.com/ocient-system-hardware-specifications.md): Hardware specifications for Foundation, Loader, and SQL Nodes in an Ocient System, with supported components, performance specs, and deployment guidance.
- [Checking System Configuration Before Bootstrapping](https://docs.ocient.com/checking-system-configuration-before-bootstrapping.md): Validate Ocient System configuration before bootstrapping nodes, including hostnames, networking, disk layout, and configuration files to prevent setup errors.
- [Checking System After Configuration](https://docs.ocient.com/checking-system-after-configuration.md): Verify that an Ocient System is healthy after configuration by checking node status, storage spaces, network connectivity, and core service operation.
- [Node Bootstrapping Reference](https://docs.ocient.com/node-bootstrapping-reference.md): Access reference documentation for bootstrapping individual nodes in an Ocient system, optimizing for scalability and reliability.
- [Amazon Web Services Ocient Installation](https://docs.ocient.com/amazon-web-services-ocient-installation.md): Install and deploy an Ocient System on Amazon Web Services (AWS), including EC2 instance selection, storage configuration, and networking for cloud workloads.
- [Google Cloud Platform Ocient Installation](https://docs.ocient.com/google-cloud-platform-ocient-installation.md): Set up an Ocient system on Google Cloud Platform, utilizing cloud infrastructure for scalable and efficient data warehousing.
- [Configure Storage Spaces](https://docs.ocient.com/configure-storage-spaces.md): Configure storage spaces in an Ocient System, including segment group width, parity width, and overprovisioning for fault tolerance and capacity planning.
- [Ocient Software Upgrade](https://docs.ocient.com/ocient-software-upgrade.md): Upgrade Ocient System software with a rolling upgrade procedure that maintains uptime, validates node compatibility, and preserves query availability.
- [Maintenance Overview](https://docs.ocient.com/maintenance-overview.md): Overview of routine maintenance tasks in an Ocient System, including software upgrades, hardware replacement, rebuilds, monitoring, and capacity planning.
- [Guide to Rebuilding Segments](https://docs.ocient.com/guide-to-rebuilding-segments.md): Step-by-step guide to rebuilding segments in an Ocient System using distributed tasks to restore redundancy after disk replacement or node failure events.
- [Startup and Shutdown Procedure](https://docs.ocient.com/startup-and-shutdown-procedure.md): Startup and shutdown procedures for an Ocient System that preserve data integrity, drain queries cleanly, and bring services online in the correct order.
- [Power Safety Recommendations](https://docs.ocient.com/power-safety-recommendations.md): Power safety recommendations for Ocient hardware deployments, including UPS, redundant power supplies, and safe shutdown procedures to prevent data corruption.
- [NVMe Drive Firmware Upgrade Process](https://docs.ocient.com/nvme-drive-firmware-upgrade-process.md): Step-by-step process for upgrading NVMe drive firmware on Ocient Foundation Nodes to maintain drive reliability, performance, and vendor support.
- [Replace an NVMe Node Drive](https://docs.ocient.com/replace-an-nvme-node-drive.md): Procedure for replacing an NVMe drive on an Ocient Foundation Node, including service rotation, drive bootstrapping, and segment rebuild to restore redundancy.
- [Expand and Rebalance System](https://docs.ocient.com/expand-and-rebalance-system.md): Expand an Ocient System by adding storage and SQL nodes, then rebalance segments across the cluster to maintain capacity, performance, and fault tolerance.
- [Replace Nodes](https://docs.ocient.com/replace-nodes.md): Procedure for replacing nodes in an Ocient System, including drain, configuration, bootstrap, and segment redistribution steps to minimize downtime.
- [Backup and Restore](https://docs.ocient.com/backup-and-restore.md): Back up and restore Ocient databases using the BACKUP and RESTORE SQL statements to protect data, recover from failures, and migrate between environments.
- [Log Monitoring](https://docs.ocient.com/log-monitoring.md): Monitor logs in an Ocient System to detect errors, audit access, and diagnose performance problems across SQL Nodes, Foundation Nodes, and data pipelines.
- [Statistics Monitoring](https://docs.ocient.com/statistics-monitoring.md): Monitor Ocient System statistics, including query throughput, resource utilization, and pipeline metrics, to maintain visibility into operational performance.
- [Prometheus Metrics Endpoint](https://docs.ocient.com/prometheus-metrics-endpoint.md): Access Ocient System metrics in Prometheus exposition format using the /metrics endpoint for integration with Prometheus, Grafana, Datadog, and other monitoring tools.
- [Datadog Integration](https://docs.ocient.com/datadog-integration.md): Monitor Ocient cluster health and query performance by collecting metrics with the official Datadog Ocient integration.
- [System Information REST Endpoints](https://docs.ocient.com/system-information-rest-endpoints.md): Access Ocient system information through REST endpoints to query configuration, statistics, status, and version data for monitoring and automation use cases.
- [Get Statistics](https://docs.ocient.com/api-playgrounds/system-information-rest-endpoints/get-statistics.md): Retrieve the statistics on each node in the database.
- [Get Version](https://docs.ocient.com/api-playgrounds/system-information-rest-endpoints/get-version.md): Retrieve the version of the software running.
- [Get Status](https://docs.ocient.com/api-playgrounds/system-information-rest-endpoints/get-status.md): Retrieve the status of the software running.
- [Get Configuration](https://docs.ocient.com/api-playgrounds/system-information-rest-endpoints/get-configuration.md): Retrieve the configuration about this node in JSON format.
- [Get Configuration of Whole System](https://docs.ocient.com/api-playgrounds/system-information-rest-endpoints/get-configuration-of-whole-system.md): Retrieve the configuration of the system as a whole in JSON format.
- [Get Configuration Parameters](https://docs.ocient.com/api-playgrounds/system-information-rest-endpoints/get-configuration-parameters.md): Retrieve values of configuration parameters.
- [Set Up System Monitoring with the TIG Stack and Kapacitor](https://docs.ocient.com/set-up-system-monitoring-with-the-tig-stack-and-kapacitor.md): Monitor an Ocient System with the TIG stack (Telegraf, InfluxDB, Grafana) and Kapacitor for metrics, dashboards, alerting, and capacity planning insight.
- [Monitor Segment Group Transfers](https://docs.ocient.com/monitor-segment-group-transfers.md): Monitor segment group transfers in Ocient during expansions, rebuilds, or rebalances using SQL queries and system catalog tables to track transfer progress.
- [Inspect the Current Configuration](https://docs.ocient.com/inspect-the-current-configuration.md): Inspect the current configuration of an Ocient System using SQL queries, the REST API, and system catalog tables to verify settings before changes.
- [Node Configuration with the Administrator Role](https://docs.ocient.com/node-configuration-with-the-administrator-role.md): Configure individual nodes in an Ocient System using the Administrator role, including bootstrapping parameters, storage settings, and per-node overrides.
- [Manage the Network Configuration of an Ocient System](https://docs.ocient.com/manage-the-network-configuration-of-an-ocient-system.md): Manage network configuration for an Ocient System, including hostnames, IP addresses, ports, NIC bonding, and inter-node communication for production.
- [Secure Connections Using TLS](https://docs.ocient.com/secure-connections-using-tls.md): Secure client and inter-node connections to an Ocient System using TLS, including certificate management, cipher configuration, and JDBC and pyocient setup.
- [Multiple Storage Clusters for Loading Data](https://docs.ocient.com/multiple-storage-clusters-for-loading-data.md): Use multiple storage clusters in an Ocient System to scale loading by distributing pipeline ingestion across independent storage and compute capacity.
- [Alter Default Data Pipeline Behavior](https://docs.ocient.com/alter-default-data-pipeline-behavior.md): Use the ALTER SYSTEM ALTER CONFIG SQL command in Ocient to tune data pipeline parameters such as execution time, partition counts, and type inference.
- [Configuration Settings for Data Pipelines](https://docs.ocient.com/configuration-settings-for-data-pipelines.md): Reference for Ocient data pipeline configuration settings, including JVM memory, S3 timeouts, Kafka polling, Parquet memory limits, and file system access.
- [Configure Data Pipeline Logging](https://docs.ocient.com/configure-data-pipeline-logging.md): Adjust log levels for Ocient data pipelines with the ALTER SYSTEM ALTER LOG LEVEL SQL command to troubleshoot loading issues without impacting performance.
- [Air-Gapped Environment with an Ocient System](https://docs.ocient.com/air-gapped-environment-with-an-ocient-system.md): Deploy and operate an Ocient System in an air-gapped environment to protect sensitive data, with no special configuration required for full isolation.
- [Ocient MCP Server](https://docs.ocient.com/ocient-mcp-server.md): Connect AI agents to Ocient with the Ocient MCP Server. Discover schemas, execute SQL statements, and extend the tool surface with user-defined MCP tools.
- [Data Analytics Workflow Using the Ocient MCP Server](https://docs.ocient.com/data-analytics-workflow-using-the-ocient-mcp-server.md): Incorporate the Ocient MCP Server into an end-to-end data analytics workflow with an AI agent, from loading data to analysis and reporting.
- [Build an AI Agent with the Ocient MCP Server](https://docs.ocient.com/build-an-ai-agent-with-the-ocient-mcp-server.md): Build your own AI agent on the Ocient MCP Server. Connect with the MCP SDK, discover tools, execute SQL statements, and design a governed tool surface.
- [Ocient Simulator](https://docs.ocient.com/ocient-simulator.md): Use the Ocient Simulator to test queries, validate schemas, and prototype data pipelines in a lightweight local environment before deploying to production.
- [Ocient Architecture](https://docs.ocient.com/ocient-architecture.md): Architecture of the Ocient System, including compute-adjacent storage, distributed query execution, and analytics components at scale.
- [Core Elements of an Ocient System](https://docs.ocient.com/core-elements-of-an-ocient-system.md): Explore the core elements of an Ocient System, including SQL Nodes, Foundation Nodes, Loader Nodes, storage clusters, and the global metadata services.
- [Compute-Adjacent Input and Output on Large Working Sets](https://docs.ocient.com/compute-adjacent-input-and-output-on-large-working-sets.md): Ocient compute-adjacent storage architecture co-locates compute and NVMe storage to deliver high throughput on large working sets and analytic queries.
- [Query Performance Optimizations](https://docs.ocient.com/query-performance-optimizations.md): Tune query performance in Ocient using indexing, clustering keys, time keys, statistics, materialization, and workload-aware query design patterns.
- [Plan Optimization](https://docs.ocient.com/plan-optimization.md): Optimize query execution plans in Ocient by reviewing EXPLAIN output, applying hints, tuning statistics, and adjusting workload settings for performance.
- [Exabyte Scalability Design](https://docs.ocient.com/exabyte-scalability-design.md): How the Ocient System scales to exabyte-class data sets using its distributed compute-adjacent storage architecture, parity, and high-throughput design.
- [Loading Characteristics and Concepts](https://docs.ocient.com/loading-characteristics-and-concepts.md): Core concepts behind data loading in Ocient, including parallelism, batching, deduplication, time-key partitioning, and end-to-end throughput considerations.
- [SQL Reference](https://docs.ocient.com/sql-reference.md): SQL reference for Ocient, covering syntax, supported statements, expressions, functions, and conventions for analytic queries against the data warehouse.
- [Alphabetical SQL Functions List](https://docs.ocient.com/alphabetical-sql-functions-list.md): Alphabetical reference of all SQL functions in Ocient, including math, string, date, conversion, geospatial, machine learning, and aggregates.
- [Categorized SQL Functions List](https://docs.ocient.com/categorized-sql-functions-list.md): Categorized reference of Ocient SQL functions grouped by purpose, including aggregate, conversion, date and time, math, string, spatial, and machine learning.
- [Aggregate Functions](https://docs.ocient.com/aggregate-functions.md): Reference for Ocient SQL aggregate functions, including SUM, AVG, COUNT, MIN, MAX, and approximate aggregates for computing values across rows in queries.
- [Array Functions and Operators](https://docs.ocient.com/array-functions-and-operators.md): Reference for Ocient SQL array functions and operators, with examples for constructing, accessing, slicing, concatenating, and aggregating array values.
- [Character and Binary Functions](https://docs.ocient.com/character-and-binary-functions.md): Reference for Ocient SQL character and binary functions for string manipulation, encoding, decoding, padding, regular expressions, and byte-level operations.
- [Data Types](https://docs.ocient.com/data-types.md): Reference of Ocient SQL data types, including numeric, character, date and time, boolean, network, geospatial, array, tuple, and matrix data types.
- [Date and Time Functions](https://docs.ocient.com/date-and-time-functions.md): Reference for Ocient SQL date and time functions, including timestamp arithmetic, formatting, parsing, time zone conversion, and date part extraction.
- [Formatting Functions](https://docs.ocient.com/formatting-functions.md): Reference for Ocient SQL formatting functions to convert values between text and other types using format strings, locales, padding, and precision options.
- [HyperLogLog Functions](https://docs.ocient.com/hyperloglog-functions.md): Reference for HyperLogLog functions in Ocient SQL for fast, approximate distinct counting at scale, including merge and cardinality estimation operations.
- [Geospatial Functions](https://docs.ocient.com/geospatial-functions.md): Reference for Ocient OcientGeo geospatial functions, including constructors, measurement, spatial relationships, and spatiotemporal operators for GIS data.
- [Attribute Functions](https://docs.ocient.com/attribute-functions.md): Reference for OcientGeo attribute functions used to inspect, extract, and modify properties of geospatial geometries such as points, linestrings, and polygons.
- [Conversion Functions](https://docs.ocient.com/conversion-functions.md): Reference for OcientGeo conversion functions that transform geospatial values between WKT, WKB, GeoJSON, and Ocient native point, linestring, and polygon types.
- [Linestring Constructors](https://docs.ocient.com/linestring-constructors.md): Construct linestring geometries in OcientGeo using ST_LINESTRING and related functions to build spatial line objects from point coordinates and arrays.
- [Linestring Functions](https://docs.ocient.com/linestring-functions.md): Reference for OcientGeo linestring functions to measure, transform, and inspect linear spatial geometries including length, projection, and conversion.
- [Point Constructors](https://docs.ocient.com/point-constructors.md): Construct point geometries in OcientGeo using ST_POINT and related functions to create spatial point values from latitude and longitude coordinate pairs.
- [Polygon Constructors](https://docs.ocient.com/polygon-constructors.md): Construct polygon geometries in OcientGeo using ST_POLYGON and related functions to build closed spatial regions from coordinate rings and boundaries.
- [Spatial Measurement](https://docs.ocient.com/spatial-measurement.md): Reference for OcientGeo spatial measurement functions that compute distance, length, area, perimeter, and other quantities on points, lines, and polygons.
- [Spatial Operators](https://docs.ocient.com/spatial-operators.md): Reference for OcientGeo spatial operators that perform geometric operations such as buffering, simplification, union, intersection, and difference.
- [Spatial Relationships](https://docs.ocient.com/spatial-relationships.md): Reference for OcientGeo spatial relationship functions including ST_INTERSECTS, ST_CONTAINS, ST_WITHIN, and other predicates for spatial joins and filtering.
- [Spatiotemporal Measurement](https://docs.ocient.com/spatiotemporal-measurement.md): Reference for OcientGeo spatiotemporal measurement functions that compute distance, duration, and velocity across space and time for trajectory analytics.
- [Spatiotemporal Operators](https://docs.ocient.com/spatiotemporal-operators.md): Reference for OcientGeo spatiotemporal operators that combine spatial and temporal predicates to analyze moving objects, trajectories, and geometries.
- [Machine Learning Model Functions](https://docs.ocient.com/machine-learning-model-functions.md): Reference for OcientML model functions used in SQL queries to invoke trained machine learning models for prediction, scoring, and feature engineering tasks.
- [Data Preparation](https://docs.ocient.com/data-preparation.md): Use Ocient SQL lag generators and vector assemblers to simplify time series feature engineering for regression, VAR, and neural network model inputs.
- [Regression Models](https://docs.ocient.com/regression-models.md): Train and apply OcientML regression models in SQL, including linear and tree-based regressors, to predict numeric outcomes from labeled training data.
- [Classification Models](https://docs.ocient.com/classification-models.md): Train and use OcientML classification models such as decision trees, random forests, and naive Bayes in SQL to categorize data and detect patterns.
- [Clustering and Dimension Reduction Models](https://docs.ocient.com/clustering-and-dimension-reduction-models.md): Train and apply OcientML clustering and dimensionality reduction models including k-means and PCA, with SQL syntax, model options, and example queries.
- [Ensemble Models](https://docs.ocient.com/ensemble-models.md): Learn how OcientML ensemble models (Bagging, Boosting, Stacking) combine base models to reduce errors and improve predictions, with SQL syntax and examples.
- [Other Models](https://docs.ocient.com/other-models.md): Reference for additional OcientML model types beyond classification, clustering, and regression, including association rules, time series, and neural networks.
- [Machine Learning Model Options](https://docs.ocient.com/machine-learning-model-options.md): Reference for OcientML model options, including required and optional parameters for association rules, bagging, boosting, decision trees, k-means, and more.
- [Math Functions and Operators](https://docs.ocient.com/math-functions-and-operators.md): Reference for Ocient SQL math functions and operators, including arithmetic, trigonometry, logarithms, exponents, rounding, and numeric type conversions.
- [Matrix Functions and Operators](https://docs.ocient.com/matrix-functions-and-operators.md): Reference for Ocient SQL matrix functions and operators for constructing, multiplying, transposing, and inspecting matrix values used in analytics and ML.
- [Network Type Functions](https://docs.ocient.com/network-type-functions.md): Reference for Ocient SQL network type functions that parse, inspect, and operate on IP address, CIDR block, and MAC address values for network analytics.
- [Scalar Data Conversion Functions](https://docs.ocient.com/scalar-data-conversion-functions.md): Reference for Ocient SQL scalar conversion functions such as CAST, CONVERT, TO_CHAR, and TO_NUMBER to transform values between supported data types.
- [Time Zone Functions](https://docs.ocient.com/time-zone-functions.md): Reference for Ocient SQL time zone functions that convert, format, and manipulate timestamp values across regions and IANA time zone database identifiers.
- [Tuple Functions and Operators](https://docs.ocient.com/tuple-functions-and-operators.md): Reference for Ocient SQL tuple functions and operators for constructing, accessing, comparing, and operating on composite tuple values in analytic queries.
- [Window Aggregate Functions](https://docs.ocient.com/window-aggregate-functions.md): Reference for Ocient SQL window aggregate functions that compute running sums, moving averages, ranks, and other windowed calculations over partitioned data.
- [Other Functions and Expressions](https://docs.ocient.com/other-functions-and-expressions.md): Reference for miscellaneous Ocient SQL functions and expressions that do not fit into a specific category, including system, session, and metadata utilities.
- [Data Definition Language (DDL) Statement Reference](https://docs.ocient.com/data-definition-language-ddl-statement-reference.md): Reference for Ocient Data Definition Language (DDL) statements, including CREATE, ALTER, and DROP for databases, tables, views, indexes, and other objects.
- [Cluster and Node Management](https://docs.ocient.com/cluster-and-node-management.md): Manage clusters and nodes in an Ocient System, including adding, removing, restarting, monitoring, and replacing storage, foundation, and SQL nodes.
- [Databases](https://docs.ocient.com/databases.md): Reference for managing databases in Ocient using SQL DDL, including CREATE DATABASE, ALTER DATABASE, and DROP DATABASE syntax with examples and options.
- [Schemas](https://docs.ocient.com/schemas.md): Manage schemas in Ocient using SQL DDL, including CREATE SCHEMA, ALTER SCHEMA, and DROP SCHEMA, plus guidance on namespacing tables, views, and indexes.
- [Tables](https://docs.ocient.com/tables.md): Manage tables in Ocient with SQL DDL, including CREATE TABLE, ALTER TABLE, and DROP TABLE, plus guidance on time keys, clustering keys, and partitioning.
- [Views](https://docs.ocient.com/views.md): Manage views in Ocient with SQL DDL, including CREATE VIEW, ALTER VIEW, and DROP VIEW, plus guidance on materialization, security, and query rewrite use cases.
- [Indexes](https://docs.ocient.com/indexes.md): Manage indexes in Ocient with SQL DDL, including CREATE INDEX and DROP INDEX, plus guidance on cluster keys and secondary index strategies.
- [Data Pipelines](https://docs.ocient.com/data-pipelines.md): Overview of Ocient data pipelines, the SQL-based ETL framework with CREATE PIPELINE DDL commands for ingesting and transforming streaming and batch data.
- [Transactional Data Pipelines](https://docs.ocient.com/transactional-data-pipelines.md): This page describes transactional data pipelines that enable the rollback of uncommitted data automatically when a failure occurs.
- [Distributed Tasks](https://docs.ocient.com/distributed-tasks.md): Overview of distributed tasks in Ocient, including rebuild tasks and data integrity checks that run in the background to maintain system health and performance.
- [Machine Learning Models](https://docs.ocient.com/machine-learning-models.md): SQL reference for managing Ocient machine learning models, with syntax for CREATE, RENAME, EXPORT, RETRAIN, query, and DROP across 23 model types.
- [Model Context Protocol Tools](https://docs.ocient.com/model-context-protocol-tools.md): Create, drop, export, and call Model Context Protocol (MCP) tools that expose database operations to AI clients in Ocient.
- [Users, Groups, and Service Classes](https://docs.ocient.com/users-groups-and-service-classes.md): Manage users, groups, and service classes in Ocient to control access and allocate resources for workloads with role-based access and workload management.
- [Data Integrity and Storage](https://docs.ocient.com/data-integrity-and-storage.md): How Ocient maintains data integrity at exabyte scale with checksums, segment redundancy, parity, fault tolerance, and storage cluster configuration.
- [Query Analysis](https://docs.ocient.com/query-analysis.md): Analyze queries in Ocient using EXPLAIN, system catalog tables, and query profiles to understand execution plans and find opportunities for SQL optimization.
- [Query Management](https://docs.ocient.com/query-management.md): Manage queries in Ocient by monitoring active sessions, killing long-running statements, setting resource limits, and reviewing historical query activity.
- [Statistics Cache Management](https://docs.ocient.com/statistics-cache-management.md): Manage the Ocient statistics cache to keep query optimizer estimates current, including refresh strategies, cache sizing, and statistics collection options.
- [Data Flows](https://docs.ocient.com/data-flows.md): Learn how to use data flows in Ocient to execute procedural SQL blocks with variables, control flow, temporary tables, and error handling.
- [Stage and Transform Data with Data Flows](https://docs.ocient.com/stage-and-transform-data-with-data-flows.md): Learn how to build a multi-step ELT pipeline using Ocient data flows to stage, transform, and load data within the database.
- [Validate Data Before Loading with Data Flows](https://docs.ocient.com/validate-data-before-loading-with-data-flows.md): Learn how to use Ocient data flows to validate data quality before committing a load, using IF, ELSEIF, and RAISE as guard clauses.
- [Build Iterative Queries with Data Flows](https://docs.ocient.com/iterative-queries-with-data-flows.md): Learn how to use Ocient data flows to execute iterative computations such as accumulation patterns, graph traversals, and convergence algorithms.
- [Data Control Language (DCL) Statement Reference](https://docs.ocient.com/data-control-language-dcl-statement-reference.md): Reference for Ocient Data Control Language (DCL) statements, including GRANT and REVOKE for managing privileges, roles, and access in the database.
- [Data Manipulation Language (DML) Statement Reference](https://docs.ocient.com/data-manipulation-language-dml-statement-reference.md): Reference Data Manipulation Language (DML) statements in Ocient to insert, delete, truncate, and manage transactional changes to data in tables.
- [Data Query Language (DQL) Statement Reference](https://docs.ocient.com/data-query-language-dql-statement-reference.md): Explore Ocient SQL syntax rules, enabling users to write clear, efficient queries for data retrieval and manipulation at scale.
- [Join Operations](https://docs.ocient.com/join-operations.md): Understand how Ocient executes SQL JOIN operations, including hash and product joins, memory considerations, and best practices for query performance.
- [SQL Syntax Conventions](https://docs.ocient.com/sql-syntax-conventions.md): SQL syntax conventions used in Ocient documentation, including notation for required, optional, repeating elements, identifiers, literals, and reserved words.
- [Identifiers](https://docs.ocient.com/identifiers.md): Learn about Ocient identifier rules for naming tables, columns, and other SQL elements, ensuring consistency and clarity in database design.
- [Generate Tables Using sys.dummy](https://docs.ocient.com/generate-tables-using-sys-dummy.md): Use the sys.dummy table in Ocient to generate sample rows for testing queries, prototyping SQL, demonstrating functions, and learning syntax patterns.
- [Transactional Control Language (TCL) Statement Reference](https://docs.ocient.com/transaction-control-language-tcl-statement-reference.md): Reference Transactional Control Language (TCL) statements in Ocient to manage multi-statement transactions with autocommit, commit, and rollback.
- [Errors and Warnings](https://docs.ocient.com/errors-and-warnings.md): Reference for handling errors and warnings in Ocient SQL queries, data pipelines, and system operations, including common codes and resolution guidance.
- [Data Pipeline Loading Errors](https://docs.ocient.com/data-pipeline-loading-errors.md): Reference of Ocient data pipeline error codes and messages, with parameter descriptions and recommended actions for resolving load and parsing failures.
- [Reserved Words](https://docs.ocient.com/reserved-words.md): Reserved words are keywords in Ocient® that are specific words that the database can interpret as SQL syntax or unquoted identifiers.
- [System Catalog Reference](https://docs.ocient.com/system-catalog-reference.md): Reference for Ocient system catalog tables and views, including schemas, columns, and example queries for inspecting metadata, sessions, and storage objects.
- [System Catalog](https://docs.ocient.com/system-catalog.md): Overview of the Ocient system catalog for metadata and schema management, including tables for sessions, queries, segments, storage, users, and configuration.
- [Information Schema](https://docs.ocient.com/information-schema.md): Explore the collection of system views that provide metadata about the Ocient System, such as table, data pipeline, and index information.
- [Discover Insights From System Catalog Tables](https://docs.ocient.com/discover-insights-from-system-catalog-tables.md): Sample SQL queries on Ocient system catalog tables to track storage use, node status, running queries, segment sizes, and other operational metrics.
- [Connection Driver Reference](https://docs.ocient.com/connection-driver-reference.md): Reference for Ocient connection drivers, including JDBC, ODBC, pyocient, and the HTTP Query API, with version compatibility and integration guidance.
- [JDBC Manual](https://docs.ocient.com/jdbc-manual.md): Manual for the Ocient JDBC driver, including installation, connection URLs, supported properties, authentication, query execution, and result-set handling.
- [Data Extract Tool](https://docs.ocient.com/data-extract-tool.md): Use the Ocient Data Extract tool with the JDBC driver to export rows from tables and queries into files for backup, migration, or downstream processing.
- [Commands Supported by the Ocient JDBC CLI Program](https://docs.ocient.com/commands-supported-by-the-ocient-jdbc-cli-program.md): Reference for commands supported by the Ocient JDBC CLI program, including session management, query execution, file output, and SQL script execution.
- [JDBC Classes and Methods](https://docs.ocient.com/jdbc-classes-and-methods.md): Reference of JDBC classes and methods supported by the Ocient JDBC driver, including Connection, Statement, PreparedStatement, ResultSet, and metadata APIs.
- [JDBC Spark Connector](https://docs.ocient.com/jdbc-spark-connector.md): Integrate Apache Spark with Ocient using the JDBC Spark Connector to run scalable analytics on large data sets with high-performance read and write operations.
- [OCGraph Java Library](https://docs.ocient.com/ocgraph-java-library.md): OCGraph Java is a SQL-native graph analytics toolkit for Ocient to model and analyze large graphs, with subgraph extraction and vertex and edge filtering.
- [Ocient Python Module: pyocient](https://docs.ocient.com/ocient-python-module-pyocient.md): Use the pyocient Python module to connect to an Ocient System, execute SQL queries, fetch results as Python objects, and integrate Ocient into data workflows.
- [OCGraph Python Library](https://docs.ocient.com/ocgraph-python-library.md): OCGraph Python provides a SQL-native interface for graph analytics on Ocient using a Python workflow, with function references, parameter tables, and examples.
- [Ingest Data with Legacy LAT Reference](https://docs.ocient.com/ingest-data-with-legacy-lat-reference.md): (deprecated) Explore methods for efficiently loading large data sets into Ocient, optimized for performance and designed for massive-scale data warehousing.
- [LAT Load JSON Data from Kafka](https://docs.ocient.com/lat-load-json-data-from-kafka.md): (deprecated) Ingest JSON data from Apache Kafka into Ocient with a LAT pipeline. This tutorial covers source, transform, and sink configuration plus monitoring options.
- [LAT Load CSV Data from S3](https://docs.ocient.com/lat-load-csv-data-from-s3.md): (deprecated) Learn to load CSV data from Amazon S3 directly into Ocient’s high-performance data warehouse, ensuring smooth and scalable data integration.
- [LAT Load JSON Data from S3](https://docs.ocient.com/lat-load-json-data-from-s3.md): (deprecated) Integrate JSON data from Amazon S3 into Ocient for advanced analytics, designed for high-throughput and efficient processing of large data sets.
- [LAT Advanced Loading and Transformations](https://docs.ocient.com/lat-advanced-loading-and-transformations.md): (deprecated) Enhance your data loading processes with advanced transformations in Ocient, tailored for complex data requirements and optimized performance.
- [LAT Overview](https://docs.ocient.com/lat-overview.md): (deprecated) Overview of the Ocient Loading and Transformation (LAT) system for building pipelines that ingest, transform, and load data into the data warehouse.
- [LAT Data Types in Loading](https://docs.ocient.com/lat-data-types-in-loading.md): (deprecated) Reference for source and target data types supported by the Ocient Loading and Transformation (LAT) system, including conversions and edge case handling.
- [LAT Pipeline Configuration](https://docs.ocient.com/lat-pipeline-configuration.md): (deprecated) Configure an Ocient LAT pipeline by defining sources, transforms, and sinks in a configuration file to control end-to-end data loading behavior.
- [LAT Source Configuration](https://docs.ocient.com/lat-source-configuration.md): (deprecated) Configure Ocient LAT pipeline sources for loading data from Kafka, S3, file systems, and other systems, including connection details and parser settings.
- [LAT Sink Configuration](https://docs.ocient.com/lat-sink-configuration.md): (deprecated) Configure Ocient LAT pipeline sinks to write transformed data into Ocient tables or other targets, including batching, commit, and error-handling options.
- [LAT Extract Configuration](https://docs.ocient.com/lat-extract-configuration.md): (deprecated) Configure the extract stage of an Ocient LAT pipeline, including source readers, record parsing, format selection, and parallelism for reliable data extraction.
- [LAT Transform Configuration](https://docs.ocient.com/lat-transform-configuration.md): (deprecated) Configure transform stages in Ocient LAT pipelines using JMESPath, user-defined transformations, and built-in functions to shape data before it is loaded.
- [LAT Data Transformation with JMESPath](https://docs.ocient.com/lat-data-transformation-with-jmespath.md): (deprecated) Use JMESPath expressions in Ocient LAT pipelines to transform, filter, and reshape incoming JSON data records before writing them to the data warehouse.
- [LAT Transformation Functions](https://docs.ocient.com/lat-transformation-functions.md): (deprecated) Reference for built-in transformation functions in Ocient LAT pipelines, including string, numeric, date, and conditional functions used in transform stages.
- [LAT User-Defined Transformations](https://docs.ocient.com/lat-user-defined-transformations.md): (deprecated) Define custom transformations in Ocient LAT pipelines using Groovy or Java to apply project-specific business logic when reshaping incoming data records.
- [LAT Record Filtering](https://docs.ocient.com/lat-record-filtering.md): (deprecated) Filter records in Ocient LAT pipelines using expression-based rules to drop, route, or accept incoming records before they reach transformation and load stages.
- [LAT Service Configuration](https://docs.ocient.com/lat-service-configuration.md): (deprecated) Configure the Ocient LAT service, including JVM options, threading, resource allocation, ports, and other parameters that affect pipeline runtime behavior.
- [LAT Metrics](https://docs.ocient.com/lat-metrics.md): (deprecated) Track Ocient LAT pipeline metrics such as record counts, throughput, errors, and latency to monitor data loading performance and detect issues quickly.
- [LAT Log4J Configuration](https://docs.ocient.com/lat-log4j-configuration.md): (deprecated) Configure Log4j logging for the Ocient Loading and Transformation (LAT) system to control log levels, appenders, and rotation for troubleshooting and audit.
- [LAT Packaging and Installation](https://docs.ocient.com/lat-packaging-and-installation.md): (deprecated) Package and install the Ocient Loading and Transformation (LAT) client and service, including standalone, distributed, and disconnected deployment options.
- [LAT Advanced Topics](https://docs.ocient.com/lat-advanced-topics.md): (deprecated) Advanced topics for the Ocient Loading and Transformation (LAT) system, including dynamic schema changes, error management, and complex pipeline behaviors.
- [LAT Client Command Line Interface](https://docs.ocient.com/lat-client-command-line-interface.md): (deprecated) Install and use the Ocient LAT client command-line interface to create, deploy, start, stop, monitor, and manage loading and transformation pipelines.
- [Install LAT Client in a Disconnected Network](https://docs.ocient.com/install-lat-client-in-a-disconnected-network.md): (deprecated) Install the Ocient Loading and Transformation (LAT) client in a disconnected or air-gapped network, including offline package distribution and setup steps.
- [Version Compatibility](https://docs.ocient.com/version-compatibility.md): Reference for Ocient version compatibility between server, JDBC, pyocient, LAT, and integrations to plan upgrades and avoid client-server mismatch issues.
- [Release Notes](https://docs.ocient.com/release-notes.md): Release notes for the Ocient System, summarizing new features, performance enhancements, and upgrade notes for each release.
- [OcientAIQ Unified Data Platform Release Notes](https://docs.ocient.com/ocientaiq-unified-data-platform-release-notes.md): Release notes for the OcientAIQ Unified Data Platform, listing new features, performance improvements, bug fixes, and upgrade considerations per release.
- [JDBC Release Notes](https://docs.ocient.com/jdbc-release-notes.md): Release notes for the Ocient JDBC driver, including new features, bug fixes, compatibility changes, and upgrade guidance for each driver version.
- [pyocient Release Notes](https://docs.ocient.com/pyocient-release-notes.md): Release notes for pyocient, the Ocient Python module, including new features, API changes, bug fixes, and dependency updates across module versions.
- [OCGraph Release Notes](https://docs.ocient.com/ocgraph-release-notes.md): Release notes for the OCGraph graph analytics libraries for Python and Java, including new algorithms, API changes, and execution mode configuration across library versions.
- [Spark Connector Release Notes](https://docs.ocient.com/spark-connector-release-notes.md): Release notes for the Ocient Spark Connector, including new features, bug fixes, and compatibility changes for each connector version.
- [Glossary](https://docs.ocient.com/glossary.md): Glossary of acronyms and terms used in the Ocient System, covering architecture, SQL, data pipelines, geospatial, and ML concepts.
- [Open Source Acknowledgments](https://docs.ocient.com/open-source-acknowledgments.md): Acknowledgments for third-party open source software included with the Ocient System, including library names, versions, licenses, and source references.
- [Download](https://docs.ocient.com/download.md): Redirect to the Ocient documentation landing page where you can download PDFs, browse release-specific docs, and access additional product resources.

## OpenAPI Specs

- [generated-api-methods](/openapi/generated-api-methods.json)
- [xzu2ulvos3yqf969gbwpo-6fbu-thlb6sassx992he-20241018-144135-f43eac92](/openapi/xzu2ulvos3yqf969gbwpo-6fbu-thlb6sassx992he-20241018-144135-f43eac92.json)
- [xzu2ulvos3yqf969gbwpo-j6ibltoc4gyo2uzzph3yt-20241018-144135-42445ccd](/openapi/xzu2ulvos3yqf969gbwpo-j6ibltoc4gyo2uzzph3yt-20241018-144135-42445ccd.json)