Data Gateway

The Lumi AI Data Gateway is a lightweight application for facilitating secure connections between local systems and the Lumi AI platform. It is an effective alternative for systems that should not be directly accessible from the Internet.

If you're looking for a guide to setup an instance of the Data Gateway, view our article on Deploying the Data Gateway.

How it Works

The Data Gateway runs as a service on a local system. It continuously polls the Lumi AI platform for pending requests, executes those requests against the local source system, and returns the results — including query data and associated metadata — back to the platform.

Supported Source Systems

The Data Gateway supports the following database engines:

• PostgreSQL

• MySQL

• Microsoft SQL Server

• Oracle

• Snowflake

• SAP HANA

• Databricks

Network Details

The Data Gateway requires no inbound ports to be opened. All communication is outbound-initiated HTTPS (port 443) from the gateway host to the Lumi AI platform.

The gateway host does require outbound TCP access to the source system on the relevant database port, so internal firewalls between the gateway and the source system must permit this.

For environments with strict outbound firewall rules, deep packet inspection, or TLS inspection, see Network Configuration for protocol details, required FQDNs, and guidance on SSL interception.

Logging

The Data Gateway writes logs to a logs folder in the same directory as the executable. Log files are named lumi_data_gateway.log, rotate daily at midnight, and are retained for 7 days.

The log file captures all events at DEBUG level. Console output defaults to INFO level and can be adjusted via the console_log_level configuration setting (see Deploying the Data Gateway).

CloudWatch Logs: For deployments where Lumi AI has configured CloudWatch integration, the gateway will automatically forward application logs to the designated AWS CloudWatch log group. This is provisioned from the Lumi AI platform side and requires no configuration on the gateway host.

Management & Monitoring

Individuals with administrative access to the Lumi AI platform can manage and monitor Data Gateways via the Admin Settings panel. This includes creating, relabeling, removing, and monitoring the status of gateway instances.

A gateway's status is usually reflected immediately, but under certain conditions (e.g., the host is shut down unexpectedly) it may take 10 to 15 minutes for the status change to be reflected in the panel.