View Connect Logs
Introduction
This guide explains how to access and query Connect application logs using Kibana. Connect uses two Elasticsearch indices for log storage: flowserver-logs for Flow-server logs and logs for other Connect services. Corresponding Kibana data views facilitate log exploration.
Log Storage Architecture
Connect organizes logs into two Elasticsearch indices:
| Index Name | Component | Data View |
|---|---|---|
|
Flow-server only |
|
|
Other Connect & Foundation services |
|
Flow-server logs
The flowserver-logs data view provides access to flow-server logs with flow-server specific fields. The following fields are useful when filtering logs:
-
appLog.contextMap.fs_flowId- Filter logs for a specific flow -
appLog.contextMap.fs_messageId- Filter logs for a specific message -
appLog.contextMap.fs_originalMessageId- Traces a message that has been split, distributed, or handed off.
The view is automatically created by the connect-kb-job Kubernetes job during the Connect deployment. It is used for flow debugging and flow-server troubleshooting.
Other Connect service logs
The logs data view includes logs from all Foundation services and all Connect services except flow-server. This view is automatically created by Foundation during monitoring stack installation. It is used for general application monitoring and cross-service troubleshooting.
Accessing Logs
-
Sign in to Kibana.
-
In the left sidebar, select Discover.
-
Select the appropriate data view from the dropdown:
-
flowserver-logs- For flow-server logs. -
logs- For Foundation and all other Connect services (use service filters to narrow down to Connect services).
-
-
Set the time range in the top-right corner.
Viewing only Connect service logs (excluding flow-server)
To display logs for all Connect services in the logs data view, apply the following filter:
kubernetes.labels.app_kubernetes_io/part-of.keyword: gridos-connect OR appLog.contextMap.deploymentId.keyword: exists
This filter applies only to the logs data view, not to flowserver-logs.
|