MySQL/MariaDB monitoring

MySQL/MariaDB server performance from prometheus/mysqld_exporter

SkyWalking leverages prometheus/mysqld_exporter for collecting metrics data. It leverages OpenTelemetry Collector to transfer the metrics to OpenTelemetry receiver and into the Meter System.

Data flow

1. mysqld_exporter collect metrics data from MySQL/MariaDB.
2. OpenTelemetry Collector fetches metrics from mysqld_exporter via Prometheus Receiver and pushes metrics to SkyWalking OAP Server via the OpenCensus gRPC Exporter or OpenTelemetry gRPC exporter.
3. The SkyWalking OAP Server parses the expression with MAL to filter/calculate/aggregate and store the results.

Set up

1. Set up mysqld_exporter.
2. Set up OpenTelemetry Collector . For details on Prometheus Receiver in OpenTelemetry Collector, refer to here.
3. Config SkyWalking OpenTelemetry receiver.

MySQL/MariaDB Monitoring

MySQL/MariaDB monitoring provides monitoring of the status and resources of the MySQL/MariaDB server. MySQL/MariaDB cluster is cataloged as a Layer: MYSQL Service in OAP. Each MySQL/MariaDB server is cataloged as an Instance in OAP.

Supported Metrics

Monitoring Panel	Unit	Metric Name	Description	Data Source
MySQL Uptime	day	meter_mysql_uptime	The MySQL startup time	mysqld_exporter
Max Connections		meter_mysql_max_connections	The max number of connections.	mysqld_exporter
Innodb Buffer Pool Size	MB	meter_mysql_innodb_buffer_pool_size	The buffer pool size in Innodb engine	mysqld_exporter
Thread Cache Size		meter_mysql_thread_cache_size	The size of thread cache	mysqld_exporter
Current QPS		meter_mysql_qps	Queries Per Second	mysqld_exporter
Current TPS		meter_mysql_tps	Transactions Per Second	mysqld_exporter
Commands Rate		meter_mysql_commands_insert_rate meter_mysql_commands_select_rate meter_mysql_commands_delete_rate meter_mysql_commands_update_rate	The rate of total number of insert/select/delete/update executed by the current server	mysqld_exporter
Threads		meter_mysql_threads_connected meter_mysql_threads_created meter_mysql_threads_cached meter_mysql_threads_running	The number of currently open connections(threads_connected) The number of threads created(threads_created) The number of threads in the thread cache(threads_cached) The number of threads that are not sleeping(threads_running)	mysqld_exporter
Connects		meter_mysql_connects_available meter_mysql_connects_aborted	The number of available connections(connects_available) The number of MySQL instance connection rejections(connects_aborted)	mysqld_exporter
Connection Errors		meter_mysql_connection_errors_internal meter_mysql_connection_errors_max_connections	Errors due to exceeding the max_connections(connection_errors_max_connections) Error caused by internal system(connection_errors_internal)	mysqld_exporter
Slow Queries Rate		meter_mysql_slow_queries_rate	The rate of slow queries	mysqld_exporter

Customizations

You can customize your own metrics/expression/dashboard panel. The metrics definition and expression rules are found in /config/otel-rules/mysql.yaml. The MySQL dashboard panel configurations are found in /config/ui-initialized-templates/mysql.

Collect sampled slow SQLs

SkyWalking leverages fluentbit or other log agents for collecting slow SQL statements from MySQL/MariaDB.

Data flow

1. fluentbit agent collects slow sql logs from MySQL/MariaDB.
2. fluentbit agent sends data to SkyWalking OAP Server using native meter APIs via HTTP.
3. The SkyWalking OAP Server parses the expression with LAL to parse/extract and store the results.

Set up

1. Set up fluentbit.
2. Config fluentbit from here for MySQL or here for MariaDB.
3. Enable slow log from here for MySQL or here for MariaDB.

Slow SQL Monitoring

Slow SQL monitoring provides monitoring of the slow SQL statements of the MySQL/MariaDB server. MySQL/MariaDB server is cataloged as a Layer: MYSQL Service in OAP.

Supported Metrics

Monitoring Panel	Unit	Metric Name	Description	Data Source
Slow Statements	ms	top_n_database_statement	The latency and statement of MySQL/MariaDB slow SQLs	fluentbit

Customizations

You can customize your own metrics/expression/dashboard panel. The slowsql expression rules are found in /config/lal/mysql-slowsql.yaml The MySQL/MariaDB dashboard panel configurations are found in /config/ui-initialized-templates/mysql.