B.6. Streaming Data

B.6. Streaming Data

Documentation

VoltDB Home » Documentation » Administrator's Guide

table of contents

B.6. Streaming Data

The following tables describe the metrics related to streaming data into and out of Volt, including import, export, and topics.

Table B.11. Import

Metrics	Type	Description
voltdb_importer_failure_total	Counter	The number of import transactions that failed.
voltdb_importer_outstanding_requests_total	Gauge	The number of records read from the import stream and waiting to be inserted into the database.
voltdb_importer_retries_total	Counter	The number of attempts to replay failed transactions.
voltdb_importer_success_total	Counter	The number of import transactions that succeeded.

Table B.12. Export

Metrics	Type	Description
voltdb_export_info	Metadata	Informational metric that contains metadata. Tags: EXPORT_IS_ACTIVE - "True" if is enabled and not blocked and is master. EXPORT_STATUS - The current status of the export connection. "Active" - Queue is currently exporting to the target; "Blocked" - There is a gap in the queue and export is waiting to see if the missing records become available when a missing node rejoins; "Dropped" - either the source stream has been dropped from the schema or the export configuration has been removed from the configuration and queue is draining any remaining records.
voltdb_export_last_acked_timestamp_seconds	Gauge	The timestamp when the last tuple was acknowledged as received by the target.
voltdb_export_last_queued_timestamp_seconds	Gauge	The timestamp when the most recent tuple was added to the export queue for this partition.
voltdb_export_latency_seconds	Histogram	The distribution of time between when records are inserted, and then acknowledged by the target.
voltdb_export_queue_gap_total	Gauge	The number of records missing from the queue for the current stream and partition.
voltdb_export_tuple_count_total	Counter	The total number of records queued to the export target since the queue was created.
voltdb_export_tuple_pending_total	Gauge	The number of records still waiting to be written to or acknowledged by the target.

Table B.13. Topics

Metrics	Type	Description
voltdb_topic_info	Metadata	Informational metric with topic metadata. Tags: TOPIC_STATUS - "Stable" - The queue is complete; "Backfilling" - records are missing but are being retrieved from other servers; "Blocked" - records are missing from all copies of the partition; "Orphaned" - the queue is no longer being served by this partition, but is saved in case other copies of the queue are blocked or backfilling and need the data. This is a transitional state and the queue is deleted as soon as no other copies need its records. TOPIC_RETENTION_POLICY - The retention policy for this topic. TOPIC_IS_MASTER - "True" or "False" indicating whether the current site is the master for the logical partition.
voltdb_topic_bytes_fetched_bytes	Gauge	The size of data sent to consumers for this partition and topic.
voltdb_topic_bytes_on_disk_bytes	Gauge	The size of data stored on disk for this partition and topic.
voltdb_topic_error_offset	Gauge	If an error occurs while encoding a message for consumers, an error is returned to the consumer, the offset of the message is recoded here.
voltdb_topic_first_offset	Gauge	The value of the first offset currently available in the topic.
voltdb_topic_first_offset_timestamp_seconds	Gauge	The timestamp when the first offset was inserted into the queue.
voltdb_topic_last_offset	Gauge	The value of the last offset in the topic.
voltdb_topic_last_offset_timestamp_seconds	Gauge	The timestamp when the most recent message (the last offset) was inserted into the queue.
voltdb_topic_skipped_rows_total	Gauge	The number of skipped rows that otherwise would cause an error. Only applies if the topic's option consumer.skip.errors is true.

table of contents