> For the complete documentation index, see [llms.txt](https://upsolver.gitbook.io/content/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://upsolver.gitbook.io/content/reference-1/monitoring/datasets/statistics.md).

# Statistics

The **Statistics** tab is available for Iceberg tables managed by Upsolver and offers a comprehensive overview of your table's current state and historical trends. This page is crucial for monitoring the health, performance, and maintenance of your table by tracking key metrics and processes, including storage usage, scan overhead, file count, snapshot expiration, compaction, and more.

While the Statistics tab provides a high-level summary, you can explore specific processes in greater detail—such as compaction, snapshot expiration, and orphan file clean-up—within the [Maintenance](#maintenance) tab.

<figure><img src="/files/TAENjiI0Rh0UBqoq7U6e" alt=""><figcaption><p>The <strong>Statistics</strong> tab displays real-time metrics on the current snapshot, maintenance, and trends withing your Iceberg table.</p></figcaption></figure>

## Current Snapshot

This widget provides an overview of the current snapshot of the table, including the size of the current snapshot, total storage used by all snapshots, the number of files, and average file size. It also displays key statistics like data row count, delete rows, and the number of columns.

<table><thead><tr><th width="125">Category </th><th width="240">Metric</th><th>Description</th></tr></thead><tbody><tr><td>Storage</td><td>Current Snapshot Size</td><td>The total size of the latest table snapshot, including Iceberg metadata size.</td></tr><tr><td>Storage</td><td>All Snapshots Size</td><td>The cumulative size of the table, including all its snapshots and associated data. This figure also includes the Iceberg metadata size.</td></tr><tr><td>Scan</td><td>Full Table Scan overhead</td><td>The total request overhead of S3 API calls to perform a full table scan.</td></tr><tr><td>Scan</td><td>Files</td><td>The total number of data files and metadata files in the current snapshot of the table.</td></tr><tr><td>Scan</td><td>Avg.File Size</td><td>The average size of files in the current snapshot. Computed as (Current Snapshot Size)/(Files)</td></tr><tr><td>Table</td><td>Data Rows</td><td><p>The total number of rows present in the data files of the current snapshot of the table.</p><p></p></td></tr><tr><td>Table</td><td>Position Delete Rows</td><td>The total number of position delete rows in the current snapshot of the table. A position delete corresponds to a specific data row that has been removed. Note: Position delete rows may overlap with equality delete rows or may reference a non-existent row.</td></tr><tr><td>Table</td><td>Equality Delete Rows</td><td>The total number of equality delete rows in the current snapshot of the table. An equality delete can be applied to multiple data rows.</td></tr><tr><td>Table</td><td>Columns</td><td>The total number of columns in the current snapshot of the table.</td></tr><tr><td>Partitions</td><td>Partitions</td><td>The total number of partitions in the current snapshot of the table. </td></tr><tr><td>Partitions</td><td>Avg. Partition Size</td><td>The average size of each partition in the current snapshot.</td></tr><tr><td>Partitions</td><td>Max. Partition Size</td><td>The size of the largest partition in the current snapshot.</td></tr></tbody></table>

## Maintenance

This widget highlights various metrics related to maintenance tasks performed by Upsolver, including compaction, snapshot expiration, orphan file clean-up, and data retention.

<table><thead><tr><th width="163">Category </th><th width="240">Metric</th><th>Description</th></tr></thead><tbody><tr><td>Time Travel</td><td>Oldest Snapshot</td><td>The timestamp of the oldest snapshot available on the main branch for time travel queries, allowing users to query the table's state at that specific time.</td></tr><tr><td>Time Travel</td><td>Snapshots</td><td>The number of available snapshots.</td></tr><tr><td>Data Retention</td><td>Oldest Retained Time</td><td><p>The oldest date for which data is retained in the current snapshot. Note that data will be completely deleted once all snapshots referencing that data have expired. </p><p></p><p>If no retention policy is defined for the table, this value will display as <strong>Indefinitely</strong>.</p></td></tr><tr><td>Compaction</td><td>Compaction Score</td><td><p>The compaction score represents the table's compaction level as a percentage (0-100%).</p><ul><li><strong>100%</strong>: The table is near its optimal state, with minimal size and high scan efficiency.</li><li><strong>0%</strong>: Indicates significant room for improvement in reducing table size or enhancing scan efficiency.</li></ul><p><strong>Calculation:</strong><br>The score is determined as the minimum of two ratios:</p><ul><li><strong>Size Ratio</strong>: Projected Table Size / Current Table Size</li><li><strong>Scan Overhead Ratio</strong>: Projected Scan Overhead / Current Scan Overhead</li></ul></td></tr><tr><td>Compaction</td><td>Last Compaction Time</td><td>The date and time when the last compaction operation was performed.</td></tr><tr><td>Compaction</td><td>Files Reduced - Lifetime</td><td>The total number of files reduced through compaction operations over the lifetime of the table.</td></tr><tr><td>Orphan Files</td><td>Last Clean Up Time</td><td><p>The last date and time a clean-up operation was run to delete dangling files.</p><p></p></td></tr><tr><td>Orphan Files</td><td>Files deleted - lifetime</td><td>The The number of files deleted during the last clean-up operation.</td></tr><tr><td>Orphan Files</td><td>Storage reduced - lifetime</td><td>The total amount of storage space saved through clean-up operations over the lifetime of the table.</td></tr></tbody></table>

## Trends

In this section, you can monitor trends over time for the following metrics. You can adjust the timeframe to view trends across different time ranges.

1. **Storage** - This graph displays the trend of table size over time using a stacked area chart. It comprises the size of the table's current snapshot and the historical snapshots' storage size over time. The cumulative graph represents the total storage of the table. You can toggle between viewing only the **Current State** or **Historical Snapshots** trends separately.
2. **Full Table Scan Overhead  -** Shows the total S3 API request overhead required to perform a full table scan over time.
3. **Files  -** Displays the number of files in the current snapshot over time.&#x20;


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://upsolver.gitbook.io/content/reference-1/monitoring/datasets/statistics.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.