# Time your data with freshness

## :clock1: Track your data operation like Amazon delivery

Tailer Studio allows you to display all Job information relating to execution time and period. It is also possible to announce the next execution. Let's see if your data operations are well-timed.

:warning: **Only data operations in production with at least 2 regular executions can have a freshness status.**

## :eyes: View your data freshness

* Log in to [Tailer Studio](https://jarvis-platform.io/sign-in?redirect=%2F&__hstc=57968821.199e85015347f5cf00c120e5932c4c81.1601276395705.1601476688274.1601480246130.19&__hssc=57968821.4.1601480246130&__hsfp=649433320).
* If necessary, select an account in the drop-down menu at the top of the screen.
* In the left navigation panel, in the **Data quality** section, select the **Freshness Monitoring**
* All your jobs are listed and can be sorted :

<figure><img src="https://4122513927-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MIIsP_DvP2J-c1szWrQ%2Fuploads%2Fgit-blob-5528db389df63fd467669b5a51000bd33028c0d1%2FCapture%20d%E2%80%99e%CC%81cran%202023-06-05%20a%CC%80%2014.47.30.png?alt=media&#x26;token=e02dbadb-ec4b-4cec-a536-c887af803deb" alt=""><figcaption></figcaption></figure>

## :information\_source: Information lists

<table><thead><tr><th width="211.5">Information</th><th>Description</th></tr></thead><tbody><tr><td><p><strong>Configuration Type</strong></p><p><em>Sorting option</em></p></td><td><p>Type of data operation.</p><p><br>ex: <em>tables-to-tables, storage-to-tables, vm-launcher...</em></p></td></tr><tr><td><strong>Job ID</strong></td><td>ID of the job linked to the execution of a configuration.<br><br>A job ID is the concatenation of data operation, ID of the configuration and optionally the environnement and the file used or produced depending of the data operation.<br><strong>This ID is unique and linked to the page of the configuration related.</strong></td></tr><tr><td><strong>Last Execution</strong></td><td>Date time (UTC+0) of the last execution of your data operation.</td></tr><tr><td><strong>Next Execution</strong></td><td>Date time (UTC+0) of the next execution of your data operation.<br><br><strong>This is one of our main objectives. It estimates from previous executions the next time it will come.</strong><br><br><span data-gb-custom-inline data-tag="emoji" data-code="26a0">⚠️</span>The more regular the executions, the more precise it will be. Conversely, if there are few executions, or some that come irregularly, the calculation will be less accurate.</td></tr><tr><td><strong>Confidence</strong></td><td><p>It's an indicator about the arrival confidence interval. The value is correlated with the potential number of hours of delay for the data operation : <strong>the higher the number is, the more likely the operation is to be late.</strong><br><br>Here are a few examples to help you understand :</p><ul><li><strong>[0] :</strong> The operation is well-timed overall.</li><li><strong>[1-3] :</strong> Often, the operation may be delayed because it is at the end of the workflow or waiting to receive an inconsistent file.</li><li><strong>[5-10] :</strong> For a daily operation, you may have an issue. For weekly or monthly information, you may lake of well-timed executions or waiting to receive an inconsistent key file.</li><li><strong>[10 +] :</strong> the operation is often late or inconsistent. It might be interesting to see if there's a problem behind it.<br></li></ul></td></tr><tr><td><strong>Frequency</strong><br><em>Sorting option</em></td><td>Type of frequency detected with cron schedule expressions or with frequency calculation.<br><br>ex: <em>Daily, Weekly, Monthly Yearly and Unfollow.</em><br><br><strong>Yearly</strong> is about a data operation with very few regular executions with long waiting times<br><strong>Unfollow</strong> is about data operation with less than 2 regular executions in production.</td></tr><tr><td><p><strong>Status</strong></p><p><em>Sorting option</em></p></td><td><p>Freshness status of the data operation for the current day.<br><br><strong>It estimates from previous executions whether the operation has already been executed today, is pending or should not be activated.</strong></p><ul><li><strong>Executed :</strong> The operation is already successful today.</li><li><strong>Awaited :</strong> Thanks to the deduction of the next execution, this indicates that the flow must be executed today.</li><li><strong>Not today :</strong> Thanks to the deduction of the next execution, this indicates that the flow does not have to be executed today. Check the date time to see the futur execution date.</li><li><strong>Learning &#x26; Archived :</strong> Either the data operation in production do not have enough execution or was archived to not been displayed.</li></ul></td></tr><tr><td><p><strong>Timing</strong></p><p><em>Sorting option</em></p></td><td><p>Freshness timing of the data operation for the current day.<br><br><strong>This is one of our main objectives. It estimates from the calculus of the next execution with the confidence interval how far data is behind the times due.</strong></p><ul><li><p><strong>On time :</strong> The data operation is well-timed today.</p><ul><li><em>Paired with Executed statut, it is perfect !</em></li><li><em>Paired with Awaited statut, the data operation is on time and should be executed later in the day.</em></li></ul></li><li><p><strong>Late :</strong> Arrival time exceeds predicted time.</p><ul><li><em>Paired with Executed statut, the data operation was executed with a little delay. Check that the operations behind it accept latency.</em></li><li><em>Paired with Awaited statut, the data operation is late but should have been executed already. There may be an issue with receiving files or scheduling execution. This is the first step before we get to the extreme delay problem.</em></li></ul></li><li><span data-gb-custom-inline data-tag="emoji" data-code="26a0">⚠️</span><strong>Very Late :</strong> <strong>The due execution overlap with the next predicted execution.</strong><br><br>For example, a daily data operation has more than 25 hours late.<br><br><em>Tailer has an alert system and it's possible to send you a message via Slack or via email. You can also send a message to support@tailer.ai in that case.</em></li><li><strong>NA &#x26; Learning :</strong> Either the data operation in production do not have enough execution or was archived to not been displayed.</li></ul></td></tr></tbody></table>

## :writing\_hand: Use case with a file received on-time or lately

<figure><img src="https://4122513927-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MIIsP_DvP2J-c1szWrQ%2Fuploads%2Fgit-blob-1517bae0d8ce6ef978a24366944d5c6a41b023ac%2FCapture%20d%E2%80%99e%CC%81cran%202023-06-06%20a%CC%80%2010.02.06.png?alt=media&#x26;token=395f35cb-5916-45d3-a904-2deee8e607d5" alt=""><figcaption></figcaption></figure>