Customers dealing with especially large volumes of data commonly have an Extract, Transform, Load (ETL) process that runs once a day, typically at night when loads are lower and servers are cheaper.
For these types of setups, it’s best to change the default dashboard settings in your account, which are more focused on a real-time data visualization environment. It would be best for your dashboards to simply update once a day, right after the ETL process has run. There’s no reason to rerun your queries multiple times a day, or for it not to be cached before the first person opens it in the morning.
1. Open the dashboard which you’d like to cache prime, then select Settings in the bottom right sidebar.
2. Under the first tab (Settings), set your Cache Duration to be 24 hours.
3. Enable Snapshots and set the Snapshot Hour to be sometime after your ETL process. Note: The Snapshot Hour is set using UTC, so adjust this accordingly.
4. Click Update at the bottom of the page to save the changes.
Now the Snapshots feature will run fresh queries of your dashboards every day at the set time. This primes the cache for the remaining 24 hours that you’ve now set your cache duration to. When someone logs into Chartio and views the dashboard in the morning, they will have the latest updates right away and unnecessary queries won’t be run constantly as people view the dashboard throughout the day.
You’ll also now be able to view and download daily historical data from your dashboard by clicking on the View Snapshots option from your right-side menu. Doing this versus adjusting your queries will also help reduce load as viewing previous Snapshots won’t send new queries to your database.