Automatically Caching Data
Automatically caching data is useful when you do not want to rebuild the cache for each query. When you query data for the first time, the connector automatically initializes and builds a cache in the background. When AutoCache = true, the connector uses the cache for subsequent query executions, resulting in faster response times.
If replication is enabled, the data is generated once and then copied to local and cloud data stores. With incremental updates, the connector achieves a performance advantage over dropping the cached tables and retrieving the entire table again on every refresh. With iterative updates, the connector only performs the query from the last time that the date was refreshed. If replication is not enabled, updates to the cache require downloading the entire data set.
Configuring Automatic Caching
To automatically update the cache and return results from the local cache, set the following connection string properties:
- AutoCache: This property automatically updates the cache when the value is set to true.
- CacheTolerance: This property ensures that the data retrieved from the database is the most current version. The default value is 600 seconds (10 minutes). The connector checks with the data source for newer records after the tolerance interval has expired. Otherwise, it returns the data directly from the cache.
Caching the Subscriber Table
The following example caches the Subscriber table in the file specified by the CacheLocation property of the connection string.
SELECT Id, Status FROM Subscriber WHERE EmailAddress = 'firstname.lastname@example.org'
Common Use Case
A common use for automatically caching data is to improve driver performance when making repeated requests to a live data source, such as building a report or creating a visualization. With auto caching enabled, repeated requests to the same data may be executed in a short period of time, but within an allowable tolerance (CacheTolerance) of what is considered "live" data.