Download as PDF, PPTX
Uploaded byKasun Gajasinghe
Distributed caching with java JCache
The document discusses distributed caching with Java, explaining its necessity for improving application performance by addressing data retrieval bottlenecks. It compares various cache types including local, replicated, and distributed caches, detailing their pros, cons, and access patterns. Additionally, it introduces the Java JCache specification as a standard API for caching mechanisms and provides examples of its implementations.
Distributed caching with java JCache
- 1. Distributed Caching with Java KasunGajasinghe Senior Software Engineer WSO2
- 2. ● What &Why for (Distributed) Caching ● Different types of Caches ● Cache access patterns ● Java JCache specification ● Demo ● Q&A Agenda
- 3. (... but whydo I want to Cache?) O O O source: http://no7scramblecross.blogspot.com/2009/04/speaking-of-cats.html
- 4. Caching? … Distributed? Gotcha!! source:http://matome.naver.jp/odai/2140238539583350401/2140238875587055003
- 5. ● Application performance- get around bottlenecks arising from using data that is expensive to retrieve ○ DB or web service ○ data that is hard to calculate ○ monetary aspects Why software Caching
- 6. ● improve theresponse times by reducing data access latency ● avoid cost of repeatedly creating objects ● reduces IO overhead Caching
- 7. ● limited memorysize ● consistency - consistency between cached data vs actual data ● durability - cache expiration/invalidation ● scalability Caching considerations
- 8. Types of caches ●local cache ● replicated cache ● distributed cache
- 9. Local Cache ● LocalCache a cache that is local to (completely contained within) a particular cluster node
- 10. Local Cache -example
- 11. Local Cache -with TTL
- 12. Local Cache Pros: ● simplicity ●performance ● no serialization/deserialization overhead Cons: ● not fault-tolerant ● scalability
- 13. Replicated cache ● acache that replicates its data to all cluster nodes
- 14. GET in replicatedcache Each cluster node (JVM) accesses the data from its own memory, i.e. a local read.
- 15. PUT in replicatedcache Pushing the new version of the data to all other cluster nodes
- 16. Replicated Cache Pros: ● bestread performance ● fault–tolerant ● linear performance scalability for reads Cons: ● poor write performance ● memory consumption ● additional network load ● poor and limited scalability for writes
- 17. Distributed Cache a cachethat partitions its data among all cluster nodes
- 18. GET in DistributedCache Access often must go over the network to another cluster node
- 19. Resolving known limitationof replicated cache: PUT in Distributed Cache
- 20. PUT in DistributedCache ● the data is being sent to a primary cluster node and a backup cluster node if backup count is 1 ● modifications to the cache are not considered complete until all backups have acknowledged receipt of the modification, i.e. slight performance penalty ● such overhead guarantees that data consistency is maintained and no data is lost
- 21. Failover in DistributedCache Failover involves promoting backup data to be primary storage.
- 22. Distributed Cache Pros: ● linearperformance scalability for reads and writes ● fault–tolerant Cons: ● increased latency of reads (due to network round-trip and serialization/deserialization expenses)
- 23. Cache Access Patterns ●cache aside ● read-through ● write-through
- 24. Cache Aside Pattern ●application is responsible of reading and writing to the storage. ● cache doesn’t interact with storage ● the cache is ‘kept aside’ as a faster and more scalable in- memory data store
- 25. Read-through/Write-through ● application treatsthe cache as the main data store, and reads/writes data from/to it ● cache is responsible to read/write the data into the actual storage.
- 26. Java JCache specification ●Standard Java Caching API ● javax.cache.* ● Implementation can be local or distributed
- 27. JCache API ● javax.cache.Cache ●javax.cache.CacheManager ● javax.cache.spi.CachingProvider
- 28.
- 29. JCache API -Annotations • Use the cache
- 30. JCache API -Annotations • Put into the cache
- 31. JCache API -Annotations • Remove from the cache
- 32. javax.cache.expiry. ● AccessedExpiryPolicy: Expiresafter a given set of time measured from creation of the cache entry, the expiry timeout is updated on accessing the key. ● CreatedExpiryPolicy: Expires after a given set of time measured from creation of the cache entry, the expiry timeout is never updated. ● EternalExpiryPolicy: Never expires, this is the default behavior, similar to ExpiryPolicy to be set to null. ● ModifiedExpiryPolicy ● TouchedExpiryPolicy JCache API - Expiry Policies
- 33. JCache implementations • Hazelcast •Oracle Coherence • Pivotal Gemfire • Ehcache • Infinispan • Gridgain/Ignite • Couchbase
- 34.
- 35.
- 36.