Downloaded 51 times
![Key Value page:index <html><head>[...] user:123:session xDrSdEwd4dSlZkEkj+ user:123:avatar 77u/PD94bWwgdm+ Everything is a «blob» Commands, primarily, can GET and SET the values 3](https://image.slidesharecdn.com/04-redis-121216051138-phpapp01/75/Key-value-databases-in-practice-Redis-DotNetToscana-3-2048.jpg)
![Key Value Type page:index <html><head>[...] String events:timeline { «Joe logged», «File X Uploaded», …} List logged:today { 1, 2, 3, 4, 5 } Set time => 10927353 user:123:profile Hash username => bmatte joe ~ 1.3483 game:leaderboard smith ~ 293.45 Sorted Set fred ~ 83.22 Different «data type/structure» Rich set of specialized commands 4](https://image.slidesharecdn.com/04-redis-121216051138-phpapp01/75/Key-value-databases-in-practice-Redis-DotNetToscana-4-2048.jpg)
Uploaded byMatteo Baglini
Key-value databases in practice Redis @ DotNetToscana
This document provides an overview of Redis, an open source in-memory data structure store. It discusses how Redis can be used as a data store, cache, and message broker. It explains Redis' core abstractions like strings, hashes, lists, sets, sorted sets; persistence options; replication; and pub/sub functionality. The document also provides information about Redis' performance, clients, and how it is well-suited for caching, analytics, and real-time applications.
Key-value databases in practice Redis @ DotNetToscana
- 1. Matteo Baglini www.dotnettoscana.org Software Developer, Freelance matteo.baglini@gmail.com http://it.linkedin.com/in/matteobaglini http://github.cpom/bmatte
- 2. «Advanced key-value store. It is often referred to as a data structure server» 2
- 3. Key Value page:index <html><head>[...] user:123:session xDrSdEwd4dSlZkEkj+ user:123:avatar 77u/PD94bWwgdm+ Everything is a «blob» Commands, primarily, can GET and SET the values 3
- 4. Key Value Type page:index <html><head>[...] String events:timeline { «Joe logged», «File X Uploaded», …} List logged:today { 1, 2, 3, 4, 5 } Set time => 10927353 user:123:profile Hash username => bmatte joe ~ 1.3483 game:leaderboard smith ~ 293.45 Sorted Set fred ~ 83.22 Different «data type/structure» Rich set of specialized commands 4
- 5. Everything is stored in memory Screamingly fast performance Persistent via snapshot or append-only log file Replication (only Master/Slave) Extensible via embedded scripting engine (Lua) Rich set of client libraries High availability (In progress) ◦ Cluster (Fault tolerance, Multi-Node consistence) ◦ Sentinel (Monitoring, Notification, Automatic failover) 5
- 6. Created by Salvatore Sanfilippo (@antirez) First «public release» in March 2009. Since 2010 sponsored by VMware. Initially written to improve performance of Web Analytics product LLOOGG out of his startup 6
- 7. Written in ANSI C No external dependencies Single thread (asynchronous evented I/O) Works on all POSIX-like system Exist unofficial build for Windows Open-source BSD licensed Community (list, IRC & wiki) 7
- 8. 1. A DSL for Abstract Data Types. 2. Memory storage is #1. 3. Fundamental data structures for a fundamental API. 4. Code is like a poem. 5. We're against complexity. 6. Two levels of API. 7. We optimize for joy. 8
- 9.
- 10. Latest stable version(2.6.*) 10
- 11. Latest unstable version(2.9.7) 11
- 12.
- 13.
- 14.
- 15.
- 16. Data Types 16
- 17. Strings 17
- 18. Any blob willdo (A value can be at max 512MB) 18
- 19. Operations on stringsholding an integer 19
- 20.
- 21. Sharing state across processes ◦ Distribute lock, Incremental ID, Time series, User session. Web Analytics ◦ User visit (day, week, month), Feature Tracking. Caching ◦ String values can hold arbitrary data. Rate limiting ◦ Limit number of API calls/minute. 21
- 22. Keys 22
- 23. Any item incan be made to expire after or at a certain time. 23
- 24.
- 25. Lists 25
- 26. Sequence of stringvalues 26
- 27. Sequence of stringvalues (Max length is 232 - 1 elements) 27
- 28.
- 29.
- 30. Events Store or Notification ◦ Logs, Social Network Timelines, Notifications. Fixed Data ◦ Last N activity. Message Passing ◦ Durable MQ, Job Queue. Circular list 30
- 31. Sets 31
- 32. Unordered set ofunique values 32
- 33. Unordered set ofunique values (Max number of members is 232 – 1) 33
- 34. You can dounions, intersections, differences of sets in very short time. 34
- 35.
- 36. Web Analytics ◦ Unique Page View, IP addresses visiting. Relations ◦ Friends, Followers, Tags. Caching Result ◦ Store result of expensive intersection of data. 36
- 37. Sorted Set 37
- 38. Ordered set ofunique values 38
- 39.
- 40.
- 41.
- 42. Web Analytics ◦ Online users, Most visited pages. Leaderbord ◦ Show top N. Order by data ◦ Maintain a set of ordered data like user by age. 42
- 43. Hashes 43
- 44. Key → Valuemap (as value) 44
- 45. Set attributes (Store upto 232 - 1 field-value pairs) 45
- 46.
- 47.
- 48. Storing Objects ◦ Hashes are maps between string fields and string values, so they are the perfect data type to represent objects. 48
- 49. Persistence 49
- 50. Dump data todisk after certain conditions are met 50
- 51. Pro: ◦ RDB is a very compact single-file. ◦ RDB files are perfect for backups. ◦ RDB is very good for disaster recovery. ◦ RDB allows faster restarts with big datasets. ◦ RDB maximizes performances (backgr. I/O via fork(2)). Contro: ◦ RDB is NOT good if you need to minimize the chance of data loss in case Redis stops working (for example after a power outage). ◦ Fork can be time consuming if the dataset is very big. 51
- 52. Append all writeoperations to a log 52
- 53. Durability depends onfsync(2) policy 53
- 54. Pro: ◦ AOF is much more durable. ◦ AOF is an append only log, no seeks, nor corruption problems (for example after a power outage). ◦ AOF contains a log of all the operations one after the other in an easy to understand and parse format. Contro: ◦ AOF files are usually bigger than the equivalent RDB. ◦ AOF can be slower then RDB depending on the exact fsync policy. 54
- 55. Use both persistence methods if you want a degree of data safety comparable to what any RDBMS can provide you. If you care a lot about your data, but still can live with a few minutes of data lose in case of disasters, you can simply use RDB alone. There are many users using AOF alone, but we discourage it since to have an RDB snapshot from time to time is a great idea for doing database backups, for faster restarts. 55
- 56. C# Clients 56
- 57. Rich set ofclients 57
- 58.
- 59.
- 60. Code 60
- 61. Transactions 61
- 62.
- 63.
- 64. Classic scenario ◦ Multi atomic commands. Optimistic locking ◦ Check and Set (CAS Pattern) write only if not changed. 64
- 65.
- 66.
- 67. Subscribe multi channelsdecoupled from the key space 67
- 68. Publish on somechannel 68
- 69.
- 70.
- 71. Message Passing ◦ Distribute message-oriented system, Event- Driven Architecture, Service Bus. 71
- 72. Code 72
- 73. Replication 73
- 74. One master replicateto multiple slaves 74
- 75. Slave send SYNCcommand and master transfers the database file to the slave 75
- 76. Slaves can performonly read operation 76
- 77. Scalability ◦ Multiple slaves for read-only queries. Redundancy ◦ Data replication. Slave of Slave ◦ Graph-like structure for more scalability e redundancy. 77
- 78. Performance 78
- 79. Screamingly fast performance ~50K read/write operations per seconds. ~100K read/write ops per second on a regular EC2 instance. 79
- 80. redis-benchmark tool ona Ubuntu virtual machine ~36K rps 80
- 81.
- 82. Application Server SQL Redis Server 82
- 83.
- 84. Finally 84
- 85. «I see Redisdefinitely more as a flexible tool than as a solution specialized to solve a specific problem: his mixed soul of cache, store, and messaging server shows this very well» Salvatore Sanfilippo 85
- 86. http://redis.io/ http://github.com/antirez/redis http://groups.google.com/group/redis-db 86