Download as PDF, PPTX
Uploaded byWilliam Candillon
Scalable XQuery Processing with Zorba on top of MongoDB
The document discusses the integration of XQuery processing with MongoDB, highlighting the scalability and flexibility of both systems. It introduces JSONiq as a query language that extends XQuery for JSON and outlines how Zorba serves as an XQuery processor compatible with MongoDB. The document emphasizes the seamless mapping between XDM to BSON, enabling atomic document updates and efficient data management in scalable environments.
Scalable XQuery Processing with Zorba on top of MongoDB
- 1. Scalable XQuery Processing msec Zorba Meets MongoDB William Candillon {candillon@28msec.com}
- 2.
- 3.
- 4.
- 5. MongoDB BaseX CouchBase eXist-db Standardized Query Language X ✔ Flexible Data Modern Query Processing X ✔ Typing X ✔ High Availability ✔ X Scalability Sharding ✔ X Available as a Service ✔ X
- 6. What can XMLcontribute to JSON Datastores?
- 7. A Standardized, RockSolid Query Language
- 8. JSONiq - TheSQL of NoSQL 28
- 9. JSONiq 28 • Open Specification: jsoniq.org • Extension of the mature XQuery for JSON - Joins, Group-by, Filters, Search... • Leverage the complete XQuery Family - Scripting, Updates, Full-Text • Standardized Query Language - Run the same code accross multiple JSON stores
- 10. JSONiq - MongoDBConnector 28 http://28.io/mongodb
- 11. What can JSONdatastore contribute to XML?
- 12. A Distributed andScalable Store
- 13. The Goal 28 • memcached Scalability & Performance • key/value • MongoDB • RDBMS • XML DB Depth of functionality
- 14. The Goal 28 28msec - XQuery on top of MongoDB • memcached Scalability & Performance • key/value • MongoDB • 28msec RDBMS • XML DB Depth of functionnality
- 15. Meet Zorba 28 • Open Source XQuery Processor - Apache 2 License - Contributors: Oracle, 28msec, FLWOR Foundation • The Complete Family - XQuery 3.0, Updates, Full-Text, Scripting, JSONiq - XQuery Data Definition Facility • Pluggable Store API - Run Zorba on your own persistency layer
- 16.
- 17. Meet MongoDB 28 • Open Source JSON Document Store - License AGPL 3.0 • Focus on scalability - Replication accross multiple availability zones - Sharding - Atomic updates on documents • Available as a service - MongoHQ, MongoLab
- 18. MongoDB Deployment Example 28 Shard1 Shard2 Shard3 MongoD Replica set C1 MongoD C2 MongoD C3 MongoD MongoS MongoS Config Servers App Server App Server
- 19. The Goal 28 Zorba Runtime XDM Collections Indexes MongoDB MongoS BSON Collections Indexes
- 20. The Goal 28 • Seamless XQuery Integration into MongoDB Zorba Runtime XDM Collections Indexes MongoDB MongoS BSON Collections Indexes
- 21.
- 22. Application Example 28 • Fetching sports news from XMLTeam.com • Stored and indexed on MongoDB • 1 million documents and counting • Entirely built in XQuery from backend to frontend • 1k loc, 1 developer, 1 week work
- 23. Collection Declarations 28 declare collection sports:docs as document-node();
- 24. Collection Declarations 28 declare collection ... 1. Compile Query Compiler Runtime 2. createCollection(QName) Store API Zorba 3. Create Collection MongoDB
- 25. Index Declarations 28 declare %an:value-range index sports:by-datetime on nodes db:collection(xs:QName('sports:docs')) by ./sports-content/sports-metadata/@date-time;
- 26. Index Declarations 28 declare index ... 1. Compile Query Compiler Runtime createIndex( 2. qname, ordpath, keys ) Store API Zorba 3. Create Index MongoDB
- 27. Insert Nodes 28 let $uri := 'http://xmlteam.com/...' let $doc := http:get($uri) return db:insert-nodes($sports:docs, $doc)
- 28. Insert Nodes 28 db:insert-nodes(...) 1. Process Query Compiler Runtime 2. insertNode(qname, xdm) Store API Zorba 3. Insert BSON MongoDB
- 29. MongoDB Store Layer 28 • Direct XQuery to MongoDB mapping - Collections - Indexes • Converts XDM to BSON • Inherits MongoDB consistency model
- 30. Request Processing on28msec 28 HTTP Client 1 R 9 Availability Zone 1 ELB R 2 8 Sausalito 7 Zorba R Processor Request Handler Store 4 3 5 6 MongoDB Compiled Code Data
- 31. Scaling Out 28 Avg Response Time in ms 1000 750 500 2 App Servers 4 App Servers 250 0 10 40 50 70 80 100 120 150 Number of concurrent requests
- 32. XQuery on Topof MongoDB 28 • Seamless Integration of XQuery with MongoDB - XDM to BSON - Collections and indexes mapping - Atomicity per document • 28msec - XQuery Platform on top of MongoDB - Deploy your XQuery apps in 1-click - Scale up & down automatically
- 33. Take Away 28 • Two Drivers - Flexible Data - Scalability • Two Champions - XQuery for Flexible Data - JSON Stores for Scalability • Two Contributions - JSONiq: The SQL of NoSQL - XQuery Platform on top of MongoDB
- 34. Thank You! msec Questions?