Oracle NOSQL Database A Practical Introduction – [CON8062] Product Management Oracle NOSQL Database October 01, 2014 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Program Agenda What is Oracle NOSQL, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading, Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
What is Oracle NOSQL Database 101100101001001 001101010101011 100101010100100 101 Simple Fast Flexible Reliable advanced Key-Value database designed as cost effective, high performance solution for simple operations on collections of data with built in high availability and elastic scale-out. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 5
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle NOSQL Database From startups to enterprise ready 2009 • Servicing major Financials, LinkedIn, Amazon 2010 • Scaling out BerkeleyDB NoSQL Database 2011 • Nov 2011, version 1.0 released 2012 • Dec 2012, version 2.0 released • Oracle Eco Integrated 2013 • Quarterly releases, version 2.1 released 2014 • Version 3.0 • Hosted NoSQL • Big Data SQL Customers In Production Oracle Solutions Engineered Systems NoSQL Database In development BerkeleyDB Oracle Cloud
Oracle NOSQL Database - Enterprise Ready – Data Center Support – Secondary Indexes – Secure Access – Flexible schema Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | • NOSQL Features – Elastic – BASE Operations – Tables / JSON / Binary – Online management • Differentiators – ACID transactions – Online rolling upgrades – Oracle technology integrated (tools & solutions) – Commodity & Engineered systems – Streaming large object support Best NOSQL choice for any company using Oracle products
Oracle NOSQL Database customer success… Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Finance • Large credit card network provider • Fraud rule and history management • 6,500 ops/sec, 85% update on read Manufacturing • Large airline manufacturer • Developing next generation planes • 750K key inserts/sec, 6TB per hour Telecoms • Large mobile telecom operator • Mobile personalized advertizing • 24,000 ops/sec, 100% update on read Gaming • Real-time, live event platform provider • Sports wagering for William Hill, BetVictor • 600 concurrent feeds, 400 events/feed ……many more
Oracle NOSQL Database Subscription Model Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | • Business-friendly support service – Oracle NoSQL Database Community Edition • Open Source AGPL Edition – Support is now available for Community Edition • Price is $2,000/year per server • No upfront license fee • Provides for full Oracle support policy response • Purchase online via the Oracle Store – Offers affordable support option for startups – Provides Oracle expertise for production deployment 9 Oracle Store https://shop.oracle.com/
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle NOSQL DB Licensing • Community -or- Enterprise Edition – Enterprise Edition • Closed Source. Standard Oracle License – Community Edition has all of the basic functionality and APIs. Gets you started – Enterprise Edition for large, production, multi-data center, Oracle integration-centric customers and/or non-GPL compliant customers. 10
Oracle NOSQL Database product mission Transitioning NOSQL from Startup to Enterprise • Enterprise ready- for Administrators and Developers • Integrated - into Oracle software stack of tools and solutions • Engineered appliance – fast deployment and comprehensive support Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading, Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
R4 D Application NoSQL Driver D M3 R3 M4 M1 M2 D R1 R3 R4 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Cluster Topology Smart Topology Agents A A A Machine1 Machine2 Machine3 R1 R2 R2 D Replica Group1 Replica Group2 Replica Group3 Replica Group4
• Simple setup via Resource Declaration (no replica group definition) • Automatic HA process placement (DBA assist) • Oracle Enterprise Manager (unified SQL and NoSQL resource view) Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Cluster creation
Enterprise Ready High availability and active monitoring • Automated write availability - master re-election on failure • Cloud ready tooling and standards based alerting (html5, jmx, snmp) • Automated process rebalancing on recovery - DBA-less recovery Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
Email Example – RDBMS Schema ER Diagram Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Email Example – NOSQL Schema Hierarchical key space, table meta layer Parent/child Parent/child Value Value Value Value Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
• Simple, scripted DDL (familiar SQL concepts) • Rich modeling: Collections, Records, Primitives, Embedding, Linked (powerful modeling) • Strongly typed data, loosely coupled applications (governance with agility) Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Table creation
• Easy CLI based data loading from CVS, JSON formats • High speed bulk loading – ODI / Oracle Connectors (Map Reduce) • Data load from cluster wide snapshots Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Data Loading
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
kv-> get table -name user -field userId -value 1 kv-> get table -name user -index emailIndex -field email -value mike.smith@email.com kv-> get table -name user -index ageIndex -field age - start 12 -end 20 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Email Example Queries Query by primary key Parent/child Parent/child Query by secondary index Queries with ordered results Value Value kv-> Value get table -name user -index emailIndex Value Range Queries
Intersection Queries (JOIN) kv-> get table -name User.Folder.Message -field userId - value 1 -field folderId -value 2 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Email Example Queries Parent/child Parent/child Value Value Value Value
• Easy CLI adhoc query (Dev prototype, DBA examine) • Range and aggregate operators (advanced filtering, indexes, store wide ordered) • Scriptable and exportable results (predictable, repeatable, sharable) Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready CLI queries
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready SQL based queries • Simple Oracle integration • All SQL tools available thru Oracle Database • Foundation for unified query of Big Data SQL
Enterprise Ready and Developer friendly Table API based queries • Simple Eclipse based, multi-language development • Flexible Table, AVRO, Key-Value API with adhoc query • Powerful operators, primary/secondary indexing Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
95/5 Read/Update Throughput Engineered for Linear Scaling Big Data Appliance Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 8 7 6 5 4 3 2 1 0 80,000 70,000 60,000 50,000 40,000 30,000 20,000 10,000 0 144 (48x3) 20% 40% 60% 80% 216 (72x3) 216* (72x3) Average Latency (ms) Throughput (ops/sec) Replicas (RG x RF) Throughput (ops/sec) Read Latency (ms) Update Latency (ms) • 144 -> 216 nodes • 4% initial reduction • 9% final gain • Linear scalability
Engineered for Rolling Upgrades Big Data Appliance • 216 nodes • 15 minutes to software upgrade • Scriptable automation • Linear scalability 17.5 15 12.5 10 7.5 5 2.5 0 Online Rolling Upgrade 72 (24x3) 144 (48x3) 216 (72x3) Time to Upgrade (min) Total Nodes Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Terracotta Oracle NoSQL Database Read Latency Enterprise Ready Predictable performance beats in-memory grids
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Defense in Depth Security • Authentication (truststore) • Wire line encryption (SSL) • At rest encryption (eCryptfs) • Oracle Wallet (key management) • Upcoming security integrations • Kerberos, Database Vault, Auditing, Masking, Label Security
Data Reservoir + Data Warehouse Oracle Big Data Connectors Oracle Data Integrator Oracle Database Oracle Database Oracle Industry Models Oracle Advanced Analytics Oracle Spatial & Graph Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Cloudera Hadoop Oracle NoSQL Database Oracle R Distribution Oracle Industry Models Oracle GoldenGate Oracle Data Integrator Oracle Event Processing Oracle Event Processing Apache Flume Oracle Coherence Oracle Advanced Analytics Oracle Spatial & Graph Integrated with Oracle Software
Oracle NOSQL Database From enterprise product to market leading NOSQL Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 2014 • Version 3.0, • Hosted NoSQL • Big Data SQL 2015 • Release 4.0, seamless management • IoT platform infrastructure • Analytic enablement 2016 • NoSQL Everywhere - DMS • Cloud burst automation • Data Contexts ++ +++ ++++ Oracle Cloud Big Data Agility Ubiquitous Data
Oracle NOSQL Database From enterprise product to market leading NOSQL • Enterprise ready- for Administrators and Developers • Integrated - into Oracle software stack of tools and solutions • Engineered appliance – fast deployment and comprehensive support Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
A practical introduction to Oracle NoSQL Database - OOW2014

A practical introduction to Oracle NoSQL Database - OOW2014

  • 2.
    Oracle NOSQL Database A Practical Introduction – [CON8062] Product Management Oracle NOSQL Database October 01, 2014 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 3.
    Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 4.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Program Agenda What is Oracle NOSQL, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading, Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
  • 5.
    What is OracleNOSQL Database 101100101001001 001101010101011 100101010100100 101 Simple Fast Flexible Reliable advanced Key-Value database designed as cost effective, high performance solution for simple operations on collections of data with built in high availability and elastic scale-out. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 5
  • 6.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Oracle NOSQL Database From startups to enterprise ready 2009 • Servicing major Financials, LinkedIn, Amazon 2010 • Scaling out BerkeleyDB NoSQL Database 2011 • Nov 2011, version 1.0 released 2012 • Dec 2012, version 2.0 released • Oracle Eco Integrated 2013 • Quarterly releases, version 2.1 released 2014 • Version 3.0 • Hosted NoSQL • Big Data SQL Customers In Production Oracle Solutions Engineered Systems NoSQL Database In development BerkeleyDB Oracle Cloud
  • 7.
    Oracle NOSQL Database- Enterprise Ready – Data Center Support – Secondary Indexes – Secure Access – Flexible schema Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | • NOSQL Features – Elastic – BASE Operations – Tables / JSON / Binary – Online management • Differentiators – ACID transactions – Online rolling upgrades – Oracle technology integrated (tools & solutions) – Commodity & Engineered systems – Streaming large object support Best NOSQL choice for any company using Oracle products
  • 8.
    Oracle NOSQL Databasecustomer success… Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Finance • Large credit card network provider • Fraud rule and history management • 6,500 ops/sec, 85% update on read Manufacturing • Large airline manufacturer • Developing next generation planes • 750K key inserts/sec, 6TB per hour Telecoms • Large mobile telecom operator • Mobile personalized advertizing • 24,000 ops/sec, 100% update on read Gaming • Real-time, live event platform provider • Sports wagering for William Hill, BetVictor • 600 concurrent feeds, 400 events/feed ……many more
  • 9.
    Oracle NOSQL DatabaseSubscription Model Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | • Business-friendly support service – Oracle NoSQL Database Community Edition • Open Source AGPL Edition – Support is now available for Community Edition • Price is $2,000/year per server • No upfront license fee • Provides for full Oracle support policy response • Purchase online via the Oracle Store – Offers affordable support option for startups – Provides Oracle expertise for production deployment 9 Oracle Store https://shop.oracle.com/
  • 10.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Oracle NOSQL DB Licensing • Community -or- Enterprise Edition – Enterprise Edition • Closed Source. Standard Oracle License – Community Edition has all of the basic functionality and APIs. Gets you started – Enterprise Edition for large, production, multi-data center, Oracle integration-centric customers and/or non-GPL compliant customers. 10
  • 11.
    Oracle NOSQL Databaseproduct mission Transitioning NOSQL from Startup to Enterprise • Enterprise ready- for Administrators and Developers • Integrated - into Oracle software stack of tools and solutions • Engineered appliance – fast deployment and comprehensive support Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 12.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading, Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
  • 13.
    R4 D Application NoSQL Driver D M3 R3 M4 M1 M2 D R1 R3 R4 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Cluster Topology Smart Topology Agents A A A Machine1 Machine2 Machine3 R1 R2 R2 D Replica Group1 Replica Group2 Replica Group3 Replica Group4
  • 14.
    • Simple setupvia Resource Declaration (no replica group definition) • Automatic HA process placement (DBA assist) • Oracle Enterprise Manager (unified SQL and NoSQL resource view) Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Cluster creation
  • 15.
    Enterprise Ready Highavailability and active monitoring • Automated write availability - master re-election on failure • Cloud ready tooling and standards based alerting (html5, jmx, snmp) • Automated process rebalancing on recovery - DBA-less recovery Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 16.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
  • 17.
    Email Example –RDBMS Schema ER Diagram Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 18.
    Email Example –NOSQL Schema Hierarchical key space, table meta layer Parent/child Parent/child Value Value Value Value Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 19.
    • Simple, scriptedDDL (familiar SQL concepts) • Rich modeling: Collections, Records, Primitives, Embedding, Linked (powerful modeling) • Strongly typed data, loosely coupled applications (governance with agility) Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Table creation
  • 20.
    • Easy CLIbased data loading from CVS, JSON formats • High speed bulk loading – ODI / Oracle Connectors (Map Reduce) • Data load from cluster wide snapshots Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Data Loading
  • 21.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
  • 22.
    kv-> get table-name user -field userId -value 1 kv-> get table -name user -index emailIndex -field email -value mike.smith@email.com kv-> get table -name user -index ageIndex -field age - start 12 -end 20 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Email Example Queries Query by primary key Parent/child Parent/child Query by secondary index Queries with ordered results Value Value kv-> Value get table -name user -index emailIndex Value Range Queries
  • 23.
    Intersection Queries (JOIN) kv-> get table -name User.Folder.Message -field userId - value 1 -field folderId -value 2 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Email Example Queries Parent/child Parent/child Value Value Value Value
  • 24.
    • Easy CLIadhoc query (Dev prototype, DBA examine) • Range and aggregate operators (advanced filtering, indexes, store wide ordered) • Scriptable and exportable results (predictable, repeatable, sharable) Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Ready CLI queries
  • 25.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Enterprise Ready SQL based queries • Simple Oracle integration • All SQL tools available thru Oracle Database • Foundation for unified query of Big Data SQL
  • 26.
    Enterprise Ready andDeveloper friendly Table API based queries • Simple Eclipse based, multi-language development • Flexible Table, AVRO, Key-Value API with adhoc query • Powerful operators, primary/secondary indexing Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 27.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Program Agenda What is it, who uses it, how much does it cost Cluster setup, high availability, visual tooling Schema, data loading Query ( CLI, SQL, API’s ) Advanced Features and future 1 2 3 4 5
  • 28.
    95/5 Read/Update Throughput Engineered for Linear Scaling Big Data Appliance Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 8 7 6 5 4 3 2 1 0 80,000 70,000 60,000 50,000 40,000 30,000 20,000 10,000 0 144 (48x3) 20% 40% 60% 80% 216 (72x3) 216* (72x3) Average Latency (ms) Throughput (ops/sec) Replicas (RG x RF) Throughput (ops/sec) Read Latency (ms) Update Latency (ms) • 144 -> 216 nodes • 4% initial reduction • 9% final gain • Linear scalability
  • 29.
    Engineered for RollingUpgrades Big Data Appliance • 216 nodes • 15 minutes to software upgrade • Scriptable automation • Linear scalability 17.5 15 12.5 10 7.5 5 2.5 0 Online Rolling Upgrade 72 (24x3) 144 (48x3) 216 (72x3) Time to Upgrade (min) Total Nodes Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 30.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Terracotta Oracle NoSQL Database Read Latency Enterprise Ready Predictable performance beats in-memory grids
  • 31.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. | Enterprise Ready Defense in Depth Security • Authentication (truststore) • Wire line encryption (SSL) • At rest encryption (eCryptfs) • Oracle Wallet (key management) • Upcoming security integrations • Kerberos, Database Vault, Auditing, Masking, Label Security
  • 32.
    Data Reservoir +Data Warehouse Oracle Big Data Connectors Oracle Data Integrator Oracle Database Oracle Database Oracle Industry Models Oracle Advanced Analytics Oracle Spatial & Graph Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Cloudera Hadoop Oracle NoSQL Database Oracle R Distribution Oracle Industry Models Oracle GoldenGate Oracle Data Integrator Oracle Event Processing Oracle Event Processing Apache Flume Oracle Coherence Oracle Advanced Analytics Oracle Spatial & Graph Integrated with Oracle Software
  • 33.
    Oracle NOSQL Database From enterprise product to market leading NOSQL Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | 2014 • Version 3.0, • Hosted NoSQL • Big Data SQL 2015 • Release 4.0, seamless management • IoT platform infrastructure • Analytic enablement 2016 • NoSQL Everywhere - DMS • Cloud burst automation • Data Contexts ++ +++ ++++ Oracle Cloud Big Data Agility Ubiquitous Data
  • 34.
    Oracle NOSQL Database From enterprise product to market leading NOSQL • Enterprise ready- for Administrators and Developers • Integrated - into Oracle software stack of tools and solutions • Engineered appliance – fast deployment and comprehensive support Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 35.
    Safe Harbor Statement The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
  • 36.
    Copyright © 2014,Oracle and/or its affiliates. All rights reserved. |