Downloaded 55 times
Uploaded byKNIMESlides
Sharing and Deploying Data Science with KNIME Server
The document discusses the functionalities and features of the KNIME Server, emphasizing its role in collaboration, automation, deployment, and management of data science workflows. It highlights challenges associated with operationalizing data science across various departments and introduces KNIME's integration capabilities, including REST APIs for external applications. Additionally, it outlines the expansion of workflow execution through distributed executors to enhance performance and scalability.
Sharing and Deploying Data Science with KNIME Server
- 1. © 2019 KNIMEAG. All rights reserved. Webinar: Sharing and Deploying Data Science with KNIME Server Roland Burger Data Scientist KNIME
- 2. © 2019 KNIMEAG. All rights reserved. 2 KNIME Server • Collaboration – Share Expertise and Templates/Blueprints • Automation – Schedule, Monitor, Update • Deployment – To Humans: Analytical Applications (“Guided Analytics”) – To Machines: via REST and custom APIs • Management – Manage distributed setups – Integrate with existing enterprise setup (authentication)
- 3. © 2019 KNIMEAG. All rights reserved. 3 Challenges Operationalizing Data Science R&D MFG IT Marketing Sales … more Data Science Driven Applications Large, complex variety of technologies Providing skills and resources Continuous, high quality delivery Mainstreaming across the organization Creating Great Data Science
- 4. © 2019 KNIMEAG. All rights reserved. 4 Challenges Operationalizing Data Science R&D MFG IT Marketing Sales … more Data Science Driven Applications Large, complex variety of technologies Providing skills and resources Continuous, high quality delivery Mainstreaming across the organization Productionizing Data Science
- 5. © 2019 KNIMEAG. All rights reserved. 5 Better Decision-making, Faster! KNIME Integrations KNIME Analytics Platform KNIME Server Load > Integrate > Transform > Analyze > Visualize KNIME Extensions Community Extensions Partner Extensions Collaborate Automate Manage Deploy
- 6. © 2019 KNIMEAG. All rights reserved. 6 KNIME Server Management Deployment Configuration & Versioning RESTful Services Client & User PreferencesSecurity Guided Analytic AppsWeb Front-ends Collaboration Workflow Hub Workflows Shared Repository, Versioning Metanodes, Nodes Data Automation Distributed Executors Remote, Client ControlProvisioning
- 7. © 2019 KNIMEAG. All rights reserved. 7 KNIME Server Live Demo
- 8. © 2019 KNIMEAG. All rights reserved. 19 Guided Analytics for ML/AI Automation • Interaction & Automation • Data Scientist’s Choice: right mix for target audience
- 9. 20© 2019 KNIMEAG. All rights reserved.
- 10. 21© 2019 KNIMEAG. All rights reserved.
- 11. 22© 2019 KNIMEAG. All rights reserved.
- 12. © 2019 KNIMEAG. All rights reserved. 23 KNIME Server REST API • Enables external integration • Build applications around KNIME Server • e.g. for Microservices and real time scoring Output in server responseInput data Deploy KNIME workflows as web services
- 13. © 2019 KNIMEAG. All rights reserved. 24 KNIME Server REST API: Job Pool KNIME Workflow for e.g. sentiment prediction, churn score, chemical property Pre-loaded jobs pooled and waiting for work Workflow immediately executed External REST call No “load latency” for client Results Take from pool Pooled jobsKNIME Executor KNIME SERVER
- 14. © 2019 KNIMEAG. All rights reserved. 31 Managing Preferences – local KNIME Analytics Platform KNIME Analytics Platform KNIME Analytics Platform How do I install database drivers? How do I configure Python? KNIME Website Internal knowledgebase
- 15. © 2019 KNIMEAG. All rights reserved. 32 Managing Preferences – KNIME Server Marketing R&DFinance Linux and macOS Python R Windows 7 Oracle MS Access Windows 10 Hive Spark • Different departments/teams have different requirements • Multiple OS deployments • Windows 7 • Windows 10 • Linux • macOS
- 16. © 2019 KNIMEAG. All rights reserved. 33 Managing Preferences – KNIME Server KNIME Server Profiles can include: Preferences, drivers, and more • Client-profiles • Python-Linux • Python-macOS • R-Linux • R-macOS • Databases-Win7 • Big Data-Win10 client-profiles Big Data- Win10 Databases- Win7 Python- macOS (etc) Marketing Finance R&D
- 17. © 2019 KNIMEAG. All rights reserved. 34 Client Customization Profiles
- 18. © 2019 KNIMEAG. All rights reserved. 35 KNIME Server – Admin made easy
- 19. © 2019 KNIMEAG. All rights reserved. 36 Distributed Executors • Need more workflow horsepower? • KNIME Server currently supports ‘Scale Up’ • KNIME Server Distributed Executors allows ‘Scale Out’ https://upload.wikimedia.org/wikipedia/commons/thumb/8/8b/Server.svg/2000px-Server.svg.png https://upload.wikimedia.org/wikipedia/commons/5/53/Server-multiple.svg
- 20. © 2019 KNIMEAG. All rights reserved. 37 Distributed Executors KNIME Server Executor 1 Executor 2 Executor 3 RabbitMQ KNIME Server + Distributed Executors Requests to execute workflows
- 21. © 2019 KNIMEAG. All rights reserved. 38 Distributed Executors KNIME Server Executor 1 RabbitMQ KNIME Server + Distributed Executors Request to execute workflow Scripted launch on AWS CloudFormation
- 22. © 2019 KNIMEAG. All rights reserved. 39 Distributed Executors KNIME Server Executor 1 Executor 2 RabbitMQ KNIME Server + Distributed Executors More requests to execute workflows Launching CPU load increases AWS Auto-scaling Group
- 23. © 2019 KNIMEAG. All rights reserved. 40 Distributed Executors KNIME Server Executor 1 Executor 2 RabbitMQ KNIME Server + Distributed Executors Requests to execute workflows AWS Auto-scaling Group
- 24. © 2019 KNIMEAG. All rights reserved. 41 KNIME Software – On premise and in the cloud KNIME Analytics Platform KNIME Server KNIME Analytics Platform KNIME Server KNIME Analytics Platform KNIME Server
- 25. © 2019 KNIMEAG. All rights reserved. 42 KNIME Server Management Deployment Configuration & Versioning RESTful Services Client & User PreferencesSecurity Guided Analytic AppsWeb Front-ends Collaboration Workflow Hub Workflows Shared Repository, Versioning Metanodes, Nodes Data Automation Distributed Executors Remote, Client ControlProvisioning Ready to get started with KNIME Server? Contact us for a free trial: contact@knime.com
- 26. © 2019 KNIMEAG. All rights reserved. 43 KNIME Spring Summit 2019 March 18 – 22 at bcc Berlin Congress Center, Berlin • Monday & Tuesday: One-day courses • Wednesday & Thursday: Summit sessions • Friday: Workshops Use the code WEBINAR-20 for 20% off tickets! Register at knime.com/spring-summit2019
- 27. 44© 2019 KNIMEAG. All rights reserved. The KNIME® trademark and logo and OPEN FOR INNOVATION® trademark are used by KNIME AG under license from KNIME GmbH, and are registered in the United States. KNIME® is also registered in Germany.