Downloaded 29 times
![Node.js performance measurement APIs eventLoopUtilization([elu1[, elu1]]): elu; interface EventLoopUtilization { idle: number; active: number; utilization: number; }](https://image.slidesharecdn.com/fwdays-js-is-back-timur-shemsedinov-2021-211127132300/75/Node-js-threads-for-I-O-bound-tasks-3-2048.jpg)
![Prototype: noroutine const noroutine = require('noroutine'); const module1 = require('./module1.js'); const module2 = require('./module2.js); noroutine.init({ modules: [module1, module2] }); (async () => { const res1 = await module1.method1('value1'); const res2 = await module2.method2('value2'); console.log({ res1, res2 }); })();](https://image.slidesharecdn.com/fwdays-js-is-back-timur-shemsedinov-2021-211127132300/75/Node-js-threads-for-I-O-bound-tasks-34-2048.jpg)
![Configure noroutine noroutine.init({ modules: [module1, module2], pool: 5, // number of workers in thread pool wait: 2000, // maximum delay to wait for a free thread timeout: 5000, // maximum timeout for executing fn monitoring: 5000, // utilization monitoring interval });](https://image.slidesharecdn.com/fwdays-js-is-back-timur-shemsedinov-2021-211127132300/75/Node-js-threads-for-I-O-bound-tasks-35-2048.jpg)
Uploaded byTimur Shemsedinov
Node.js threads for I/O-bound tasks
The document discusses Node.js performance measurement APIs and I/O concurrency models. It introduces the perf_hooks and worker.performance APIs for measuring event loop utilization. It then covers Node.js' single-threaded I/O model and how a thread pool and task balancer can improve I/O concurrency. The document proposes the noroutine module as a prototype for enabling multi-threading in Node.js applications.
Node.js threads for I/O-bound tasks
- 1.
- 2. Node.js performance measurementAPIs ● perf_hooks eventLoopUtilization Added in: v14.10.0, v12.19.0 ● worker.performance eventLoopUtilization Added in: v15.1.0, v14.17.0, v12.22.0
- 3. Node.js performance measurementAPIs eventLoopUtilization([elu1[, elu1]]): elu; interface EventLoopUtilization { idle: number; active: number; utilization: number; }
- 4. Node.js I/O concurrencymodel wait
- 5. Node.js I/O concurrencymodel wait wait
- 6. Node.js I/O concurrencymodel wait wait wait
- 7. Node.js I/O concurrencymodel wait wait wait wait
- 8. Node.js I/O concurrencymodel wait wait wait wait
- 9. Node.js I/O concurrencymodel wait wait wait wait
- 10. Node.js I/O concurrencymodel wait wait wait wait
- 11. Node.js I/O concurrencymodel wait wait wait wait
- 12. Node.js I/O concurrencymodel wait wait wait wait
- 13. Node.js I/O concurrencymodel wait wait wait wait idle profit delay
- 14.
- 15. Node.js performance measurementAPIs ● perf_hooks eventLoopUtilization Added in: v14.10.0, v12.19.0 ● worker.performance eventLoopUtilization Added in: v15.1.0, v14.17.0, v12.22.0
- 16. Node.js ELU bugs ●Separation of concerns in ELU current ELU, current - previous, difference ● Code duplication Proportion in eventLoopUtilization = 3 2 versions of eventLoopUtilization * 3 = 6 ● Negative utilization https://github.com/nodejs/node/issues/40525
- 17. Node.js I/O concurrencymodel Main thread
- 18. Node.js I/O concurrencymodel Main thread
- 19. Node.js I/O concurrencymodel Main thread
- 20. Node.js I/O concurrencymodel Main thread
- 21. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread
- 22. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread
- 23. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread Worker Thread
- 24. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread Worker Thread Worker Thread
- 25. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread Worker Thread Worker Thread Worker Thread
- 26. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread Worker Thread Worker Thread Worker Thread
- 27. Node.js I/O concurrencymodel Main thread Worker Thread Worker Thread Worker Thread
- 28. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer
- 29. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer
- 30. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M
- 31. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M
- 32. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M
- 33. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M
- 34. Prototype: noroutine const noroutine= require('noroutine'); const module1 = require('./module1.js'); const module2 = require('./module2.js); noroutine.init({ modules: [module1, module2] }); (async () => { const res1 = await module1.method1('value1'); const res2 = await module2.method2('value2'); console.log({ res1, res2 }); })();
- 35. Configure noroutine noroutine.init({ modules: [module1,module2], pool: 5, // number of workers in thread pool wait: 2000, // maximum delay to wait for a free thread timeout: 5000, // maximum timeout for executing fn monitoring: 5000, // utilization monitoring interval });
- 36. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M
- 37. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M Shared Memory
- 38. Node.js I/O concurrencymodel Main thread Thread Pool Task Balancer module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M module 1 module 2 ... module M Shared Memory
- 39. Roadmap ● Better statisticsfor balancing ● Improve balancing algorithms ● Crossworker data access ● Race condition protection ● Dynamic module loading in userland workers ● Load testing
- 40. Лекции Курс по ноде github.com/HowProgrammingWorks/Index/blob/master/Courses/NodeJS.md Курспо асинхронщине github.com/HowProgrammingWorks/Index/blob/master/Courses/Asynchronous.md Все лекции github.com/HowProgrammingWorks/Index
- 41.
- 42.