Hello guys, Welcome to Africa's Largest Video Search Engine, and you are watching Efficient Scheduling Of High Performance Batch Computing For... Krzysztof Adamski & Tinco Boekestijn. and this video is uploaded by CNCF [Cloud Native Computing Foundation] at 2022-11-12T10:22:08-08:00. We are just promoting this video only for entertainment and educational purpose only. I hop you like our Video Search Engine. [brxJqOEjJ-c]
| Name | Efficient Scheduling Of High Performance Batch Computing For... Krzysztof Adamski & Tinco Boekestijn |
| Video Uploader | Video From CNCF [Cloud Native Computing Foundation] |
| Upload Date | This Video Uploaded At 12-11-2022 18:22:08 |
| Video Discription | Don’t miss out! Join us at our upcoming event: KubeCon + CloudNativeCon Europe 2023 in Amsterdam, The Netherlands from April 17-21. Learn more at https://kubecon.io. The conference features presentations from developers and end users of Kubernetes, Prometheus, Envoy, and all of the other CNCF-hosted projects. Efficient Scheduling Of High Performance Batch Computing For Analytics Workloads With Volcano - Krzysztof Adamski & Tinco Boekestijn, ING Three years ago ING Wholesale Banking Advanced Analytics team set up an ambitious goal to gather in one place a curated portfolio of internal data sources together with a large scale compute platform. At its core the idea of allowing internal projects to get access to a rich toolset of open source and industry standards frameworks and preprocessed data to validate business ideas in the secure exploration environment. Extensive growth with over 300 internal projects so far and more than 2000 internal users proofs advanced analytics i.e. ML, AI, NLP capabilities should become easily consumable not only by specialized, dedicated teams, but make them close to subject matter experts. In this session we would like to shed more light on how a specialized cloud native Kubernetes scheduler (Volcano) enables us to deliver multi-tenant large scale processing capabilities. The optimal resource usage with stability of core services are key for our cloud native platform. To enable dynamic allocation and hdrf (hierarchical dominant resource fairness) we have created an extension to Apache Spark binaries. This allows users to use Volcano with Spark interactive mode in a Jupyter notebook. Additionally we have created interfaces to visualize all the scheduling metrics like the yarn ui. [brxJqOEjJ-c] |
| Category | Science & Technology |
| Tags | Science & Technology Download MP4 | Science & Technology Download MP3 | Science & Technology Download MP4 360p | Science & Technology Download MP4 480p | Science & Technology Download MP4 720p | Science & Technology Download MP4 1080p |
