Research on cloud native batch scheduler technology

Xuemin Wang; Yang Han

doi:10.1117/12.3009420

11 October 2023 Research on cloud native batch scheduler technology

Xuemin Wang, Yang Han

Proceedings Volume 12918, Fourth International Conference on Computer Science and Communication Technology (ICCSCT 2023); 129181A (2023) https://doi.org/10.1117/12.3009420
Event: International Conference on Computer Science and Communication Technology (ICCSCT 2023), 2023, Wuhan, China

Abstract

This paper reviews the evolution of IT system architecture and highlights that container technology based on cloud computing is an inevitable trend in the future of IT technology. And big data and artificial intelligence are also closely related to container technology. For instance, the architecture for computing-storage separation and the distributed training of large models are uninterruptedly dependent upon container technology. Numerous container-based applications require robust management tool suites. Although Kubernetes is a well-known tool for container orchestration, its native scheduling is not tailored towards offline workloads, like big data and artificial intelligence. In this context, this paper first examines the principles of Kubernetes native scheduler and identifies the challenges encountered when dealing with batch tasks, then presents the concept, the workflow, and integration methods of batch schedulers, and finally summarizes its significant features and several open-source frameworks. Ultimately, enterprises’ IT infrastructure is continuously moving towards cloud and containerization. Comprehensive scheduling architectures that support both online and offline tasks are crucial, as they significantly impact the enterprise’s overall IT scalability, efficiency, and business outcomes. Therefore, this area has garnered the industry’s attention.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xuemin Wang and Yang Han "Research on cloud native batch scheduler technology", Proc. SPIE 12918, Fourth International Conference on Computer Science and Communication Technology (ICCSCT 2023), 129181A (11 October 2023); https://doi.org/10.1117/12.3009420

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Clouds

Information technology

Artificial intelligence

Computer architecture

Distributed computing

Education and training

Design and modelling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years