QQ客服 官方微博 反馈留言

	A multi-group and preemptable scheduling of cloud resource based on htcondor
	Jiang,Xiaowei; Zou,Jiaheng; Cheng,Yaodong; Shi,Jingyan
刊名	Journal of physics: conference series
	2017-10-01
卷号	898期号:9
ISSN号	1742-6588
DOI	10.1088/1742-6596/898/9/092051
英文摘要	Abstract due to the features of virtual machine-flexibility, easy controlling and various system environments, more and more fields utilize the virtualization technology to construct the distributed system with the virtual resources, also including high energy physics. this paper introduce a method used in high energy physics that supports multiple resource group and preemptable cloud resource scheduling, combining virtual machine with htcondor (a batch system). it makes resource controlling more flexible and more efficient and makes resource scheduling independent of job scheduling. firstly, the resources belong to different experiment-groups, and the type of user-groups mapping to resource-groups(same as experiment-group) is one-to-one or many-to-one. in order to make the confused group simply to be managed, we designed the permission controlling component to ensure that the different resource-groups can get the suitable jobs. secondly, for the purpose of elastically allocating resources for suitable resource-group, it is necessary to schedule resources like scheduling jobs. so this paper designs the cloud resource scheduling to maintain a resource queue and allocate an appropriate amount of virtual resources to the request resource-group. thirdly, in some kind of situations, because of the resource occupied for a long time, resources need to be preempted. this paper adds the preemption function for the resource scheduling that implement resource preemption based on the group priority. additionally, the way to preempting is soft that when virtual resources are preempted, jobs will not be killed but also be held and rematched later. it is implemented with the help of htcondor, storing the held job information in scheduler, releasing the job to idle status and doing second matcher. in ihep (institute of high energy physics), we have built a batch system based on htcondor with a virtual resources pool based on openstack. and this paper will show some cases of experiment juno and lhaaso. the result indicates that multi-group and preemptable resource scheduling is efficient to support multi-group and soft preemption. additionally, the permission controlling component has been used in the local computing cluster, supporting for experiment juno, cms and lhaaso, and the scale will be expanded to more experiments at the first half year, including dyw, bes and so on. its evidence that the permission controlling is efficient.
语种	英语
出版者	IOP Publishing
WOS记录号	IOP:1742-6588-898-9-092051
内容类型	期刊论文
URI标识	http://www.corc.org.cn/handle/1471x/2175693
专题	高能物理研究所
作者单位	Institute of High Energy Physics, Chinese Academy of Sciences, Beijing, China
推荐引用方式 GB/T 7714	Jiang,Xiaowei,Zou,Jiaheng,Cheng,Yaodong,et al. A multi-group and preemptable scheduling of cloud resource based on htcondor[J]. Journal of physics: conference series,2017,898(9).
APA	Jiang,Xiaowei,Zou,Jiaheng,Cheng,Yaodong,&Shi,Jingyan.(2017).A multi-group and preemptable scheduling of cloud resource based on htcondor.Journal of physics: conference series,898(9).
MLA	Jiang,Xiaowei,et al."A multi-group and preemptable scheduling of cloud resource based on htcondor".Journal of physics: conference series 898.9(2017).

个性服务

查看访问统计

相关权益政策

暂无数据

收藏/分享

除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。