job scheduling question - 未名空间MITBBS历史存档

国际科技财经博客移民网络热点娱乐民生时事公众号

Redian新闻

>未名空间

>Linux - Linux 操作系统

job scheduling question

job scheduling question# Linux - Linux 操作系统

l*r2011-08-16 07:08

1 楼

Hi all,
One question about job scheduling... say I have a 8 core machine and would
like to run hundreds of big tasks in the background, each takes a couple of
hours to finish. How can I make them to use only 6 cores and leave 2 for me
for other light weight tasks? Is there any command that can help to do this?
Thanks!

S*A2011-08-16 07:08

2 楼

Just limit the total number thread/process of your job
to 6.
That is depend on how you write your project code.

o*p2011-08-16 07:08

3 楼

You can use xargs.

of
me
this?

【在 l*******r 的大作中提到】

: Hi all,
: One question about job scheduling... say I have a 8 core machine and would
: like to run hundreds of big tasks in the background, each takes a couple of
: hours to finish. How can I make them to use only 6 cores and leave 2 for me
: for other light weight tasks? Is there any command that can help to do this?
: Thanks!

q*d2011-08-16 07:08

4 楼

sched_setaffinity?

l*o2011-08-16 07:08

5 楼

pthread_setaffinity_np可以吧。
但如果是这些程序本身也要用到大量内存，那么目前的Linux系统不可能reserve一些资
源。
我记得有一篇paper就是讨论此类问题的，www.usenix.org/event/osdi08/tech/full_
papers/yang/yang.pdf。
不过，好像需要修改操作系统。

d*o2011-08-16 07:08

6 楼

》》》那么目前的Linux系统不可能reserve一些资
linux container能不？

【在 l*****o 的大作中提到】

: pthread_setaffinity_np可以吧。
: 但如果是这些程序本身也要用到大量内存，那么目前的Linux系统不可能reserve一些资
: 源。
: 我记得有一篇paper就是讨论此类问题的，www.usenix.org/event/osdi08/tech/full_
: papers/yang/yang.pdf。
: 不过，好像需要修改操作系统。

l*o2011-08-16 07:08

7 楼

没用过linux container，不知道，系统默认支持这个吗？
能不能说说你为什么需要这么做吗？