刚开始看python - 未名空间MITBBS历史存档

国际科技财经博客移民网络热点娱乐民生时事公众号

Redian新闻

>未名空间

>Programming - 葵花宝典

刚开始看python

刚开始看python# Programming - 葵花宝典

c*22008-07-11 07:07

1 楼

中了五百万还会接着上班，因为我是北京人，大家都知道北京房价之高，五百万可能也
就买套房子，还不能是太好的房子。我和我爱人都是普通的上班族，一年的总收入加起
来也就十二万块钱，有一个八岁的儿子上私立小学，一年学费要四万七。有套二居室，
家里老人留下的，没车。我老买彩票，也想过中了五百万怎么办？结合自已的实际情况
，还得上班。一是我现在的工作比较喜欢，适合我。二是我要不上班，天天在家待着受
不了，人得有点事干，不然人会变废物的。三、五百万在北京可真不多，远没到让我放
心，不用上班就能无忧无虑生活的地步。中了五百万，我会一边上班，一边理财。瞅准
股市低点，把钱全买上股票，等大牛市一来，五百万翻上几翻，哪我的后半辈子就不愁
了。

l*c2008-07-11 07:07

2 楼

被大家吊起兴趣了，呵呵。
问个问题。Pythong内建的multi-core support如何？比如像map()这样在collection上
的operation，有内建的multithreading机制么？

r*t2008-07-11 07:07

3 楼

You are welcome to look into python. :)
There's multithreading, but you cannot utilize multi-core using one process,
no matter how many threads you have, because of GIL problem.
One has to look somewhere else if you are to use default CPython, like
processing module, or IPython1 to get parallelized map() operations.
Or use mpipython etc etc...

【在 l*****c 的大作中提到】

: 被大家吊起兴趣了，呵呵。
: 问个问题。Pythong内建的multi-core support如何？比如像map()这样在collection上
: 的operation，有内建的multithreading机制么？

l*c2008-07-11 07:07

4 楼

3x. GIL is definitely ridiculous. Is there a 3rd party module utilize hadoop
or other grid mode for this?

process,

【在 r****t 的大作中提到】

: You are welcome to look into python. :)
: There's multithreading, but you cannot utilize multi-core using one process,
: no matter how many threads you have, because of GIL problem.
: One has to look somewhere else if you are to use default CPython, like
: processing module, or IPython1 to get parallelized map() operations.
: Or use mpipython etc etc...

r*t2008-07-11 07:07

5 楼

GIL has deep reasons that are still not coped with. You can use hadoop via
Pyton, from my impression.

hadoop

【在 l*****c 的大作中提到】

: 3x. GIL is definitely ridiculous. Is there a 3rd party module utilize hadoop
: or other grid mode for this?
:
: process,

l*c2008-07-11 07:07

6 楼

That's not what I mean. We use hadoop with python. But that is hadoop
calling python.
This is the other way: use hadoop to implement map() and reduce() in python,
so python could be used as the master language.

【在 r****t 的大作中提到】

: GIL has deep reasons that are still not coped with. You can use hadoop via
: Pyton, from my impression.
:
: hadoop

r*t2008-07-11 07:07

7 楼

I dnnot know a map() implemented with hadoop.
But there's such things in IPython1. or maybe "processing" module that's
going to enter standard library since python2.6. If processing is in
standard library, there's hope to see a map() that makes use of SMP...

python,

【在 l*****c 的大作中提到】

: That's not what I mean. We use hadoop with python. But that is hadoop
: calling python.
: This is the other way: use hadoop to implement map() and reduce() in python,
: so python could be used as the master language.

l*c2008-07-11 07:07

8 楼

OK. I read a little about IPython1. It uses MPI to implement the
architecture. Gonna to read more this weekend to see if it is worthy to
implement one to accommodate Hadoop, which I would expect to be much less
work and more handful than implement IPython1.

【在 r****t 的大作中提到】

: I dnnot know a map() implemented with hadoop.
: But there's such things in IPython1. or maybe "processing" module that's
: going to enter standard library since python2.6. If processing is in
: standard library, there's hope to see a map() that makes use of SMP...
:
: python,

r*t2008-07-11 07:07

9 楼

?? It can work with MPI, but MPI is not required.
I am using it without MPI...

【在 l*****c 的大作中提到】

: OK. I read a little about IPython1. It uses MPI to implement the
: architecture. Gonna to read more this weekend to see if it is worthy to
: implement one to accommodate Hadoop, which I would expect to be much less
: work and more handful than implement IPython1.

l*c2008-07-11 07:07

10 楼

I just read the introduction, maybe I missed something.

【在 r****t 的大作中提到】

: ?? It can work with MPI, but MPI is not required.
: I am using it without MPI...

r*t2008-07-11 07:07

11 楼

刚刚看见这个应该是你要的。不知道你那个是不是搞定了。
http://blog.last.fm/2008/05/29/python-hadoop-flying-circus-elephant

python,

【在 l*****c 的大作中提到】