S*e
2 楼
你们是用standalone mode, 还是over Hadoop/HDFS? 要是standalone mode, 怎么处
理‘cluster’ 的 filesystem?
用了别人的10个datanode的Hadoop cluster 试SPARK。 Count records in files
with SPARK, 只需要4分钟(1 billion records)。 曾用 Hadoop's MR在40个
datanode上至少要用 三十几分钟。这个该死的40datanode现在试不了SPARK -- 老给我
出错.
现在, 自己组里想搭建一个小的spark cluster。 不知是用standalone mode, 还是
over hdfs。
理‘cluster’ 的 filesystem?
用了别人的10个datanode的Hadoop cluster 试SPARK。 Count records in files
with SPARK, 只需要4分钟(1 billion records)。 曾用 Hadoop's MR在40个
datanode上至少要用 三十几分钟。这个该死的40datanode现在试不了SPARK -- 老给我
出错.
现在, 自己组里想搭建一个小的spark cluster。 不知是用standalone mode, 还是
over hdfs。
c*i
3 楼
John Pomfret, China pushing the envelope on science, and sometimes ethics;
The Other Superpower. Washington Post, June 28, 2010.
http://www.washingtonpost.com/wp-dyn/content/article/2010/06/27/AR2010062703639.html?sub=AR
Note:
(a) Zhao Bowen I cannot find his Chinese name. However, his English name is
listed in a paper, where his affiliation was "High School Affiliated to
Renmin University of China, Beijing, China" 人大附中.
www.rdfz.cn/
("位于北京市中关村高科技园区的中心地带,是北京市首批示范高中校")
Huang SW et al, The genome
The Other Superpower. Washington Post, June 28, 2010.
http://www.washingtonpost.com/wp-dyn/content/article/2010/06/27/AR2010062703639.html?sub=AR
Note:
(a) Zhao Bowen I cannot find his Chinese name. However, his English name is
listed in a paper, where his affiliation was "High School Affiliated to
Renmin University of China, Beijing, China" 人大附中.
www.rdfz.cn/
("位于北京市中关村高科技园区的中心地带,是北京市首批示范高中校")
Huang SW et al, The genome
c*o
4 楼
over hdfs
d*y
5 楼
老哥 你也到这混?
B*g
6 楼
yarn
【在 S*******e 的大作中提到】![](/moin_static193/solenoid/img/up.png)
: 你们是用standalone mode, 还是over Hadoop/HDFS? 要是standalone mode, 怎么处
: 理‘cluster’ 的 filesystem?
: 用了别人的10个datanode的Hadoop cluster 试SPARK。 Count records in files
: with SPARK, 只需要4分钟(1 billion records)。 曾用 Hadoop's MR在40个
: datanode上至少要用 三十几分钟。这个该死的40datanode现在试不了SPARK -- 老给我
: 出错.
: 现在, 自己组里想搭建一个小的spark cluster。 不知是用standalone mode, 还是
: over hdfs。
【在 S*******e 的大作中提到】
![](/moin_static193/solenoid/img/up.png)
: 你们是用standalone mode, 还是over Hadoop/HDFS? 要是standalone mode, 怎么处
: 理‘cluster’ 的 filesystem?
: 用了别人的10个datanode的Hadoop cluster 试SPARK。 Count records in files
: with SPARK, 只需要4分钟(1 billion records)。 曾用 Hadoop's MR在40个
: datanode上至少要用 三十几分钟。这个该死的40datanode现在试不了SPARK -- 老给我
: 出错.
: 现在, 自己组里想搭建一个小的spark cluster。 不知是用standalone mode, 还是
: over hdfs。
e*r
7 楼
高中生么
is
Lawrence
in
【在 c**i 的大作中提到】![](/moin_static193/solenoid/img/up.png)
: John Pomfret, China pushing the envelope on science, and sometimes ethics;
: The Other Superpower. Washington Post, June 28, 2010.
: http://www.washingtonpost.com/wp-dyn/content/article/2010/06/27/AR2010062703639.html?sub=AR
: Note:
: (a) Zhao Bowen I cannot find his Chinese name. However, his English name is
: listed in a paper, where his affiliation was "High School Affiliated to
: Renmin University of China, Beijing, China" 人大附中.
: www.rdfz.cn/
: ("位于北京市中关村高科技园区的中心地带,是北京市首批示范高中校")
: Huang SW et al, The genome
is
Lawrence
in
【在 c**i 的大作中提到】
![](/moin_static193/solenoid/img/up.png)
: John Pomfret, China pushing the envelope on science, and sometimes ethics;
: The Other Superpower. Washington Post, June 28, 2010.
: http://www.washingtonpost.com/wp-dyn/content/article/2010/06/27/AR2010062703639.html?sub=AR
: Note:
: (a) Zhao Bowen I cannot find his Chinese name. However, his English name is
: listed in a paper, where his affiliation was "High School Affiliated to
: Renmin University of China, Beijing, China" 人大附中.
: www.rdfz.cn/
: ("位于北京市中关村高科技园区的中心地带,是北京市首批示范高中校")
: Huang SW et al, The genome
S*e
8 楼
谢各位大牛。
c*o
12 楼
基本上我们和二爷的完全不一样。。。
kinesis + mesos + hdfs
二爷是
kafka + yarn + Cassandra
我们也在找办法用Cassandra.
kinesis + mesos + hdfs
二爷是
kafka + yarn + Cassandra
我们也在找办法用Cassandra.
c*o
22 楼
payment mysql
数据当然是各有各的,再互联。
数据当然是各有各的,再互联。
相关阅读
请推荐一个 automated DNA extraction station.生物创业者的一个可能方向公司职位招聘:微生物采油,微生态,发酵方向AHA postdoc fellowship resubmission 几率怎么样?NCI 2015FY的budget出来了吗?有人知道NCI K99的pay line吗?请帮忙下载paperTreat cell时候medium不一样结果不一样国内CRO两个职位,求选择建议!paper help (nature communications)请教如何从小鼠肾脏里分离β-细胞, 谢谢。求绘制植物墨线图的好方法!量大人少,画不起!多谢!在hiPSC里做CRISPR mutation correction用ssODN靠谱么CRISPR求助NGS生物信息工作paper help [bz]公司招人据说奥巴马今天会宣布政府出钱测1million个genome职场问题求教!【供求】波士顿近东北大学,哈佛医学院一大房带卫生间出租 (转载)请教一个诱导cre表达的问题