做了一个太空飞行科技blog，欢迎来交流 - 未名空间MITBBS历史存档

做了一个太空飞行科技blog，欢迎来交流# Aviation - 航空航天

x*n2009-07-22 07:07

1 楼

【以下文字转载自 Music 讨论区】
发信人: highouse (高屋 ), 信区: Music
标题: Music 版周末 Party No. 2 实况录音
发信站: BBS 未名空间站 (Thu Apr 30 02:30:30 2009)
第二次周末 Party 在上周六成功举办，感谢所有策划、表演和听友！
这是当时的部分现场录音，以方便错过实况的版友：
其余录音尚在处理当中，我会尽快加到播放列表里。

m*k2009-07-22 07:07

2 楼

我在试http://hadoop.apache.org/common/docs/r0.20.2/quickstart.html
我用的是win7 和 cygwin,
Standalone Operation
By default, Hadoop is configured to run in a non-distributed mode, as a
single Java process. This is useful for debugging.
The following example copies the unpacked conf directory to use as input and
then finds and displays every match of the given regular expression. Output
is written to the given output directory.
$ mkdir input
$ cp conf/*.xml input
在这一步
$ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+'
总是出错，
看上去是不能更改permission, 实际上.staging根本就没创建出来，但我可以 mkdir -
p /tmp/hadoop-mywinusername/mapred/staging/mywinusername1444391482/.staging
, mywinusername1444391482 是temp folder, 每次都不一样，在windows explorer中
也可在/tmp/hadoop-mywinusername创建folder,不知道为何hadoop运行时不行，求高手
指点，谢谢啦！
------------cygwin console dispaly------------------------------
[email protected] /cygdrive/c/hadoop-0.20.203.0
$ bin/hadoop jar hadoop-examples-0.20.203.0.jar grep input output 'dfs[a-z.]
+'
java.io.IOException: Failed to set permissions of path: file:/tmp/hadoop-
mywinusername/mapred/staging/mywinusername1444391482/.staging to 0700
at org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(
RawLocalFileSystem.java:525)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
RawLocalFileSystem.java:499)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem
.java:318)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.
java:183)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
JobSubmissionFiles.java:116)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:797)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:791)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.
java:791)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:765)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1200)
at org.apache.hadoop.examples.Grep.run(Grep.java:69)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.examples.Grep.main(Grep.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(
ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:
139)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:
64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

f*n2009-07-22 07:07

3 楼

fdasun.blog.hexun.com
刚开始做，欢迎留言或评论

m*k2009-07-22 07:07

4 楼

重新在Linux CentOS 上试了一下，
http://hadoop.apache.org/common/docs/r0.20.203.0/single_node_se
前述问题没了，新问题来了，上网一查，就是和这个
http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user
同问题，回帖的fix 也不解决问题，
你们玩hadop时有碰到过这么？搞不懂堂堂一个demo居然如此麻烦。 :(

r*k2009-07-22 07:07

5 楼

很少有人在cygwin 上跑hadoop，所以没人测试，所以就别浪费时间了。
请试试hadoop 1.0.
有问题应该发信到 official user mail list.

m*k2009-07-22 07:07

6 楼

我在试http://hadoop.apache.org/common/docs/r0.20.2/quickstart.html
我用的是win7 和 cygwin,
Standalone Operation
By default, Hadoop is configured to run in a non-distributed mode, as a
single Java process. This is useful for debugging.
The following example copies the unpacked conf directory to use as input and
then finds and displays every match of the given regular expression. Output
is written to the given output directory.
$ mkdir input
$ cp conf/*.xml input
在这一步
$ bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+'
总是出错，
看上去是不能更改permission, 实际上.staging根本就没创建出来，但我可以 mkdir -
p /tmp/hadoop-mywinusername/mapred/staging/mywinusername1444391482/.staging
, mywinusername1444391482 是temp folder, 每次都不一样，在windows explorer中
也可在/tmp/hadoop-mywinusername创建folder,不知道为何hadoop运行时不行，求高手
指点，谢谢啦！
------------cygwin console dispaly------------------------------
[email protected] /cygdrive/c/hadoop-0.20.203.0
$ bin/hadoop jar hadoop-examples-0.20.203.0.jar grep input output 'dfs[a-z.]
+'
java.io.IOException: Failed to set permissions of path: file:/tmp/hadoop-
mywinusername/mapred/staging/mywinusername1444391482/.staging to 0700
at org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(
RawLocalFileSystem.java:525)
at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(
RawLocalFileSystem.java:499)
at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem
.java:318)
at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.
java:183)
at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(
JobSubmissionFiles.java:116)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:797)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:791)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(
UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.
java:791)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:765)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1200)
at org.apache.hadoop.examples.Grep.run(Grep.java:69)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.examples.Grep.main(Grep.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(
ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:
139)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:
64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(
NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(
DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

m*k2009-07-22 07:07

7 楼

重新在Linux CentOS 上试了一下，
http://hadoop.apache.org/common/docs/r0.20.203.0/single_node_se
前述问题没了，新问题来了，上网一查，就是和这个
http://comments.gmane.org/gmane.comp.jakarta.lucene.hadoop.user
同问题，回帖的fix 也不解决问题，
你们玩hadop时有碰到过这么？搞不懂堂堂一个demo居然如此麻烦。 :(

r*k2009-07-22 07:07

8 楼

很少有人在cygwin 上跑hadoop，所以没人测试，所以就别浪费时间了。
请试试hadoop 1.0.
有问题应该发信到 official user mail list.

S*h2009-07-22 07:07

9 楼

I run local mode using cygwin on windows with 0.20.2 with no problem. Make
sure it is set to the local mode.