r*d
2 楼
请问大家:有什么好方法好资料帮助学习Pig Latin? Pig Latin我完全是新手。我在
amazon上找了下,好像没有书评特别好的。
谢谢!
amazon上找了下,好像没有书评特别好的。
谢谢!
c*z
4 楼
You need the following things:
1. An editor, I use sublime2, the cloudera package uses Gedit
2. A cluster with Pig installed at the edge nodes, you can use the VM in the
cloudera package
3. A file transfer to move Pig code from local drive (if you edit locally)
to edge node, I use Winscp, the cloudera package uses Hue
4. A way to run the code at edge node, I use putty, the cloudera package
uses Hue
My work flow: write Pig code locally using sublime2, upload code to edge
node using winscp, run code at edge node using putty.
1. An editor, I use sublime2, the cloudera package uses Gedit
2. A cluster with Pig installed at the edge nodes, you can use the VM in the
cloudera package
3. A file transfer to move Pig code from local drive (if you edit locally)
to edge node, I use Winscp, the cloudera package uses Hue
4. A way to run the code at edge node, I use putty, the cloudera package
uses Hue
My work flow: write Pig code locally using sublime2, upload code to edge
node using winscp, run code at edge node using putty.
s*n
5 楼
AA时候
c*z
6 楼
Also, my work flow using Scala Scalding (i.e. Scala on Hadoop):
1. edit and compile in Intelij, or other IDE, or edit in any text editor and
compile in a terminal (CMD for windows)
setting up Intelij is complicated and out of my scope
2. upload the jar file to edge node, I use winscp
optionally, upload the code to github for version control
3. run the jar file at edge node using putty, with specific input path,
output path and other argument, I save them to an .sh file for reuse (you
can save to .txt file and then copy and paste)
the command to run the jar is something like
hadoop jar myjar.jar packagename.functionname --input "myinputpath/part*" --
output "myoutputpath" --hdfs
4. to get the output to a text file, use something like
hadoop fs -cat "myoutputpath/part*" > myresult.tsv
(I prefer .tsv over .csv because comma can appear in numbers like 133,010
and mess up things)
1. edit and compile in Intelij, or other IDE, or edit in any text editor and
compile in a terminal (CMD for windows)
setting up Intelij is complicated and out of my scope
2. upload the jar file to edge node, I use winscp
optionally, upload the code to github for version control
3. run the jar file at edge node using putty, with specific input path,
output path and other argument, I save them to an .sh file for reuse (you
can save to .txt file and then copy and paste)
the command to run the jar is something like
hadoop jar myjar.jar packagename.functionname --input "myinputpath/part*" --
output "myoutputpath" --hdfs
4. to get the output to a text file, use something like
hadoop fs -cat "myoutputpath/part*" > myresult.tsv
(I prefer .tsv over .csv because comma can appear in numbers like 133,010
and mess up things)
c*8
7 楼
武则天时期会不会好一点
g*t
8 楼
pig好慢好慢
c*y
9 楼
这个时候:直教天下父母心,不重生男重生女。
还有这个:宋废帝给妹妹山阴公主置面首三十。
还有这个:宋废帝给妹妹山阴公主置面首三十。
r*d
14 楼
谢谢大家回复!
update: i found the book 'Programming Pig' especially the first 6 chapters
very helpful - it is not demanding to pick up Pig as yet another tool :)
update: i found the book 'Programming Pig' especially the first 6 chapters
very helpful - it is not demanding to pick up Pig as yet another tool :)
相关阅读
有人了解state farm 的data scientist 吗一点小建议,关于那些证书女儿的专业选择问题 (转载)GrailsSenior Data Scientist in NC刚电面一个,fail了计算 confidence interval 和 prediction interval的一般方法请问我的背景能申请Data Scientist吗?谢谢!about access (转载)湾区大妈转行做DS或BA,求建议A FB page about analytics有没有cdh的spark的培训资料?Pig 问题请教分享今年看到的最好的文章我转行DS的理由,欢迎拍砖求助 信息提取 (转载)说说Facebook的Data Scientists职位 (转载)新人请教20000个records 寻找联系方式 的 方案一个经常会用到的问题,和推荐算法有点关系。想不到有什么直接简单的方法。