logo
Redian新闻
>未名空间
>JobHunting - 待字闺中
>
请教个问题
avatar
请教个问题# JobHunting - 待字闺中
s*s
1 楼
有一个问题想问问大家，谢谢了。
You have a 200 GB text file and a Linux box with 8GB of RAM and 4 cores.
Write a program/script that outputs a file listing the frequency of all
words in the file (i.e. a TSV file with two columns ). Note
that the set of words in the file may not fit in memory.
avatar
f*t
2 楼
mlock 8GB as buffer;
4 threads: 1st process 0-2G buffer; 2nd process 2-4G buffer; 3rd 4-6G .. and
produce their own unorderded_maps.
mmap 8GB file each time into memory.
merge unordered_maps.

Note

【在 s******s 的大作中提到】
: 有一个问题想问问大家，谢谢了。
: You have a 200 GB text file and a Linux box with 8GB of RAM and 4 cores.
: Write a program/script that outputs a file listing the frequency of all
: words in the file (i.e. a TSV file with two columns ). Note
: that the set of words in the file may not fit in memory.
相关阅读
怎么查H1B quota满没满？如果有两个degree，可以选其中一个申请opt么？求助：办H1B时，流行工资要求刚onsite完, 贴面经, 一个中等的硬件上市公司--加了详细的inteminimize the max of sums of each segment in an array请推荐Multithread的学习资料。IBM intern 请教Job Opening at NEC Research Labs, Princeton, NJ (http://www.nec-labs.com/careers/careers-p40.php)ms phone interview很纠结，我适合裸奔吗？问个写程序的问题，matrix max onesamazon约好了电话面试但是没有发邮件怎么办？做过volunteer的公司不愿给reference怎末办?5个人2个小时的电面那个狐狸追兔子的题的答案是什么？amazon的电话面试大家做过在线的personality测试么？求教：followup一问自己申请还是用recruiterpre opt申请起来快吗？
logo
联系我们隐私协议©2024 redian.news
Redian新闻
Redian.news刊载任何文章，不代表同意其说法或描述，仅为提供更多信息，也不构成任何建议。文章信息的合法性及真实性由其作者负责，与Redian.news及其运营公司无关。欢迎投稿，如发现稿件侵权，或作者不愿在本网发表文章，请版权拥有者通知本网处理。