我想问问partitioner的作用是什么呢? 比如那个word count的例子 mapper input(line, text) --> output(word, frequency) combiner input(word, frequency) --> output(word frequency) combines results from multiple mappers.. Then we use reducer to sort words according to index (e.g. 26 reducers and each take words for a particular alphabet). 这个例子中如果fit in partitioner呢?
你可以自己实现partitioner based on Alphabets, for example, reducer1 output words initial from A-F, reducer 2 output initial from G-J ...
【在 u*****o 的大作中提到】 : 我想问问partitioner的作用是什么呢? : 比如那个word count的例子 : mapper input(line, text) --> output(word, frequency) : combiner input(word, frequency) --> output(word frequency) : combines results from multiple mappers.. : Then we use reducer to sort words according to index (e.g. 26 reducers and : each take words for a particular alphabet). : 这个例子中如果fit in partitioner呢?