Description
· Reverse index (1.5h session)
Description
Practical session. Design and implement a MapReduce-based algorithm to calculate the inverted index over the web crawl data.
Contents
· Count words and elliminate those appearing in most (or all) documents (“and”, “or”, etc.)
· Implement the inverted index. It should not contain the words identified before. Several Map Reduce passes might be necessary.
