Write a (Python) program that preprocesses a collection of documents using the recommendations given in the Text O
Need help with this assignment?Get an original answer from a qualified tutor — from $10/page.
Get it written →
Problem 1 [30 points]. Write a (Python) program that preprocesses a
collection of documents using the recommendations given in the
Text Operations lecture. The input to the program will be a directory
containing a list of text files. Use the files from assignment #3 as
test data as well as 10 documents (manually) collected from news.yahoo.com .
The yahoo documents must be converted to text before using them.
Remove the following during the preprocessing:
- digits
- punctuation
- stop words (use the generic list available at ...ir-websearch/papers/english.stopwords.txt)
- urls and other html-like strings
- uppercases
- morphological variationsAbove mentioned assignment 3# file is also attached and by running this code in anaconda spider you can see the output
Get a plagiarism-free answer to this question
Send us your instructions and we’ll match you with the best writer in your subject.
- 100% human-written, zero AI
- Turnitin report included
- Confidential — we never share your data
- Free revisions & refunds