Skip to content

Devender's Musings

  • Home
  • Quotes
  • Emacs
View Devender Gollapally's profile on LinkedIn

Unknown's avatar

Top Posts

  • AWS Kinesis Demo
  • On Reading Books
  • GOLANG Package/Dependency Managers
  • Envelope Encryption using AWS
  • Envelope Encryption
  • Conscious Recommendation Systems
  • Help Me!! I am hooked on Galaxy of Heroes
  • Smart Databases : RethinkDB
  • The n+1 problem, or why we can never truly have artificial life.
  • Pairing Functions

Goodreads

Follow me on Twitter

My Tweets

“”

ABC
Skip to content

Devender's Musings

Tag: stopwords

General

Stop Words and commonly concatenated words

Posted on March 16, 2011March 16, 2011 by devender

Here is a list of about 800 stop words made based on 4 million documents (I started with this set). This set has helped us reduce model size and increase accuracy, please note that the same list may not be applicable in your application, please review the list before using.

More interestingly here list of commonly concatenated words that I found and their corrections.

0
  • Subscribe Subscribed
    • Devender's Musings
    • Already have a WordPress.com account? Log in now.
    • Devender's Musings
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar