Nltk.word_tokenize () providing AttributeError: object 'module' does not have attribute 'defaultdict'

Question

I am new to nltk. I tried some basics.

import nltk
nltk.word_tokenize("Tokenize me")

gives me the following error

Traceback (most recent call last):
File "<pyshell#27>", line 1, in <module>
nltk.word_tokenize("hi im no onee")
File "C:\Python27\lib\site-packages\nltk\tokenize\__init__.py", line 101, in word_tokenize
return [token for sent in sent_tokenize(text, language)
File "C:\Python27\lib\site-packages\nltk\tokenize\__init__.py", line 85, in sent_tokenize
tokenizer = load('tokenizers/punkt/{0}.pickle'.format(language))
File "C:\Python27\lib\site-packages\nltk\data.py", line 786, in load
resource_val = pickle.load(opened_resource)
AttributeError: 'module' object has no attribute 'defaultdict'

Please help someone. Please tell me how to fix this error.

Answer 1

Later I found out that I used the backdated nltk data. Programs started to work fine as soon as I updated the data.

Answer 2

I just checked it on my system.

Fix:

>> import nltk
>> nltk.download('all')

Then everything worked fine.

>> import nltk
>> nltk.word_tokenize("Tokenize me")
['Tokenize', 'me']

Answer 3

nltk. anaconda, :

>> conda update nltk

nltk. ipython !