def tokenize(text):
    text = ''.join([ch for ch in text if ch not in string.punctuation])
tokens = nltk.word_tokenize(text)
Combining text stemming and removal of punctuation in NLTK and scikit-learn