牛骨文教育服务平台(让学习变的简单)
博文笔记

function summary of nltk in python

创建时间:2016-01-12 投稿人: 浏览次数:136
1. re.findall(regexp,word):find the characters in word by the pattern "regexp"
2. nltk.regexp_tokenize(text,pattern): find the characters in text by the pattern "pattern" 
3. re.split(r",",string):divide the string by ","
4. text.concordance("hello"):find "hello" in text and output the at line 
5. text.similar("hello"):find the similar attribute like "hello" and output the word 
6. sorted(word_list):sort the words in word_list
7. set(word_list):delete the words 
8. word_list.append("hello"):add "hello" to the word_list
9. len(word_list):count the words number 
10. word_list.count("hello"):count the number of "hello" in the word_list  
11. word_list.index("hello"):return the index of the first "hello" in the word_list
12. fdist = FreqDist(word_list):calculate the words number and create the word:number pairs 
13. nltk.***.words("fileid"):get the content of "fileid" in type of words
14. ***.fileids():return all the fileid in the language library "***"
15. text = nltk.Text(wordlist):convert the wordlist into the text mode 
16. PlaintextCorpusReader(path,".*"):get all the file content in the path
17. nltk.word_tokenize(string):divide the string into wordlist
18. nltk.sent_tokenize(string):divide the string into sent
19. the for used in nltk
    for item in s : traverse elements in s
    for item in set(s) :  traverse elements in s and no repeat
    for item in sort(s) ; traverse elements in s by order
    for item in reversed(s) : traverse elements in s by reversed order
    for item in set(s).difference(t) : traverse elements in s but not in t
    for item in random.shuffle(s) : traverse elements in s by random order