how to get the most frequent words
10 views (last 30 days)
Show older comments
how can i creat a function with input n and return as output paramer a cell array which will contains the n most frequent words in a text together with the number of times they appeared and return same withleast frequent words and I have a seperet text file.
many thanks
0 Comments
Answers (1)
Matt J
on 26 Nov 2018
Edited: Matt J
on 26 Nov 2018
Say str is your text. Then you could get a histogram of all the words in str by doing,
[u,i,j]=unique(strsplit(str));
H=histcounts(j,1:max(j)+1)
6 Comments
Steven Lord
on 26 Nov 2018
Let's choose a sample piece of text (thanks to Mr. Dickens and Earl Bulwer-Lytton):
str = 'it was the best of times it was the worst of times it was a dark and stormy night';
[u,i,j]=unique(strsplit(str));
H=histcounts(j,1:max(j)+1);
The +1 in the histcounts call is necessary so the last bin does not contain both max(j) and max(j)-1. Look at the elements of u and H. To see them side-by-side easily I'll put them in a table.
t = table(u.', H.', 'VariableNames', {'u', 'H'})
Looking at the information in the table t, what would you assign to the most and least variables if you were solving this problem manually? How do you think you could generate those most and least variables in your program using the information stored in the u and H variables?
See Also
Categories
Find more on Cell Arrays in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!