PubMed IDs and scores of the relevant training examples.
Started at
2009/05/14 12:30:20 GMT
Time at which query was started
Finished at
2009/05/14 12:35:26 GMT
Time at which this file was written.
Feature score method
scores_laplace_split
Name of the method used to calculate feature scores.
Docstring for the method: For feature probabilities we use a Laplace prior, of 1 success and 1
failure in total, split between the classes according to size. This
avoids problems with class skew.
Min Information Gain
2e-05
We exclude features with less than this value of
Information Gain.
Base score
-37.2018681102
The log likelihood ratio of an empty article (one in
which every feature failed to occur).
Prior score
-8.97687229901
The log of the prior probability ratio for
an article being relevant versus irrelevant (added to log likelihood ratio
to obtain the final score). Equals the logit of the estimated
prevalence of relevant articles in Medline (which may be estimated
from the input size or specified separately).
Limit
1000
The maximum number of results to include.
Threshold
-30.0
Default Naive Bayes classification threshold is
zero. This threshold is the minimum log probability ratio for
predicting an article to be relevant.
Minimum date
20050101
The minimum date considered when parsing Medline
(both when making feature counts, and when querying)
Feature Statistics
Quantity
Relevant Docs
Irrelevant Docs
Number of documents
326
2589129
Number of selected, occurring features
5748
38998
Total occurrences of selected features
32636
182211439
Selected features per Medline record
100.110
70.376
Of the considered feature types, 39105 features are selected out
of 2289534 occurring at least once in training data. The aggressivity of
selection is 58.548.
The complete database lists 3703762 potential features.
Features with high TF.IDF
Features with TF.IDF above 0.2 or 0.3 could make good keywords. TF.IDF is term frequency times
inverse document frequency, where we treat the set of input citations as a
single document