FP%/FN% Percentages
The main system used to measure spam-filtering accuracy in SpamAssassin is the "FP%/FN% percentages" system.
It's quite simple. First, you scan a corpus of hand-classified mail (see HandClassifiedCorpora) to get 4 figures:
nspam = number of known-to-be-spam messages in the corpus nham = number of known-to-be-ham (nonspam) messages in the corpus fp = number of ham messages incorrectly marked as spam fn = number of spam messages incorrectly marked as ham
fp is so named because it's more commonly and concisely called a FalsePositive, and fn a FalseNegative.
Next, perform this calculation:
FP% = (fp / nham) * 100 FN% = (fn / nspam) * 100
and you have two numbers that simply, concisely, and comprehensibly describe the accuracy and performance of the filter.
For example, let's say we do a test as follows:
nspam = 1000 nham = 1500 fp = 2 fn = 30
the FP% and FN% work out as (2 / 1500) * 100 = 0.1333% and (30 / 1000) * 100 = 3.0% respectively.
The 'STATISTICS.txt' files distributed with SpamAssassin versions since about 2.30 include this data, measuring the ruleset's accuracy against a validation ruleset:
# SUMMARY for threshold 5.0: # Correctly non-spam: 29443 99.97% # Correctly spam: 27220 97.53% # False positives: 9 0.03% # False negatives: 688 2.47% # TCR(l=50): 24.523726 SpamRecall: 97.535% SpamPrec: 99.967%
As you can see, FP% and FN% get pride of place in the measurement scheme.
See also MeasuringAccuracy for other methods.
[http://teensiest.fcpages.com/8.html kissing bridge ny] | [http://gonococcal.150m.com/95.html pee wees pads] | [http://expletives.100freemb.com/26.html bondage torture female] | [http://benched.00freehost.com/32.html petite tit teens] | [http://clearstory.00freehost.com/60.html japanese porno] | [http://refiled.1sweethost.com/7.html wmv handjob] | [http://potty.freewebsitehosting.com/52.html young-gush] | [http://stillborn.freewebpages.org/47.html teenage gay pictures] | [http://handed.dreamstation.com/49.html anal movie tgp] | [http://rumbas.freecities.com/47.html drunk swing party] | [http://gelatins.o-f.com/94.html gunge filled knickers] | [http://shuffles.fcpages.com/41.html young webcam girl] | [http://rigidness.freewebpages.org/21.html mmf bisexual] | [http://goodnight.freewebpages.org/33.html used gran prix] | [http://faux.1sweethost.com/76.html wet shirt contest] | [http://homepage.mac.com/islam2/34.html burn porn dvds] | [http://mayflies.angelcities.com/49.html free webcam voyer] | [http://woofed.ibnsites.com/92.html hairy wet blondes] | [http://muffler.741.com/36.html xxx webcam] | [http://clownishly.00freehost.com/20.html mt bachelor webcam] | [http://porkers.o-f.com/42.html adult webcam chatrooms] | [http://homepage.mac.com/cornflour/93.html erotic black drawings] | [http://counters.150m.com/7.html big dick bukkake] | [http://homepage.mac.com/docilities/45.html wife orgasm] | [http://unwiser.ibnsites.com/53.html spanking story] | [http://whensoever.envy.nu/92.html erotic hand job] | [http://rigidness.freewebpages.org/64.html female celebrity gallery] | [http://catholicly.g0g.net/44.html natural breasted bbw]