100%

80%

Score of TOP 3 places

KASPERSKY LAB PROVIDES BEST IN THE INDUSTRY PROTECTION*

In 2014 Kaspersky Lab products participated in 93
independent tests and reviews. Our products were
awarded 51 firsts and received 66 top-three finishes.

Kaspersky Lab
1st places 51
Participation in 93
tests/reviews
TOP 3 = 71%

Bitdefender

60%

Avira

Qihoo 360

ESET

40%

Kingsoft

Trend Micro

G DATA

BullGuard
20%

Symantec

Sophos

AhnLab

Panda Security
Tencent

ThreatTrack (VIPRE)

Microsoft

Intel Security (McAfee)

F-Secure
Avast

AVG

N of independent tests/reviews

0%
20

* Notes:
According to summary results of independent
tests in 2014 for corporate, consumer and
mobile products.
Summary includes tests conducted by the
following independent test labs and magazines:
Test labs: AV-Comparatives, AV-Test, Dennis
Technology Labs, MRG Effitas, NSS Labs, PC
Security Labs, VirusBulletin
The size of the bubble reflects the number of 1st
places achieved.

40

60

2015 Kaspersky Lab. All rights reserved. Registered trademarks and service marks are the property of their respective owners.

80

100

2014 TOP3 METRIC DESCRIPTION

TOP3 metric reflects the percentage of times when a vendor gained
one of top-three places in independent tests within reported period
(calendar year).
A list of AV vendors participating in TOP3 measurements, includes (but not limited to): Avast,
AVG, Avira, BitDefender, BullGuard, ESET, F-Secure, G DATA, Kaspersky Lab, Intel Security
(McAfee), Microsoft, Panda Security, Sophos, Symantec, Trend Micro, etc. Check the full list of
vendors.
Only those who participate in 35% of tests or more have their results represented in the chart
to reflect equal opportunities in calculation. Participation in any test affects two counters for
each vendor: TOP3 and Participation.
1. TOP3 counter for a vendor is incremented each time, once the vendor gains any of the

first three places or an award in a test. No other places let the counter to be increased. In
case several vendors share the same place in a test, the next vendors place is
calculated as amount of previous vendors + 1.For instance, the following sequence can
exist: 1,2,2,4, while 1,2,2,3 cant. It means that in the sequence 1,2,2,4 only three
first vendors get their TOP3 counters incremented. There is an exception for tests with
medals as a final result. In this case several vendors can receive Platinum,Gold,
Silver, etc. And three first medals will increment the vendors Participation counter in
TOP3. Each product of a vendor can increment its TOP3 counter on other products
independently.

2. Each time a product of a vendor participates in a test/review/overview (with no regard to

the final result), the vendors Participation counter is incremented (and then compared
with total amount of different tests).

The final result (TOP3 characteristic) is counted as TOP3 counter divided by Participation
counter to measure in percent.

2015 Kaspersky Lab. All rights reserved. Registered trademarks and service marks are the property of their respective owners.

N of
tests entered

N of
TOP3 places

Score of
TOP3 places (%)

N of
1st places

Kaspersky Lab

93

66

71%

51

Bitdefender

75

47

63%

35

Trend Micro

76

29

38%

18

Avira

58

27

47%

20

ESET

61

27

44%

17

Symantec

68

24

35%

9
18

Qihoo 360

46

20

43%

Intel Security (McAfee)

74

15

20%

G DATA

44

13

30%

10
11

Kingsoft

35

12

34%

Sophos

47

11

23%

BullGuard

36

11

31%

11

Panda Security

43

10

23%

10

F-Secure

64

14%

AVG

68

12%

Tencent

41

17%

Microsoft

55

11%

AhnLab

36

17%

Avast

62

8%

ThreatTrack (VIPRE)

33

6%

2014 TOP3 METRIC DESCRIPTION

The following tests are taken into consideration (by the end of 2014):
ANTI-MALWARE
Parental Control test
The test evaluates efficiency of an antivirus filter to prevent
children from visiting unwanted sites. Each product receives
points within the categories and, due to its final score, gets an
award of Platinum, Gold, Silver, Bronze. Also it can be
disqualified basing on the total performance. The vendors with
Platinum, Gold, Silver get their TOP3 counters incremented.

AV-COMPARATIVES
Product of the Year
The award is given to the outstanding vendor as a result of a
whole year testing cycle, which contains the following tests: File
Detection Rate (FDT) + Whole Product Dynamic Test (WPDT) +
Proactive test + Malware Removal test + Anti-Phishing test +
Parental Control test. Due to the testers rule, in case of two
vendors receive the same maximum score, the award goes to the
tester who did not receive it the previous year. Only the awarded
vendor gets its TOP3 counters incremented.
File Detection Test
The test consists of two parts: Detection Rate test and False
Positives one. As a test result, products receive the following
awards: Advanced+, Advanced, Standard or Tested. Only
products with Advanced+ , gain increment of TOP3 counters for
a particular vendor. In addition all results are ranked by Detection
Rate, and , products of the highest three places basing on
Disinfection Rate, gain increment of TOP3 counters for
correspondent vendors.

WPDT (Whole Product Dynamic Real-World Protection Test)

The test lasts 4 months using mainly current, visible, and
relevant malicious websites/malware. All product components
contribute a significant role in protection, so the results allow to
estimate the overall efficiency of Anti-malware products in Real
World scenarios.
Only products with Advanced+ gain increment of TOP3 counters
for a particular vendor. In addition all results are ranked by
Protection Rate, and three products with the highest results gain
TOP3 counter increment for a correspondent vendor as well.
Retrospective/Proactive Test
The retrospective tests evaluate products against new malware
and unknown one to measure proactive detection capabilities
(e.g. through heuristics, generic signatures, etc.). This test also
takes into consideration a false positive rate. Starting from 2012,
the remaining malware files are also being executed, so that the
proactive protection provided by e.g. behavior blockers are
evaluated. The TOP3 counter is incremented for a particular
vendor when it gets Award Advanced+.
Mobile Security Review
The review includes malware protection test as well as the
overview of additional features (theft protection, battery
consumption, etc.). Products of the highest three places basing
on Protection Rate, gain increment of TOP3 counters for
correspondent vendors.
Mac Security Test & Review
The review evaluates various Mac protection products against

2015 Kaspersky Lab. All rights reserved. Registered trademarks and service marks are the property of their respective owners.

product feature list , and measures protection level in categories

such as detection rate on separate Mac- & Windows-related
malware sets and False Positive level. Products of the highest
three places basing on Protection Rate, gain increment of TOP3
counters for correspondent vendors.
Malware Removal Test
The 8 month long test focuses on malware removal/cleaning
capabilities of security products, so samples selection process
considers that the sample should be detected statically . The
main question before the test is whether the products are able to
disinfect system successfully i.e. to remove malware and its
leftovers from already infected/compromised system.
Only products with Advanced+ gain increment of TOP3 counters
for a particular vendor. In addition, products of the highest three
places basing on Disinfection Rate, gain increment of TOP3
counters for correspondent vendors.
Parental Control test
The test evaluates efficiency of security products to prevent
children from visiting unwanted web sites. Each product receives
points within the categories, and due to its overall score,
products of the highest three places get their TOP3 counters
incremented.
Small Business Products Review
The test evalustes protection of different Small Business antivirus programs. The products demonstrated high overall standard
in the products review receive the award and gain increment of
TOP3 counters for correspondent vendors.

2014 TOP3 METRIC DESCRIPTION

AV-TEST
Bi-Monthly Certification Consumer and Business.
The year-long certification series consists of Consumer and
Business segments. Each of them is divided into 6 separate tests
(2 months each). All participating products are evaluated and
receive points in Protection, Performance and Usability
categories. Sum of the points makes an overall score. Basing on
the overall score, products of top three places get their TOP3
counters incremented.
Best Protection Award Consumer and Business
The award is given for perfect results in protection category
during the entire year in Bi-monthly certification, separately for
Consumer and Business related products. Only products which
get this award, gain TOP3 counter increment for correspondent
vendors.
Best Performance Award Consumer and Business
The award is given for perfect results in performance category
during the entire year in Bi-monthly certification, separately for
Consumer and Business related products. Only products which
get this award, gain TOP3 counter increment for correspondent
vendors.
Best Usability Award Consumer and Business
The award is given for perfect results in Usability category during
the entire year in Bi-monthly certification, separately for
Consumer and Business related products. Only products which
get this award, gain TOP3 counter increment for correspondent
vendors.
Best Repair Award
The award is given for perfect results in repair category during the
entire year in Bi-monthly certification, separately for Consumer

and Business related products. Only products which get this

award, gain TOP3 counter increment for correspondent vendors.

three places basing on overall results, gain increment of TOP3

counters for correspondent vendors.

Endurance Test Consumer\Corporate

The 6-month test represents accumulated protection results
which were received during the 3 tests cycle and announced by
the tester for participated consumer\corporate products
separately.
Sum of the points makes an overall score. Basing on the overall
score, products of top three places get their TOP3 counters
incremented.

Virtual Desktops Security Test

The commissioned by Kaspersky Lab private comparative test of
security solutions for virtual environments analyzes their
capabilities to protect against a real world and prevalent malware
as well as the performance impact in virtual desktop
infrastructure (VDI) environments. Three vendors with the highest
scores get their TOP3 counters incremented.

Android Mobile Security Products Test

The year-long certification ceria is divided into 6 separate tests (2
months each). All participating products are evaluated and
receive points in categories Protection, Usability and Features.
Sum of the points makes an overall score. Basing on the overall
score, products of top three places get their TOP3 counters
incremented.
Best Android Security Product
The award is given for perfect results in Android security testing
during the whole year. Only products which get this award, gain
TOP3 counter increment for correspondent vendors.
Endurance Test Android H1 &H2
The 6-month reports represent accumulated protection results for
participating products.
Sum of the points makes an overall score. Basing on the overall
score, products of top three places get their TOP3 counters
incremented.
Exploit Protection on Windows XP
The commissioned by a vendor test of popular consumer
products measures protection capabilities against exploits
targeting vulnerabilities on Windows XP. Products of the highest

2015 Kaspersky Lab. All rights reserved. Registered trademarks and service marks are the property of their respective owners.

Mac Security Products test

The test evaluates various Security protection products for Mac
OSX. Products of the highest three places basing on Detection
Rate, gain increment of TOP3 counters for correspondent
vendors.TOP3 counters for correspondent vendors.

DENNIS TECHNOLOGY LABS

Enterprise Anti-Virus Protection Test
Home Anti-Virus Protection Test
Small Business Anti-Virus Protection Test
These reports aim to compare the effectiveness of anti-malware
products provided by well-known security companies. The
products were exposed to internet threats that were live during
the test period. This exposure was carried out in a realistic way,
reflecting a customers experience closely. These results reflect
what could happen if a user used one of the products and visited
an infected website. The tests include a detection subtest and a
false positive one. Three products with the highest Accuracy
scores (they are calculated as a combination of points of the two
subsets) gain increment of TOP3 counters for correspondent
vendors.

2014 TOP3 METRIC DESCRIPTION

MRG EFFITAS
Online Banking/Browser Security certification
The test assesses the efficiency of products against financial
malware by implementing different test methodics and scenarios:
in The Wild real financial malware sets, in botnet environments
and on simulators of different sensitive data interception
techniques. Only products which successfully passed all the
steps, receive certification, and gain TOP3 counter increment for
correspondent vendors.
360 Assessment & Certification
The test both evaluates ability of security products to block initial
infection, and measures time taken to detect malware on a
compromised system and remediate the last one. The test is a
successor of Time to Detect & Remediate Assessment test.
Only products which got certified gain increment of TOP3
counters for correspondent vendors.
Real World Enterprise Security Exploit Prevention Test
The commissioned by Kaspersky Lab test evaluates the ability of
products to prevent drive-by exploitation. Endpoint instances with
KES of full functionality, KES with AEP-only functionality and other
five vendors products were tried by 110 test-cases. Products
with three highest results in Detection Rate gain increment of
TOP3 counters for correspondent vendors
Time to Detect & Remediate Assessment
Being the predecessor of 360 Assessment & Certification, the
test evaluates the ability of security products to prevent an
endpoint from being infected by live, ITW malware. In case
infection happened, time the products take to detect the
infection and remediate the system was measured during twenty

four hours. Products with three highest results in Detection Rate

gain increment of TOP3 counters for correspondent vendors.

NSS LABS
Consumer Endpoint Protection test
The test evaluates Endpoint security products for their ability to
block socially engineered malware attacks. Products of the
highest three places basing on Block Rate, gain increment of
TOP3 counters for correspondent vendors. Additionally, separate
award Recommended for KIS also incremented TOP3 counter
for Kaspersky Lab.

PCSL (PC SECURITY LABS)

Mobile Security Product Test for Android
The test evaluates Detection Rate and False Positives of mobile
products. The final score defines place of each product
participated. Only vendors with the top three results get their
TOP3 counters incremented. Products of the top three Ranks,
gain increment of TOP3 counters for correspondent vendors.
Product of the year Android
The award is given for perfect results in Android security testing
during the whole year. Only products which get this award, gain
TOP3 counter increment for correspondent vendors.
Exploit Mitigations Test
The commissioned by a vendor test evaluates efficiency of exploit
blocking capabilities for participating security products. Products
of the highest three places basing on Exploit Protection, gain
increment of TOP3 counters for correspondent vendors.

2015 Kaspersky Lab. All rights reserved. Registered trademarks and service marks are the property of their respective owners.

VIRUSBULLETIN
VB100 Comparative Review and Certification
The tests are held every 2 months, each time basing on distinct
operation system and evaluating different types of products.
Each product that passes successfully the certification gains
increment of TOP3 counter for the correspondent vendor.

THE FULL LIST OF AV VENDORS THAT PARTICIPATE IN TOP3 MEASUREMENTS

Aegislab

Check Point

F-Secure

Kyrol

Qihoo 360

Trustlook

Agnitum

Cheetah Mobile

G DATA

Lavasoft

Quarri

TrustPort

AhnLab

Commtouch

G-Protector

Lenovo

Quick Heal

ULIS

Alibaba

Comodo

Hauri

Malwarebytes

Roboscan

ThreatTrack (VIPRE)

Anguanjia

ContentKeeper

Heise

Maya

SecureAlive

Visual Threat

Antiy Labs

Cranes

HitmanPro

Intel Security (McAfee)

Skydns

Webroot

Arcabit

Cyren

Ikarus

Microsoft

White Gate

Ariasecure

Defenx

Inca

Microworld

SoftSphere
Technologies

Avast

Dr.Web

Intego

MSecure Data Labs

Sophos

wontok

Avetix

DU Apps Studio

Iolo

NetQin

AVG

Emsisoft

iSheriff

Norman ASA

Avira

Entensys

Jarviz

NQ

Baidu

eScan

K7

NSHC

Bitdefender

ESET

Kaspersky Lab

Optenet

Bluepex

ESTsoft

Kingsoft

Panda Security

Bornaria

Faronics

Kromtech

PC Pitstop

BullGuard

Fortinet

KSMobile

PSafe

2015 Kaspersky Lab. All rights reserved. Registered trademarks and service marks are the property of their respective owners.

SourceFire
SPAMfighter
SUPERAntiSpyware
Symantec
Tencent
Total Defense
Trend Micro
TrustGo

Wifi protector
Zemana
ZeoBIT LLC
Zoner