IEDB Analysis Resource

MHC I Automated Server Benchmarks


This is a live ranking of MHC I servers based on performance, which continues to be reevaluated over time. The weekly IEDB releases are automatically checked for datasets large enough to add to the benchmarks. The benchmark metrics in the table below will only be updated on releases where such new data is becoming available.

Accumulated overall ranking scores

Ranking scores based on data sets submitted to the IEDB for the last at least 5 references.

Server 2024-05-23 2024-05-16 2024-04-18 2024-02-29 2024-02-15 2023-10-19 2023-08-10 2023-08-03 2023-06-15 2023-05-11 2023-04-20 2022-11-24 2022-10-28 2022-10-06 2022-07-22 2022-05-20 2022-04-29 2021-12-24 2021-12-10 2021-11-05 2021-10-08 2021-10-01 2021-09-03 2021-08-20 2021-08-06 2021-06-11 2021-05-21 2021-04-16 2021-03-05 2021-02-19 2021-01-29 2021-01-15 2021-01-01 2020-12-25 2020-12-18 2020-12-11 2020-11-13 2020-10-02 2020-09-11 2020-07-10 2020-04-24 2020-03-13 2019-11-01 2019-10-04 2019-08-30 2019-06-21 2019-06-07 2019-05-24 2019-03-15 2019-02-01 2018-05-11 2018-01-26 2017-12-22 2017-10-27 2017-09-01 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-06-20 2014-05-23 2014-03-28 2014-03-21
mhcflurry 1.2.0 80 98 70 69 68 63 56 51 56 58 61 56 59 42 33 49 52 58 60 59 70 71 76 74 50 57 66 53 58 59 56 68 50 57 61 49 53 49 49 52 60 80 80 83 74 68 69 63 65 69 57 65 60 55 61 70 69 80 88 88 90 92 92 92 93 93 83 55 90 88 86 85
ANN 4.0 78 72 54 56 54 56 55 60 53 64 65 67 73 76 64 57 55 50 53 52 49 51 45 51 67 60 59 66 63 62 71 70 66 71 69 66 50 45 39 36 30 23 23 77 79 81 83 86 61 63 50 53 61 59 56 71 66 65 68 76 58 55 58 59 56 58 56 55 78 72 68 69
IEDB Consensus 77 47 48 47 44 48 52 58 65 71 72 69 71 69 58 60 51 54 58 57 61 59 59 61 62 54 37 55 62 59 72 61 51 63 64 71 56 51 40 39 30 0 0 54 39 43 51 52 43 48 40 42 57 58 59 62 56 36 24 55 46 48 48 47 37 39 37 48 52 48 59 58
NetMHCpan 4.0 BA 74 67 68 68 69 68 66 61 48 60 60 60 68 76 76 80 81 81 72 70 62 62 66 60 69 69 81 76 72 76 73 74 79 78 78 71 74 72 71 71 71 59 66 65 74 80 73 80 66 65 63 60 77 93 - - - - - - - - - - - - - - - - - -
ANN 3.4 64 54 62 63 65 64 66 62 73 64 63 61 50 44 48 45 46 44 46 50 51 52 49 58 69 71 66 82 79 75 85 71 66 75 58 62 62 58 56 62 60 54 54 86 77 65 65 59 61 61 71 69 73 77 81 78 82 74 65 77 67 69 65 68 64 63 59 59 58 65 46 48
NetMHCpan 4.1 BA 64 59 70 70 71 73 74 74 65 66 67 66 72 83 76 80 75 72 64 64 63 63 69 70 76 81 85 76 74 75 70 69 74 74 74 75 81 80 83 85 91 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 4.1 EL 60 62 45 41 42 34 32 32 56 51 48 42 36 25 26 39 53 52 59 52 45 47 41 30 38 31 41 39 39 35 28 17 37 52 56 51 45 40 41 46 50 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 2.8 53 34 59 58 59 60 65 59 41 60 57 63 69 46 54 48 63 64 62 60 47 48 48 49 64 72 81 58 59 61 50 53 50 52 48 58 65 63 63 65 64 59 66 65 71 67 58 55 55 59 63 66 69 65 66 67 63 66 67 72 55 56 53 54 50 52 51 43 65 67 61 60
PickPocket 52 48 35 33 33 34 40 46 54 57 57 68 68 55 41 40 34 38 52 54 54 54 57 47 60 39 35 34 30 31 38 29 43 53 49 53 56 52 67 56 54 46 55 21 35 29 28 33 49 44 38 43 36 41 44 57 52 47 47 53 33 36 32 33 27 24 29 25 64 62 46 42
NetMHCpan 3.0 51 54 62 63 63 65 65 64 58 68 65 70 73 72 74 74 72 70 67 64 59 58 58 53 64 63 72 72 70 73 72 73 72 71 66 56 57 53 54 59 67 73 78 81 74 72 66 71 54 57 56 55 68 58 62 62 64 66 81 83 70 65 63 59 56 56 60 56 58 53 59 59
NetMHCcons 48 49 68 68 72 69 70 65 64 60 57 60 56 49 61 60 68 67 55 56 47 48 49 56 71 72 71 79 74 74 76 58 57 62 53 58 71 69 70 71 68 56 63 71 84 74 67 61 62 64 71 73 76 77 80 78 73 70 61 68 66 68 69 71 67 65 64 71 56 63 64 63
SMM 47 38 45 44 43 46 51 54 55 56 57 56 61 58 52 54 39 42 50 49 64 62 66 68 60 48 32 45 55 51 65 55 39 50 64 74 62 59 48 42 35 8 8 30 29 37 38 39 37 36 35 35 47 52 51 49 49 36 26 51 54 58 51 50 44 43 42 53 61 50 40 40
SMMPMBEC 47 48 46 45 44 50 56 73 75 57 60 61 61 73 62 50 42 45 52 53 63 61 66 66 54 49 36 60 69 63 74 59 45 58 73 78 64 61 56 50 40 - - 29 27 35 33 36 45 43 47 49 55 61 65 72 91 77 76 81 54 48 46 44 37 36 35 53 59 46 40 41
NetMHCpan 4.0 EL 46 67 52 51 51 45 42 37 51 46 43 46 37 25 36 34 46 45 52 47 42 45 30 42 60 46 66 65 55 50 37 25 37 53 51 36 23 15 23 32 41 61 68 55 39 40 26 23 23 27 31 38 57 89 - - - - - - - - - - - - - - - - - -
ARB 44 35 26 26 22 31 34 48 52 48 49 53 41 37 42 34 26 23 25 27 34 37 44 28 29 43 27 62 64 56 64 40 37 65 53 41 53 49 58 56 59 69 69 23 14 22 21 19 22 26 14 17 16 11 10 30 25 25 33 55 31 34 29 30 28 29 30 18 52 52 24 21

Weekly ranking scores

Ranking scores based on data sets submitted to the IEDB within a single week.

Server 2024-05-23 2024-05-16 2024-04-18 2024-02-29 2024-02-15 2023-10-19 2023-08-10 2023-08-03 2023-06-15 2023-05-11 2023-04-20 2022-11-24 2022-10-28 2022-10-06 2022-07-22 2022-05-20 2022-04-29 2021-12-24 2021-12-10 2021-11-05 2021-10-08 2021-10-01 2021-09-03 2021-08-20 2021-08-06 2021-06-11 2021-05-21 2021-04-16 2021-03-05 2021-02-19 2021-01-29 2021-01-15 2021-01-01 2020-12-25 2020-12-18 2020-12-11 2020-11-13 2020-10-02 2020-09-11 2020-07-10 2020-04-24 2020-03-13 2019-11-01 2019-10-04 2019-08-30 2019-06-21 2019-06-07 2019-05-24 2019-03-15 2019-02-01 2018-05-11 2018-01-26 2017-12-22 2017-10-27 2017-09-01 2017-03-23 2016-12-09 2016-05-03 2016-02-19 2015-08-07 2015-07-31 2015-07-17 2015-06-26 2015-06-19 2015-05-15 2015-02-06 2015-01-16 2014-10-31 2014-06-20 2014-05-23 2014-03-28 2014-03-21
mhcflurry 1.2.0 36 100 100 86 - 100 61 44 54 - 64 52 58 100 0 71 4 55 74 56 50 46 74 93 - 14 93 43 - 64 45 79 64 - 61 25 86 79 54 0 51 - 85 75 - - 88 50 71 62 68 - 82 4 50 89 10 59 - 95 87 86 - 89 93 92 95 55 91 95 91 85
ANN 4.0 71 93 57 89 - 66 51 64 61 - 50 44 73 79 62 75 82 42 74 50 21 71 46 40 - 57 57 86 - 50 75 68 57 73 82 43 86 71 61 71 31 - 23 - - - 77 100 61 88 88 16 71 79 35 89 40 55 - 95 100 9 - 89 52 59 57 55 100 73 36 69
IEDB Consensus 79 79 64 86 - 25 50 58 53 - 71 76 69 89 31 93 54 52 55 47 93 68 52 61 - 100 57 29 - 33 85 79 43 64 57 29 100 86 50 93 36 - 0 - - - 54 21 29 67 57 16 57 50 36 61 85 73 - 9 27 36 - 100 36 44 33 48 36 36 0 58
NetMHCpan 4.0 BA 71 71 86 68 - 61 70 69 46 - 59 44 65 57 62 88 80 78 90 80 71 38 80 53 - 21 93 93 - 73 73 71 100 59 79 100 93 43 75 43 83 - 55 62 - 100 52 75 89 81 77 52 69 93 - - - - - - - - - - - - - - - - - -
ANN 3.4 100 86 64 7 - 55 68 57 71 - 59 86 57 57 23 27 64 44 39 46 43 59 48 50 - 50 57 100 - 58 99 82 50 82 57 57 96 64 14 79 61 - 54 - - - 86 68 68 50 64 66 64 50 92 59 85 100 - 95 46 55 - 95 64 66 62 59 32 36 36 48
NetMHCpan 4.1 BA 71 57 71 57 - 57 74 77 71 - 71 55 68 79 62 88 93 74 79 69 57 42 74 66 - 50 93 86 - 82 65 75 86 66 50 100 86 61 71 57 91 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 4.1 EL 93 57 86 4 - 71 36 13 50 - 75 50 46 7 23 16 43 45 80 52 14 57 54 23 - 14 100 0 - 36 56 0 7 11 54 100 86 36 7 29 50 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
NetMHCpan 2.8 71 21 57 61 - 25 66 66 62 - 29 23 79 21 85 38 48 51 70 83 36 46 55 37 - 50 93 50 - 87 31 57 79 61 7 43 86 61 43 57 69 - 63 56 - 100 63 75 54 50 52 59 77 54 74 70 60 56 - 95 60 77 50 89 46 54 52 43 64 86 82 60
PickPocket 21 21 100 64 - 37 30 42 74 - 4 62 67 57 100 64 21 39 27 38 64 52 64 38 - 86 57 36 - 27 40 7 36 50 4 75 86 14 68 21 63 - 100 10 - 100 0 54 21 39 20 68 0 7 27 47 85 24 - 95 34 82 0 70 27 31 24 25 0 77 82 42
NetMHCpan 3.0 75 0 57 71 - 63 63 71 63 - 39 63 76 29 85 75 86 70 82 62 79 54 68 45 - 39 57 96 - 69 68 82 93 61 68 79 86 36 61 21 61 - 47 90 - 100 57 75 82 64 75 36 89 21 73 65 65 36 - 95 72 77 100 89 54 58 56 56 91 9 82 59
NetMHCcons 100 21 57 14 - 62 72 66 71 - 54 62 60 21 85 38 55 67 65 75 29 49 50 44 - 64 57 93 - 69 85 57 71 - 46 54 86 29 50 71 80 - 55 56 - 100 80 82 75 50 61 66 80 54 89 74 65 88 - 95 60 41 50 89 69 70 63 71 18 82 82 63
SMM 18 57 57 57 - 23 48 55 58 - 43 58 58 79 8 95 36 47 43 27 86 61 55 75 - 96 57 25 - 26 71 89 29 61 32 11 86 100 89 86 40 - 8 - - - 30 18 36 51 34 21 30 61 39 35 85 68 - 0 9 68 - 89 49 41 42 53 64 55 18 40
SMMPMBEC 18 57 57 57 - 41 46 69 79 - 75 69 48 93 100 75 46 44 43 38 100 51 58 75 - 79 57 25 - 33 99 86 21 57 75 14 86 100 89 100 40 - - - - - 29 7 43 42 38 60 21 21 61 49 90 82 - 95 100 32 - 89 40 36 35 53 91 55 18 41
NetMHCpan 4.0 EL 36 71 57 21 - 80 46 28 56 - 36 54 46 7 62 7 34 41 61 48 7 79 35 29 - 0 93 86 - 51 73 14 14 7 82 75 93 7 0 7 21 - 49 69 - 100 12 57 11 30 4 28 41 89 - - - - - - - - - - - - - - - - - -
ARB 18 57 0 100 - 21 23 58 44 - 25 82 42 57 - 25 39 35 21 11 0 33 44 27 - 79 0 7 - 43 100 21 0 - 100 11 86 0 68 43 56 - 69 - - - 23 0 11 30 16 - 29 21 0 26 0 0 - 100 0 0 - 89 25 20 37 18 9 36 82 21

Benchmark results get recalculated as new servers are added to the benchmarks. Numbers in light grey represent scores on datasets before the server was incorporated into the benchmarks. Previous versions of the benchmark results can be downloaded below