Algorithm data sets for the bbob test suite
In the first table below, you will find all official algorithm data sets on the bbob test suite, together with their year of publication, the authors, and related PDFs for each data set. Links to the source code to run the corresponding experiments/algorithms are provided whenever available.
A second table mentions data sets that have been collected on the bbob suite, but which are not complete in the sense that they miss at least one of the requested dimensions 2, 3, 5, 10, 20.
To sort the tables, simply click on the table header of the corresponding column.
Note that a manual download of the data is not necessary if you use the displaying results module (cocopp) of COCO.
Official and complete data sets
| Algorithm | Year | Author(s) | Dataset | Comment |
|---|---|---|---|---|
| ALPS | 2009 | Hornby | tgz | |
| AMALGAM | 2009 | Bosman et al. | tgz | pdf noiseless - pdf noisy |
| BAYEDA | 2009 | Gallagher | tgz | pdf noiseless - pdf noisy |
| BFGS | 2009 | Ros | tgz | pdf noiseless - pdf noisy |
| BIPOP-CMA-ES | 2009 | Hansen | tgz | pdf noiseless - pfd noisy |
| Cauchy-EDA | 2009 | Pošík | tgz | |
| CMA-ESPLUSSEL | 2009 | Auger and Hansen | tgz | pdf noiseless - pdf noisy |
| DASA | 2009 | Korošec and Šilc | tgz | pdf noiseless - pdf noisy |
| DE-PSO | 2009 | García-Nieto et al. | tgz | pdf noiseless - pdf noisy |
| DIRECT | 2009 | Pošík | tgz | pdf - algorithm is deterministic and thus, only run on each instance once |
| EDA-PSO | 2009 | El-Abd and Kamel | tgz | |
| FULLNEWUOA | 2009 | Ros | tgz | original 2009 noiseless paper - original 2009 noisy paper - 2010 comparison noiseless - 2010 comparison noisy |
| G3PCX | 2009 | Pošík | tgz | |
| GA | 2009 | Nicolau | tgz | |
| GLOBAL | 2009 | Pál et al. | tgz | BBOB-2009 paper not available online - corresponding ECJ paper |
| iAMALGAM | 2009 | Bosman et al. | tgz | pdf noiseless - pdf noisy |
| IPOP-SEP-CMA-ES | 2009 | Ros | tgz | pdf noiseless - pdf noisy |
| LSfminbnd | 2009 | Pošík | tgz | |
| LSstep | 2009 | Pošík | tgz | |
| MA-LS-CHAIN | 2009 | Molina et al. | tgz | pdf noiseless - pdf noisy |
| MCS | 2009 | Huyer and Neumaier | tgz | pdf noiseless - pdf noisy |
| NELDERDOERR | 2009 | Doerr et al. | tgz | |
| NELDER | 2009 | Hansen | tgz | |
| NEWUOA | 2009 | Ros | tgz | original 2009 noiseless paper - original 2009 noisy paper - 2010 comparison with BIPOP-CMA-ES noiseless - 2010 comparison noiseless - 2010 comparison noisy |
| ONEFIFTH | 2009 | Auger | tgz | pdf noiseless - pdf noisy |
| POEMS | 2009 | Kubalík | tgz | |
| PSO | 2009 | El-Abd and Kamel | tgz | |
| PSO_Bounds | 2009 | El-Abd and Kamel | tgz | |
| RANDOMSEARCH | 2009 | Auger and Ros | tgz | pdf noiseless - pdf noisy |
| Rosenbrock | 2009 | Pošík | tgz | |
| VNS | 2009 | García-Martínez and Lozano | tgz | pdf noiseless - pdf noisy |
| 1komma2 | 2010 | Auger et al. | tgz | pdf cmp1komma2mirAnd1komma2mirser - doi - pdf cmp1komma2ser - pdf cmp1komma2serNoisy |
| 1komma2mir | 2010 | Auger et al. | tgz | pdf cmp1komma2And1komma2mirser - doi |
| 1komma2mirser | 2010 | Auger et al. | tgz | pdf cmp1komma2And1komma2mir - doi |
| 1komma2ser | 2010 | Auger et al. | tgz | pdf cmp1komma2 - cmp1komma2Noisy |
| 1komma4 | 2010 | Auger et al. | tgz | pdf cmp1komma4serNoisy - doi - the other three papers are not linked to at the moment |
| 1komma4mir | 2010 | Auger et al. | tgz | pdf cmp1komma4And1komma4mirser - cmp1komma4And1komma4mirserNoisy |
| 1komma4mirser | 2010 | Auger et al. | tgz | pdf noiseless - pdf noisy - pdf cmp1komma4And1komma4mir - pdf cmp1komma4And1komma4mirNoisy |
| 1komma4ser | 2010 | Auger et al. | tgz | pdf cmp1komma4 - pdf cmp1komma4Noisy - doi |
| 1plus1 | 2010 | Auger et al. | tgz | pdf cmp1plus2mirser |
| 1plus2mirser | 2010 | Auger et al. | tgz | pdf cmp1plus1 |
| ABC | 2010 | El-Abd | tgz | doi |
| AVGNEWUOA | 2010 | Ros | tgz | mentioned in 2009 paper, data set submitted in 2009, but data presented only in 2010 - pdf cmpNEWUOAFULLNEWUOnoiseless - algname still NEWUOA |
| CMAEGS | 2010 | Finck and Beyer | tgz | |
| DE-F-AUC | 2010 | Fialho et al. | tgz | pdf cmpPM-AdapSS-DE |
| DEuniform | 2010 | Fialho et al. | tgz | pdf cmpPM-AdapSS-DE |
| IPOP-ACTCMA-ES | 2010 | Hansen and Ros | tgz | pdf cmpIPOP-CMA-ESNoiseless - pdf cmpIPOP-CMA-ESNoisy |
| IPOP-CMA-ES | 2010 | Hansen and Ros | tgz | pdf cmpIPOP-ACTCMA-ESNoiseless - pdf cmpIPOP-ACTCMA-ESNoisy - cmpBIPOP-CMA-ESNoiseless - pdf cmpBIPOP-CMA-ESNoisy |
| MOS | 2010 | LaTorre et al. | tgz | pdf noiseless - pdf noisy |
| NBC-CMA | 2010 | Preuss | tgz | doi |
| PM-AdapSS-DE | 2010 | Fialho et al. | tgz | pdf cmpUniformDE - pdf cmpDE-F-AUC |
| RCGA | 2010 | Tran and Jin | tgz | doi noiseless - doi noisy |
| SPSA | 2010 | Finck and Beyer | tgz | pdf noiseless - pdf noisy |
| oPOEMS | 2010 | Kubalík | tgz | doi cmppPOEMS |
| pPOEMS | 2010 | Kubalík | tgz | doi cmpoPOEMS |
| ACOR | 2012 | Liao et al | tgz | |
| BIPOPaCMA | 2012 | Loshchilov et al. | tgz | |
| BIPOPsaACM | 2012 | Loshchilov et al. | tgz | pdf - source code |
| CMA | 2012 | Brockhoff et al. | tgz | |
| CMAa | 2012 | Brockhoff et al. | tgz | pdf cmpCMAmaAndIPOP-ACTCMA-ES - pdf cmpCMAandCMAm |
| CMAm | 2012 | Brockhoff et al. | tgz | |
| CMAma | 2012 | Brockhoff et al. | tgz | pdf cmpCMAaAndIPOP-ACTCMA-ES - pdf cmpCMAmah |
| CMAmah | 2012 | Brockhoff et al. | tgz | pdf cmpCMAma - pdf cmpCMAmh |
| CMAmh | 2012 | Brockhoff et al. | tgz | |
| CMAES | 2012 | Pošík and Klemš | tgz | pdf - source code |
| DBRCGA | 2012 | Chuang and Chen | tgz | |
| DE | 2012 | Pošík and Klemš | tgz | pdf - source code |
| DEAE | 2012 | Pošík and Klemš | tgz | pdf - source code |
| DEb | 2012 | Pošík and Klemš | tgz | pdf - source code |
| DEctpb | 2012 | Pošík and Klemš | tgz | pdf - source code |
| DE-AUTO | 2012 | Voglis et al. | tgz | |
| DE-BFGS | 2012 | Voglis et al. | tgz | pdf - pdf cmpPSO-BFGS |
| DE-ROLL | 2012 | Voglis et al. | tgz | |
| DE-SIMPLEX | 2012 | Voglis et al. | tgz | |
| IPOPsaACM | 2012 | Loshchilov et al. | tgz | pdf cmpBIPOPsaACM - pdf cmpIPOP-ACTCMA-ESNoisy - source code |
| JADE | 2012 | Pošík and Klemš | tgz | pdf - source code |
| JADEb | 2012 | Pošík and Klemš | tgz | pdf - source code |
| JADEctpb | 2012 | Pošík and Klemš | tgz | pdf - source code |
| MVDE | 2012 | Veloso de Melo | tgz | |
| NBIPOPaCMA | 2012 | Loshchilov et al. | tgz | |
| NIPOPaCMA | 2012 | Loshchilov et al. | tgz | |
| PSO-BFGS | 2012 | Voglis et al. | tgz | |
| SNES | 2012 | Schaul | tgz | |
| xNES | 2012 | Schaul | tgz | pdf - pdf cmpxNESas |
| xNESas | 2012 | Schaul | tgz | pdf - pdf cmpxNES - pdf cmpBIPOP-CMA-ES |
| BIPOP-saACM-k | 2013 | Loshchilov et al. | tgz | pdf - source code - BBOB2010 instances |
| BIPOP-aCMA-STEP | 2013 | Loshchilov et al. | tgz | pdf - source code - BBOB2010 instances |
| CGA-grid16 | 2013 | Holtschulte and Moses | tgz | |
| CGA-grid100 | 2013 | Holtschulte and Moses | tgz | |
| CGA-ring16 | 2013 | Holtschulte and Moses | tgz | |
| CGA-ring100 | 2013 | Holtschulte and Moses | tgz | |
| CMAES_Hutter | 2013 | Hutter et al. | tgz | |
| DE_Pal | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| fmincon | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| fminunc | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| GA-100 | 2013 | Holtschulte and Moses | tgz | |
| HCMA | 2013 | Loshchilov et al. | tgz | pdf - source code - BBOB2010 instances |
| HILL | 2013 | Holtschulte and Moses | tgz | |
| HMLSL | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| IP | 2013 | Liao and Stützle | tgz | pdf cmpLiaoTesting - pdf cmpLiaoBounding - BBOB2010 instances |
| IP-10DDr | 2013 | Liao and Stützle | tgz | pdf - BBOB2010 instances |
| IP-500 | 2013 | Liao and Stützle | tgz | pdf - BBOB2010 instances |
| IPOP400D | 2013 | Auger et al. | tgz | |
| lmm-CMA-ES | 2013 | Auger et al. | tgz | |
| MEMPSODE | 2013 | Voglis | tgz | |
| MLSL | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| OQNLP | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| P-DCN | 2013 | Tran et al. | tgz | pdf - source code |
| P-zero | 2013 | Tran et al. | tgz | pdf - source code |
| PRCGA | 2013 | Sawyerr et al. | tgz | |
| simplex | 2013 | Pàl | tgz | pdf - BBOB2010 instances |
| SMAC-BBOB | 2013 | Hutter et al. | tgz | |
| tany | 2013 | Liao and Stützle | tgz | pdf - BBOB2010 instances |
| texp | 2013 | Liao and Stützle | tgz | pdf - BBOB2010 instances |
| U-DCN | 2013 | Tran et al. | tgz | pdf - source code |
| U-zero | 2013 | Tran et al. | tgz | pdf - source code |
| MATSuMoToDefault-50D | 2015 | Brockhoff | tgz | CEC paper |
| R-DE-10e2 | 2015 | Tanabe and Fukunaga | tgz | CEC paper |
| R-DE-10e5 | 2015 | Tanabe and Fukunaga | tgz | CEC paper |
| R-SHADE-10e2 | 2015 | Tanabe and Fukunaga | tgz | CEC paper |
| R-SHADE-10e5 | 2015 | Tanabe and Fukunaga | tgz | CEC paper |
| RL-SHADE-10e2 | 2015 | Tanabe and Fukunaga | tgz | CEC paper |
| RL-SHADE-10e5 | 2015 | Tanabe and Fukunaga | tgz | CEC paper |
| SOO | 2015 | Derbel and Preux | tgz | CEC paper |
| BrentSTEPif | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| BrentSTEPifeg | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| BrentSTEPqi | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| BrentSTEPrr | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| CMA-CSA | 2015 | Atamna | tgz | GECCO paper - source code |
| CMA-MSR | 2015 | Atamna | tgz | GECCO paper - source code |
| CMA-TPA | 2015 | Atamna | tgz | GECCO paper - source code |
| GP1-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| GP1-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| GP5-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| GP5-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| IPOPCMAv3p61 | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| IPOPCMAv3p61 | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| LHD-10xDefault-MATSuMoTo | 2015 | Brockhoff et al. | tgz | GECCO paper |
| LHD-2xDefault-MATSuMoTo | 2015 | Brockhoff et al. | tgz | GECCO paper |
| RAND-2xDefault-MATSuMoTo | 2015 | Brockhoff et al. | tgz | GECCO paper |
| RF1-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| RF1-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| RF5-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| RF5-CMAES | 2015 | Bajer et al. | tgz | doi - Thanks to the authors, two data sets are available with the 2015 and the 2013 instances |
| STEPif | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| STEPifeg | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| STEPrr | 2015 | Pošík and Baudiš | tgz | GECCO paper |
| PSAaLmC-CMA-ES | 2016 | Nishida and Akimoto | tgz | GECCO paper |
| PSAaLmD-CMA-ES | 2016 | Nishida and Akimoto | tgz | GECCO paper |
| PSAaSmC-CMA-ES | 2016 | Nishida and Akimoto | tgz | GECCO paper |
| PSAaSmD-CMA-ES | 2016 | Nishida and Akimoto | tgz | GECCO paper |
| CMAES-APOP | 2017 | Nguyen and Hansen | tgz | doi |
| DTS-CMA-ES | 2017 | Pitra et al. | tgz | doi |
| EvoSpace-PSO-GA | 2017 | García-Valdez and Merelo | tgz | doi |
| KL-BIPOP-CMA-ES | 2017 | Yamaguchi and Akimoto | tgz | GECCO paper |
| KL-IPOP-CMA-ES | 2017 | Yamaguchi and Akimoto | tgz | GECCO paper |
| KL-Restart-CMA-ES | 2017 | Yamaguchi and Akimoto | tgz | GECCO paper |
| Ord-H-DTS-CMA-ES | 2017 | Pitra et al. | tgz | doi |
| Ord-N-DTS-CMA-ES | 2017 | Pitra et al. | tgz | doi |
| Ord-Q-DTS-CMA-ES | 2017 | Pitra et al. | tgz | doi |
| SSEABC | 2017 | Aydin and Yavuz | tgz | doi |
| RANDOMSEARCH-4 | 2017 | Brockhoff | tgz | COCO baseline data without BBOB paper |
| RANDOMSEARCH-4p5 | 2017 | Brockhoff | tgz | COCO baseline data without BBOB paper |
| RANDOMSEARCH-5 | 2017 | Brockhoff | tgz | COCO baseline data without BBOB paper |
| BBDE | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| BBDE-best | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| BBDE-N | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| BBDE-ttb | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| BFGS-M-17 | 2018 | Blelly et al. | tgz | GECCO 2018 paper |
| BFGS-P-09 | 2018 | Blelly et al. | tgz | GECCO 2018 paper |
| BFGS-P-Instances | 2018 | Blelly et al. | tgz | GECCO 2018 paper |
| BFGS-P-range | 2018 | Blelly et al. | tgz | GECCO 2018 paper |
| BFGS-P-StPt | 2018 | Blelly et al. | tgz | GECCO 2018 paper |
| CMAES-APOP-Var1 | 2018 | Nguyen | tgz | GECCO 2018 paper |
| CMAES-APOP-Var2 | 2018 | Nguyen | tgz | GECCO 2018 paper |
| CMAES-APOP-Var3 | 2018 | Nguyen | tgz | GECCO 2018 paper |
| DE-best | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| DE-rand | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| DE-ttb | 2018 | Vodopija et al. | tgz | GECCO 2018 paper doi |
| PSA-CMA-ES | 2018 | Nishida and Akimoto | tgz | GECCO 2018 paper |
| PSA-CMA-ESwRS | 2018 | Nishida and Akimoto | tgz | GECCO 2018 paper |
| uBBDE | 2018 | Vodopija et al. | tgz | paper |
| uBBDE-best | 2018 | Vodopija et al. | tgz | paper |
| uBBDE-N | 2018 | Vodopija et al. | tgz | paper |
| uBBDE-ttb | 2018 | Vodopija et al. | tgz | paper |
| uDE-best | 2018 | Vodopija et al. | tgz | paper |
| uDE-rand | 2018 | Vodopija et al. | tgz | paper |
| uDE-ttb | 2018 | Vodopija et al. | tgz | paper |
| DTS-CMA-ES_005-2pop_v26_1model | 2018 | Bajer et al. | tgz | link to paper - details on the differences to #161 |
| Adaptive-Two-Mode | 2019 | Bodner | tgz | doi |
| BFGS-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| CG-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| COBYLA-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| DE-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| L-BFGS-B-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| Nelder-Mead-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| Powell-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| RS-0p5-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-0p5 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-1-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-1 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-2-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-2 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-3-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-3 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-4-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-5-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-6-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-6 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-10-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-10 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-20-initIn0 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| RS-20 | 2019 | Brockhoff and Hansen | tgz | GECCO 2019 paper |
| SLSQP-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| TNC-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| adapt-Nelder-Mead-scipy | 2019 | Varelas and Dahito | tgz | GECCO 2019 paper |
| HE-ES | 2020 | Glasmachers and Krause | tgz | continuous submission: accompanying paper - source code |
| CMA-ES-2019 | 2020 | Hansen | tgz | continuous submission: accompanying paper - source code |
| lq-CMA-ES | 2020 | Hansen | tgz | continuous submission: accompanying paper - source code |
| SLSQP-11-scipy | 2020 | Hansen | tgz | continuous submission: accompanying paper - source code |
| SLSQP+lq-CMA-ES | 2020 | Hansen | tgz | continuous submission: accompanying paper - source code |
| SHADE-LM | 2021 | Okulewicz and Zaborski | tgz | GECCO 2021 paper |
| SHADE-LM-POP4-to-10 | 2021 | Okulewicz and Zaborski | tgz | GECCO 2021 paper |
| oMads-2N | 2022 | Dahito et al. | tgz | continuous submission: accompanying paper |
| oMADS-Neg | 2022 | Dahito et al. | tgz | continuous submission: accompanying paper |
| EXPLO2 | 2022 | Huntsman | tgz | continuous submission: accompanying paper |
| CMA-ES-Akimoto | 2022 | Gharafi | tgz | IPOP-CMA-ES as implemented by Y. Akimoto [BBOB-2022 paper] |
| CMA-ES-pycma | 2022 | Gharafi | tgz | IPOP-CMA-ES as implemented in pycma [BBOB-2022 paper] |
| CMAES-APOP-KMA | 2022 | Nguyen | tgz | adaptive population size CMA-ES with KP and MA strategy [BBOB-2022 paper] |
| CMAES-APOP-KP | 2022 | Nguyen | tgz | adaptive population size CMA-ES reusing part of the known population (KP) [BBOB-2022 paper] |
| CMAES-APOP-MA | 2022 | Nguyen | tgz | adaptive population size CMA-ES with mirrored sampling and active CMA [BBOB-2022 paper] |
| DD-CMA-ES-Akimoto | 2022 | Gharafi | tgz | diagonal encoding CMA-ES as implemented by Y. Akimoto [BBOB-2022 paper] |
| DD-CMA-ES-pycma | 2022 | Gharafi | tgz | diagonal encoding CMA-ES as implemented in pycma [BBOB-2022 paper] |
| BIRMIN | 2023 | Kudela | tgz | globally-biased, hybridized version of BIRECT by Paulavicius et al. as benchmarked by Jakub Kudela [BBOB-2023 paper] |
| DIRECT-REV | 2023 | Kudela | tgz | DIRECT variant with enhancements for the reduction of the global drag [BBOB-2023 paper] |
| E-WOA | 2023 | Espinoza et al. | tgz | Enhanced Whale Optimization Algorithm as implemented by Epinoza et al. in their [BBOB-2023 paper] |
| I-DBDP-GL | 2023 | Kudela | tgz | BIRECT variant which uses hyper-rectangular partitioning based on 1-D bisections and evaluations at two diagonal points with global and local search enhancements [BBOB-2023 paper] |
| WOA | 2023 | Espinoza et al. | tgz | Whale Optimization Algorithm as implemented by Epinoza et al. in their [BBOB-2023 paper] |
| a-CMA-ES | 2023 | Gissler | tgz | affine-invariant version of CMA-ES [BBOB-2023 paper] |
| ad-CMA-ES | 2023 | Gissler | tgz | affine-invariant and continuously differentiable version of CMA-ES [BBOB-2023 paper] |
| adm-CMA-ES | 2023 | Gissler | tgz | affine-invariant and continuously differentiable version of CMA-ES with default stepsize damping factor d_{\sigma} [BBOB-2023 paper] |
| c-CMA-ES | 2023 | Gissler | tgz | CMA-ES variant without cumulation for the covariance matrix [BBOB-2023 paper] |
| cd-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES variant without cumulation for the covariance matrix [BBOB-2023 paper] |
| cdm-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES variant without cumulation for the covariance matrix and default learning rate d_{\sigma} [BBOB-2023 paper] |
| cma-bp-bbob | 2023 | Brockhoff | tgz | bound-constrained CMA-ES with BoundPenalty as compared in SBOX-COST 2023 workshop paper |
| cma-bt-bbob | 2023 | Brockhoff | tgz | bound-constrained CMA-ES with BoundTransform as as compared in SBOX-COST 2023 workshop paper |
| d-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES [BBOB-2023 paper] |
| default-CMA-ES | 2023 | Gissler | tgz | default CMA-ES from the pycma module, version 3.3.0 [BBOB-2023 paper] |
| dm-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES with default learning rate d_{\sigma} [BBOB-2023 paper] |
| m-SDWOA | 2023 | Espinoza et al. | tgz | modified Symbiotic organism search - Differential Evolution - Whale Optimization Algorithm hybrid as implemented by Espinoza et al. in their [BBOB-2023 paper] |
| s-CMA-ES | 2023 | Gissler | tgz | CMA-ES without cumulation for the step size [BBOB-2023 paper] |
| sc-CMA-ES | 2023 | Gissler | tgz | CMA-ES without cumulation for both step size and covariance matrix [BBOB-2023 paper] |
| scd-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES without cumulation for both step size and covariance matrix [BBOB-2023 paper] |
| scdm-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES without cumulation for both step size and covariance matrix and default d_{\sigma} [BBOB-2023 paper] |
| sd-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES without cumulation for the step size [BBOB-2023 paper] |
| sdm-CMA-ES | 2023 | Gissler | tgz | continuously differentiable CMA-ES without cumulation for the step size and default d_{\sigma} [BBOB-2023 paper] |
Inofficial/incomplete data sets
| Number | Algorithm Name | Year | Author(s) | link to data | pdf, source code, remarks |
|---|---|---|---|---|---|
| inofficial-001 | BFGS-scipy | 2014 | Baudiš | data | arXiv paper |
| inofficial-002 | CG-Fletcher-Reeves-scipy | 2014 | Baudiš | data | arXiv paper |
| inofficial-003 | CMA-ES-python | 2014 | Baudiš | data | arXiv paper |
| inofficial-004 | EG50-cocopf | 2014 | Baudiš | data | arXiv paper |
| inofficial-005 | L-BFGS-B-scipy | 2014 | Baudiš | data | arXiv paper |
| inofficial-006 | Nelder-Mead-scipy | 2014 | Baudiš | data | arXiv paper |
| inofficial-007 | Powell-scipy | 2014 | Baudiš | data | arXiv paper |
| inofficial-008 | SLSQP-scipy | 2014 | Baudiš | data | arXiv paper |
| inofficial-009 | UNIF-cocopf | 2014 | Baudiš | data | arXiv paper |
| inofficial-010 | GNN-CMA-ES | 2019 | Faury et al. | data | GECCO 2019 paper |
| inofficial-011 | IPOP-CMA-ES-2019 | 2019 | Faury et al. | data | GECCO 2019 paper |