ec competition 2019 analysis on results - jpnsec.org
TRANSCRIPT
Dec. 14, 2019
Naoki Hamada Fujitsu Laboratories Ltd.
EC Competition 2019Analysis on Results
Copyright 2019 FUJITSU LABORATORIES LTD.
Why analysis?
Purpose of EC competition
To understand real-world problems by solving them
•What algorithms are effective in practice?
•How should we formulate real-world problems?
Knowing is worthier than winning
What is the key aspect that decided the victory?
Let’s see the submitted data from each team
Copyright 2019 FUJITSU LABORATORIES LTD.1
Single-objective
2 Copyright 2019 FUJITSU LABORATORIES LTD.
Ranking
Copyright 2019 FUJITSU LABORATORIES LTD.3
Similar values but different variables
Copyright 2019 FUJITSU LABORATORIES LTD.4
All solutions are different local optima
Copyright 2019 FUJITSU LABORATORIES LTD.5
Multi-objective
6 Copyright 2019 FUJITSU LABORATORIES LTD.
Ranking
Copyright 2019 FUJITSU LABORATORIES LTD.7
M02: N=617
Copyright 2019 FUJITSU LABORATORIES LTD.8
M03: N=1503
Copyright 2019 FUJITSU LABORATORIES LTD.9
M04: N=1994
Copyright 2019 FUJITSU LABORATORIES LTD.10
M05: N=1092
Copyright 2019 FUJITSU LABORATORIES LTD.11
M07: N=1399
Copyright 2019 FUJITSU LABORATORIES LTD.12
M02
Copyright 2019 FUJITSU LABORATORIES LTD.13
M03
Copyright 2019 FUJITSU LABORATORIES LTD.14
x15
M04
Copyright 2019 FUJITSU LABORATORIES LTD.15
M05
Copyright 2019 FUJITSU LABORATORIES LTD.16
M07
Copyright 2019 FUJITSU LABORATORIES LTD.17
Findings
The problem may have a single funnel
All non-dominated fronts have one cluster
Diversity enhancement is needed but niching is not
Diversity in decision space is also important
The winner maintained diversity in all coordinates
The other teams lost diversity in some coordinates
The problem may be simplicial
Copyright 2019 FUJITSU LABORATORIES LTD.18