(minor bug) in new display of job pairs
3 posters
Page 1 of 1
(minor bug) in new display of job pairs
Hi folks,
The headers do no longer fit the table entries, e.g.,
solver config benchmark status time result
bench1 solver1 config1 pending submission (1) 0.0 s --
The new display also disallows to compare the job pairs of two different solvers. Is this intended?
A second "filter by solver" combo box would help ... (actually filtering by any column would be nice).
Harald.
The headers do no longer fit the table entries, e.g.,
solver config benchmark status time result
bench1 solver1 config1 pending submission (1) 0.0 s --
The new display also disallows to compare the job pairs of two different solvers. Is this intended?
A second "filter by solver" combo box would help ... (actually filtering by any column would be nice).
Harald.
hzankl- Posts : 19
Join date : 2014-05-14
Re: (minor bug) in new display of job pairs
Hello,
Thank you for pointing out the column error-- it will be resolved in our next deploy.
That page is intended to show only the job pairs for a single solver/configuration combination. If it would be useful, though, it would be straightforward to present an option to show all the pairs regardless of which solver worked on them.
Thank you for pointing out the column error-- it will be resolved in our next deploy.
That page is intended to show only the job pairs for a single solver/configuration combination. If it would be useful, though, it would be straightforward to present an option to show all the pairs regardless of which solver worked on them.
eric-burns- Posts : 27
Join date : 2014-06-17
Re: (minor bug) in new display of job pairs
As a side note, for Termination, we have a display like this:
http://nfa.imn.htwk-leipzig.de/termcomp-devel/show_job_results/3441
- J.
http://nfa.imn.htwk-leipzig.de/termcomp-devel/show_job_results/3441
- J.
Last edited by j.waldmann on Sun Jul 06, 2014 5:48 pm; edited 1 time in total
j.waldmann- Posts : 84
Join date : 2014-04-26
Re: (minor bug) in new display of job pairs
Currently the presentation of results is one-dimensional (based on benchmarks). This has the advantage that then the width
of the window is fixed.
I agree with Johannes that a two-dimensional presentation (as in termcomp) is more compact and eases the comparison of tools.
One dimension (the rows) are the benchmarks and the second dimension (columns) are solvers/configurations.
The information of status/time/result can be merged since status is only relevant for jobs which are not completed
and time is only relevant for completed jobs. The result can be represented by a color code (set by the community leader),
e.g. result1 = green, result2 = yellow, result3 = blue, result4 = gray.
I think this is (apart from the inflexible scoring scheme) the main reason why most (all?) competition organizers (have to)
extract the data from StarExec to present the results. As a mid-term goal I'd like to be able to present the competition
inside StarExec ...
Harald.
of the window is fixed.
I agree with Johannes that a two-dimensional presentation (as in termcomp) is more compact and eases the comparison of tools.
One dimension (the rows) are the benchmarks and the second dimension (columns) are solvers/configurations.
The information of status/time/result can be merged since status is only relevant for jobs which are not completed
and time is only relevant for completed jobs. The result can be represented by a color code (set by the community leader),
e.g. result1 = green, result2 = yellow, result3 = blue, result4 = gray.
I think this is (apart from the inflexible scoring scheme) the main reason why most (all?) competition organizers (have to)
extract the data from StarExec to present the results. As a mid-term goal I'd like to be able to present the competition
inside StarExec ...
Harald.
hzankl- Posts : 19
Join date : 2014-05-14
Similar topics
» Job display missing subspaces
» Job pairs failing
» minor bug when uploading benchmarks
» minor bug: manage cycle bin
» StarExec display, and smt-comp
» Job pairs failing
» minor bug when uploading benchmarks
» minor bug: manage cycle bin
» StarExec display, and smt-comp
Page 1 of 1
Permissions in this forum:
You cannot reply to topics in this forum
|
|