The ISBI 2015 Conference is soliciting proposals for scientific challenges. The aim of the challenges is to accelerate the pace of research by providing quantitative comparisons of competing approaches to cutting-edge problems, using standardized datasets.
Each challenge needs an organizer, who will be responsible for providing training and testing data, defining the tasks, specifying the metrics, managing entries, and conducting the studies and on-site presentations. ISBI will assist in advertising challenges, but the organizer is ultimately responsible for challenge participation and success.
The format of each challenge will be determined by the challenge organizer. We strongly encourage on-site evaluations and scientific presentations by challenge participants. We also encourage the investigation of alternative formats for hosting grand challenges, repetition of previous challenges to track how the field has advanced, and challenges that address machine learning and other base technologies as well as challenges that address end-user applications. Challenge organizers will have the opportunity to present summaries of their challenges during the main conference.
Challenges are tentatively scheduled for the day prior to ISBI oral sessions, April 16, 2015, at the Marriott Hotel at Brooklyn Bridge, NY, USA. Challenges may run for a half-day or a full day.
Important Challenge Dates
Challenge Proposal Deadline: September 10, 2014
Notification of Acceptance: September 24, 2014
Challenge Announcements (Website, Tasks, Data, and Metrics): September 30, 2014
How to Submit Challenge Proposal
To propose a challenge, a PDF file containing the following information must be sent to the ISBI 2015 Challenge Co-Chairs:
All submissions will be acknowledged by email. Please include the following in the PDF:
- Contest title and abstract.
- Name, affiliation, and contact information for the primary organizer as well as the names and affiliations of the co-organizers.
- Description of and motivation for the problem being addressed by the challenge.
- Description of the dataset that will be used and how it will be allocated for training and testing.
- Description of the challenge tasks and schedule.
- Details on the evaluation metrics.
- Plan of how to organize the contest.
- Estimated number of participants.
When designing a challenge, please consider the following:
- The dataset should be interesting, available, and sufficiently large.
- The tasks should be interesting and novel, but also accessible without too much domain specific knowledge.
- The evaluation metrics should be clear and easy to apply. Supplying implementations in C++ or Python is ideal.
Previous ISBI Challenges:
Grand-challenge hosting options:
The following links are provided for convenience. The services provided are not specifically endorsed by ISBI.