AVSS2017 Challenge



Challenge organization

In order to allow a wide participation to the challenge, a "task"/"degree of difficult" division has been considered, leading to 4 different tracks as in figure below.

task
Figure 1: Challenge tasks and levels of difficulty scheme. Each branch reports prize and metric baseline

All the works, whose results are above the set thresholds, will be automatically published in the workshop proceeding (in association with the AVSS 2017 conference) and the best ones will be presented in the workshop day session. Results and authorship of the papers that participated to the challenge and that scored more than the threshold will be summarized in a final paper in the main conference. Submissions to the workshop that do not participate the challenge are permitted, but are subject to the standard peer review process.

relation
Figure 2: Workshop/Challenge relations

Challenge organization

The UA-DETRAC dataset contains videos with large variations in scale, pose and illumination, occlusion, and background clutters making useful to classify the test sequences in different level of difficulty (easy, medium and hard).


Thus we provide participation in two levels:

  • Beginner:   People participating to the beginner degree of difficult must submit only the results referred to 10 test video sequences marked as easy independently on the task (detection or tracking)
  • Experienced:  People participating to the experienced level of difficult must submit the results referred to 40 overall test video sequences set for the detection task and the results referred to 30 test video sequences marked as hard and medium for the tracking task.

    • For detection evaluation, we use the precision vs. recall (PR) curve. For tracking evaluation, we use the UA-DETRAC metrics by considering the effect of detection modules. Note that the private detection input is allowed.


Result and paper submission

The result must be submitted by means of the UA-DETRAC web site. Specifically, participants must:

  1. Register an account at http://detrac-db.rit.albany.edu/auth/register and activate it by a verification email.
  2. Download the detection/tracking dataset and the latest toolkit.
  3. Upload your detection/tracking result files with the format described at http://detrac-db.rit.albany.edu/instructions. Besides, a short document describing the applied methodology using the provided template is a must.
  4. Check your email for the evaluation results for DETRAC-test set.
  5. Paper related with the challenge must be submitted through a Content Management Toolkit. A template will be provided to the authors by considering the guidelines given by AVSS 2017 Workshop chairs. The corresponding author email indicated in the paper must be the same as the one used in step 1.

Prize

The challenge includes some prizes. One for each task/level of difficulty:

  • Tracking/Experienced: Nvidia TX1 development kit
  • Tracking/Beginner: Conference Free access
  • Detection/Experienced: Nvidia TX1 development kit
  • Detection/Beginner: Conference Free access
Figure 3. Jadson TX1 development kit

The challenge is sponsored by Nvidia.