Dr. Shengcai Liao

Acting Director of R&D, Principal Scientist, Senior Member, IEEE
Inception Institute of Artificial Intelligence (IIAI), G42, Abu Dhabi, UAE
Email: scliao at ieee
Google Scholar   |   GitHub   |   VOS Team
HOME TEAM MEMBERS SOURCE CODES PUBLICATIONS PROJECTS BLOGS

Open-set Person Re-identification Database and Evaluation v1.0

Person re-identification is becoming a hot research for developing both machine learning algorithms and video surveillance applications. The task of person re-identification is to determine which person in a gallery has the same identity to a probe image. This task basically assumes that the subject of the probe image belongs to the gallery, that is, the gallery contains this person. However, in practical applications such as searching a suspect in a video, this assumption is usually not true. In this paper, we consider the open-set person re-identification problem, which includes two sub-tasks, detection and identification. The detection sub-task is to determine the presence of the probe subject in the gallery, and the identification sub-task is to determine which person in the gallery has the same identity as the accepted probe. We present a database collected from a video surveillance setting of 6 cameras, with 200 persons and 7,413 images segmented. Based on this database, we develop a benchmark protocol for evaluating the performance under the open-set person re-identification scenario. Several popular metric learning algorithms for person re-identification have been evaluated as baselines. From the baseline performance, we observe that the open-set person re-identification problem is still largely unresolved, thus further attention and effort is needed.

We provide the OPeRID v1.0 database, baseline features, and a benchmark toolkit here to further advance research in this field. For more information, please read our paper[1].

Download

Note: License agreement is only required if you would like to obtain the original images of the OPeRID v1.0 database.

Results

Table 1. OPeRID Performances measured in (μ – σ) of 10 trials
Method FAR=1% FAR=10%
Rank=1 Rank=10 Rank=1 Rank=10
IDENTITY 0.84 0.91 7.36 9.21
MAHAL 1.89 1.99 10.50 11.97
KISSME 1.82 1.92 9.99 11.46
LMNN 0.41 0.41 3.97 4.58
ITML 1.18 1.21 8.39 9.27
LADF 1.53 1.74 9.11 10.82
RRDA 3.99 4.35 14.51 16.72

Download the result files and demo code for performance plot: results.zip

Contact

National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences.

References

[1]Shengcai Liao, Zhipeng Mo, Jianqing Zhu, Yang Hu, and Stan Z. Li, “Open-set Person Re-identification,” arXiv:1408.0872, 2014. [pdf]

Last updated: Oct. 16, 2014