Learning to Associate: HybridBoosted Multi-Target Tracker for Crowded Scene

1. Learning to Associate: HybridBoosted Multi-Target Tracker for Crowded Scene Present by 陳群元

2. Outline • introduction • Related work • MAP formulation • Affinity model • Results • Conclusion

5. overview

6. STAGE 1 STAGE 2 STAGE 3 STAGE 4

7. Introduction • learning-based hierarchical approach of multi-target tracking • HybridBoost algorithm-hybrid loss function • association of tracklet is formulated as a joint problem of ranking and classification

8. ranking • the ranking part aims to rank correct tracklet associations higher than other alternatives

9. classification • the classification part is responsible to reject wrong associations when no further association should be done

10. HybridBoost • combines the merits of the RankBoost algorithm and the AdaBoost algorithm .

11. adaboost

12. RankBoost

13. Related work • the earliest works look at a longer period of time in contrast to frame-by-frame tracking. • To overcome this, a category of DataAssociation based Tracking algorithm • there has been no use of machine learning algorithmin building the affinity model.

14. MAP formulation • Robust Object Tracking by Hierarchical Association of Detection Responses • ours

15. MAP formulation v1 • R = {ri} the set of all detection responses j i j i j i i j j i

16. MAP formulation v1(cont.) • tracklet association

17. MAP formulation v1(cont.)

18. MAP formulation v2

19. MAP formulation v2(cont.) • Inner cost • Transition cost

20. MAP formulation v2(cont.) • With these ,we can rewrite it

21. Affinity model • Hybridboostalgorithm • Feature pool and weak learner • Training process

22. Hybridboostalgorithm • Ie. T2 T1 T3

23. Hybridboostalgorithm(cont.)

24. Loss function • initial

25. Strong ranking classifier weak weak weak weak Update sample weight Update weight Update weight

26. Hybridboostalgorithm

29. Feature pool and weak learner

30. Training process • T:tracklet set from the previous stage • G:groundtruth track set

31. Training process(cont) • For each Ti ∈ T, if • connecting Ti’stail to the head of some other tracklet

32. Training process(cont) • connecting Ti’s head to the tail of some other tracklet before Ti which is also matched to G

33. Ranking sample set

34. Binary sample set

35. Training process(cont.) • use thegroundtruthG and the tracklet set Tk−1 obtained from stagek − 1 to generate ranking and binary classification samples • learn a strong ranking classifier Hkby the HybridBoost algorithm • UsingHk as the affinity model to perform association on Tk−1and generate Tk

36. Experimental results • Implementation details • Evaluation metrics • Analysis of the training process • Tracking performance

37. Implementation details • dual-threshold strategy to generate short but reliable tracklets • four stages of association • maximum allowed frame gap 16, 32, 64 and 128 • a strong ranking classifier H with 100 weak ranking classifiers • Β=0.75 • ζ = 0

38. Evaluation metrics

39. track fragments &ID switches • Traditional ID switch:“two tracks exchanging their ids”. • ID switch : a tracked trajectory changing its matched GT ID • track fragments:more strict

40. compare

41. Best features • Motion smoothness (feature type 13 or 14) • color histogram similarity (feature 4) • number of miss detected frames in the gap between the two trackelts (feature 7 or 9).

42. Strong ranking classifier output

43. Choice of β

44. Tracking performance

45. Conclusion and future work • Use HybridBoost algorithm to learn the affinity model as a joint problem of ranking and classification • The affinity model is integrated in a hierarchical data association framework to track multiple targets in very crowded scenes.

47. The end • Thank you

48. progress

49. Learning to Associate: HybridBoosted Multi-Target Tracker for Crowded Scene Present by 陳群元

50. overview