Solving double-sided puzzles: Automated assembly of torn-up banknotes evidence

Abstract

Reconstruction of 2D object is a problem concerning many different fields such as forensics science, archiving, and banking. In the literature, it is considered as one-sided puzzle problem. But this study handles torn banknotes as a double-sided puzzle problem for the first time. In addition to that, a new dataset (ToB) is created for solving this problem. A selection approach based on the Borda count method is adopted in order to make the right decision as to which keypoint-based method is to be used in the proposed reconstruction system. The selection approach was determined the Accelerated-KAZE (AKAZE) as the most successful keypoint-based method. This study also proposes new measures determining the success ratio of the reconstructed banknotes and calculating their loss ratio. When the torn banknotes were reconstructed with the AKAZE-based reconstruction system, the average success rate was calculated as 95.55% by the proposed metric.