100 likes | 215 Vues
This comprehensive study explores a practical approach to lane and obstacle detection using advanced image processing techniques. Highlighting the theoretical foundations, we delve into the Inverse Perspective Mapping (IPM) method, transforming 3D spatial coordinates into 2D image coordinates. Through detailed analysis, we present lane detection workflows utilizing filtered and enhanced images, while obstacle detection employs stereo imaging and horopter calibration. Strengths include robust performance across varied conditions, whereas weaknesses focus on challenges presented by uneven surfaces and road markings. The PAPRICA system showcases efficient processing for real-time applications in automotive environments.
E N D
A Practical Solution: GOLD Generic Obstacle and Lane Detection • Theoretical Bases • Lane Detection • Obstacle Detection • Strong Points • Weak Points
Theoretical Bases The Inverse Perspective Mapping The 3d space is transformed into the image space by the Perspective Transformation. The coordinates in the 3d space are (x,y,z), and the (u,v) are the coordinates in the image space.
Theoretical… (continued) Mapping from image to a z=0 plane in 3d world (IPM) Mapping from the 3d space to image space (remapping)
Theoretical…(example) Camera parameters which are relevant in the computation Example of a result obtained from IPM. At right, the FOV of the camera
Lane Detection a) b) c) d) e) • Original Image • IPM image • Filtered image • Enhanced image (using morfodilatation) • Binarized image
Obstacle Detection Stereo IPM Main Idea: the Zero Disparity Surface (HOROPTER) Cameras are calibrated so that the IPM images from both cameras will be identical in the features aquired from the road plane (the horopter is a line, not a curve)
Obstacle Detection (cont’d) a) b) c) d) • Acquired images from the left and right cameras • IPM transformed images (L,R) • Difference image. (Obstacles are the ones causing the differences) • Remapped image. A black line indicates the detected obstacle
The Computing Architecture The PAPRICA System PArallel PRocessor for Image Checking and Analysis
Strong Points • Tested on MOBLAB vehicle, on extra-urban roads, for 3000km • The vehicle speed: up to 80km/h • Not influenced by shadows on the road, illumination conditions • and road&vehicle texture
Weak Points Lane detection fails when: - the road is not flat (a,b) - the road markings are not visible (c,d) Due to the vehicle movements slight changes appear in the camera parameters – this problem can be solved by image stabilization schemes