opencv - Best Facial Landmark that can be easily extracted from NIR Image? -
i'm playing eye gaze estimation using ir camera. far have detected 2 pupil center points follows:
- detect face using haar face cascade & set roi face.
- detect eyes using haar eye cascade & name left & right eye respectively.
- detect pupil center thresholding eye region & found pupil center.
so far i've tried find gaze direction using haar eye boundary region. haar eye rect not showing eye corner points. results poor.
then i've tried tried detect eye corner points using gftt, harriscorners & fast since i'm using nir camera eye corner points not visible & cant able exact corner positions.so i'm stuck here!
what else best feature can tracked face? heard flandmark think not work in ir captured images.
is there feature can extracted face images? here i've attached sample output image.
i suggest flandmark, if intuition opposite - i've used in master thesis (which head pose estimation, related topic). , if question whether work example image you've provided, think might detect features - on gray scaled image. think in flandmark convert image grayscale before applying detector (like haar detector works). moreover, surprisingly works low resolution images advantage (especially when you're saying eye corners not visible). , flandmark can detect both eye corners, mouth corners , nose tip (actually not rely on last one, experience detecting nose tip on single image quite noisy, works fine image sequence filtering e.g. average, kalman). if decide use technique , works, please let know!
Comments
Post a Comment