Re: [Shotwell] Enhance face detection

[Narendra Acharya <narendra_m_a yahoo com>]

I have made the first level changes to migrate from process execution for every detect faces call, to one time execution of facedetect process and then communicate over DBus.

https://gitlab.gnome.org/nma83/shotwell/commit/4c84248b80ebf3a1f1eb05aa60625d9d8c5d0134

The DBus interface XML is at:

https://gitlab.gnome.org/nma83/shotwell/blob/wip/faces/facedetect/org.gnome.ShotwellFaces1.xml

I have implemented DetectFaces and Terminate methods. The next steps are:

1. Extract the faces detected in photos and cache them (downsizing if needed) - maybe in $HOME/.cache/shotwell

2. Run face training on the labelled faces, with a minimum number of faces per label (maybe 10)

3. Attempt to automatically recognise and label faces in photos after training

On Saturday, 23 June, 2018, 8:54:43 PM IST, Jens Georg <mail jensge org> wrote:

On Fri, 2018-06-22 at 08:08 +0000, Narendra Acharya via shotwell-list wrote:

Hi,

I was looking at the current face detection code in shotwell 0.29.2 and feel that it can be enhanced.

So I pulled the code from https://gitlab.gnome.org/GNOME/shotwell.git and started making some changes.

1. Do not run another process for face detection (shotwell-facedetect) but integrate the OpenCV calls into shotwell and link to OpenCV libraries

This is potentially problematic as OpenCV can be compiled against Gtk2 - which will break Shotwell then and is the reason why the detection was done in a separate process in the first place.

2. Ability to use OpenCL when available on the platform using T-API in OpenCV 3.x

3. Eventually add face recognition on photos using a trained model based on faces labelled by the user - this would need a few faces to be tagged by the user before the OpenCV face recognition calls can be used (https://docs.opencv.org/2.4/modules/contrib/doc/facerec/facerec_tutorial.html).

There is also some prior work on this by the original author of facedetect: https://github.com/Sanva/facedetect

Is there anyone else working on this area? 

Thanks,

Narendra

_______________________________________________

shotwell-list mailing list

shotwell-list gnome org

https://mail.gnome.org/mailman/listinfo/shotwell-list