Re: [Shotwell] Adding face recognition to shotwell

[Andreas Brauchli <a brauchli elementarea net>]

Hi Narendra,

On Mon, 2018-07-16 at 15:28 +0000, Narendra Acharya via shotwell-list
wrote:
> Hi,
>
> As mentioned in my recent posts, I am working on better integration
> of face detection (via DBus) and add face recognition as the next
> step. The DBus connection cleanup is mostly done in my
> fork: https://gitlab.gnome.org/nma83/shotwell/commits/wip/faces.
Thanks, looking forward to it.

> In order to get to face recognition, I would like to use the OpenFace
> method described here: https://cmusatyalab.github.io/openface/
> It involves running the extracted face image (already available from
> detection) through a DNN to get a 128 element vector which supposedly
> represents the face. This vector needs to be stored (say in
> FaceTable) per face. Face recognition can be performed by
> transforming the face to be recognized to a similar vector and
> correlating via dot-product with each stored face's vector. The one
> with the highest dot product is the most likely match.
> To do this, a DNN model is needed which is open-source under Apache
> 2.0. 
> https://storage.cmusatyalab.org/openface-models/nn4.small2.v1.t7t7 -
> 31MB size
> How could we add this model as part of the shotwell package? Or
> create another package which can be an optional dependency.
Since you're using DBus, the application coupling is very low already,
so it sounds like the better approach is indeed to provide a standalone
face-recognition service. This could then also be used by other apps
wishing to connect to it (say, gnome photos).

As such, you'd bundle it separately. Shotwell should then only need the
code to interface with the DBus service: detect if it's available,
maybe start it if necessary and send photo-handles to run the
recognition on.

Maybe you can even Flatpak your bundle and have it export the DBus
service. That would make it quite easy to deploy.

> Thanks,
> Narendra
Cheers,
Andreas

> _______________________________________________
> shotwell-list mailing list
> shotwell-list gnome org
> https://mail.gnome.org/mailman/listinfo/shotwell-list