Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Face Recognition does not work on images #201

Closed
jahknem opened this issue Dec 12, 2019 · 16 comments
Closed

Face Recognition does not work on images #201

jahknem opened this issue Dec 12, 2019 · 16 comments

Comments

@jahknem
Copy link

jahknem commented Dec 12, 2019 •
edited by matiasdelellis
Loading

Hey, Thanks for reporting issues back to Nextcloud Face Recognition. Please, try to complete this report in detail so we can help you easier. 😄

Make sure you read all the documentation, and the FAQ, and that the issue has not been reported before. 😉

Expected behaviour

Adding the tick mark to face recognition should start the facial recognition process
When starting occ face:background_job faces should be recognized on the images

Actual behaviour

The facial recognition process does not start. Neither does the web interface show any reaction, nor does the cpu usage or memory usage change
Also when starting occ face:background_job no faces are recognized

Steps to reproduce

  1. Install Nextcloud
  2. Install Face Recognition Manually
  3. Set the tick mark

Server configuration

  • Operating system:
    Debian Buster

  • Pdlib version:

  • How is DLib installed: Make sure it is working correctly with this tool
    Manually with github
    Tool works.

  • How is PDlib installed: Make sure it is working correctly with this tool
    Manually with github
    Tool works.

  • PHP version:
    7.3

  • Web server:
    apache2

  • Database:
    Maria DB

  • Nextcloud version:
    17.0.1

Client configuration

  • Browser:
    Firefox
  • Operating system:
    Manjaro

Logs

Background task log with debug.

sudo -u apache php occ -vvv face:background_job 
1/10 - Executing task CheckRequirementsTask (Check all requirements)
        Found 3072 MB available to PHP.
2/10 - Executing task CheckCronTask (Check that service is started from either cron or from command)
3/10 - Executing task LockTask (Acquire lock so that only one background task can run)
4/10 - Executing task DisabledUserRemovalTask (Purge all the information of a user when disable the analysis.)
yielding
yielding
yielding
yielding
yielding
yielding
5/10 - Executing task StaleImagesRemovalTask (Crawl for stale images (either missing in filesystem or under .nomedia) and remove them from DB)
        Skipping stale images removal for user admin as there is no need for it
        Skipping stale images removal for user claudia as there is no need for it
        Skipping stale images removal for user gerald as there is no need for it
        Skipping stale images removal for user jan as there is no need for it
        Skipping stale images removal for user judith as there is no need for it
        Skipping stale images removal for user valentin as there is no need for it
6/10 - Executing task CreateClustersTask (Create new persons or update existing persons)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
yielding
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
yielding
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
yielding
        0 faces found for clustering
        0 persons found after clustering
yielding
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
yielding
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
yielding
7/10 - Executing task AddMissingImagesTask (Crawl for missing images for each user and insert them in DB)
        Skipping image scan for user admin that has disabled the analysis
        Skipping image scan for user claudia that has disabled the analysis
        Skipping image scan for user gerald that has disabled the analysis
        Skipping full image scan for user jan
        Skipping image scan for user judith that has disabled the analysis
        Skipping image scan for user valentin that has disabled the analysis
8/10 - Executing task EnumerateImagesMissingFacesTask (Find all images which don't have faces generated for them)
yielding
9/10 - Executing task ImageProcessingTask (Process all images to extract faces)
        NOTE: Starting face recognition. If you experience random crashes after this point, please look FAQ at https://github.com/matiasdelellis/facerecognition/wiki/FAQ
10/10 - Executing task UnlockTask (Release obtained lock)

Web server error log

Web server error log 
[Thu Dec 12 06:06:00.398295 2019] [ssl:warn] [pid 351] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 06:06:00.398551 2019] [ssl:warn] [pid 351] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 06:06:00.398662 2019] [mpm_prefork:notice] [pid 351] AH00163: Apache/2.4.25 (Debian) OpenSSL/1.0.2t configured -- resuming normal operations
[Thu Dec 12 06:06:00.398672 2019] [core:notice] [pid 351] AH00094: Command line: '/usr/sbin/apache2'
[Thu Dec 12 09:54:52.586114 2019] [mpm_prefork:notice] [pid 351] AH00169: caught SIGTERM, shutting down
[Thu Dec 12 14:05:43.253841 2019] [ssl:warn] [pid 323] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:05:43.254116 2019] [ssl:warn] [pid 323] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:05:43.339246 2019] [ssl:warn] [pid 346] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:05:43.339513 2019] [ssl:warn] [pid 346] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:05:43.343208 2019] [mpm_prefork:notice] [pid 346] AH00163: Apache/2.4.25 (Debian) OpenSSL/1.0.2t configured -- resuming normal operations
[Thu Dec 12 14:05:43.343241 2019] [core:notice] [pid 346] AH00094: Command line: '/usr/sbin/apache2'
[Thu Dec 12 14:12:59.508388 2019] [mpm_prefork:notice] [pid 346] AH00169: caught SIGTERM, shutting down
[Thu Dec 12 14:13:23.976688 2019] [ssl:warn] [pid 21328] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:13:23.977679 2019] [ssl:warn] [pid 21328] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:13:24.007287 2019] [ssl:warn] [pid 21329] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:13:24.007631 2019] [ssl:warn] [pid 21329] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:13:24.010147 2019] [mpm_prefork:notice] [pid 21329] AH00163: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Thu Dec 12 14:13:24.010179 2019] [core:notice] [pid 21329] AH00094: Command line: '/usr/sbin/apache2'
[Thu Dec 12 14:15:43.125889 2019] [mpm_prefork:notice] [pid 21329] AH00169: caught SIGTERM, shutting down
[Thu Dec 12 14:15:43.170922 2019] [ssl:warn] [pid 24423] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:15:43.171261 2019] [ssl:warn] [pid 24423] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:15:43.198678 2019] [ssl:warn] [pid 24424] AH01909: localhost:443:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:15:43.199026 2019] [ssl:warn] [pid 24424] AH01909: localhost:12322:0 server certificate does NOT include an ID which matches the server name
[Thu Dec 12 14:15:43.201840 2019] [mpm_prefork:notice] [pid 24424] AH00163: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations
[Thu Dec 12 14:15:43.201877 2019] [core:notice] [pid 24424] AH00094: Command line: '/usr/sbin/apache2'

Nextcloud log (data/nextcloud.log)

Nextcloud log 
As the log is far too large (25.6MB)
I've added the last lines here:
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/Partition.v12.0\/EASEUS Partition Master 12.0 Technican Edition Portable\/App\/DefaultData\/Languages\/English\/helptool_home.png): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/IMG_20190125_141745.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/IMG-20150319-WA0006.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/Huawei P9\/Internal\/WhatsApp\/Media\/WhatsApp Images\/IMG-20170722-WA0005.jpeg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/IMAG1271.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/MATLAB R2017a\/MATLAB R2017a\/help\/install\/csh\/b_next_zh_CN.gif): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/0300026f.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/Alte_Cloud\/Quellen\/Websites\/Definition \u00bb Stadtplanung \u00ab _ Gabler Wirtschaftslexikon-Dateien\/def_keyword.gif): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/IMG-20140926-WA0009.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/Alte_Cloud\/IHK\/Abschlu\u00dfpr\u00fcfungen\/Sommer 2011\/AP_SE_S11\/GA2\/03.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/IMG-20160104-WA0005.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/Huawei P9\/Internal\/MagazineUnlock\/magazine-unlock-01-2.3.773-_3273e8cbe5e74b6286b71f08888d5b5a.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Bilder\/Google\/030000fe.jpg): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:09:59+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:10:00+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"file_get_contents(\/var\/www\/nextcloud\/data\/jan\/files\/var\/www\/nextcloud\/data\/jan\/files\/Dokumente\/Alte_Cloud\/Fotos\/9. Klasse\/Grillen_2010\/P1080903.JPG): failed to open stream: No such file or directory at \/var\/www\/nextcloud\/lib\/private\/Files\/Storage\/Local.php#217","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:10:00+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"imagecreatefromstring(): Empty string or invalid image at \/var\/www\/nextcloud\/lib\/private\/legacy\/image.php#622","userAgent":"--","version":"17.0.1.1"}
{"reqId":"oGhx2E3Fq23wcWC6sfRn","level":3,"time":"2019-12-12T15:10:00+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"You are using a fallback implementation of the intl extension. Installing the native one is highly recommended instead. at \/var\/www\/nextcloud\/3rdparty\/patchwork\/utf8\/src\/Patchwork\/Utf8\/Bootup\/intl.php#18","userAgent":"--","version":"17.0.1.1"}
{"reqId":"SpWktWgry5lwVHhdjd0S","level":3,"time":"2019-12-12T18:37:49+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"You are using a fallback implementation of the intl extension. Installing the native one is highly recommended instead. at \/var\/www\/nextcloud\/3rdparty\/patchwork\/utf8\/src\/Patchwork\/Utf8\/Bootup\/intl.php#18","userAgent":"--","version":"17.0.1.1"}
{"reqId":"DS4atk8nVeFKHCpst8Ni","level":3,"time":"2019-12-12T20:03:34+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"You are using a fallback implementation of the intl extension. Installing the native one is highly recommended instead. at \/var\/www\/nextcloud\/3rdparty\/patchwork\/utf8\/src\/Patchwork\/Utf8\/Bootup\/intl.php#18","userAgent":"--","version":"17.0.1.1"}
{"reqId":"s5RTgotaAJL0gk3LUUxE","level":3,"time":"2019-12-12T20:18:33+00:00","remoteAddr":"","user":"--","app":"PHP","method":"","url":"--","message":"You are using a fallback implementation of the intl extension. Installing the native one is highly recommended instead. at \/var\/www\/nextcloud\/3rdparty\/patchwork\/utf8\/src\/Patchwork\/Utf8\/Bootup\/intl.php#18","userAgent":"--","version":"17.0.1.1"}

Browser log

Browser log 
Insert your browser log here, this could for example include:

a) The javascript console log
b) The network log
c) ...
@jahknem
Copy link
Author

jahknem commented Dec 12, 2019

Addendum: I have now reinstalled the nextcloud app in the app interface and activated face recognition in the interface for the admin account. When manually starting the background task 10 faces were recognized on the nextcloud community jpg. However these faces are not shown in the web interface. The web interface still shows that the analysis is disabled, even though the tick mark is set.

        Processing image /var/www/nextcloud/data/admin/files/Photos/Nextcloud Community.jpg
        Image scaled from 3000x2000 to 1881x1254 (since max image area is 2359296 pixels^2)
        Faces found: 10
yielding

@matiasdelellis
Copy link
Owner

Hi @jahknem

Thank you very much for reporting .. 😄

And thank you very much for using the template .. You almost deserve a prize because you're the first. 😅 🎉

Seeing the log of the command, it seems that the user Jan finished. I understand whit you report that it always finish without analyzing any images. No?

Can you check the oc_facerecog_images table that has data and none have an error?.

You can try to reset the user using the occ face:reset_all -u jan command and try again.

@matiasdelellis
Copy link
Owner

Woo @jahknem

Addendum: I have now reinstalled the nextcloud app in the app interface and activated face recognition in the interface for the admin account. When manually starting the background task 10 faces were recognized on the nextcloud community jpg. However these faces are not shown in the web interface.

The command expects to gather 100 faces before clustering them into 'Persons' This is to ensure the stability of the clusters/persons.

The web interface still shows that the analysis is disabled, even though the tick mark is set.

This seems like a bug. I didn't check it, but to make sure, can you show me a screenshot? 😞

@jahknem
Copy link
Author

jahknem commented Dec 13, 2019 •
edited
Loading

Hi @matiasdelellis thanks for the fast answer!
Yes, when analysing images of user jan it does not analyse any images. I have reset the user jan and tried again for two times, each time with a different output:
First run (output too large, I will attach the problematic part)

        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Sommer 2015/AP_SE_S15/GA1/09.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG-20150830-WA0002.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/03000136.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG-20150814-WA0000.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Partition.v12.0/EASEUS Partition Master 12.0 Technican Edition Portable/App/E
aseUS/share/themes/Epm/gtk-2.0/icons/35x35-undo-last-change-normal.png
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Huawei P9/Internal/MagazineUnlock/magazine-unlock-01-2.3.920-_f52ab714b121487
e9bca003e79fb8c32.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG_20170828_110849.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Abschlu_pr_fungen/Winter 2013/AP_SE_W13/GA2/01.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG_20170916_200740.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMAG0821.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG-20160925-WA0007.jpeg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Abschlu_pr_fungen/Sommer 2013/AP_FIAE_S13/Wiso/03.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Huawei P9/Internal/WhatsApp/Media/WhatsApp Images/IMG-20180322-WA0001.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/030003cf.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Abschlu_pr_fungen/Winter 2012/AP_SE_W12/Wiso/09.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG-20180731-WA0005.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Sommer 2013/AP_FIAE_S13/GA1/11.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG-20170109-WA0006.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG_20180916_153647.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/03000540.jpg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Bilder/Google/IMG-20171222-WA0036.jpeg
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Partition.v12.0/EASEUS Partition Master 12.0 Technican Edition Portable/App/E
aseUS/share/themes/Epm/gtk-2.0/icons/35x35-resizemove-image.png
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Partition.v12.0/EASEUS Partition Master 12.0 Technican Edition Portable/App/D
efaultData/Languages/French/tip.png
        Faces found: 0. Image will be skipped because of the following error: Image is not valid, probably cannot be loaded
        Processing image /var/www/nextcloud/data/admin/files/Photos/Hummingbird.jpg
Killed

Second run after reset:

root@Nextcloud ~# sudo -u www-data php /var/www/nextcloud/occ face:background_job
1/10 - Executing task CheckRequirementsTask (Check all requirements)
2/10 - Executing task CheckCronTask (Check that service is started from either cron or from command)
3/10 - Executing task LockTask (Acquire lock so that only one background task can run)
4/10 - Executing task DisabledUserRemovalTask (Purge all the information of a user when disable the analysis.)
5/10 - Executing task StaleImagesRemovalTask (Crawl for stale images (either missing in filesystem or under .nomedia) and remove them from DB)
6/10 - Executing task CreateClustersTask (Create new persons or update existing persons)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 5),
        * or you need to have 95% of you images processed (you have 0.00%)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
        0 faces found for clustering
        0 persons found after clustering
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
7/10 - Executing task AddMissingImagesTask (Crawl for missing images for each user and insert them in DB)
        Skipping image scan for user claudia that has disabled the analysis
        Skipping image scan for user gerald that has disabled the analysis
        Skipping image scan for user judith that has disabled the analysis
        Skipping image scan for user valentin that has disabled the analysis
8/10 - Executing task EnumerateImagesMissingFacesTask (Find all images which don't have faces generated for them)
9/10 - Executing task ImageProcessingTask (Process all images to extract faces)
        NOTE: Starting face recognition. If you experience random crashes after this point, please look FAQ at https://github.com/matiasdelellis/f
acerecognition/wiki/FAQ
        Processing image /var/www/nextcloud/data/jan/files/Dokumente/Huawei P9/Internal/WhatsApp/Media/WhatsApp Images/IMG-20180214-WA0012.jpeg
An unhandled exception has been thrown:
Error: Call to a member function file_get_contents() on null in /var/www/nextcloud/lib/private/Files/Filesystem.php:711
Stack trace:
#0 /var/www/nextcloud/lib/private/legacy/image.php(622): OC\Files\Filesystem::file_get_contents('/var/www/nextcl...')
#1 /var/www/nextcloud/apps/facerecognition/lib/BackgroundJob/Tasks/ImageProcessingTask.php(249): OC_Image->loadFromFile('/var/www/nextcl...')
#2 /var/www/nextcloud/apps/facerecognition/lib/BackgroundJob/Tasks/ImageProcessingTask.php(217): OCA\FaceRecognition\BackgroundJob\Tasks\ImageProc
essingTask->prepareImage('/var/www/nextcl...')
#3 /var/www/nextcloud/apps/facerecognition/lib/BackgroundJob/Tasks/ImageProcessingTask.php(167): OCA\FaceRecognition\BackgroundJob\Tasks\ImageProc
essingTask->findFaces(Object(CnnFaceDetection), '/var/www/nextcl...', Object(OCA\FaceRecognition\Db\Image))
#4 /var/www/nextcloud/apps/facerecognition/lib/BackgroundJob/BackgroundService.php(120): OCA\FaceRecognition\BackgroundJob\Tasks\ImageProcessingTa
sk->execute(Object(OCA\FaceRecognition\BackgroundJob\FaceRecognitionContext))
#5 /var/www/nextcloud/apps/facerecognition/lib/Command/BackgroundCommand.php(138): OCA\FaceRecognition\BackgroundJob\BackgroundService->execute(0,
 false, NULL, NULL)
#6 /var/www/nextcloud/3rdparty/symfony/console/Command/Command.php(255): OCA\FaceRecognition\Command\BackgroundCommand->execute(Object(Symfony\Com
ponent\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#7 /var/www/nextcloud/3rdparty/symfony/console/Application.php(908): Symfony\Component\Console\Command\Command->run(Object(Symfony\Component\Conso
le\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#8 /var/www/nextcloud/3rdparty/symfony/console/Application.php(269): Symfony\Component\Console\Application->doRunCommand(Object(OCA\FaceRecognitio
n\Command\BackgroundCommand), Object(Symfony\Component\Console\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#9 /var/www/nextcloud/3rdparty/symfony/console/Application.php(145): Symfony\Component\Console\Application->doRun(Object(Symfony\Component\Console
\Input\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#10 /var/www/nextcloud/lib/private/Console/Application.php(213): Symfony\Component\Console\Application->run(Object(Symfony\Component\Console\Input
\ArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#11 /var/www/nextcloud/console.php(97): OC\Console\Application->run()
#12 /var/www/nextcloud/occ(11): require_once('/var/www/nextcl...')

Sadly I do not know where to find the oc_facerecog_images table, could you tell me?

If I'm correct it all seems to hinge on the fact that the pictures of user jan are not valid. All images of user admin seem to be valid, but admin does not have enough images for clusters

I've attached a link to the screenshot of the website:
https://nextcloud.kuehnemund.io/index.php/s/B5LBHfcD4P3Ynwc

@matiasdelellis
Copy link
Owner

matiasdelellis commented Dec 13, 2019 •
edited
Loading

Hi @jahknem
Can you make sure these files exist? Are all the files inside a local storage? Without encryption?

  • /var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Sommer 2015/AP_SE_S15/GA1/09.jpg

In the first files the background_job try to open it, but they don't seem to be valid. You may require a simple update of a library (e.g: ), but to make sure, you can send me privately a couple of files of those that fail. Whatever fails and does not affect your privacy .. 😉 mati86dl at gmail com

  • /var/www/nextcloud/data/jan/files/Dokumente/Huawei P9/Internal/WhatsApp/Media/WhatsApp Images/IMG-20180214-WA0012.jpeg

This last image cannot read the file directly. Exists on your hard drive? -Those are absolute paths on the disk.-

Sadly I do not know where to find the oc_facerecog_images table, could you tell me?

My recommendation is to use adminer, but if you do not know about databases, do not worry. It was to verify just the errors of files, which you can already see after resetting the user. 😉

@jahknem
Copy link
Author

jahknem commented Dec 13, 2019 •
edited
Loading

Hi @matiasdelellis
The files do exist. I have tested that specific file with ls -l "/var/www/nextcloud/data/jan/files/Dokumente/Alte_Cloud/IHK/Sommer 2015/AP_SE_S15/GA1/09.jpg".
However I have enabled encryption on the nextcloud server.. I did not know that that was a problem :( Can the program work with encryption or do I have to find a way to undo the encryption?

The table does exist:
Part of the output:

| 59444 | jan   | 133367 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59445 | jan   | 133361 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59446 | jan   | 133391 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59447 | jan   | 133397 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59448 | jan   | 133403 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59449 | jan   | 133409 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59450 | jan   | 497213 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59451 | jan   | 497195 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59452 | jan   | 497207 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59453 | jan   | 497189 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59454 | jan   | 497200 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59455 | jan   | 497369 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59456 | jan   | 624925 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59457 | jan   | 624931 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59458 | jan   | 624919 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59459 | jan   | 693063 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59460 | jan   | 693057 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59461 | jan   | 693270 |     1 |            1 | Image is not valid, probably cannot be loaded | 2019-12-13 07:18:49 |                   0 |
| 59462 | jan   | 693294 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59463 | jan   | 693275 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59464 | jan   | 693282 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59465 | jan   | 693300 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59466 | jan   | 693288 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59467 | jan   | 696790 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59468 | jan   | 696802 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59469 | jan   | 696796 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59470 | jan   | 696784 |     1 |            1 | Image is not valid, probably cannot be loaded | 2019-12-13 07:18:17 |                   0 |
| 59471 | jan   | 190591 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59472 | jan   | 190722 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59473 | jan   | 190726 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59474 | jan   | 190885 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59475 | jan   | 190881 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59476 | jan   | 191032 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59477 | jan   | 191028 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59478 | jan   | 192431 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59479 | jan   | 192425 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59480 | jan   | 192423 |     1 |            1 | Image is not valid, probably cannot be loaded | 2019-12-13 07:19:44 |                   0 |
| 59481 | jan   | 192435 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59482 | jan   | 192443 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59483 | jan   | 192441 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59484 | jan   | 192442 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59485 | jan   | 192455 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59486 | jan   | 192454 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59487 | jan   | 192451 |     1 |            1 | Image is not valid, probably cannot be loaded | 2019-12-13 07:18:13 |                   0 |
| 59488 | jan   | 192453 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59489 | jan   | 192465 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59490 | jan   | 192466 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59491 | jan   | 192467 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59492 | jan   | 192463 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59493 | jan   | 192479 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59494 | jan   | 192476 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59495 | jan   | 192478 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59496 | jan   | 192477 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59497 | jan   | 192487 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59498 | jan   | 193511 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59499 | jan   | 193512 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59500 | jan   | 193517 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59501 | jan   | 193522 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59502 | jan   | 193523 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59503 | jan   | 193627 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59504 | jan   | 193631 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59505 | jan   | 193641 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59506 | jan   | 193639 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59507 | jan   | 193642 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59508 | jan   | 193644 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59509 | jan   | 193645 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59510 | jan   | 193648 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59511 | jan   | 193656 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59512 | jan   | 193662 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59513 | jan   | 193659 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59514 | jan   | 193661 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59515 | jan   | 193663 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59516 | jan   | 193668 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59517 | jan   | 193678 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59518 | jan   | 194876 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59519 | jan   | 194877 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59520 | jan   | 194875 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59521 | jan   | 194882 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59522 | jan   | 194892 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59523 | jan   | 194895 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59524 | jan   | 194894 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59525 | jan   | 195040 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59526 | jan   | 195042 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59527 | jan   | 195043 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59528 | jan   | 195044 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59529 | jan   | 195061 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59530 | jan   | 195059 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59531 | jan   | 195060 |     1 |            0 | NULL                                          | NULL                |                NULL |
| 59532 | jan   | 713490 |     1 |            0 | NULL                                          | NULL                |                NULL |
+-------+-------+--------+-------+--------------+-----------------------------------------------+---------------------+---------------------+
18627 rows in set (0.16 sec)

@matiasdelellis
Copy link
Owner

Ohh..

However I have enabled encryption on the nextcloud server..

Unfortunately, we do not support encrypted files. 😞
The problem is that we read the files directly from the disk due PDlib needed access to them.

Well,
You install the application from git?.
Although it was not the original intention, we may have support for encrypted files in the shared-storage-experiments branch.

You want to try this branch? I never tried it for it, but this prevents direct access to the files. Maybe we are lucky.. 😄 If not, you will have to decrypt the files .. 😥

@jahknem
Copy link
Author

jahknem commented Dec 13, 2019

In that case I'll first try that branch. Should I after checking out to that branch just use the app as usual?

@matiasdelellis
Copy link
Owner

matiasdelellis commented Dec 13, 2019 •
edited
Loading

If you already installed it from git, just move to the branch and it should work exactly the same

Just git checkout shared-storage-experiments

EDIT: ..and you will have to reset the user again before executing the task. 😉

@jahknem
Copy link
Author

jahknem commented Dec 13, 2019 •
edited
Loading

Interesting: It now does process the images! It fails at the first image but it does seem to be able to read the images. I'm currently sending you the image at which it fails

root@Nextcloud ~# sudo -u www-data php /var/www/nextcloud/occ face:background_job
1/10 - Executing task CheckRequirementsTask (Check all requirements)
2/10 - Executing task CheckCronTask (Check that service is started from either cron or from command)
3/10 - Executing task LockTask (Acquire lock so that only one background task can run)
4/10 - Executing task DisabledUserRemovalTask (Purge all the information of a user when disable the analysis.)
5/10 - Executing task StaleImagesRemovalTask (Crawl for stale images (either missing in filesystem or under .nomedia) and remove them from DB)
6/10 - Executing task CreateClustersTask (Create new persons or update existing persons)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 5),
        * or you need to have 95% of you images processed (you have 0.00%)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
        0 faces found for clustering
        0 persons found after clustering
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
        Skipping cluster creation, not enough data (yet) collected. For cluster creation, you need either one of the following:
        * have 1000 faces already processed (you have 0),
        * have 100 images (you have 0),
        * or you need to have 95% of you images processed (you have 0.00%)
7/10 - Executing task AddMissingImagesTask (Crawl for missing images for each user and insert them in DB)
        Skipping image scan for user claudia that has disabled the analysis
        Skipping image scan for user gerald that has disabled the analysis
        Skipping image scan for user judith that has disabled the analysis
        Skipping image scan for user valentin that has disabled the analysis
8/10 - Executing task EnumerateImagesMissingFacesTask (Find all images which don't have faces generated for them)
9/10 - Executing task ImageProcessingTask (Process all images to extract faces)
        NOTE: Starting face recognition. If you experience random crashes after this point, please look FAQ at https://github.com/matiasdelellis/f
acerecognition/wiki/FAQ
        Processing image /tmp/oc_tmp_2X7upo
Killed

@matiasdelellis
Copy link
Owner

First try to reduce the assigned memory..

Killed 99% of the time the process was killed by the kernel or by php, because you exceeded the physical memory or the one configured by php-fpm

@jahknem
Copy link
Author

jahknem commented Dec 13, 2019

First try to reduce the assigned memory..

Killed 99% of the time the process was killed by the kernel or by php, because you exceeded the physical memory or the one configured by php-fpm

I've now changed the memory limit in /etc/php/7.3/apache2/php.ini as well as /etc/php/7.3/cli/php.ini
However I only found an fpm folder in /etc/php/7.0 which does not have a php.ini file :/

@matiasdelellis
Copy link
Owner

I've now changed the memory limit in /etc/php/7.3/apache2/php.ini as well as /etc/php/7.3/cli/php.ini

Great.

However I only found an fpm folder in /etc/php/7.0 which does not have a php.ini file :/

Don't worry, I assumed you used that, but it probably isn't.. With the previous two it's fine. 😉

But be sure to reduce the memory limit in the administration panel of our application. With 1 or 2 GB is more than enough. 😉

@matiasdelellis
Copy link
Owner

matiasdelellis commented Dec 13, 2019 •
edited
Loading

imagen

You have to log in with the administrator account .. No jam.. 😉

@jahknem
Copy link
Author

jahknem commented Dec 13, 2019

It seems like that has finally solved the problem. Also I have to get new glasses for not seeing the configuration options!
I think that would also be a good addition to the wiki: When using encryption, using the shared-storage branch :)
Thanks a lot for your patience!! Do you take tips?

@jahknem jahknem closed this as completed Dec 13, 2019
@matiasdelellis matiasdelellis mentioned this issue Dec 17, 2019
Merged
@matiasdelellis
Copy link
Owner

imagen
Just upload it here to document on wiki.. 😉

matiasdelellis added a commit that referenced this issue Dec 18, 2019
@matiasdelellis
Merge pull request #198 from matiasdelellis/shared-storage-experiments
99e2ad0 
This branch ended up being the introduction of a FileService, to simplify a lot of code.
The support of shared files is quite proven, but will remain experimental, hidden to admin/users.. Note that also automatically gain support of encrypted files. (See issue #201 ) grimacing
This was referenced Dec 20, 2019
Merged
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@matiasdelellis @jahknem