Blurhash generation

[ArtificialOwl]

• needs Add kornrunner/blurhash 3rdparty#1625

Catching FilesMetadata's event and when encountering an image file, this will fill metadata with blurhash [1] which is a little string that simulate a placeholder.

Should greatly improve loading smoothness when displaying gallery of pictures

---

If you want to test:

• patch 3rdparty#1625
• upload a picture and get file id
• run the cron
• run ./occ metadata:get <file_id>
• paste the value in [1] (blurhash string)

$ php -f cron.php 
$ ./occ metadata:get 21
{
    "blurhash": {
        "value": "LTGX}Xs,|IOWV]NbjIazxFods.j@",
        "type": "string",
        "indexed": false,
        "editPermission": 0
    }
}

[1] https://blurha.sh/

[ArtificialOwl]

example:

[github-advanced-security]

Psalm found more than 10 potential problems in the proposed changes. Check the Files changed tab for more details.

[SystemKeeper]

Is it expected that running files:scan --generate-metadata --all is significantly slower with this?

Without blurhash:

Starting scan for user 1 out of 12 (admin)
Starting scan for user 2 out of 12 (alice)
Starting scan for user 3 out of 12 (bob)
Starting scan for user 4 out of 12 (jane)
Starting scan for user 5 out of 12 (john)
Starting scan for user 6 out of 12 (nextcloud-mm)
Starting scan for user 7 out of 12 (user1)
Starting scan for user 8 out of 12 (user2)
Starting scan for user 9 out of 12 (user3)
Starting scan for user 10 out of 12 (user4)
Starting scan for user 11 out of 12 (user5)
Starting scan for user 12 out of 12 (user6)
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:00     |
+---------+-------+-----+---------+---------+--------+--------------+

With blurhash:

Starting scan for user 1 out of 12 (admin)
Starting scan for user 2 out of 12 (alice)
Starting scan for user 3 out of 12 (bob)
Starting scan for user 4 out of 12 (jane)
Starting scan for user 5 out of 12 (john)
Starting scan for user 6 out of 12 (nextcloud-mm)
Starting scan for user 7 out of 12 (user1)
Starting scan for user 8 out of 12 (user2)
Starting scan for user 9 out of 12 (user3)
Starting scan for user 10 out of 12 (user4)
Starting scan for user 11 out of 12 (user5)
Starting scan for user 12 out of 12 (user6)
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:07     |
+---------+-------+-----+---------+---------+--------+--------------+

[ArtificialOwl]

Yes,

• what type of file are you testing with ?
• what is the elapsed time if you try a second time ?

[SystemKeeper]

3 times with blurhash:

+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:05     |
+---------+-------+-----+---------+---------+--------+--------------+
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:05     |
+---------+-------+-----+---------+---------+--------+--------------+
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:06     |
+---------+-------+-----+---------+---------+--------+--------------+

and three times without:

+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:00     |
+---------+-------+-----+---------+---------+--------+--------------+
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:00     |
+---------+-------+-----+---------+---------+--------+--------------+
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 32      | 19    | 0   | 0       | 0       | 0      | 00:00:00     |
+---------+-------+-----+---------+---------+--------+--------------+

Basically only the default media files from julius docker dev (see https://github.com/juliushaertl/nextcloud-docker-dev/tree/master/data/skeleton):

Starting scan for user 1 out of 12 (admin)
	Folder	/admin/
	Folder	/admin/cache
	Folder	/admin/files
	File	/admin/files/20240108_153511.gif
	File	/admin/files/Nextcloud_Server_Administration_Manual.pdf
	Folder	/admin/files/Talk
	Folder	/admin/files/Templates
	Folder	/admin/files/Media
	File	/admin/files/Media/photo-1533658925625-2f94d23fc425.jpeg
	File	/admin/files/Media/photo-1517603250781-c4eac1449a80.jpeg
	File	/admin/files/Media/photo-1532597751369-606119ceda8a.jpeg
	File	/admin/files/Media/photo-1527668441211-67a036f77ab4.jpeg
	File	/admin/files/Media/photo-1495962637988-4be9db2af01f.jpeg
	File	/admin/files/Media/Big_Buck_Bunny_1080_10s_10MB.mkv
	File	/admin/files/Media/photo-1498855592392-af2bf1e0a4c7.jpeg
	File	/admin/files/Media/photo-1503991721143-75f95ebf1e55.jpeg

...

Starting scan for user 3 out of 12 (bob)
	Folder	/bob/
	Folder	/bob/cache
	Folder	/bob/files
	File	/bob/files/Nextcloud_Server_Administration_Manual.pdf
	Folder	/bob/files/Vorlagen
	Folder	/bob/files/Talk
	Folder	/bob/files/Media
	File	/bob/files/Media/photo-1533658925625-2f94d23fc425.jpeg
	File	/bob/files/Media/photo-1517603250781-c4eac1449a80.jpeg
	File	/bob/files/Media/photo-1532597751369-606119ceda8a.jpeg
	File	/bob/files/Media/photo-1527668441211-67a036f77ab4.jpeg
	File	/bob/files/Media/photo-1495962637988-4be9db2af01f.jpeg
	File	/bob/files/Media/Big_Buck_Bunny_1080_10s_10MB.mkv
	File	/bob/files/Media/photo-1498855592392-af2bf1e0a4c7.jpeg
	File	/bob/files/Media/photo-1503991721143-75f95ebf1e55.jpeg

...