Coder Social home page Coder Social logo

Comments (3)

mixpc avatar mixpc commented on July 1, 2024 1

Hi,

Thank you for your time to review. Instead, I've chosen to rebuild immich from scractch, created external library and scanned new library files (machine learning, video transcoding disabled for quicker import). So this feedback basically is a new attempt.

Regarding album deletion, I note the immich bug, thank you for the link and feedback. And yes, /usr/src/app/external is the only Import Path for my external library

Server status online
Server version v1.105.1

sudo docker exec -it immich_server /bin/bash
immich login https://website.com/api apikey
root@ababababab:/usr/src/app# immich -V
2.2.0

command:

sudo docker run --rm -e API_URL="https://website.com/api/" -e API_KEY="thisistheapikey" -e ROOT_PATH="/usr/src/app/external" -e ALBUM_LEVELS=3 -e LOG_LEVEL=DEBUG salvoxia/immich-folder-album-creator:latest /script/immich_auto_album.sh

For the album, I'm run the script again with the DEBUG parameter, it's big file, 11MB. But the good thing is this time not a single error, no strange album at all, the exact 150 albums have been created. I must check that each album has the right number of photos, but I'm sure that will be ok.

time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=root_path = ['/usr/src/app/external']
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=root_url = https://website.com/api/
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=api_key = thisistheapikey
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=number_of_images_per_request = 2000
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=number_of_assets_to_fetch_per_request = 5000
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=unattended = True
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=album_levels = 3
time=2024-05-20T13:09:22.532+00:00 level=DEBUG msg=album_level_separator =
time=2024-05-20T13:09:22.532+00:00 level=INFO msg=Requesting all assets
time=2024-05-20T13:09:22.534+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:27.745+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000 HTTP/1.1" 200 6702353
time=2024-05-20T13:09:27.880+00:00 level=DEBUG msg=Received 5000 assets with chunk 1
time=2024-05-20T13:09:28.086+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:30.492+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=5000 HTTP/1.1" 200 6638550
time=2024-05-20T13:09:30.729+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:30.917+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:32.026+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=10000 HTTP/1.1" 200 6753833
time=2024-05-20T13:09:32.159+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:32.360+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:37.423+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=15000 HTTP/1.1" 200 6755903
time=2024-05-20T13:09:37.591+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:37.785+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:38.901+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=20000 HTTP/1.1" 200 6822480
time=2024-05-20T13:09:39.035+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:39.252+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:41.843+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=25000 HTTP/1.1" 200 6778459
time=2024-05-20T13:09:41.977+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:42.174+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:43.265+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=30000 HTTP/1.1" 200 6750336
time=2024-05-20T13:09:43.402+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:43.595+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:44.685+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=35000 HTTP/1.1" 200 6753376
time=2024-05-20T13:09:44.820+00:00 level=DEBUG msg=Received 5000 assets with chunk
time=2024-05-20T13:09:45.010+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:45.595+00:00 level=DEBUG msg=https://website.com:443 "GET /api/asset?take=5000&skip=40000 HTTP/1.1" 200 2925378
time=2024-05-20T13:09:45.653+00:00 level=DEBUG msg=Received 2169 assets with chunk
time=2024-05-20T13:09:45.764+00:00 level=INFO msg=42169 photos found
...
time=2024-05-20T13:09:48.090+00:00 level=INFO msg=150 albums identified
time=2024-05-20T13:09:48.091+00:00 level=INFO msg=Album list: ['aaa', '...', 'zzz']
time=2024-05-20T13:09:48.091+00:00 level=INFO msg=Listing existing albums on immich
time=2024-05-20T13:09:48.092+00:00 level=DEBUG msg=Starting new HTTPS connection (1): website.com:443
time=2024-05-20T13:09:48.149+00:00 level=DEBUG msg=https://website.com:443 "GET /api/album HTTP/1.1" 200 2
time=2024-05-20T13:09:48.151+00:00 level=INFO msg=0 existing albums identified
time=2024-05-20T13:09:48.151+00:00 level=INFO msg=Creating albums if needed
...
time=2024-05-20T13:09:58.820+00:00 level=INFO msg=150 albums created
time=2024-05-20T13:09:58.820+00:00 level=INFO msg=Adding assets to albums
...
time=2024-05-20T13:10:19.053+00:00 level=INFO msg=Done!

Why was that strange album created? Really, I can't tell. But with a new install, it works as expected and your script is wonderful :)

from immich-folder-album-creator.

Salvoxia avatar Salvoxia commented on July 1, 2024

Hi,

something is definitely off.
First for the error when trying to delete the "usr src" album: I assume that all of your images have been added to that single album?
If so, it looks you're affected by this Immich bug when trying to delete albums with a huge number of images.
A workaround would be to remove images in chunks from the album until the number of images falls below the critical threshold. This script faced a similar issue when trying to add too many images to an album at once, and it seems the Immich web UI has the same problem for deleting.

Now for the strange album itself:
I'm not yet sure what's going on there. I tried recreating your setup with that exact mount path, and the albums the script wants to create are exactly what I expect, no "usr src" in there.
What's also very strange is the leading blank in the album name

time=2024-05-19T10:40:30.098+00:00 level=INFO msg=Album list: [' usr src']

Could you please run the script again with -e LOG_LEVEL=DEBUG and post the logs here (make sure to run tag 0.5.0 or re-pull latest tag)? It will be VERY long for 42k files, but hopefully can shed some light on the reason for this strange behavior.

Also, is /usr/src/app/external the only Import Path you have set for your external library?

Best Regards,
Salvoxia

from immich-folder-album-creator.

Salvoxia avatar Salvoxia commented on July 1, 2024

Thanks for reporting back!
I would have loved to get behind whatever caused the initial problem, just to make sure it's not a systemic issue, but glad to hear it's working as expected after the reset.
Closing the issue.

from immich-folder-album-creator.

Related Issues (17)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.