armbian / mirror Goto Github PK

View Code? Open in Web Editor NEW

47.0 5.0 9.0 1.6 MB

Armbian Linux Mirrors Infrastructure

cdn mirror cache-storage cache infrastructure

mirror's People

Contributors

Stargazers

Watchers

Forkers

brolandz tystuyfzand tryweirdier armbiant cvh wangyq199 allenlile evilolaf

mirror's Issues

Apt Found No Kernel Update on 24.02 Release

Dear Armbian Developers!

Usually, with every quarterly Armbian release, there is a kernel update installable via apt for users running the stable build.

As for 24.02 release, there is no kernel update. So I decided to open a web browser and viewing the contents of armbian apt repository.

Actually, there are new kernel files on the mirror directory listing (version 6.6.16) with maybe wrong filename (23.2 instead of 24.2).

Screenshot of mirror files

It would be better to get this fixed so users can enjoy the newer kernel included with the 24.02 release.

apt update fails on Armbian 23 (focal)

Armbian 23 fails to update because focal was removed from the apt repo ¹:

Welcome to Armbian 23.02.2 Focal with Linux 5.15.93-sunxi

$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.6 LTS
Release:        20.04
Codename:       focal

$ sudo apt update
Hit:1 http://ports.ubuntu.com focal InRelease
Hit:2 http://ports.ubuntu.com focal-security InRelease
Get:3 http://ports.ubuntu.com focal-updates InRelease [114 kB]
Hit:4 https://apt.grafana.com stable InRelease
Hit:5 http://ports.ubuntu.com focal-backports InRelease
Ign:6 http://fi.mirror.armbian.de/apt focal InRelease
Err:7 http://fi.mirror.armbian.de/apt focal Release
  404  Not Found [IP: 2a01:4f9:3b:4943::2 80]
Reading package lists... Done
E: The repository 'http://apt.armbian.com focal Release' no longer has a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.

Focal is getting quite old but it will be EOL only in April 2025 ² and many of us still use it everyday. Please consider adding it back to the apt repo at least until it reaches EOL.

Intermittent build failures due to inconsistent redirects on apt.armbian.com

TL;DR: apt.armbian.com redirects to different mirrors for different requests, leading to apt update and build failures.

Not sure if this is the right place for this report, but the repo title seemed appropriate.

Over the last weeks, I've been seeing some intermittent build failures, related to failed apt updates inside the rootfs chroot. Usually it helped to just restart the build, but yesterday they were quite persistent (something like 6 out of 10 attempts failed), so I decided to investigate.

The error I get in install.log is:

E: Failed to fetch https://imola.armbian.com/apt/dists/focal/main/binary-armhf/Packages.bz2  File has unexpected size (199533 != 123546). Mirror sync in progress? [IP: 93.103.15.56 443]
   Hashes of expected file:
    - Filesize:123546 [weak]
    - SHA512:cfa454cb1bbcb61b47ca00d2b6970feaf9ab7085740b864d7e021b5a6d2f830097703c7fe86a4e591508bab6bc3fce7a8edc1484df62767cdce169b076712226
    - SHA256:65c20abb7cdf3a958056f6e6c8420b6c64d2972db8ff06a3c4ae1f839665a831
    - SHA1:12fb81cbdd36bc04236551dcee503ed42ff25d09 [weak]
    - MD5Sum:06a04d0d482b380776dc4fb5f292d5a1 [weak]
   Release file created at: Tue, 01 Feb 2022 17:25:15 +0000

I've also seen 404 errors occasionally, which I suspect are the result of the same underlying issue.

Apt seems to be configured (by default) to use apt.armbian.com, which redirects to some (local?) mirror. However, this redirect is not consistent, in that it seems to decide which mirror to use for each request separately, rather than consistently redirecting the same client (IP) to the same mirror all the time time.

This approach seems to cause a problem when the different mirrors are not completely in sync. What I saw happening, is that the InRelease file is fetched from one mirror, and then the Packages file is fetched from another mirror. If these mirrors are not exactly in sync, the checksums from the InRelease file will not match the Packages file, failing the update and thus the build.

It seems like this should be fixed by adding some stability to the redirection mechanism (i.e. when there are multiple options based on the geolocation, use a hash of the client IP or so to decide on the mirror to use?).

Running apt -oDebug::Acquire::http=1 update inside the chroot manually shows the problem clearly. Here's an exerpt, full log at https://gist.github.com/3683adddbd1dbf8dd3e2412e9cd6c034

Answer for: http://apt.armbian.com/dists/focal/InRelease
HTTP/1.1 302 FOUND^M
Server: nginx/1.18.0 (Ubuntu)^M
Date: Mon, 07 Mar 2022 21:49:00 GMT^M
Content-Type: text/html; charset=utf-8^M
Content-Length: 328^M
Connection: keep-alive^M
Location: http://xogium.performanceservers.nl/apt/dists/focal/InRelease^M

...

Answer for: http://apt.armbian.com/dists/focal/main/binary-armhf/Packages
HTTP/1.1 302 FOUND^M
Server: nginx/1.18.0 (Ubuntu)^M
Date: Mon, 07 Mar 2022 21:49:20 GMT^M
Content-Type: text/html; charset=utf-8^M
Content-Length: 340^M
Connection: keep-alive^M
Location: http://imola.armbian.com/apt/dists/focal/main/binary-armhf/Packages^M

Mirror stpete-mirror.armbian.com slow/not available

Hi, it seems that the mirror stpete-mirror.armbian.com is not more available.
Verbindung mit stpete-mirror.armbian.com:80 konnte nicht aufgebaut werden (188.227.12.37), Zeitüberschreitung aufgetreten

Query regarding mirror

can I just sync the armbian-apt (only packages)
and would that be added to the official mirror list?
Thanks
https://mirror.albony.xyz/

Getting 404 error when run compile.sh without any parameter.

https://paste.next.armbian.com/elozuqupev

Armbian Apt Package Mirror Funkfreundelandshut discontinued

The package mirror "http://mirror.funkfreundelandshut.de/armbian/apt/" is no longer avalable. Please remove it from redirection and listing.

Armbian of Orange Pi plus 2 linked to wrong software version.

All of the Armbian OS of Orange Pi plus 2 is linked to Pi plus. Is there armbian version for orange pi plus 2?? If there is it, let me know :( I spent whole weeks for trying plus Os to plus2 hardware

http://armbian.16z.eu/apt/ is not available

Failed to fetch http://armbian.lv.auroradev.org

Having the issue while attempting to install Diet Pi on and Odroid C2. See MichaIng/DietPi#5190

packages.ubuntu.com Internal Server Error

https://packages.ubuntu.com/jammy-updates/amd64/base-files/download

😞 Are there any known alternatives or mirrors?

Odroid N2(+) not in supported downloads

The Odroid N2(+) isn't in supported downloads. https://www.armbian.com/download/?device_support=Supported
Seems it's set to csc. Seems weird to me since it's one of the more popular boards. Ricardo is mentioned as maintainer.

Change in mirror URL

mirror.albony.xyz now uses the domain mirror.albony.in
Please change it accordingly.

Thanks

rsync error when syncing apt from rsync.armbian.com

When running rsync -avhr rsync://rsync.armbian.com/apt apt to sync my mirror I get the following error:

@ERROR: chroot failed
rsync error: error starting client-server protocol (code 5) at main.c(1817) [Receiver=3.2.3]

Even if I can successfully sync beta and dl from rsync.armbian.com

I sent some message on Discord but without answer I create an issue here hoping it is a better place.

invalid Host header runners.sh:211

I use Ubuntu 22. I can't start, I get error. My steps

git clone --depth=1 --branch=main https://github.com/armbian/build
cd build
./compile.sh

[🔨] #1 14.90 time="2024-01-16T09:03:15Z" level=info msg="running server on /run/buildkit/buildkitd.sock"
[🔨] ------
[🔨] ERROR: http: invalid Host header
[💥] Error 1 occurred in main shell [ at /home/a/build/lib/functions/logging/runners.sh:211
run_host_command_logged_raw() --> lib/functions/logging/runners.sh:211
run_host_command_logged() --> lib/functions/logging/runners.sh:193
docker_cli_build_dockerfile() --> lib/functions/host/docker.sh:360
do_with_logging() --> lib/functions/logging/section-logging.sh:81
cli_docker_run() --> lib/functions/cli/cli-docker.sh:54
armbian_cli_run_command() --> lib/functions/cli/utils-cli.sh:136
cli_entrypoint() --> lib/functions/cli/entrypoint.sh:176
main() --> ./compile.sh:50
]
[💥] Cleaning up [ please wait for cleanups to finish ]

$ uname -a
Linux linux 6.5.0-14-generic #14~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 20 18:15:30 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
$ docker --version 
Docker version 20.10.24, build 297e128

In my HDD I have 42 GB free. This bug looks like this.

Inconsisten sync state on some mirrors (at least netix, stpete, xogium)

I'm reporting this here in the assumption that repo is for tracking issues with the sync state of various apt.armbian.com mirrors. If this should be elsewhere, let me know.

While investigating some build failures related to failed apt updates, I noticed that some mirrors seem to be inconsistent. I originally thought this was caused by apt.armbian.com doing inconsistent redirects (which I still think is an issue, reported at armbian/dl-router#29, but not the biggest cause for these problems right now), but it seems that some mirrors are also inconsistent.

In short, it seems that at least the netix, stpete and xogium mirrors have an outdated InRelease file (dated Feb 1), while other files do seem up-to-date. To reproduce, use either of these sources.list lines:

deb http://stpete-mirror.armbian.com/apt focal main focal-utils focal-desktop
deb http://mirrors.netix.net/armbian/apt focal main focal-utils focal-desktop
deb http://xogium.performanceservers.nl/apt focal main focal-utils focal-desktop

Which produces either of these errors (depending, I think, on whether the mirror has by-hash enabled):

Err:6 https://stpete-mirror.armbian.com/apt focal/main armhf Packages
  404  Not Found [IP: 188.227.12.37 443]                   
Fetched 50.2 kB in 26s (1,903 B/s)                                                                                                                             
Reading package lists... Done                                                                                                                                  
E: Failed to fetch https://stpete-mirror.armbian.com/apt/dists/focal/main/binary-armhf/by-hash/SHA512/7df5a6040bc2fc97457a149e7901b816af1299a7441353104c3f07fe7
345dffbe154ecca08f7c12f5bf7206e06c39ad070df355c475ea6a0d65f110d6733ea8d  404  Not Found [IP: 188.227.12.37 443]
E: Failed to fetch https://stpete-mirror.armbian.com/apt/dists/focal/focal-utils/binary-armhf/by-hash/SHA512/f419d6ec3f1cd578e203dcf2dac89a8db42a9694649bc0edce
7119db12b1fe05b574b5ceeac06630b84a1f1758018d7cc219d75ced2677271dc86ec6ac2036b3  404  Not Found [IP: 188.227.12.37 443]

Err:6 http://mirrors.netix.net/armbian/apt focal/main armhf Packages
  File has unexpected size (199533 != 123546). Mirror sync in progress? [IP: 87.121.121.2 80]
  Hashes of expected file:
   - Filesize:123546 [weak]
   - SHA512:cfa454cb1bbcb61b47ca00d2b6970feaf9ab7085740b864d7e021b5a6d2f830097703c7fe86a4e591508bab6bc3fce7a8edc1484df62767cdce169b076712226
   - SHA256:65c20abb7cdf3a958056f6e6c8420b6c64d2972db8ff06a3c4ae1f839665a831
   - SHA1:12fb81cbdd36bc04236551dcee503ed42ff25d09 [weak]
   - MD5Sum:06a04d0d482b380776dc4fb5f292d5a1 [weak]
  Release file created at: Tue, 01 Feb 2022 17:25:15 +0000
E: Failed to fetch http://mirrors.netix.net/armbian/apt/dists/focal/main/binary-armhf/Packages.bz2  File has unexpected size (199533 != 123546). Mirror sync in progress? [IP: 87.121.121.2 80]

To confirm that these mirrors are indeed inconsistent, I manually downloaded some files:

$ for i in {stpete-mirror,imola}.armbian.com xogium.performanceservers.nl mirrors.netix.net/armbian; do mkdir -p $i; wget http://$i/apt/dists/focal/InRelease -O $i/InRelease; wget http://$i/apt/dists/focal/main/binary-armhf/Packages.bz2 -O $i/Packages.bz2; done
$ mv mirrors.netix.net/armbian/* mirrors.netix.net/ # Remove one extra directory level for easier scripting

Then you can see that only imola is up-to-date:

$ grep Date */InRelease
imola.armbian.com/InRelease:Date: Mon, 7 Mar 2022 09:45:17 UTC
mirrors.netix.net/InRelease:Date: Tue, 1 Feb 2022 17:25:15 UTC
stpete-mirror.armbian.com/InRelease:Date: Tue, 1 Feb 2022 17:25:15 UTC
xogium.performanceservers.nl/InRelease:Date: Tue, 1 Feb 2022 17:25:15 UTC

Looking at the MD5Sums of the Packages.bz2 files in the InRelease file also shows imola differs:

$ for f in */InRelease; do grep --max-count=1 --with-filename main/binary-armhf/Packages.bz2 "$f";done
imola.armbian.com/InRelease: f7971fdc3eeb0cf0c81b77870e447057   199533 main/binary-armhf/Packages.bz2
mirrors.netix.net/InRelease: 06a04d0d482b380776dc4fb5f292d5a1   123546 main/binary-armhf/Packages.bz2
stpete-mirror.armbian.com/InRelease: 06a04d0d482b380776dc4fb5f292d5a1   123546 main/binary-armhf/Packages.bz2
xogium.performanceservers.nl/InRelease: 06a04d0d482b380776dc4fb5f292d5a1   123546 main/binary-armhf/Packages.bz2

However, the actual files seem to all match the imola MD5sum:

md5sum */Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057  imola.armbian.com/Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057  mirrors.netix.net/Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057  stpete-mirror.armbian.com/Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057  xogium.performanceservers.nl/Packages.bz2

IOW, it seems that the Packages files have been synced correctly, but not the InRelease files (for 5 weeks now).

This causes issues for anyone using these mirrors, including when redirected to them through apt.armbian.com (as I was).

To confirm my setup is otherwise ok, I tried:

deb http://imola.armbian.com/apt focal main focal-utils focal-desktop

Which succeeds every time.

armbian / mirror Goto Github PK

mirror's People

Contributors

Stargazers

Watchers

Forkers

mirror's Issues

Footnotes

Recommend Projects

Recommend Topics

Recommend Org