armbian / mirror Goto Github PK
View Code? Open in Web Editor NEWArmbian Linux Mirrors Infrastructure
Armbian Linux Mirrors Infrastructure
Dear Armbian Developers!
Usually, with every quarterly Armbian release, there is a kernel update installable via apt for users running the stable build.
As for 24.02 release, there is no kernel update. So I decided to open a web browser and viewing the contents of armbian apt repository.
Actually, there are new kernel files on the mirror directory listing (version 6.6.16) with maybe wrong filename (23.2 instead of 24.2).
It would be better to get this fixed so users can enjoy the newer kernel included with the 24.02 release.
Armbian 23 fails to update because focal was removed from the apt repo 1:
Welcome to Armbian 23.02.2 Focal with Linux 5.15.93-sunxi
$ lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 20.04.6 LTS
Release: 20.04
Codename: focal
$ sudo apt update
Hit:1 http://ports.ubuntu.com focal InRelease
Hit:2 http://ports.ubuntu.com focal-security InRelease
Get:3 http://ports.ubuntu.com focal-updates InRelease [114 kB]
Hit:4 https://apt.grafana.com stable InRelease
Hit:5 http://ports.ubuntu.com focal-backports InRelease
Ign:6 http://fi.mirror.armbian.de/apt focal InRelease
Err:7 http://fi.mirror.armbian.de/apt focal Release
404 Not Found [IP: 2a01:4f9:3b:4943::2 80]
Reading package lists... Done
E: The repository 'http://apt.armbian.com focal Release' no longer has a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
Focal is getting quite old but it will be EOL only in April 2025 2 and many of us still use it everyday. Please consider adding it back to the apt repo at least until it reaches EOL.
TL;DR: apt.armbian.com redirects to different mirrors for different requests, leading to apt update and build failures.
Not sure if this is the right place for this report, but the repo title seemed appropriate.
Over the last weeks, I've been seeing some intermittent build failures, related to failed apt updates inside the rootfs chroot. Usually it helped to just restart the build, but yesterday they were quite persistent (something like 6 out of 10 attempts failed), so I decided to investigate.
The error I get in install.log
is:
E: Failed to fetch https://imola.armbian.com/apt/dists/focal/main/binary-armhf/Packages.bz2 File has unexpected size (199533 != 123546). Mirror sync in progress? [IP: 93.103.15.56 443]
Hashes of expected file:
- Filesize:123546 [weak]
- SHA512:cfa454cb1bbcb61b47ca00d2b6970feaf9ab7085740b864d7e021b5a6d2f830097703c7fe86a4e591508bab6bc3fce7a8edc1484df62767cdce169b076712226
- SHA256:65c20abb7cdf3a958056f6e6c8420b6c64d2972db8ff06a3c4ae1f839665a831
- SHA1:12fb81cbdd36bc04236551dcee503ed42ff25d09 [weak]
- MD5Sum:06a04d0d482b380776dc4fb5f292d5a1 [weak]
Release file created at: Tue, 01 Feb 2022 17:25:15 +0000
I've also seen 404 errors occasionally, which I suspect are the result of the same underlying issue.
Apt seems to be configured (by default) to use apt.armbian.com, which redirects to some (local?) mirror. However, this redirect is not consistent, in that it seems to decide which mirror to use for each request separately, rather than consistently redirecting the same client (IP) to the same mirror all the time time.
This approach seems to cause a problem when the different mirrors are not completely in sync. What I saw happening, is that the InRelease file is fetched from one mirror, and then the Packages file is fetched from another mirror. If these mirrors are not exactly in sync, the checksums from the InRelease file will not match the Packages file, failing the update and thus the build.
It seems like this should be fixed by adding some stability to the redirection mechanism (i.e. when there are multiple options based on the geolocation, use a hash of the client IP or so to decide on the mirror to use?).
Running apt -oDebug::Acquire::http=1 update
inside the chroot manually shows the problem clearly. Here's an exerpt, full log at https://gist.github.com/3683adddbd1dbf8dd3e2412e9cd6c034
Answer for: http://apt.armbian.com/dists/focal/InRelease
HTTP/1.1 302 FOUND^M
Server: nginx/1.18.0 (Ubuntu)^M
Date: Mon, 07 Mar 2022 21:49:00 GMT^M
Content-Type: text/html; charset=utf-8^M
Content-Length: 328^M
Connection: keep-alive^M
Location: http://xogium.performanceservers.nl/apt/dists/focal/InRelease^M
...
Answer for: http://apt.armbian.com/dists/focal/main/binary-armhf/Packages
HTTP/1.1 302 FOUND^M
Server: nginx/1.18.0 (Ubuntu)^M
Date: Mon, 07 Mar 2022 21:49:20 GMT^M
Content-Type: text/html; charset=utf-8^M
Content-Length: 340^M
Connection: keep-alive^M
Location: http://imola.armbian.com/apt/dists/focal/main/binary-armhf/Packages^M
Hi, it seems that the mirror stpete-mirror.armbian.com is not more available.
Verbindung mit stpete-mirror.armbian.com:80 konnte nicht aufgebaut werden (188.227.12.37), Zeitüberschreitung aufgetreten
can I just sync the armbian-apt (only packages)
and would that be added to the official mirror list?
Thanks
https://mirror.albony.xyz/
The package mirror "http://mirror.funkfreundelandshut.de/armbian/apt/" is no longer avalable. Please remove it from redirection and listing.
All of the Armbian OS of Orange Pi plus 2 is linked to Pi plus. Is there armbian version for orange pi plus 2?? If there is it, let me know :( I spent whole weeks for trying plus Os to plus2 hardware
Having the issue while attempting to install Diet Pi on and Odroid C2. See MichaIng/DietPi#5190
https://packages.ubuntu.com/jammy-updates/amd64/base-files/download
😞 Are there any known alternatives or mirrors?
The Odroid N2(+) isn't in supported downloads. https://www.armbian.com/download/?device_support=Supported
Seems it's set to csc. Seems weird to me since it's one of the more popular boards. Ricardo is mentioned as maintainer.
mirror.albony.xyz
now uses the domain mirror.albony.in
Please change it accordingly.
Thanks
When running rsync -avhr rsync://rsync.armbian.com/apt apt
to sync my mirror I get the following error:
@ERROR: chroot failed
rsync error: error starting client-server protocol (code 5) at main.c(1817) [Receiver=3.2.3]
Even if I can successfully sync beta and dl from rsync.armbian.com
I sent some message on Discord but without answer I create an issue here hoping it is a better place.
I use Ubuntu 22. I can't start, I get error. My steps
git clone --depth=1 --branch=main https://github.com/armbian/build
cd build
./compile.sh
[🔨] #1 14.90 time="2024-01-16T09:03:15Z" level=info msg="running server on /run/buildkit/buildkitd.sock"
[🔨] ------
[🔨] ERROR: http: invalid Host header
[💥] Error 1 occurred in main shell [ at /home/a/build/lib/functions/logging/runners.sh:211
run_host_command_logged_raw() --> lib/functions/logging/runners.sh:211
run_host_command_logged() --> lib/functions/logging/runners.sh:193
docker_cli_build_dockerfile() --> lib/functions/host/docker.sh:360
do_with_logging() --> lib/functions/logging/section-logging.sh:81
cli_docker_run() --> lib/functions/cli/cli-docker.sh:54
armbian_cli_run_command() --> lib/functions/cli/utils-cli.sh:136
cli_entrypoint() --> lib/functions/cli/entrypoint.sh:176
main() --> ./compile.sh:50
]
[💥] Cleaning up [ please wait for cleanups to finish ]
$ uname -a
Linux linux 6.5.0-14-generic #14~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Mon Nov 20 18:15:30 UTC 2 x86_64 x86_64 x86_64 GNU/Linux
$ docker --version
Docker version 20.10.24, build 297e128
In my HDD I have 42 GB free. This bug looks like this.
I'm reporting this here in the assumption that repo is for tracking issues with the sync state of various apt.armbian.com mirrors. If this should be elsewhere, let me know.
While investigating some build failures related to failed apt updates, I noticed that some mirrors seem to be inconsistent. I originally thought this was caused by apt.armbian.com doing inconsistent redirects (which I still think is an issue, reported at armbian/dl-router#29, but not the biggest cause for these problems right now), but it seems that some mirrors are also inconsistent.
In short, it seems that at least the netix, stpete and xogium mirrors have an outdated InRelease file (dated Feb 1), while other files do seem up-to-date. To reproduce, use either of these sources.list lines:
deb http://stpete-mirror.armbian.com/apt focal main focal-utils focal-desktop
deb http://mirrors.netix.net/armbian/apt focal main focal-utils focal-desktop
deb http://xogium.performanceservers.nl/apt focal main focal-utils focal-desktop
Which produces either of these errors (depending, I think, on whether the mirror has by-hash enabled):
Err:6 https://stpete-mirror.armbian.com/apt focal/main armhf Packages
404 Not Found [IP: 188.227.12.37 443]
Fetched 50.2 kB in 26s (1,903 B/s)
Reading package lists... Done
E: Failed to fetch https://stpete-mirror.armbian.com/apt/dists/focal/main/binary-armhf/by-hash/SHA512/7df5a6040bc2fc97457a149e7901b816af1299a7441353104c3f07fe7
345dffbe154ecca08f7c12f5bf7206e06c39ad070df355c475ea6a0d65f110d6733ea8d 404 Not Found [IP: 188.227.12.37 443]
E: Failed to fetch https://stpete-mirror.armbian.com/apt/dists/focal/focal-utils/binary-armhf/by-hash/SHA512/f419d6ec3f1cd578e203dcf2dac89a8db42a9694649bc0edce
7119db12b1fe05b574b5ceeac06630b84a1f1758018d7cc219d75ced2677271dc86ec6ac2036b3 404 Not Found [IP: 188.227.12.37 443]
or
Err:6 http://mirrors.netix.net/armbian/apt focal/main armhf Packages
File has unexpected size (199533 != 123546). Mirror sync in progress? [IP: 87.121.121.2 80]
Hashes of expected file:
- Filesize:123546 [weak]
- SHA512:cfa454cb1bbcb61b47ca00d2b6970feaf9ab7085740b864d7e021b5a6d2f830097703c7fe86a4e591508bab6bc3fce7a8edc1484df62767cdce169b076712226
- SHA256:65c20abb7cdf3a958056f6e6c8420b6c64d2972db8ff06a3c4ae1f839665a831
- SHA1:12fb81cbdd36bc04236551dcee503ed42ff25d09 [weak]
- MD5Sum:06a04d0d482b380776dc4fb5f292d5a1 [weak]
Release file created at: Tue, 01 Feb 2022 17:25:15 +0000
E: Failed to fetch http://mirrors.netix.net/armbian/apt/dists/focal/main/binary-armhf/Packages.bz2 File has unexpected size (199533 != 123546). Mirror sync in progress? [IP: 87.121.121.2 80]
To confirm that these mirrors are indeed inconsistent, I manually downloaded some files:
$ for i in {stpete-mirror,imola}.armbian.com xogium.performanceservers.nl mirrors.netix.net/armbian; do mkdir -p $i; wget http://$i/apt/dists/focal/InRelease -O $i/InRelease; wget http://$i/apt/dists/focal/main/binary-armhf/Packages.bz2 -O $i/Packages.bz2; done
$ mv mirrors.netix.net/armbian/* mirrors.netix.net/ # Remove one extra directory level for easier scripting
Then you can see that only imola is up-to-date:
$ grep Date */InRelease
imola.armbian.com/InRelease:Date: Mon, 7 Mar 2022 09:45:17 UTC
mirrors.netix.net/InRelease:Date: Tue, 1 Feb 2022 17:25:15 UTC
stpete-mirror.armbian.com/InRelease:Date: Tue, 1 Feb 2022 17:25:15 UTC
xogium.performanceservers.nl/InRelease:Date: Tue, 1 Feb 2022 17:25:15 UTC
Looking at the MD5Sums of the Packages.bz2 files in the InRelease file also shows imola differs:
$ for f in */InRelease; do grep --max-count=1 --with-filename main/binary-armhf/Packages.bz2 "$f";done
imola.armbian.com/InRelease: f7971fdc3eeb0cf0c81b77870e447057 199533 main/binary-armhf/Packages.bz2
mirrors.netix.net/InRelease: 06a04d0d482b380776dc4fb5f292d5a1 123546 main/binary-armhf/Packages.bz2
stpete-mirror.armbian.com/InRelease: 06a04d0d482b380776dc4fb5f292d5a1 123546 main/binary-armhf/Packages.bz2
xogium.performanceservers.nl/InRelease: 06a04d0d482b380776dc4fb5f292d5a1 123546 main/binary-armhf/Packages.bz2
However, the actual files seem to all match the imola MD5sum:
md5sum */Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057 imola.armbian.com/Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057 mirrors.netix.net/Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057 stpete-mirror.armbian.com/Packages.bz2
f7971fdc3eeb0cf0c81b77870e447057 xogium.performanceservers.nl/Packages.bz2
IOW, it seems that the Packages files have been synced correctly, but not the InRelease files (for 5 weeks now).
This causes issues for anyone using these mirrors, including when redirected to them through apt.armbian.com (as I was).
To confirm my setup is otherwise ok, I tried:
deb http://imola.armbian.com/apt focal main focal-utils focal-desktop
Which succeeds every time.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.