Problems fetching Debian packages from linaro-overlay repo

Products Support DragonBoard410c
#1

Our build process generates fresh db410c system images from the linaro-overlay repo, but recently we’ve encountered issues where apt fails to download files from the repo with errors like:

Get:1 https://obs.linaro.org/linaro-overlay-sid/sid ./ firmware-qcom-soc 20200817-1+linaro1 [7214 kB]
Get:2 https://obs.linaro.org/linaro-overlay-sid/sid ./ libqrtr1 0.3+47g9dc7a88-1 [10.0 kB]
Get:3 https://obs.linaro.org/linaro-overlay-sid/sid ./ linux-image-5.4.0-qcomlt-arm64 5.4.54-00257-g360170a47363-118 [19.6 MB]
Err:4 https://obs.linaro.org/linaro-overlay-sid/sid ./ qrtr 0.3+47g9dc7a88-1
  403  Forbidden [IP: 52.218.30.74 443]
Err:5 https://obs.linaro.org/linaro-overlay-sid/sid ./ rmtfs 0.2+36g293ab8b-1
  403  Forbidden [IP: 52.218.30.74 443]
Fetched 26.8 MB in 3min 13s (139 kB/s)
E: Failed to fetch https://publishing-ie-linaro-org.s3.amazonaws.com/releases/obs/linaro-overlay-sid/sid/arm64/qrtr_0.3%2B47g9dc7a88-1_arm64.deb?Signature=flyAVX%2BVzQ5NEj%2Fiu9JfzWZ4ll0%3D&Expires=1712173653&AWSAccessKeyId=AKIAIELXV2RYNAHFUP7A  403  Forbidden [IP: 52.218.30.74 443]
E: Failed to fetch https://publishing-ie-linaro-org.s3.amazonaws.com/releases/obs/linaro-overlay-sid/sid/arm64/rmtfs_0.2%2B36g293ab8b-1_arm64.deb?Signature=99qoIpjC4TdJ3LYoGewOuE%2FKfFo%3D&Expires=1712173654&AWSAccessKeyId=AKIAIELXV2RYNAHFUP7A  403  Forbidden [IP: 52.218.30.74 443]
E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

I initially thought that something was going wrong on our end (I was using http so that we could have a proxy server cache things), but I switched over to https and we’re still having issues. Trying to recreate the problem “by hand” is tricky. About the closest I’ve been able to come is by using:

wget --no-check-certificate --max-redirect 0 https://obs.linaro.org/linaro-overlay-sid/sid/arm64/qrtr_0.3+47g9dc7a88-1_arm64.deb
wget --no-check-certificate --max-redirect 0 https://releases.linaro.org/obs/linaro-overlay-sid/sid/arm64/qrtr_0.3+47g9dc7a88-1_arm64.deb
wget --no-check-certificate --max-redirect 0 https://publishing-ie-linaro-org.s3.amazonaws.com/releases/obs/linaro-overlay-sid/sid/arm64/qrtr_0.3%2B47g9dc7a88-1_arm64.deb?Signature=5BdORjKpvoo68PNIG2iaRWdM8Oc%3D&Expires=1712177815&AWSAccessKeyId=AKIAIELXV2RYNAHFUP7A

So, I think what must be going on is that the “Expires” is happening too soon (taking too long to download files) when apt is triggering the download.

#2

I think this is expected.

The OBS instance has been turned off. What you see at https://releases.linaro.org is a backup archive. It should allow you to fetch any packages that did not cache locally but it is not intended that apt can fetch from it.

#3

@danielt So, sounds like we should put up our own internal archive then. The way that this is setup breaks caching, so it hits the server every time, and 90 seconds (the apparent timeout) isn’t long enough to guarantee that apt will fetch the file in time.

#4

If you need them then an internal archive is likely to be best.

Note that if you are generating the filesystem from scratch you might
find you don’t actually need any of the OBS packages… most are either
optional or newer version are available from the Debian repos.