Download server too slow (location: germany)

[ozgur-yalcin]

Are you aware of this issue which has been going on for months ?

[harshavardhana]

We will check it's hosted ok DigitalOcean we will see why is that the case .

@aead do you see this on your end?

[klauspost]

@harshavardhana I've been seeing this as well as @vadmeste - it runs very fast and then suddenly slows down.

[harshavardhana]

@harshavardhana I've been seeing this as well as @vadmeste - it runs very fast and then suddenly slows down.

Hmm not sure why DigitalOcean would be throttling..

[kotso]

yes, noticed last couple weeks, when need to download client, speed varies a lot.

testing from various locations of central and eastern EU.

[aead]

Hm interesting. For me it starts quite slow (~200 KiB/s) but after a 15/20s or so it becomes quite fast > 10 MiB/s. After about 15% it starts speeding up..

[klauspost]

Yeah, it is very intermittent. Sometimes starts fast, stuck at 40% for minutes, then suddenly resumes.

[vadmeste]

I tested from a dedicated server in France and it works fine.. but seeing the issue while using my local machine.

ping -c 30 dl.min.io can show mdev value.. High mdev value means less quality transferring datay

[harshavardhana]

I have blocked an IP which was hogging the network on a continuous basis. Please let us know if the issue persists.

[jamescorbett]

I have same issue in the UK. Limiting me to kb/s

[harshavardhana]

Exploring if it's possible to move to a different server or a different public IP @jamescorbett

[brendanbbbb]

I'm located in Australia and have seen the same very slow downloads (initially when I downloaded it a few months ago). I didn't think much of it at the time until one of my staff commented to me about a week ago about the same issue. Just tested it again and still very slow.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed after 15 days if no further activity occurs. Thank you for your contributions.

[jaimem88]

I'm also seeing very slow downloads in Australia 😞

[torblerone]

curl --output minio.RELEASE.2020-10-09T22-55-05Z  http://dl.min.io/server/minio/release/linux-amd64/minio.RELEASE.2020-10-09T22-55-05Z
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 49.4M  100 49.4M    0     0  3375k      0  **0:00:15**  0:00:15 --:--:-- 3826k

Download speed from Germany. Not that much time spent

[JanHolger]

Download takes 2-3 min for me aswell so i guess this issue still isn't solved.

[pleclech]

Downloading from spain also too slow 2min for downloading 19Mb

[DerDanilo]

@minio Server admins: Why not just use some servers from Hetzner Cloud, netcup, other providers who don't really throttle and build download replica servers. Just let them sync and have this problem gone. They are fast and cheap.

As a hint for the other, axel is your friend. Building 50+ connections to download one file speeds up things on our end (located in Germany). https://github.com/axel-download-accelerator/axel

[JanHolger]

Another workaround might be downloading the docker image tarball from DockerHub and extracting the minio binary. We ended up mirroring it locally instead. The easiest official solution would be uploading artifacts with releases on GitHub. GitHub's azure servers are sometimes terrible aswell but still way better than waiting 15 minutes for a 30mb file.

[amyspark]

Ran into this while trying to download minio to a GitLab CI pipeline on France (OVH). I had to use Alpine edge and download their release.

[tholu]

--2021-05-12 13:09:55--  (try:14)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:10:37--  (try:15)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:11:18--  (try:16)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

Really frustrating.

[harshavardhana]

--2021-05-12 13:09:55--  (try:14)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:10:37--  (try:15)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:11:18--  (try:16)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

Really frustrating.

We will be moving to GitHub for downloads from our own infrastructure this is currently a work in progress.

[ozgur-yalcin]

--2021-05-12 13:09:55--  (try:14)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:10:37--  (try:15)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

--2021-05-12 13:11:18--  (try:16)  https://dl.min.io/client/mc/release/linux-amd64/mc
Connecting to dl.min.io (dl.min.io)|178.128.69.202|:443... failed: Connection timed out.
Retrying.

Really frustrating.

We will be moving to GitHub for downloads from our own infrastructure this is currently a work in progress.

finally good news !

[tholu]

@harshavardhana Any ETA on this change? I have meanwhile rehosted the binary on our own CDN for internal use.

[harshavardhana]

@harshavardhana Any ETA on this change? I have meanwhile rehosted the binary on our own CDN for internal use.

@tholu there is no set ETA yet as it requires some refactoring of our download infrastructure and release management to start using GitHub for our releases.

[JanHolger]

Is this a good idea? Since GitHub was bought by Microsoft and at least parts of the infrastructure have been migrated into azure cloud, I started to get problems with downloading files from GitHub and accessing GitHub Pages aswell and i've spoken to several people who had similar experiences. I mean it's probably better than the current servers but even sending out pigeons would be faster. At the moment we are pulling the docker image and extracting the executable so we don't need to wait 30 minutes for a 30 mb download from the official server everytime we update.

[chotaire]

minio 27%[====> ] 15,45M 11,1KB/s ETA 11m 54s

This has been terrible for years. First only from single ISPs, now since a year from all ISPs I am trying. Please get rid of whoever is hosting this.

[tmoschou]

Hi,

Located in Australia

This is consistently taking over 5 minutes to download https://dl.min.io/client/mc/release/linux-amd64/mc

[JanHolger]

Hi,

Located in Australia

This is consistently taking over 5 minutes to download https://dl.min.io/client/mc/release/linux-amd64/mc

I can recommend pulling the docker image and extracting the binary (:

[tmoschou]

Thanks @JanHolger

For others interested, if you are building a Docker image with mc, Docker has an easy way to do this with multistage build

COPY --from=minio/mc /usr/bin/mc /usr/local/bin/mc

[viceice]

Thanks @JanHolger

For others interested, if you are building a Docker image with mc, Docker has an easy way to do this with multistage build

COPY --from=minio/mc /usr/bin/mc /usr/local/bin/mc

Doesn't work for windows 😕

[klauspost]

Locking this topic since there it seems to have drifted off topic.

TLDR; We know it is slow - we are working on an alternative.

[harshavardhana]

TLDR; We know it is slow - we are working on an alternative.

After a lot of understanding looks like DO is very poor and their US routes are fully saturated. Downloading within DO

SFO2 -> NYC3

--2021-11-26 20:20:16--  https://dl.min.io/server/minio/linux-arm6vl.tar.gz
Reusing existing connection to dl.min.io:443.
HTTP request sent, awaiting response... 200 OK
Length: 48461328 (46M) [application/gzip]
Saving to: ‘dl.min.io/server/minio/linux-arm6vl.tar.gz’

dl.min.io/server/minio/linux-arm6vl.t   5%[===>                                                                      ]   2.74M  19.3KB/s    eta 15m 34s

We are planning to move to a different provider and this may take some time.