error: unable to unpack tarball to temporary directory: EndOfStream

[hazeycode]

Zig Version

0.13.0-dev.351+64ef45eb0

Steps to Reproduce and Observed Behavior

zig fetch --save https://github.com/zig-gamedev/system-sdk/archive/refs/tags/v0.2.0.tar.gz
error: unable to unpack tarball to temporary directory: EndOfStream

Expected Behavior

Package is downloaded and build.zig.zon dependency entry is added.

[squeek502]

I get Unexpected end of data when trying to extract with 7-zip.

[hazeycode]

Weird. I can open and extract this archive using the Windows 11 File Explorer builtin thing and with tar on Linux but not with the builtin thing on MacOS 14.5.

[Paul-Dempsey]

Windows 11 recent updates added more compression formats.

[hazeycode]

Even weirder, I downloaded from the same url twice and got 2 different results on macOS (no Zig involved). One is 42.6 MB and the other is 3.5 MB.

https://github.com/zig-gamedev/system-sdk/archive/refs/heads/main.tar.gz if anyone wants to try it.

Something is truncating the archives so I'll close this on the basis that this is not a Zig issue.

[hazeycode]

A similar issue: NixOS/nix#4533

Maybe Zig could prompt to retry the download if the archive can't be unpacked?

[hippietrail]

Maybe zig fetch is not correctly detecting that the download fails and/or not checking that actual and expected download lengths match before trying to unpack. Could also be the server not (correctly) reporting download aborting or expected length.

[marler8997]

Even weirder, I downloaded from the same url twice and got 2 different results on macOS (no Zig involved). One is 42.6 MB and the other is 3.5 MB.
https://github.com/zig-gamedev/system-sdk/archive/refs/heads/main.tar.gz if anyone wants to try it.

That URL you linked is pointing to the main branch which does change.

[hazeycode]

That URL you linked is pointing to the main branch which does change.

You can download from the url multiple times without the main branch changing. Sometimes the archive is truncated and other times it isn't. See #20256 (comment)

[rofrol]

In case of the server or proxy server is SIGKILLed during data transfer, Linux kernel will terminated the TCP connection by FIN+ACK. And if the server doesn't provide Content-Length (eg. GitHub tarball archive URLs), our current behavior is to exit without error, leaving incomplete data.

curl/curl#6736