src/usr.bin/fetch/fetch.c, branch releng/14.0 FreeBSD source tree https://cgit-dev.freebsd.org/src/atom?h=releng%2F14.0 2023-08-16T17:54:42Z Remove $FreeBSD$: one-line .c pattern 2023-08-16T17:54:42Z Warner Losh imp@FreeBSD.org 2023-08-16T17:54:42Z urn:sha1:1d386b48a555f61cb7325543adbbb5c3f3407a66 Remove /^[\s*]*__FBSDID\("\$FreeBSD\$"\);?\s*\n/ fetch: make -S argument accept values > 2GB 2022-02-20T14:24:43Z Stefan Eßer se@FreeBSD.org 2022-02-20T14:24:43Z urn:sha1:32066c96fa00fc19c8355e1956ca5aa9ead37673 Use strtoll() to parse the argument of the -S option. FreeBSD has supported 64 bit file offsets for more than 25 years on all architectures and off_t is a 64 bit integer type for that reason. While strtol() returns a 64 bit value on 64 LP64 architectures, it is limit to 32 bit on e.g. i386. The strtoll() function returns a 64 but result on all supported architectures and therefore supports the possible file lengths and file offsets on 32 bit archtectures. Reported by: antoine MFC after: 3 days fetch(1): more fixes for soft failure handling 2022-01-25T05:48:28Z Eugene Grosbein eugen@FreeBSD.org 2022-01-25T05:46:07Z urn:sha1:85f15576b423b9ad5b8a9e6dab3e71558ebe4335 Fix logic error introduced in my commit bf599c03f09dea0f7e188e002b42d782af6841c3 Also, authorization errors should not be considered as soft failures. fetch(1): fix error in previous commit 2022-01-24T08:07:18Z Eugene Grosbein eugen@FreeBSD.org 2022-01-24T08:07:18Z urn:sha1:08a2504a207c9302939bc0d1173fe44875e2a2e4 strncmp() compares terminating zero and sizeof() includes it. Un-obsfuscate the code and show what it is indended to do. fetch(1): do not consider HTTP 5XX errors as soft failures 2022-01-24T07:38:26Z Eugene Grosbein eugen@FreeBSD.org 2022-01-24T07:35:49Z urn:sha1:bf599c03f09dea0f7e188e002b42d782af6841c3 This change fixes "fetch -a" looping forever on "502 Bad gateway" error and similar. MFC after: 1 month fetch(1): correct progress accounting after previous commit 2022-01-24T04:17:24Z Eugene Grosbein eugen@FreeBSD.org 2022-01-24T04:17:24Z urn:sha1:a4efbe0d6da28eea0de4d414af25e7853ab8adfa MFC after: 1 month fetch(1): process truncated transfer as soft failure 2022-01-24T04:09:37Z Eugene Grosbein eugen@FreeBSD.org 2022-01-24T04:03:42Z urn:sha1:e3bad5f7aa86a0911cf8d28395e7a29395739985 Let "fetch -a" resume truncated transfer automatically perform another attempt if it obtained some new data in previous one making progress. This makes it more robust against frequent but transient network failures. For example: => sqlite-src-3370200.zip doesn't seem to exist in /usr/ports/distfiles/. => Attempting to fetch https://www.sqlite.org/2022/sqlite-src-3370200.zip sqlite-src-3370200.zip 3% of 12 MB 45 kBps 04m24s fetch: sqlite-src-3370200.zip appears to be truncated: 524288/13145234 bytes sqlite-src-3370200.zip 10% of 12 MB 67 kBps 02m56s fetch: sqlite-src-3370200.zip appears to be truncated: 1327104/13145234 bytes sqlite-src-3370200.zip 28% of 12 MB 123 kBps 01m14s fetch: sqlite-src-3370200.zip appears to be truncated: 3735552/13145234 bytes sqlite-src-3370200.zip 54% of 12 MB 253 kBps 24s fetch: sqlite-src-3370200.zip appears to be truncated: 7176192/13145234 bytes sqlite-src-3370200.zip 62% of 12 MB 90 kBps 55s fetch: sqlite-src-3370200.zip appears to be truncated: 8241152/13145234 bytes sqlite-src-3370200.zip 82% of 12 MB 113 kBps 20s fetch: sqlite-src-3370200.zip appears to be truncated: 10862592/13145234 bytes sqlite-src-3370200.zip 12 MB 185 kBps 12s ===> Fetching all distfiles required by sqlite3-3.37.2,1 for building MFC after: 1 month Through a combination of insufficient variable initialization and 2018-09-10T19:39:20Z Dag-Erling Smørgrav des@FreeBSD.org 2018-09-10T19:39:20Z urn:sha1:6434dda6e396b0b7e96eb480c9dbd57c10065686 imprudent reuse of static buffers, the end-of-transfer statistics displayed when stdout is not a tty always ended up as 0 B / 0 Bps. Reorganize the code to use caller-provided buffers, tweak the ETA display a bit, and reduce the visual differences between the tty and non-tty end-of-transfer displays. PR: 202424 Approved by: re (gjb@) Support If-Modified-Since for https as well as http. 2018-05-12T17:04:40Z Dag-Erling Smørgrav des@FreeBSD.org 2018-05-12T17:04:40Z urn:sha1:deb1ff232df5fc7bfc456c708a23e7c3e9b5aba5 PR: 224426 Submitted by: zsnafzig@edu.uwaterloo.ca MFC after: 1 week various: general adoption of SPDX licensing ID tags. 2017-11-27T15:37:16Z Pedro F. Giffuni pfg@FreeBSD.org 2017-11-27T15:37:16Z urn:sha1:1de7b4b805ddbf2429da511c053686ac4591ed89 Mainly focus on files that use BSD 2-Clause license, however the tool I was using misidentified many licenses so this was mostly a manual - error prone - task. The Software Package Data Exchange (SPDX) group provides a specification to make it easier for automated tools to detect and summarize well known opensource licenses. We are gradually adopting the specification, noting that the tags are considered only advisory and do not, in any way, superceed or replace the license texts. No functional change intended.