src/libexec/atf, branch release/13.4.0

Remove $FreeBSD$: one-line sh pattern

2023-08-23T17:43:30Z

Remove /^\s*#[#!]?\s*\$FreeBSD\$.*$\n/ Similar commit in main: (cherry picked from commit d0b2dbfa0ecf)

atf_pytest_wrapper: fix use with pytest-7.4

2023-08-04T14:08:05Z

As of pytest 7.4 it no longer walks all the way to the root directory of the file system to find conftest files. As a result we don't find / usr/tests/conftest.py, and don't load atf_python. That in turn causes atf_python tests to fail. Explicitly set the confcutdir, as advised by the pytest changelog. See also: https://github.com/pytest-dev/pytest/pull/11043 MFC after: 3 weeks Sponsored by: Orange Business Services Differential Revision: https://reviews.freebsd.org/D41064 (cherry picked from commit 9f23cbd6cae82fd77edfad7173432fa8dccd0a95)

Explicitly set CXXSTD to c++11 for old C++ code using std::auto_ptr<>.

2023-05-02T23:47:59Z

GCC 12 defaults to C++17 which removes (not just deprecates) std::auto_ptr<>. Trying to use CXXSTD of c++03 doesn't work with libc++ headers, but c++11 does. Reviewed by: brooks, imp, emaste Differential Revision: https://reviews.freebsd.org/D37531 (cherry picked from commit 42fb28cef42e883d808c9efadd44016563248817)

atf_pytest_wrapper: fix pytest output truncation

2023-02-09T15:45:28Z

Pass `-vv` to pytest in order to always get the full output. While here, enforce the modeline. Differential Revision: https://reviews.freebsd.org/D37894 MFC after: 2 weeks (cherry picked from commit 058ac3e8063366dafa634d9107642e12b038bf09)

testing: provide meaningful error when pytest is not available

2023-01-13T21:24:10Z

atf format does not provide any way of signalling any error message back to the atf runner when listing tests. Work this around by reporting "__test_cases_list_pytest_binary_not_found__" test instead. Reviewed By: kp Differential Revision: https://reviews.freebsd.org/D35721 (cherry picked from commit 2bfd8b5b9419b0ceb3dd0295fdf413d32969e5b2)

testing: pass ATF vars to pytest via env instead of arguments.

2023-01-13T21:24:10Z

This change is a continuation of 9c42645a1e4d workaround. Apparently pytest argument parser is not happy when parsing values with spaces or just more than one --atf-var argument. Switch wrapper to send these kv pairs as env variables. Specifically, use _ATF_VAR_key=value format to distinguish from the other vars. Add the `atf_vars` fixture returning all passed kv pairs as a dict. Reviewed by: lwhsu Differential Revision: https://reviews.freebsd.org/D35625 MFC after: 2 weeks (cherry picked from commit 513ce835b55831d343185e03a51efa2901405ac8)

testing: workaround pytest parser bug in pytest-atf-wrapper.

2023-01-13T21:24:10Z

Reviewed by: lwhsu, kp Differential Revision: https://reviews.freebsd.org/D35614 MFC after: 2 weeks (cherry picked from commit 9c42645a1e4d6695730187aef0f1494394503624)

testing: move atf-pytest-wrapper to /usr/libexec

2023-01-13T21:24:10Z

Move pytest wrapper to the collection of the other atf wrappers in libexec. It solves the problem of combining bits & pieces from bsd.test.mk and bgs.prog.mk to address "test binary, but not the suite binary". Reviewed by: kp Differential Revision: https://reviews.freebsd.org/D35604 MFC after: 2 weeks (cherry picked from commit 924226fba12cc9a228c73b956e1b7fa24c60b055)

pkgbase: Install atf and kyua in the tests package

2021-01-04T15:20:47Z

While here make sure that all tests dirs are taggued correctly. Reviewed by: bapt, emaste Differential Revision: https://reviews.freebsd.org/D27714

Another round of attempting to squelch -Wdeprecated-declarations, which

2019-09-17T06:07:08Z

has become very trigger-happy with libc++ 9.0.0. It does not help that gcc's implementation of this warning is even more trigger-happy, in the sense that it already warns on the declaration itself, not when you are using it. This is very annoying with our use of -Wsystem-headers. That should really be disabled for gcc.