aboutsummaryrefslogtreecommitdiff
path: root/tests/ci
Commit message (Collapse)AuthorAgeFilesLines
* tests/ci: Use :H:H rather than ../..Ed Maste2025-12-261-1/+1
| | | | | | | | | In general we want to strip subdir components, rather than appending `..`s. Reviewed by: lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D54352
* tests/ci: Fix building in GithubMuhammad Moinur Rahman2025-12-171-4/+4
| | | | | | | | | | | | | When we are using Cirrus-CI and using a PR branch it creates a filename in the form "pull/XXXX" which becomes a path seperator and the file creation process fails. Fails to complete the process with the following: /bin/sh: cannot create /tmp/meta.hUNGUq/ci-FreeBSD-16.0-pull/1932-amd64-nullhash-GENERIC.env: No such file or directory For future also apply the same regex for OSRELEASE and VOLUME_LABEL.
* tests/ci: Collect environment informationMuhammad Moinur Rahman2025-12-172-23/+77
| | | | | | | | | | | | | | | | | | | For reproducing errors or test results it is important to gather environment information. These environments are divided into two parts. One part is in which environment the artifacts were built into and the second part is in which environment the tests were run. This patch collects thesee information and saves into a .env file in the metadir. After this patch lands we will also need to change our jenkins job where we are uploading the artifact to a central location. This environment file should also be stored along with the artifact. For easier location the image basename and the environment basename are kept same. Approved by: lwhsu MFC after: 3 days Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D54247
* release: Create /firstboot in common VM image creation codeMark Johnston2025-09-111-1/+0
| | | | | | | | | | | | | | | | Some services, such as growfs, only run upon the first boot of an image. The first boot is indicated by the presence of the file /firstboot, which is unlinked after boot. Individual cloudware types shouldn't be responsible for creating it. Do so in a centralized place. Aside from simplifying things, this ensures that we create a metalog entry for the firstboot file. Reviewed by: cperciva, emaste MFC after: 2 weeks Sponsored by: The FreeBSD Foundation Sponsored by: Klara, Inc. Differential Revision: https://reviews.freebsd.org/D52450
* tests/ci: Add CIENV variableMuhammad Moinur Rahman2025-08-271-8/+8
| | | | | | | | | | | | | | | | | | The default behavior of of pre-commit script is to suppress all the logs as it is assumed that developers will run this on their terminal for the tests. But there are also other use cases like running these in different CI tools like Cirrus, GH Actions etc where these build logs are important in the web interface itself. To fix this issue introduce a new variable named CIENV which defaults to local if empty or undefined. If the CIENV is local in those cases the logs are suppressed while for anything else it is not. This variable is also important for some other WIP projects of CI I am working on like running the CI tests on remote cloud AWS, Azure, GCP etc. Approved by: lwhsu Differential Revision: https://reviews.freebsd.org/D51178 Event: Oslo hackathon 202508
* tests/ci: Add missing kmods and pkgs to unskip testsSiva Mahadevan2025-08-131-0/+19
| | | | | | Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51309
* tests/ci: style: canonicalize, sort, and multiline kmods/pkgsSiva Mahadevan2025-08-131-11/+27
| | | | | | | | | This helps to remove ambiguity and reduce future diffs of changes to the VM_EXTRA_PACKAGES list. Also sort kld_list. Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51308
* tests/ci: Fix unescaped kld_list var in rc.confSiva Mahadevan2025-08-131-16/+16
| | | | | | Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51305
* tests/ci: Add KYUA_TEST_FILTERS to allow user to select specific testsSiva Mahadevan2025-08-133-1/+6
| | | | | Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51306
* tests/ci: Use QEMU blockdev declaration for all platformsSiva Mahadevan2025-07-256-8/+7
| | | | | | | | | | | | | This patch uses the QEMU manpage-recommended '-blockdev' option instead of '-drive' to declare block devices. This also makes the mandatory '-device' declarations constant across all platforms, which fixes the missing QEMU_DEVICES tarfs device declarations on all Makefile.<arch> files. Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Reviewed by: imp, lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51479
* tests/ci: Fix wrong chflags target path in 'beforeclean' targetSiva Mahadevan2025-07-241-2/+3
| | | | | | | Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51304
* tests/ci: Fix race condition with ci-extractmetaSiva Mahadevan2025-07-241-1/+2
| | | | | | | | | | | | | This solves an issue where 'ci-extractmeta' runs in parallel with 'ci-runtest', which would extract an empty test result into the final test reports output dir. This also cleans up the intermediate temporary files created along the way. Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Reviewed by: emaste, lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51363
* tests/ci: Indent Makefile properlyMuhammad Moinur Rahman2025-07-221-14/+14
| | | | | | Approved by: imp, lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D51445
* tests/ci: Fix missing qemu devicesMuhammad Moinur Rahman2025-07-221-1/+1
| | | | | | | | Fix missing QEMU_DEVICES which in turn is the META_TAR device Approved by: imp, lwhsu Sponsored by: The FreeBSD Foundation Pull Request: https://reviews.freebsd.org/D51445
* tests/ci: fix missing /usr/local/{sbin,bin} in freebsdci rc PATHSiva Mahadevan2025-07-161-4/+5
| | | | | | | | | | | | | | | | | | Currently, a lot of tests report 'skipped' due to missing binaries in the PATH. The real issue is that /etc/rc forcibly restricts the PATH to the base system only. This patch re-enables a large chunk of skipped tests by adding the missing LOCALBASE directories to the PATH so that Kyua can discover third-party packages. It also fixes some minor rc scripting style as per the official freebsd scripting guide[0]. [0] https://docs.freebsd.org/en/articles/rc-scripting Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Sponsored by: The FreeBSD Foundation Approved by: lwhsu Differential Revision: https://reviews.freebsd.org/D51303
* tests/ci: fix race condition in bhyveload bootSiva Mahadevan2025-07-081-1/+5
| | | | | | | | | | | | | | | | | Currently, there is a race condition where the Makefile sh invocation of 'bhyveload -c stdio' exits before receiving any user input in the bootloader (e.g. in the form of a user typically pressing <enter>), causing the 'expect' script to wrongly spawn the 'bhyve' invocation while still in the bootloader. This patch wraps bhyveload in expect(1) to ensure that stdio is correctly consumed before the process exits. Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Sponsored by: The FreeBSD Foundation Pull Request: https://github.com/freebsd/freebsd-src/pull/1757
* tests/ci: Use suitable variable for qemu-user-static existence checkSiva Mahadevan2025-07-071-2/+2
| | | | | | | | | | And simplify a qemu-system existence check. Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Reviewed by: imp Sponsored by: The FreeBSD Foundation Pull Request: https://github.com/freebsd/freebsd-src/pull/1751
* tests/ci: run ci-full kyua tests in parallelSiva Mahadevan2025-07-041-1/+2
| | | | | | | | | By default, use all available cpus given to the VM. This can be controlled with the already available PARALLEL_JOBS make variable. Signed-off-by: Siva Mahadevan <me@svmhdvn.name> Pull Request: https://github.com/freebsd/freebsd-src/pull/1754
* Fix typos in the CI configurationkalinasp2025-06-271-3/+3
| | | | | | | Fixes: a5f03413aade8f69cf954162151da043d34dd1f5 Fixes: c08f5ad160bf7c844677e1960b1a882d492006f8 Reviewed by: asomers, imp, zlei Pull Request: https://github.com/freebsd/freebsd-src/pull/1736
* Refactor pre-commit CIMuhammad Moinur Rahman2025-05-071-3/+5
| | | | | | | | | | | Currently our test mechanism is not fit for building without cross-toolchain as we are not allowing EXTRA_MAKE_FLAGS. Also we are not allowing to build and test other KERNCONF. So allow these variables to be overridden in command line. Approved by: lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D50220
* tests/ci: Switch vmm detectionMuhammad Moinur Rahman2025-05-021-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | Previously, the CI Makefile used `kldload -n vmm` to determine whether the host supported bhyve virtualization. However, due to changes in how QEMU/KVM exposes CPU features to guests, this check no longer reliably indicates the presence of usable VMX/SVM support. In particular, modern QEMU configurations expose the vmx CPUID bit by default, allowing the vmm module to load even when nested virtualization is disabled. This causes the old check to incorrectly succeed inside virtualized environments where bhyve cannot function. This patch replaces the check with a sysctl-based approach that inspects kern.vm_guest. If the system identifies itself as running inside a guest (!= "none"), we assume nested virtualization is unavailable and fallback to QEMU. This change ensures CI behaves correctly on platforms where the vmm module loads but is not usable. Approved by: emaste Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D50115
* CI: Add full test supportMuhammad Moinur Rahman2025-04-303-24/+79
| | | | | | | | | | | | | | | | | | | | | | | The patch adds support for running full tests in the local CI Environment. New features added: - New target `ci-full` which runs the full test. This is also the default now - Renamed the previous target `ci-smokeit` to `ci-smoke` - Unlike previous if the available memory is more than 16G a default of 8G will be used - Removed some unnecessary debug messages - Added `dummybuf` kernel module to the list of modules to be loaded on the VM The features that can be tested: `make TARGET=<TARGET> TARGET_ARCH=<TARGET_ARCH> CITYPE=full ci` `make TARGET=<TARGET> TARGET_ARCH=<TARGET_ARCH> ci` is also the same as above as CITYPE full is the default now Approved by: lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D48015
* ci: Redirect output for builds.Warner Losh2024-05-231-3/+15
| | | | | | | This target is far too noisy to be at all useful. Save the output ala make universe in _. files. Also report where to find errors. Sponsored by: Netflix
* Add preliminary in-tree CI infrastructure for developersMuhammad Moinur Rahman2024-04-189-0/+568
The goal of this project is to integrate the relevant scripts from the FreeBSD-CI project (https://github.com/freebsd/freebsd-ci) into the src repository. This allows developers to run the test suite similar to how it is executed on ci.freebsd.org, and eventually, have it directly used by our CI system. This effort is also part of the workflow improvement project, aiming to incorporate pre-merge testing. Current Features: * Does smoke tests using either bhyve(amd64 only) or qemu(Non x86_64 or when defined USE_QEMU=1). Currently defined CITYPE=smoke. Once we have added full tests we can also utilize something like CITYPE=full * Most of the resources are dynamically allocated based on available resources in the host * If CPU supports POPCNT or vmm can be loaded then bhyve is used for amd64 otherwise automatically installs and uses qemu@nox11 * When required third party applications or packages for booting non-x86 images are automatically installed Current Limitation: * Does not support full tests like the one in our Jenkins * At this moment this is also not suitable to be used in our Jenkins platform as the jobs are divided in multiple smaller tasks and artifacts are moved here and there which are not exactly the scenario for individual developers. Future Works: * Add full tests like the one in ci.freebsd.org * Add different tests or options to disable some tests * Add test profiles full * Possibly add test through Cloud Providers like AWS/GCP/Azure or Cirrus or Github Actions * Update documentation Test Plan: cd /usr/src/tests/ci make ci make TARGET=amd64 TARGET_ARCH=amd64 ci make TARGET=amd64 TARGET_ARCH=amd64 USE_QEMU=1 ci make TARGET=arm64 TARGET_ARCH=aarch64 ci make TARGET=powerpc TARGET_ARCH=powerpc64 ci make TARGET=powerpc TARGET_ARCH=powerpc64le ci make TARGET=riscv TARGET_ARCH=riscv64 ci Reviewed by: lwhsu Sponsored by: The FreeBSD Foundation Differential Revision: https://reviews.freebsd.org/D43786
generated by cgit v1.3 (git 2.53.0) at 2026-04-08 00:02:02 +0000