From aaa3351983a4e4f05c0975bef4b4dfbb2fee9331 Mon Sep 17 00:00:00 2001 From: Vladlen Popolitov Date: Tue, 21 Jul 2026 22:26:15 +0300 Subject: Status/2026Q2: fix location of reports in wrong dirs --- .../hpc-ports-modernization.adoc | 46 ++++++++++++++++ .../en/status/report-2026-04-2026-06/openjdk.adoc | 61 ++++++++++++++++++++++ .../hpc-ports-modernization.adoc | 46 ---------------- .../en/status/report-2026-04-3036-06/openjdk.adoc | 61 ---------------------- 4 files changed, 107 insertions(+), 107 deletions(-) create mode 100644 website/content/en/status/report-2026-04-2026-06/hpc-ports-modernization.adoc create mode 100644 website/content/en/status/report-2026-04-2026-06/openjdk.adoc delete mode 100644 website/content/en/status/report-2026-04-2026-07/hpc-ports-modernization.adoc delete mode 100644 website/content/en/status/report-2026-04-3036-06/openjdk.adoc diff --git a/website/content/en/status/report-2026-04-2026-06/hpc-ports-modernization.adoc b/website/content/en/status/report-2026-04-2026-06/hpc-ports-modernization.adoc new file mode 100644 index 0000000000..907f41eb7a --- /dev/null +++ b/website/content/en/status/report-2026-04-2026-06/hpc-ports-modernization.adoc @@ -0,0 +1,46 @@ +=== FreeBSD HPC Ports Modernization: Slurm 26.05, UCX 1.20 Upstreaming, and MPI-Parallel File Utilities + +Links: + +link:https://cgit.freebsd.org/ports/tree/sysutils/slurm-wlm/[sysutils/slurm-wlm] URL: link:https://cgit.freebsd.org/ports/tree/sysutils/slurm-wlm/[] + +link:https://cgit.freebsd.org/ports/tree/net/ucx/[net/ucx] URL: link:https://cgit.freebsd.org/ports/tree/net/ucx/[] + +link:https://cgit.freebsd.org/ports/tree/sysutils/mpifileutils/[sysutils/mpifileutils] URL: link:https://cgit.freebsd.org/ports/tree/sysutils/mpifileutils/[] + +link:https://cgit.freebsd.org/ports/tree/devel/libcircle/[devel/libcircle] URL: link:https://cgit.freebsd.org/ports/tree/devel/libcircle/[] + +link:https://cgit.freebsd.org/ports/tree/devel/lwgrp/[devel/lwgrp] URL: link:https://cgit.freebsd.org/ports/tree/devel/lwgrp/[] + +link:https://cgit.freebsd.org/ports/tree/devel/dtcmp/[devel/dtcmp] URL: link:https://cgit.freebsd.org/ports/tree/devel/dtcmp/[] + +link:https://cgit.freebsd.org/ports/tree/benchmarks/py-reframe-hpc/[benchmarks/py-reframe-hpc] URL: link:https://cgit.freebsd.org/ports/tree/benchmarks/py-reframe-hpc/[] + +link:https://github.com/openucx/ucx/pull/11354[openucx/ucx#11354: UCS/TYPE portability fixes for non-glibc/Clang environments (merged)] URL: link:https://github.com/openucx/ucx/pull/11354[] + +link:https://github.com/openucx/ucx/pull/11549[openucx/ucx#11549: UCS/SYS portability fixes for non-Linux platforms (in review)] URL: link:https://github.com/openucx/ucx/pull/11549[] + +link:https://github.com/hpc/mpifileutils/pull/664[hpc/mpifileutils#664: Portability fixes for FreeBSD/non-Linux builds (in review)] URL: link:https://github.com/hpc/mpifileutils/pull/664[] + +link:https://kavocado.net/reports/[Kavocado Monthly Status Reports – FreeBSD HPC notes] URL: link:https://kavocado.net/reports/[] + +Contact: Generic Rikka + +This report continues the FreeBSD HPC Ports Modernization initiative. +Previous quarters focused on bringing the Slurm + PMIx + PRRTE + UCX stack up to date and filling gaps in the surrounding ecosystem. +This quarter's work centered on three things: keeping the core scheduler and communication libraries current against fast-moving upstream releases, upstreaming the FreeBSD portability fixes accumulated while maintaining these ports so the local patchsets keep shrinking, and adding a new port for MPI-parallel file utilities that are common on large HPC filesystems. + +==== Work completed + +* Updated package:sysutils/slurm-wlm[] twice this quarter, from 25.11.4 to 25.11.5 and then from 25.11.5 to 26.05.1, tracking the latest upstream releases. +* Fixed several FreeBSD-specific runtime issues in package:net/ucx[]: hardened async thread state handling, corrected UCM relocation handling, fixed mm signal socket binding, and resolved other FreeBSD runtime portability issues. +* Updated package:net/ucx[] from 1.20.0 to 1.20.1, and separately fixed a libucm early-init panic together with several gtest suite failures uncovered while validating the update. +* Added package:sysutils/mpifileutils[] as a new port, along with its dependency stack: package:devel/libcircle[], package:devel/lwgrp[], and package:devel/dtcmp[]. These provide MPI-parallel file utilities (copy, remove, checksum, etc.) commonly used on large HPC filesystems. +* Updated package:benchmarks/py-reframe-hpc[] twice this quarter to track upstream releases of the regression testing framework. +* Upstreamed "UCS/TYPE: Portability fixes for non-glibc/Clang environments" to UCX, which was reviewed and merged. +* Opened "UCS/SYS: portability fixes for non-Linux platforms" against UCX, covering hostname buffer sizing, MAC address retrieval via `getifaddrs()`/`AF_LINK`, shared-memory error reporting, `mmap`/`munmap`-based reallocation, and `cpuset_getaffinity()`-based thread affinity queries; currently addressing review feedback. +* Opened a portability PR against mpifileutils guarding Linux-only APIs for FreeBSD and other non-Linux builds; currently in review. +* Collaborated with SchedMD on a Slurm configure-time probe for `H5PTopen`, used to detect the HDF5 high-level library, which was merged upstream. + +==== Work in progress + +* Addressing reviewer feedback on the open UCX and mpifileutils portability pull requests to get them merged upstream and reduce the FreeBSD ports' local patchsets further. +* Continuing collaboration with SchedMD to upstream additional portability fixes discovered while maintaining package:sysutils/slurm-wlm[] on FreeBSD, including BSD socket-handling improvements. +* Evaluating a `proctrack/freebsd_reaper` Slurm plugin design, made possible by recently landed FreeBSD kernel support for exposing reaper metadata in process information. +* Continuing to track upstream Slurm, UCX, and PMIx/PRRTE releases closely to keep the FreeBSD ports current with minimal local patching. + +==== Future plans + +* Land the outstanding UCX and mpifileutils upstream pull requests, and continue identifying further portability issues to upstream rather than patch locally. +* Prototype and submit the Slurm `proctrack/freebsd_reaper` plugin once the underlying kernel interface work is finalized. +* Continue expanding the HPC software ecosystem available in the FreeBSD Ports Collection and reduce local patchsets across the stack wherever upstream acceptance is possible. +* Document a reference Slurm + OpenMPI + PMIx + PRRTE + UCX deployment on FreeBSD to lower the barrier for new sites experimenting with FreeBSD in an HPC context. diff --git a/website/content/en/status/report-2026-04-2026-06/openjdk.adoc b/website/content/en/status/report-2026-04-2026-06/openjdk.adoc new file mode 100644 index 0000000000..77ee433995 --- /dev/null +++ b/website/content/en/status/report-2026-04-2026-06/openjdk.adoc @@ -0,0 +1,61 @@ +=== Improve OpenJDK on FreeBSD + +Links: + +link:https://freebsdfoundation.org/project/improving-openjdk-on-freebsd/[Project description] URL: https://freebsdfoundation.org/project/improving-openjdk-on-freebsd/[] + +link:https://github.com/freebsd/openjdk[Project repository] URL: https://github.com/freebsd/openjdk[] + +link:https://github.com/openjdk/bsd-port[Upstream BSD port repo] URL: https://github.com/openjdk/bsd-port[] + +Contact: + +Harald Eilertsen + +FreeBSD Java mailing list + +The goal of this project is to improve OpenJDK support for FreeBSD/amd64 and FreeBSD/arm64. + +Java is an important runtime environment for many high performance, critical enterprise systems. +Making sure Java based applications run correctly and efficiently on FreeBSD is important to ensure that FreeBSD will continue to be a viable and attractive platform for enterprises, as well as businesses and organizations of all sizes. + +This quarter has been spent mostly on getting the upstreaming process properly going. +We submit patches to a link:https://github.com/openjdk/bsd-port[separate repository] under the OpenJDK org on Github, and make sure that each PR is reviewed by at least one upstream reviewer. +This way, when we get to the point where we want to merge our port into the upstream mainline, all commits should already be reviewed by someone in the project. + +This is a fairly slow process, as we depend on upstream reviewers having time. +We also encounter that some of the changes that has been living in our port for a long time is rejected. +Then we have to rework them, or if not strictly needed, just throw them out. +I feel this is a useful correction, but sometimes causes quite a bit of work. + + +In this quarter the following issues/milestones were reached: + +* OpenJDK 25 port was updated to link:https://reviews.freebsd.org/D56522[version 25.0.3]. +* Upstream mainline changes and bugfixes: + - link:https://github.com/openjdk/jdk/pull/30853[8382614: Consolidate implementation of current_stack_base_and_size on BSD] + - link:https://github.com/openjdk/jdk/pull/31069[8384085: Make os::Bsd::dlopen_helper private, and drop unused arg] + - link:https://github.com/openjdk/jdk/pull/31070[8384088: osThread _thread_id should be an int on all BSD's] + - link:https://github.com/openjdk/jdk/pull/31199[8384946: os::Bsd::gettid misses the return value] + - link:https://github.com/openjdk/jdk/pull/31455[8386344: runtime/StackGuardPages/TestStackGuardPages build failure after JDK-8303612] +* Upstream BSD Port: + - link:https://github.com/openjdk/bsd-port/pull/7[Fix conditional sections for BSD in hotspot/cpu] + - link:https://github.com/openjdk/bsd-port/pull/8[Port hotspot/os/posix for BSD] + - Merged changes accepted for mainline. +* Current (out-of-tree) BSD port: + - link:https://github.com/battleblow/jdk/pull/49[Merge + Remove VFORK for BSD + rebase GHA workflow on OpenJDK26] + - link:https://github.com/battleblow/jdk/pull/53[Merge + Fix usage of FREE_C_HEAP_ARRAY macro on BSD] + - link:https://github.com/battleblow/jdk/pull/54[Sync aarch64 cpuinfo impl for *BSD with Linux] + - link:https://github.com/battleblow/jdk/pull/55[Remove duplicate include in global defs for zero] + - link:https://github.com/battleblow/jdk/pull/59[Remove ThreadWXEnable from BSD code] + - Backported changes accepted for mainline upstream BSD port. +* Ports: + - link:https://cgit.freebsd.org/ports/commit/?id=7878106082fd1f07814d754ef767c1f59168d1e9[java/javavmwrapper: JAVA_VERSION does not work with openjdk25] + +In addition, these tasks are still ongoing, or waiting for review: + +* Upstream BSD port: + - link:https://github.com/openjdk/bsd-port/pull/9[Port hotspot/os/bsd/os_perf_bsd.cpp to BSD] (Waiting for refactor, see link:https://github.com/battleblow/jdk/pull/61[WIP: Split os_perf impl for macOS and BSD]) + - link:https://github.com/openjdk/bsd-port/pull/11[os::get_process_uid and os::rss for BSD] (Still ongoing) + +Other notes: + +* Started preparing for link:https://github.com/snake66/jdk/tree/freebsd-jdk27[OpenJDK 27 port]. +* Presented the project at link:https://foss-north.se/2026/speakers-and-talks.html#heilertsen[Foss North 2026]. + +Sponsor: The FreeBSD Foundation diff --git a/website/content/en/status/report-2026-04-2026-07/hpc-ports-modernization.adoc b/website/content/en/status/report-2026-04-2026-07/hpc-ports-modernization.adoc deleted file mode 100644 index 907f41eb7a..0000000000 --- a/website/content/en/status/report-2026-04-2026-07/hpc-ports-modernization.adoc +++ /dev/null @@ -1,46 +0,0 @@ -=== FreeBSD HPC Ports Modernization: Slurm 26.05, UCX 1.20 Upstreaming, and MPI-Parallel File Utilities - -Links: + -link:https://cgit.freebsd.org/ports/tree/sysutils/slurm-wlm/[sysutils/slurm-wlm] URL: link:https://cgit.freebsd.org/ports/tree/sysutils/slurm-wlm/[] + -link:https://cgit.freebsd.org/ports/tree/net/ucx/[net/ucx] URL: link:https://cgit.freebsd.org/ports/tree/net/ucx/[] + -link:https://cgit.freebsd.org/ports/tree/sysutils/mpifileutils/[sysutils/mpifileutils] URL: link:https://cgit.freebsd.org/ports/tree/sysutils/mpifileutils/[] + -link:https://cgit.freebsd.org/ports/tree/devel/libcircle/[devel/libcircle] URL: link:https://cgit.freebsd.org/ports/tree/devel/libcircle/[] + -link:https://cgit.freebsd.org/ports/tree/devel/lwgrp/[devel/lwgrp] URL: link:https://cgit.freebsd.org/ports/tree/devel/lwgrp/[] + -link:https://cgit.freebsd.org/ports/tree/devel/dtcmp/[devel/dtcmp] URL: link:https://cgit.freebsd.org/ports/tree/devel/dtcmp/[] + -link:https://cgit.freebsd.org/ports/tree/benchmarks/py-reframe-hpc/[benchmarks/py-reframe-hpc] URL: link:https://cgit.freebsd.org/ports/tree/benchmarks/py-reframe-hpc/[] + -link:https://github.com/openucx/ucx/pull/11354[openucx/ucx#11354: UCS/TYPE portability fixes for non-glibc/Clang environments (merged)] URL: link:https://github.com/openucx/ucx/pull/11354[] + -link:https://github.com/openucx/ucx/pull/11549[openucx/ucx#11549: UCS/SYS portability fixes for non-Linux platforms (in review)] URL: link:https://github.com/openucx/ucx/pull/11549[] + -link:https://github.com/hpc/mpifileutils/pull/664[hpc/mpifileutils#664: Portability fixes for FreeBSD/non-Linux builds (in review)] URL: link:https://github.com/hpc/mpifileutils/pull/664[] + -link:https://kavocado.net/reports/[Kavocado Monthly Status Reports – FreeBSD HPC notes] URL: link:https://kavocado.net/reports/[] - -Contact: Generic Rikka - -This report continues the FreeBSD HPC Ports Modernization initiative. -Previous quarters focused on bringing the Slurm + PMIx + PRRTE + UCX stack up to date and filling gaps in the surrounding ecosystem. -This quarter's work centered on three things: keeping the core scheduler and communication libraries current against fast-moving upstream releases, upstreaming the FreeBSD portability fixes accumulated while maintaining these ports so the local patchsets keep shrinking, and adding a new port for MPI-parallel file utilities that are common on large HPC filesystems. - -==== Work completed - -* Updated package:sysutils/slurm-wlm[] twice this quarter, from 25.11.4 to 25.11.5 and then from 25.11.5 to 26.05.1, tracking the latest upstream releases. -* Fixed several FreeBSD-specific runtime issues in package:net/ucx[]: hardened async thread state handling, corrected UCM relocation handling, fixed mm signal socket binding, and resolved other FreeBSD runtime portability issues. -* Updated package:net/ucx[] from 1.20.0 to 1.20.1, and separately fixed a libucm early-init panic together with several gtest suite failures uncovered while validating the update. -* Added package:sysutils/mpifileutils[] as a new port, along with its dependency stack: package:devel/libcircle[], package:devel/lwgrp[], and package:devel/dtcmp[]. These provide MPI-parallel file utilities (copy, remove, checksum, etc.) commonly used on large HPC filesystems. -* Updated package:benchmarks/py-reframe-hpc[] twice this quarter to track upstream releases of the regression testing framework. -* Upstreamed "UCS/TYPE: Portability fixes for non-glibc/Clang environments" to UCX, which was reviewed and merged. -* Opened "UCS/SYS: portability fixes for non-Linux platforms" against UCX, covering hostname buffer sizing, MAC address retrieval via `getifaddrs()`/`AF_LINK`, shared-memory error reporting, `mmap`/`munmap`-based reallocation, and `cpuset_getaffinity()`-based thread affinity queries; currently addressing review feedback. -* Opened a portability PR against mpifileutils guarding Linux-only APIs for FreeBSD and other non-Linux builds; currently in review. -* Collaborated with SchedMD on a Slurm configure-time probe for `H5PTopen`, used to detect the HDF5 high-level library, which was merged upstream. - -==== Work in progress - -* Addressing reviewer feedback on the open UCX and mpifileutils portability pull requests to get them merged upstream and reduce the FreeBSD ports' local patchsets further. -* Continuing collaboration with SchedMD to upstream additional portability fixes discovered while maintaining package:sysutils/slurm-wlm[] on FreeBSD, including BSD socket-handling improvements. -* Evaluating a `proctrack/freebsd_reaper` Slurm plugin design, made possible by recently landed FreeBSD kernel support for exposing reaper metadata in process information. -* Continuing to track upstream Slurm, UCX, and PMIx/PRRTE releases closely to keep the FreeBSD ports current with minimal local patching. - -==== Future plans - -* Land the outstanding UCX and mpifileutils upstream pull requests, and continue identifying further portability issues to upstream rather than patch locally. -* Prototype and submit the Slurm `proctrack/freebsd_reaper` plugin once the underlying kernel interface work is finalized. -* Continue expanding the HPC software ecosystem available in the FreeBSD Ports Collection and reduce local patchsets across the stack wherever upstream acceptance is possible. -* Document a reference Slurm + OpenMPI + PMIx + PRRTE + UCX deployment on FreeBSD to lower the barrier for new sites experimenting with FreeBSD in an HPC context. diff --git a/website/content/en/status/report-2026-04-3036-06/openjdk.adoc b/website/content/en/status/report-2026-04-3036-06/openjdk.adoc deleted file mode 100644 index 77ee433995..0000000000 --- a/website/content/en/status/report-2026-04-3036-06/openjdk.adoc +++ /dev/null @@ -1,61 +0,0 @@ -=== Improve OpenJDK on FreeBSD - -Links: + -link:https://freebsdfoundation.org/project/improving-openjdk-on-freebsd/[Project description] URL: https://freebsdfoundation.org/project/improving-openjdk-on-freebsd/[] + -link:https://github.com/freebsd/openjdk[Project repository] URL: https://github.com/freebsd/openjdk[] + -link:https://github.com/openjdk/bsd-port[Upstream BSD port repo] URL: https://github.com/openjdk/bsd-port[] - -Contact: + -Harald Eilertsen + -FreeBSD Java mailing list - -The goal of this project is to improve OpenJDK support for FreeBSD/amd64 and FreeBSD/arm64. - -Java is an important runtime environment for many high performance, critical enterprise systems. -Making sure Java based applications run correctly and efficiently on FreeBSD is important to ensure that FreeBSD will continue to be a viable and attractive platform for enterprises, as well as businesses and organizations of all sizes. - -This quarter has been spent mostly on getting the upstreaming process properly going. -We submit patches to a link:https://github.com/openjdk/bsd-port[separate repository] under the OpenJDK org on Github, and make sure that each PR is reviewed by at least one upstream reviewer. -This way, when we get to the point where we want to merge our port into the upstream mainline, all commits should already be reviewed by someone in the project. - -This is a fairly slow process, as we depend on upstream reviewers having time. -We also encounter that some of the changes that has been living in our port for a long time is rejected. -Then we have to rework them, or if not strictly needed, just throw them out. -I feel this is a useful correction, but sometimes causes quite a bit of work. - - -In this quarter the following issues/milestones were reached: - -* OpenJDK 25 port was updated to link:https://reviews.freebsd.org/D56522[version 25.0.3]. -* Upstream mainline changes and bugfixes: - - link:https://github.com/openjdk/jdk/pull/30853[8382614: Consolidate implementation of current_stack_base_and_size on BSD] - - link:https://github.com/openjdk/jdk/pull/31069[8384085: Make os::Bsd::dlopen_helper private, and drop unused arg] - - link:https://github.com/openjdk/jdk/pull/31070[8384088: osThread _thread_id should be an int on all BSD's] - - link:https://github.com/openjdk/jdk/pull/31199[8384946: os::Bsd::gettid misses the return value] - - link:https://github.com/openjdk/jdk/pull/31455[8386344: runtime/StackGuardPages/TestStackGuardPages build failure after JDK-8303612] -* Upstream BSD Port: - - link:https://github.com/openjdk/bsd-port/pull/7[Fix conditional sections for BSD in hotspot/cpu] - - link:https://github.com/openjdk/bsd-port/pull/8[Port hotspot/os/posix for BSD] - - Merged changes accepted for mainline. -* Current (out-of-tree) BSD port: - - link:https://github.com/battleblow/jdk/pull/49[Merge + Remove VFORK for BSD + rebase GHA workflow on OpenJDK26] - - link:https://github.com/battleblow/jdk/pull/53[Merge + Fix usage of FREE_C_HEAP_ARRAY macro on BSD] - - link:https://github.com/battleblow/jdk/pull/54[Sync aarch64 cpuinfo impl for *BSD with Linux] - - link:https://github.com/battleblow/jdk/pull/55[Remove duplicate include in global defs for zero] - - link:https://github.com/battleblow/jdk/pull/59[Remove ThreadWXEnable from BSD code] - - Backported changes accepted for mainline upstream BSD port. -* Ports: - - link:https://cgit.freebsd.org/ports/commit/?id=7878106082fd1f07814d754ef767c1f59168d1e9[java/javavmwrapper: JAVA_VERSION does not work with openjdk25] - -In addition, these tasks are still ongoing, or waiting for review: - -* Upstream BSD port: - - link:https://github.com/openjdk/bsd-port/pull/9[Port hotspot/os/bsd/os_perf_bsd.cpp to BSD] (Waiting for refactor, see link:https://github.com/battleblow/jdk/pull/61[WIP: Split os_perf impl for macOS and BSD]) - - link:https://github.com/openjdk/bsd-port/pull/11[os::get_process_uid and os::rss for BSD] (Still ongoing) - -Other notes: - -* Started preparing for link:https://github.com/snake66/jdk/tree/freebsd-jdk27[OpenJDK 27 port]. -* Presented the project at link:https://foss-north.se/2026/speakers-and-talks.html#heilertsen[Foss North 2026]. - -Sponsor: The FreeBSD Foundation -- cgit v1.3