src/lib/libmemstat, branch release/13.1.0

sys/bitset.h: reduce visibility of BIT_* macros

2022-01-14T16:17:30Z

(cherry picked from commit 5e04571cf3cf4024be926976a6abf19626df30be)

malloc: move malloc_type_internal into malloc_type

2020-11-06T21:33:59Z

According to code comments the original motivation was to allow for malloc_type_internal changes without ABI breakage. This can be trivially accomplished by providing spare fields and versioning the struct, as implemented in the patch below. The upshots are one less memory indirection on each alloc and disappearance of mt_zone. Reviewed by: markj Differential Revision: https://reviews.freebsd.org/D27104

malloc: export kernel zones instead of relying on them being power-of-2

2020-11-02T17:38:08Z

Reviewed by: markj (previous version) Differential Revision: https://reviews.freebsd.org/D27026

memstat_kvm_uma: fix reading of uma_zone_domain structures

2020-08-28T19:50:40Z

Coverity flagged the scaling by sizeof(uzd). That is the type of the pointer, so the scaling was already done by pointer arithmetic. However, this was also passing a stack frame pointer to kvm_read, so it was doubly wrong. Move ZDOM_GET into the !_KERNEL section and use it in libmemstat. Reported by: Coverity Reviewed by: markj MFC after: 2 weeks Sponsored by: Dell EMC Isilon Differential Revision: https://reviews.freebsd.org/D26213

Use per-domain locks for the bucket cache.

2020-02-19T18:48:46Z

This gives much better concurrency when there are a large number of cores per-domain and multiple domains. Avoid taking the lock entirely if it will not be productive. ROUNDROBIN domains will have mixed memory in each domain and will load balance to all domains. While here refactor the zone/domain separation and bucket limits to simplify callers. Reviewed by: markj Differential Revision: https://reviews.freebsd.org/D23673

libmemstat: Catch up with r357776.

2020-02-11T20:15:49Z

Reported by: O. Hartmann

Fix libmemstat_uma build after r357485.

2020-02-04T05:27:45Z

Submitted by: cy

Use per-domain keg locks. This provides both a lock and separate space

2020-01-04T03:30:08Z

accounting for each NUMA domain. Independent keg domain locks are important with cross-domain frees. Hashed zones are non-numa and use a single keg lock to protect the hash table. Reviewed by: markj, rlibby Differential Revision: https://reviews.freebsd.org/D22829

Optimize fast path allocations by storing bucket headers in the per-cpu

2019-12-25T20:50:53Z

cache area. This allows us to check on bucket space for all per-cpu buckets with a single cacheline access and fewer branches. Reviewed by: markj, rlibby Differential Revision: https://reviews.freebsd.org/D22825

Revert r355706 & r355710

2019-12-13T11:21:28Z

The quick fix didn't work. I'll sort it out tomorrow. Revert r355710: "libmemstat: unbreak build" Revert r355706: "uma dbg: flexible size for slab debug bitset too"