History

Merge tag 'mm-stable-2026-06-18-09-26' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm

Pull MM updates from Andrew Morton: - "selftests/mm: clean up build output and verbosity" (Li Wang) Remove some noise from the MM selftests build - "mm: Free contiguous order-0 pages efficiently" (Ryan Roberts) Speed up the freeing of a batch of 0-order pages by first scanning them for coalescing opportunities. This is applicable to vfree() and to the releasing of frozen pages - "mm/damon: introduce DAMOS failed region quota charge ratio" (SeongJae Park) Address a DAMOS usability issue: The DAMOS quota often exhausts prematurely because it charges for all memory attempted, causing slow and inconsistent performance when actions fail on unreclaimable memory. To fix this, a new feature lets users set a smaller, flexible quota charge ratio (via a numerator and denominator) for failed regions. Since failed actions cause less overhead, reducing their quota cost ensures more predictable and efficient DAMOS processing - "selftests/cgroup: improve zswap tests robustness and support large page sizes" (Li Wang) Fix various spurious failures and improves the overall robustness of the cgroup zswap selftests - "fix MAP_DROPPABLE not supported errno" (Anthony Yznaga) Fix an issue in the mlock selftests on arm32 - "mm: huge_memory: clean up defrag sysfs with shared" (Breno Leitao) Some maintenance work in the huge_memory code - "treewide: fixup gfp_t printks" (Brendan Jackman) Use the special vprintf() gfp_t conversion in various places - "mm: Fix vmemmap optimization accounting and initialization" (Muchun Song) Fix several bugs in the vmemmap optimization, mainly around incorrect page accounting and memmap initialization in the DAX and memory hotplug paths. It also fixes pageblock migratetype initialization and struct page initialization for ZONE_DEVICE compound pages - "mm/damon: repost non-hotfix reviewed patches in damon/next tree" A sprinkle of unrelated minor bugfixes for DAMON - "mm: remove page_mapped()" (David Hildenbrand) Remove this function from the tree, replacing it with folio_mapped() - "mm/damon: let DAMON be paused and resumed" (SeongJae Park) Allow DAMON to be paused and resumed without losing its current state - "kasan: hw_tags: Disable tagging for stack and page-tables" (Muhammad Usama Anjum) Simplify and speed up kasan by removing its ineffective tagging of stacks and page tables - "mm/damon/reclaim,lru_sort: monitor all system rams by default" (SeongJae Park) Simplify deployment on diverse hardware like NUMA systems by updating DAMON_RECLAIM and DAMON_LRU_SORT to automatically monitor the physical address range covering all System RAM areas by default, replacing the overly restrictive behavior that only targeted the single largest memory block to save on negligible overhead - "mm/damon/sysfs: document filters/ directory as deprecated" (SeongJae Park) Update some DAMON docs - "mm: use spinlock guards for zone lock" (Dmitry Ilvokhin) Switch zone->lock handling over to using the guard() mechanisms - "mm/filemap: tighten mmap_miss hit accounting" (fujunjie) Fix a flaw where the mmap_miss counter over-credited page cache hits during fault-arounds and page-fault retries. This results in significant reduction of redundant synchronous mmap readahead I/O, drastically cutting down execution time and gigabytes read for sparse random or strided memory access workloads - "selftests/cgroup: Fix false positive failures in test_percpu_basic" (Li Wang) Fix a couple of false-positives in the cgroup kmem selftests - "mm/damon/reclaim: support monitoring intervals auto-tuning" (SeongJae Park) Add a new parameter to DAMON permitting DAMON_RECLAIM to automatically tune DAMON's sampling and aggregation intervals - "mm/damon/stat: add kdamond_pid parameter" (SeongJae Park) Change DAMON_STAT to provide the pid of its kdamond - "mm/kmemleak: dedupe verbose scan output" (Breno Leitao) Remove large amounts of duplicated backtraces from the verbose-mode kmemleak output - "mm: remove CONFIG_HAVE_BOOTMEM_INFO_NODE (Part 1)" (David Hildenbrand) Reduce our use of CONFIG_HAVE_BOOTMEM_INFO_NODE, with a view to removing it entirely in a later series - "mm/damon: validate min_region_size to be power of 2" (Liew Rui Yan) Prevent users from passing a non-power-of-2 value of `addr_unit', as this later results in undesirable behavior - "mm: document read_pages and simplify usage" (Frederick Mayle) - "tools/mm/page-types: Fix misc bugs" (Ye Liu) Fix three issues in tools/mm/page-types.c - "mm: misc cleanups from __GFP_UNMAPPED series" (Brendan Jackman) Implement several cleanups in the page allocator and related code - "mm, swap: swap table phase IV: unify allocation" (Kairui Song) Unify the allocation and charging of anon and shmem swap in folios, provides better synchronization, consolidates the metadata management, hence dropping the static array and map, and improves performance - "mm/damon: introduce data attributes monitoring" (SeongJae Park( Extend DAMON to monitor general data attributes other than accesses - "mm/vmalloc: free unused pages on vrealloc() shrink" (Shivam Kalra) Implement the TODO in vrealloc() to unmap and free unused pages when shrinking across a page boundary - "mm/damon: documentation and comment fixes" (niecheng) - "remove mmap_action success, error hooks" (Lorenzo Stoakes) Eliminate custom hooks from mmap_action by removing the problematic success_hook which allowed drivers to improperly access uninitialized VMAs. It replaces the error_hook with a simple error-code field and updates the memory char driver accordingly - "mm/damon: minor improvements for code readability and tests" (SeongJae Park) - "mm/damon: fix macro arguments and clarify quota goals doc" (Maksym Shcherba) - "userfaultfd: merge fs/userfaultfd.c into mm/userfaultfd.c" (Mike Rapoport) - "mm/mglru: improve reclaim loop and dirty folio" (Kairui Song and others) Clean up and slightly improves MGLRU's reclaim loop and dirty writeback handling. Large performance improvements are measured - "use vma locks for proc/pid/{smaps|numa_maps} reads" (Suren Baghdasaryan) Use per-vma locks when reading /proc/pid/smaps and numa_maps similar to reduce contention on central mmap_lock - "refactors thpsize_shmem_enabled_store() and thpsize_shmem_enabled_show()" (Ran Xiaokai) Some cleanup work in the THP code - "selftests/memfd: fix compilation warnings" (Konstantin Khorenko) Fix a few build glitches in the memfd selftest code. - "memcg: shrink obj_stock_pcp and cache multiple objcgs" (Shakeel Butt) Resolve a 68% performance regression caused by NUMA-node cache thrashing around struct obj_stock_pcp by shrinking its existing fields and expanding it into a multi-slot array that caches up to five obj_cgroup pointers per CPU, allowing per-node variants of the same memcg to coexist within a single 64-byte cache line. - "zram: writeback fixes" (Sergey Senozhatsky) address a couple of unrelated zram writeback issues - "mm: switch THP shrinker to list_lru" (Johannes Weiner) Resolve NUMA-awareness issues and streamlines callsite interaction by refactoring and extending the list_lru API to completely replace the complex, open-coded deferred split queue for Transparent Huge Pages - "mm: improve large folio readahead for exec memory" (Usama Arif) Improve large-folio readahead on systems like 64K-page arm64 by preventing the mmap_miss check from permanently disabling target-oriented VM_EXEC readahead, and by generalizing the force_thp_readahead gate to support mappings with any usefully large maximum folio order under the cache cap. - "userfaultfd/pagemap: pre-existing fixes" (Kiryl Shutsemau) Fix a bunch of minor issues in the userfaultfd/pagemap, all of which were flagged by Sashiko review of proposed new material - "mm/sparse-vmemmap: Provide generic vmemmap_set_pmd() and vmemmap_check_pmd()" (Muchun Song) Provide generic versions of these two functions so the four arch-specific implementations can be removed. - "mm/swap, PM: hibernate: fix swapoff race in uswsusp by pinning swap device" (Youngjun Park) Address a uswsusp-vs-swapoff race and reduces the swap device reference taking/releasing frequency. - "mm/hmm: A fix and a selftest" (Dev Jain) * tag 'mm-stable-2026-06-18-09-26' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm: (321 commits) selftests/mm/hmm-tests: test pagemap reads of PMD device-private entries fs/proc/task_mmu: do not warn on seeing non-migration pmd entry lib/test_hmm: check alloc_page_vma() return value and handle OOM mm/compaction: cap compact_gap() at COMPACT_CLUSTER_MAX mm/swap: remove redundant swap device reference in alloc/free mm/swap, PM: hibernate: fix swapoff race in uswsusp by pinning swap device mm/filemap: use folio_next_index() for start vmalloc: fix NULL pointer dereference in is_vm_area_hugepages() sparc/mm: drop vmemmap_check_pmd helper and use generic code loongarch/mm: drop vmemmap_check_pmd helper and use generic code riscv/mm: drop vmemmap_pmd helpers and use generic code arm64/mm: drop vmemmap_pmd helpers and use generic code mm/sparse-vmemmap: provide generic vmemmap_set_pmd() and vmemmap_check_pmd() rust: page: mark Page::nid as inline userfaultfd: build __VMA_UFFD_FLAGS from config-gated masks userfaultfd: gate must_wait writability check on pte_present() mm/huge_memory: preserve pmd_swp_uffd_wp on device-private PMD downgrade fs/proc/task_mmu: fix hugetlb self-deadlock in pagemap_scan_pte_hole() fs/proc/task_mmu: use huge_page_size() in pagemap_scan_hugetlb_entry() fs/proc/task_mmu: fix make_uffd_wp_huge_pte() prot-update race ...

Linus Torvalds committed 4 months ago

Commit a552c812 parents c98d767 e3d8707169 files · +9215 −5618Browse files

Showing the changes to drivers/base (2 of 169 files). Show all

Unified · Split

2 files
  1. drivers/base/memory.c +16 −25
  2. drivers/base/node.c +4 −2
drivers/base/memory.c+16−25
@@ -649,7 +649,7 @@ int __weak arch_get_memory_phys_device(unsigned long start_pfn) · 648 unmodified lines
649 *649 *
650 * Called under device_hotplug_lock.650 * Called under device_hotplug_lock.
651 */651 */
652struct memory_block *find_memory_block_by_id(unsigned long block_id)652struct memory_block *memory_block_get(unsigned long block_id)
653{653{
654 struct memory_block *mem;654 struct memory_block *mem;
655 655
@@ -659,16 +659,6 @@ struct memory_block *find_memory_block_by_id(unsigned long block_id) · 3 unmodified lines
659 return mem;659 return mem;
660}660}
661 661
662/*
663 * Called under device_hotplug_lock.
664 */
665struct memory_block *find_memory_block(unsigned long section_nr)
666{
667 unsigned long block_id = memory_block_id(section_nr);
668
669 return find_memory_block_by_id(block_id);
670}
671
672static struct attribute *memory_memblk_attrs[] = {662static struct attribute *memory_memblk_attrs[] = {
673 &dev_attr_phys_index.attr,663 &dev_attr_phys_index.attr,
674 &dev_attr_state.attr,664 &dev_attr_state.attr,
@@ -701,7 +691,7 @@ static int __add_memory_block(struct memory_block *memory) · 26 unmodified lines
701 691
702 ret = device_register(&memory->dev);692 ret = device_register(&memory->dev);
703 if (ret) {693 if (ret) {
704 put_device(&memory->dev);694 memory_block_put(memory);
705 return ret;695 return ret;
706 }696 }
707 ret = xa_err(xa_store(&memory_blocks, memory->dev.id, memory,697 ret = xa_err(xa_store(&memory_blocks, memory->dev.id, memory,
@@ -795,9 +785,9 @@ static int add_memory_block(unsigned long block_id, int nid, unsigned long state · 87 unmodified lines
795 struct memory_block *mem;785 struct memory_block *mem;
796 int ret = 0;786 int ret = 0;
797 787
798 mem = find_memory_block_by_id(block_id);788 mem = memory_block_get(block_id);
799 if (mem) {789 if (mem) {
800 put_device(&mem->dev);790 memory_block_put(mem);
801 return -EEXIST;791 return -EEXIST;
802 }792 }
803 mem = kzalloc_obj(*mem);793 mem = kzalloc_obj(*mem);
@@ -807,7 +797,6 @@ static int add_memory_block(unsigned long block_id, int nid, unsigned long state · 3 unmodified lines
807 mem->start_section_nr = block_id * sections_per_block;797 mem->start_section_nr = block_id * sections_per_block;
808 mem->state = state;798 mem->state = state;
809 mem->nid = nid;799 mem->nid = nid;
810 mem->altmap = altmap;
811 INIT_LIST_HEAD(&mem->group_next);800 INIT_LIST_HEAD(&mem->group_next);
812 801
813#ifndef CONFIG_NUMA802#ifndef CONFIG_NUMA
@@ -825,6 +814,8 @@ static int add_memory_block(unsigned long block_id, int nid, unsigned long state · 11 unmodified lines
825 if (ret)814 if (ret)
826 return ret;815 return ret;
827 816
817 mem->altmap = altmap;
818
828 if (group) {819 if (group) {
829 mem->group = group;820 mem->group = group;
830 list_add(&mem->group_next, &group->memory_blocks);821 list_add(&mem->group_next, &group->memory_blocks);
@@ -845,8 +836,8 @@ static void remove_memory_block(struct memory_block *memory) · 14 unmodified lines
845 memory->group = NULL;836 memory->group = NULL;
846 }837 }
847 838
848 /* drop the ref. we got via find_memory_block() */839 /* drop the ref. we got via memory_block_get() */
849 put_device(&memory->dev);840 memory_block_put(memory);
850 device_unregister(&memory->dev);841 device_unregister(&memory->dev);
851}842}
852 843
@@ -880,7 +871,7 @@ int create_memory_block_devices(unsigned long start, unsigned long size, · 27 unmodified lines
880 end_block_id = block_id;871 end_block_id = block_id;
881 for (block_id = start_block_id; block_id != end_block_id;872 for (block_id = start_block_id; block_id != end_block_id;
882 block_id++) {873 block_id++) {
883 mem = find_memory_block_by_id(block_id);874 mem = memory_block_get(block_id);
884 if (WARN_ON_ONCE(!mem))875 if (WARN_ON_ONCE(!mem))
885 continue;876 continue;
886 remove_memory_block(mem);877 remove_memory_block(mem);
@@ -908,7 +899,7 @@ void remove_memory_block_devices(unsigned long start, unsigned long size) · 21 unmodified lines
908 return;899 return;
909 900
910 for (block_id = start_block_id; block_id != end_block_id; block_id++) {901 for (block_id = start_block_id; block_id != end_block_id; block_id++) {
911 mem = find_memory_block_by_id(block_id);902 mem = memory_block_get(block_id);
912 if (WARN_ON_ONCE(!mem))903 if (WARN_ON_ONCE(!mem))
913 continue;904 continue;
914 num_poisoned_pages_sub(-1UL, memblk_nr_poison(mem));905 num_poisoned_pages_sub(-1UL, memblk_nr_poison(mem));
@@ -1015,12 +1006,12 @@ int walk_memory_blocks(unsigned long start, unsigned long size, · 100 unmodified lines
1015 return 0;1006 return 0;
1016 1007
1017 for (block_id = start_block_id; block_id <= end_block_id; block_id++) {1008 for (block_id = start_block_id; block_id <= end_block_id; block_id++) {
1018 mem = find_memory_block_by_id(block_id);1009 mem = memory_block_get(block_id);
1019 if (!mem)1010 if (!mem)
1020 continue;1011 continue;
1021 1012
1022 ret = func(mem, arg);1013 ret = func(mem, arg);
1023 put_device(&mem->dev);1014 memory_block_put(mem);
1024 if (ret)1015 if (ret)
1025 break;1016 break;
1026 }1017 }
@@ -1228,22 +1219,22 @@ int walk_dynamic_memory_groups(int nid, walk_memory_groups_func_t func, · 201 unmodified lines
1228void memblk_nr_poison_inc(unsigned long pfn)1219void memblk_nr_poison_inc(unsigned long pfn)
1229{1220{
1230 const unsigned long block_id = pfn_to_block_id(pfn);1221 const unsigned long block_id = pfn_to_block_id(pfn);
1231 struct memory_block *mem = find_memory_block_by_id(block_id);1222 struct memory_block *mem = memory_block_get(block_id);
1232 1223
1233 if (mem) {1224 if (mem) {
1234 atomic_long_inc(&mem->nr_hwpoison);1225 atomic_long_inc(&mem->nr_hwpoison);
1235 put_device(&mem->dev);1226 memory_block_put(mem);
1236 }1227 }
1237}1228}
1238 1229
1239void memblk_nr_poison_sub(unsigned long pfn, long i)1230void memblk_nr_poison_sub(unsigned long pfn, long i)
1240{1231{
1241 const unsigned long block_id = pfn_to_block_id(pfn);1232 const unsigned long block_id = pfn_to_block_id(pfn);
1242 struct memory_block *mem = find_memory_block_by_id(block_id);1233 struct memory_block *mem = memory_block_get(block_id);
1243 1234
1244 if (mem) {1235 if (mem) {
1245 atomic_long_sub(i, &mem->nr_hwpoison);1236 atomic_long_sub(i, &mem->nr_hwpoison);
1246 put_device(&mem->dev);1237 memory_block_put(mem);
1247 }1238 }
1248}1239}
1249 1240
drivers/base/node.c+4−2
@@ -523,6 +523,7 @@ static ssize_t node_read_meminfo(struct device *dev, · 522 unmodified lines
523#ifdef CONFIG_UNACCEPTED_MEMORY523#ifdef CONFIG_UNACCEPTED_MEMORY
524 "Node %d Unaccepted: %8lu kB\n"524 "Node %d Unaccepted: %8lu kB\n"
525#endif525#endif
526 "Node %d Balloon: %8lu kB\n"
526 "Node %d GPUActive: %8lu kB\n"527 "Node %d GPUActive: %8lu kB\n"
527 "Node %d GPUReclaim: %8lu kB\n"528 "Node %d GPUReclaim: %8lu kB\n"
528 ,529 ,
@@ -559,6 +560,7 @@ static ssize_t node_read_meminfo(struct device *dev, · 30 unmodified lines
559 nid, K(sum_zone_node_page_state(nid, NR_UNACCEPTED))560 nid, K(sum_zone_node_page_state(nid, NR_UNACCEPTED))
560#endif561#endif
561 ,562 ,
563 nid, K(node_page_state(pgdat, NR_BALLOON_PAGES)),
562 nid, K(node_page_state(pgdat, NR_GPU_ACTIVE)),564 nid, K(node_page_state(pgdat, NR_GPU_ACTIVE)),
563 nid, K(node_page_state(pgdat, NR_GPU_RECLAIM))565 nid, K(node_page_state(pgdat, NR_GPU_RECLAIM))
564 );566 );
@@ -847,13 +849,13 @@ static void register_memory_blocks_under_nodes(void) · 282 unmodified lines
847 for (block_id = start_block_id; block_id <= end_block_id; block_id++) {849 for (block_id = start_block_id; block_id <= end_block_id; block_id++) {
848 struct memory_block *mem;850 struct memory_block *mem;
849 851
850 mem = find_memory_block_by_id(block_id);852 mem = memory_block_get(block_id);
851 if (!mem)853 if (!mem)
852 continue;854 continue;
853 855
854 memory_block_add_nid_early(mem, nid);856 memory_block_add_nid_early(mem, nid);
855 do_register_memory_block_under_node(nid, mem);857 do_register_memory_block_under_node(nid, mem);
856 put_device(&mem->dev);858 memory_block_put(mem);
857 }859 }
858 860
859 }861 }