| Seq | Timestamp | Type | Name | Duration |
|---|---|---|---|---|
| 0/0 | 2026/07/28 09:11 | flow | patch-triage |
0mArgs:null Results: {
"EnableConfigs": null,
"FocusSymbols": [],
"Reasoning": "The patch is a tree-wide refactoring that introduces `hw_pte_t` as a typedef for `pte_t` (by default) and replaces `pte_t *` with `hw_pte_t *` in various page table manipulation functions. It also replaces direct pointer dereferences with `ptep_get()`. There are no functional changes to the execution flow or logic; it is purely a type renaming and cleanup preparation for future architecture-specific changes.",
"WorthFuzzing": false
} |
| 1/1 | 2026/07/28 09:11 | action | read-patch-diff |
0mArgs:null Results: {
"PatchDiff": "commit bedbb15f09a956bd5571f86925850f5feac4f333\nAuthor: syz-cluster \u003ctriage@syzkaller.com\u003e\nDate: Tue Jul 28 09:11:56 2026 +0000\n\n syz-cluster: applied patch under review\n\ndiff --git a/MAINTAINERS b/MAINTAINERS\nindex 15dd00c7ffec5d..78aac059498295 100644\n--- a/MAINTAINERS\n+++ b/MAINTAINERS\n@@ -16981,6 +16981,7 @@ F:\tinclude/linux/mmu_notifier.h\n F:\tinclude/linux/pagewalk.h\n F:\tinclude/linux/pgalloc.h\n F:\tinclude/linux/pgtable.h\n+F:\tinclude/linux/pgtable_types.h\n F:\tinclude/linux/ptdump.h\n F:\tinclude/linux/vmpressure.h\n F:\tinclude/linux/vmstat.h\ndiff --git a/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c b/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c\nindex d01acfb7d93d09..056faf4a3618b0 100644\n--- a/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c\n+++ b/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c\n@@ -1690,7 +1690,7 @@ static int igt_mmap_gpu(void *arg)\n \treturn 0;\n }\n \n-static int check_present_pte(pte_t *pte, unsigned long addr, void *data)\n+static int check_present_pte(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tpte_t ptent = ptep_get(pte);\n \n@@ -1703,7 +1703,7 @@ static int check_present_pte(pte_t *pte, unsigned long addr, void *data)\n \treturn 0;\n }\n \n-static int check_absent_pte(pte_t *pte, unsigned long addr, void *data)\n+static int check_absent_pte(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tpte_t ptent = ptep_get(pte);\n \ndiff --git a/drivers/gpu/drm/i915/i915_mm.c b/drivers/gpu/drm/i915/i915_mm.c\nindex fd89e7c7d8d6f7..aab88e8edf9465 100644\n--- a/drivers/gpu/drm/i915/i915_mm.c\n+++ b/drivers/gpu/drm/i915/i915_mm.c\n@@ -48,7 +48,7 @@ static inline unsigned long sgt_pfn(const struct remap_pfn *r)\n \t\treturn r-\u003esgt.pfn + (r-\u003esgt.curr \u003e\u003e PAGE_SHIFT);\n }\n \n-static int remap_sg(pte_t *pte, unsigned long addr, void *data)\n+static int remap_sg(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tstruct remap_pfn *r = data;\n \n@@ -70,7 +70,7 @@ static int remap_sg(pte_t *pte, unsigned long addr, void *data)\n #define EXPECTED_FLAGS (VM_PFNMAP | VM_DONTEXPAND | VM_DONTDUMP)\n \n #if IS_ENABLED(CONFIG_X86)\n-static int remap_pfn(pte_t *pte, unsigned long addr, void *data)\n+static int remap_pfn(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tstruct remap_pfn *r = data;\n \ndiff --git a/drivers/misc/sgi-gru/grufault.c b/drivers/misc/sgi-gru/grufault.c\nindex 3557d78ee47a27..ff89d34ad2aa4f 100644\n--- a/drivers/misc/sgi-gru/grufault.c\n+++ b/drivers/misc/sgi-gru/grufault.c\n@@ -228,10 +228,10 @@ static int atomic_pte_lookup(struct vm_area_struct *vma, unsigned long vaddr,\n \t\tgoto err;\n #ifdef CONFIG_X86_64\n \tif (unlikely(pmd_leaf(*pmdp)))\n-\t\tpte = ptep_get((pte_t *)pmdp);\n+\t\tpte = ptep_get((hw_pte_t *)pmdp);\n \telse\n #endif\n-\t\tpte = *pte_offset_kernel(pmdp, vaddr);\n+\t\tpte = ptep_get(pte_offset_kernel(pmdp, vaddr));\n \n \tif (unlikely(!pte_present(pte) ||\n \t\t (write \u0026\u0026 (!pte_write(pte) || !pte_dirty(pte)))))\ndiff --git a/drivers/parisc/sba_iommu.c b/drivers/parisc/sba_iommu.c\nindex d9339dd5082629..27a7efe3e0a707 100644\n--- a/drivers/parisc/sba_iommu.c\n+++ b/drivers/parisc/sba_iommu.c\n@@ -1697,9 +1697,9 @@ sba_common_init(struct sba_device *sba_dev)\n \t\tint res_size;\n #ifdef DEBUG_DMB_TRAP\n \t\textern void iterate_pages(unsigned long , unsigned long ,\n-\t\t\t\t\t void (*)(pte_t * , unsigned long),\n+\t\t\t\t\t void (*)(hw_pte_t *, unsigned long),\n \t\t\t\t\t unsigned long );\n-\t\tvoid set_data_memory_break(pte_t * , unsigned long);\n+\t\tvoid set_data_memory_break(hw_pte_t *, unsigned long);\n #endif\n \t\t/* resource map size dictated by pdir_size */\n \t\tres_size = sba_dev-\u003eioc[i].pdir_size/sizeof(u64); /* entries */\ndiff --git a/drivers/xen/gntdev.c b/drivers/xen/gntdev.c\nindex 1dcc4675580ed1..b013bcad99b5bd 100644\n--- a/drivers/xen/gntdev.c\n+++ b/drivers/xen/gntdev.c\n@@ -301,7 +301,7 @@ void gntdev_put_map(struct gntdev_priv *priv, struct gntdev_grant_map *map)\n \n /* ------------------------------------------------------------------ */\n \n-static int find_grant_ptes(pte_t *pte, unsigned long addr, void *data)\n+static int find_grant_ptes(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tstruct gntdev_grant_map *map = data;\n \tunsigned int pgnr = (addr - map-\u003epages_vm_start) \u003e\u003e PAGE_SHIFT;\ndiff --git a/drivers/xen/privcmd.c b/drivers/xen/privcmd.c\nindex 725a49a0eee72e..b4a487dcc9ecb8 100644\n--- a/drivers/xen/privcmd.c\n+++ b/drivers/xen/privcmd.c\n@@ -1658,7 +1658,7 @@ static int privcmd_mmap(struct file *file, struct vm_area_struct *vma)\n * on a per pfn/pte basis. Mapping calls that fail with ENOENT\n * can be then retried until success.\n */\n-static int is_mapped_fn(pte_t *pte, unsigned long addr, void *data)\n+static int is_mapped_fn(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \treturn pte_none(ptep_get(pte)) ? 0 : -EBUSY;\n }\ndiff --git a/drivers/xen/xenbus/xenbus_client.c b/drivers/xen/xenbus/xenbus_client.c\nindex 27682cb5e58ab5..387f97a5555945 100644\n--- a/drivers/xen/xenbus/xenbus_client.c\n+++ b/drivers/xen/xenbus/xenbus_client.c\n@@ -749,7 +749,7 @@ int xenbus_unmap_ring_vfree(struct xenbus_device *dev, void *vaddr)\n EXPORT_SYMBOL_GPL(xenbus_unmap_ring_vfree);\n \n #ifdef CONFIG_XEN_PV\n-static int map_ring_apply(pte_t *pte, unsigned long addr, void *data)\n+static int map_ring_apply(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tstruct map_ring_valloc *info = data;\n \ndiff --git a/drivers/xen/xlate_mmu.c b/drivers/xen/xlate_mmu.c\nindex 8efd7b55223fbd..d7244f9f9a545a 100644\n--- a/drivers/xen/xlate_mmu.c\n+++ b/drivers/xen/xlate_mmu.c\n@@ -93,7 +93,7 @@ static void setup_hparams(unsigned long gfn, void *data)\n \tinfo-\u003efgfn++;\n }\n \n-static int remap_pte_fn(pte_t *ptep, unsigned long addr, void *data)\n+static int remap_pte_fn(hw_pte_t *ptep, unsigned long addr, void *data)\n {\n \tstruct remap_data *info = data;\n \tstruct page *page = info-\u003epages[info-\u003eindex++];\n@@ -269,7 +269,7 @@ struct remap_pfn {\n \tunsigned long i;\n };\n \n-static int remap_pfn_fn(pte_t *ptep, unsigned long addr, void *data)\n+static int remap_pfn_fn(hw_pte_t *ptep, unsigned long addr, void *data)\n {\n \tstruct remap_pfn *r = data;\n \tstruct page *page = r-\u003epages[r-\u003ei];\ndiff --git a/fs/hugetlbfs/inode.c b/fs/hugetlbfs/inode.c\nindex a578fba8e2fcad..03a538352229b8 100644\n--- a/fs/hugetlbfs/inode.c\n+++ b/fs/hugetlbfs/inode.c\n@@ -328,7 +328,8 @@ static void hugetlb_delete_from_page_cache(struct folio *folio)\n static bool hugetlb_vma_maps_pfn(struct vm_area_struct *vma,\n \t\t\t\tunsigned long addr, unsigned long pfn)\n {\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \n \tptep = hugetlb_walk(vma, addr, huge_page_size(hstate_vma(vma)));\n \tif (!ptep)\ndiff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c\nindex 817e3e0f919430..ff5ef88148b8a1 100644\n--- a/fs/proc/task_mmu.c\n+++ b/fs/proc/task_mmu.c\n@@ -1046,7 +1046,7 @@ static void smaps_pte_hole_lookup(unsigned long addr, struct mm_walk *walk)\n #endif\n }\n \n-static void smaps_pte_entry(pte_t *pte, unsigned long addr,\n+static void smaps_pte_entry(hw_pte_t *pte, unsigned long addr,\n \t\tstruct mm_walk *walk)\n {\n \tstruct mem_size_stats *mss = walk-\u003eprivate;\n@@ -1140,7 +1140,7 @@ static int smaps_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,\n \t\t\t struct mm_walk *walk)\n {\n \tstruct vm_area_struct *vma = walk-\u003evma;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tspinlock_t *ptl;\n \n \tptl = pmd_trans_huge_lock(pmd, vma);\n@@ -1263,7 +1263,7 @@ static void show_smap_vma_flags(struct seq_file *m, struct vm_area_struct *vma)\n }\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static int smaps_hugetlb_range(pte_t *pte, unsigned long hmask,\n+static int smaps_hugetlb_range(hw_pte_t *pte, unsigned long hmask,\n \t\t\t\t unsigned long addr, unsigned long end,\n \t\t\t\t struct mm_walk *walk)\n {\n@@ -1704,7 +1704,7 @@ static inline bool pte_is_pinned(struct vm_area_struct *vma, unsigned long addr,\n }\n \n static inline void clear_soft_dirty(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *pte)\n+\t\tunsigned long addr, hw_pte_t *pte)\n {\n \tif (!pgtable_supports_soft_dirty())\n \t\treturn;\n@@ -1772,7 +1772,8 @@ static int clear_refs_pte_range(pmd_t *pmd, unsigned long addr,\n {\n \tstruct clear_refs_private *cp = walk-\u003eprivate;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n-\tpte_t *pte, ptent;\n+\thw_pte_t *pte;\n+\tpte_t ptent;\n \tspinlock_t *ptl;\n \tstruct folio *folio;\n \n@@ -2172,7 +2173,7 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end,\n \tstruct vm_area_struct *vma = walk-\u003evma;\n \tstruct pagemapread *pm = walk-\u003eprivate;\n \tspinlock_t *ptl;\n-\tpte_t *pte, *orig_pte;\n+\thw_pte_t *pte, *orig_pte;\n \tint err = 0;\n \n #ifdef CONFIG_TRANSPARENT_HUGEPAGE\n@@ -2210,7 +2211,7 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end,\n \n #ifdef CONFIG_HUGETLB_PAGE\n /* This function walks within one hugetlb entry in the single call */\n-static int pagemap_hugetlb_range(pte_t *ptep, unsigned long hmask,\n+static int pagemap_hugetlb_range(hw_pte_t *ptep, unsigned long hmask,\n \t\t\t\t unsigned long addr, unsigned long end,\n \t\t\t\t struct mm_walk *walk)\n {\n@@ -2501,7 +2502,7 @@ static unsigned long pagemap_page_category(struct pagemap_scan_private *p,\n }\n \n static void make_uffd_wp_pte(struct vm_area_struct *vma,\n-\t\t\t unsigned long addr, pte_t *pte, pte_t ptent)\n+\t\t\t unsigned long addr, hw_pte_t *pte, pte_t ptent)\n {\n \tif (pte_present(ptent)) {\n \t\tpte_t old_pte;\n@@ -2634,7 +2635,7 @@ static unsigned long pagemap_hugetlb_category(struct vm_area_struct *vma,\n }\n \n static void make_uffd_wp_huge_pte(struct vm_area_struct *vma,\n-\t\t\t\t unsigned long addr, pte_t *ptep,\n+\t\t\t\t unsigned long addr, hw_pte_t *ptep,\n \t\t\t\t pte_t ptent)\n {\n \tconst unsigned long psize = huge_page_size(hstate_vma(vma));\n@@ -2868,7 +2869,7 @@ static int pagemap_scan_pmd_entry(pmd_t *pmd, unsigned long start,\n \tstruct pagemap_scan_private *p = walk-\u003eprivate;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n \tunsigned long addr, flush_end = 0;\n-\tpte_t *pte, *start_pte;\n+\thw_pte_t *pte, *start_pte;\n \tspinlock_t *ptl;\n \tint ret;\n \n@@ -2962,7 +2963,7 @@ static int pagemap_scan_pmd_entry(pmd_t *pmd, unsigned long start,\n }\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static int pagemap_scan_hugetlb_entry(pte_t *ptep, unsigned long hmask,\n+static int pagemap_scan_hugetlb_entry(hw_pte_t *ptep, unsigned long hmask,\n \t\t\t\t unsigned long start, unsigned long end,\n \t\t\t\t struct mm_walk *walk)\n {\n@@ -3043,7 +3044,7 @@ static int pagemap_scan_hugetlb_hole_wp(struct vm_area_struct *vma,\n \tunsigned long psize = huge_page_size(h);\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n \tspinlock_t *ptl;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpte_t pte;\n \n \tfor (addr = ALIGN_DOWN(addr, psize); addr \u003c end; addr += psize) {\n@@ -3427,8 +3428,8 @@ static int gather_pte_stats(pmd_t *pmd, unsigned long addr,\n \tstruct numa_maps *md = walk-\u003eprivate;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n \tspinlock_t *ptl;\n-\tpte_t *orig_pte;\n-\tpte_t *pte;\n+\thw_pte_t *orig_pte;\n+\thw_pte_t *pte;\n \n #ifdef CONFIG_TRANSPARENT_HUGEPAGE\n \tptl = pmd_trans_huge_lock(pmd, vma);\n@@ -3461,8 +3462,9 @@ static int gather_pte_stats(pmd_t *pmd, unsigned long addr,\n \treturn 0;\n }\n #ifdef CONFIG_HUGETLB_PAGE\n-static int gather_hugetlb_stats(pte_t *pte, unsigned long hmask,\n-\t\tunsigned long addr, unsigned long end, struct mm_walk *walk)\n+static int gather_hugetlb_stats(hw_pte_t *pte, unsigned long hmask,\n+\t\t\t\tunsigned long addr, unsigned long end,\n+\t\t\t\tstruct mm_walk *walk)\n {\n \tpte_t huge_pte;\n \tstruct numa_maps *md;\n@@ -3484,8 +3486,9 @@ static int gather_hugetlb_stats(pte_t *pte, unsigned long hmask,\n }\n \n #else\n-static int gather_hugetlb_stats(pte_t *pte, unsigned long hmask,\n-\t\tunsigned long addr, unsigned long end, struct mm_walk *walk)\n+static int gather_hugetlb_stats(hw_pte_t *pte, unsigned long hmask,\n+\t\t\t\tunsigned long addr, unsigned long end,\n+\t\t\t\tstruct mm_walk *walk)\n {\n \treturn 0;\n }\ndiff --git a/include/asm-generic/hugetlb.h b/include/asm-generic/hugetlb.h\nindex 635c41cc34797b..07dc4acd8eec86 100644\n--- a/include/asm-generic/hugetlb.h\n+++ b/include/asm-generic/hugetlb.h\n@@ -60,7 +60,7 @@ static inline int huge_pte_uffd(pte_t pte)\n \n #ifndef __HAVE_ARCH_HUGE_PTE_CLEAR\n static inline void huge_pte_clear(struct mm_struct *mm, unsigned long addr,\n-\t\t pte_t *ptep, unsigned long sz)\n+\t\t hw_pte_t *ptep, unsigned long sz)\n {\n \tpte_clear(mm, addr, ptep);\n }\n@@ -68,7 +68,7 @@ static inline void huge_pte_clear(struct mm_struct *mm, unsigned long addr,\n \n #ifndef __HAVE_ARCH_HUGE_SET_HUGE_PTE_AT\n static inline void set_huge_pte_at(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, pte_t pte, unsigned long sz)\n+\t\thw_pte_t *ptep, pte_t pte, unsigned long sz)\n {\n \tset_pte_at(mm, addr, ptep, pte);\n }\n@@ -76,7 +76,7 @@ static inline void set_huge_pte_at(struct mm_struct *mm, unsigned long addr,\n \n #ifndef __HAVE_ARCH_HUGE_PTEP_GET_AND_CLEAR\n static inline pte_t huge_ptep_get_and_clear(struct mm_struct *mm,\n-\t\tunsigned long addr, pte_t *ptep, unsigned long sz)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned long sz)\n {\n \treturn ptep_get_and_clear(mm, addr, ptep);\n }\n@@ -84,7 +84,7 @@ static inline pte_t huge_ptep_get_and_clear(struct mm_struct *mm,\n \n #ifndef __HAVE_ARCH_HUGE_PTEP_CLEAR_FLUSH\n static inline pte_t huge_ptep_clear_flush(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep)\n+\t\tunsigned long addr, hw_pte_t *ptep)\n {\n \treturn ptep_clear_flush(vma, addr, ptep);\n }\n@@ -99,7 +99,7 @@ static inline int huge_pte_none(pte_t pte)\n \n #ifndef __HAVE_ARCH_HUGE_PTEP_SET_WRPROTECT\n static inline void huge_ptep_set_wrprotect(struct mm_struct *mm,\n-\t\tunsigned long addr, pte_t *ptep)\n+\t\tunsigned long addr, hw_pte_t *ptep)\n {\n \tptep_set_wrprotect(mm, addr, ptep);\n }\n@@ -107,7 +107,7 @@ static inline void huge_ptep_set_wrprotect(struct mm_struct *mm,\n \n #ifndef __HAVE_ARCH_HUGE_PTEP_SET_ACCESS_FLAGS\n static inline int huge_ptep_set_access_flags(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep,\n+\t\tunsigned long addr, hw_pte_t *ptep,\n \t\tpte_t pte, int dirty)\n {\n \treturn ptep_set_access_flags(vma, addr, ptep, pte, dirty);\n@@ -115,7 +115,8 @@ static inline int huge_ptep_set_access_flags(struct vm_area_struct *vma,\n #endif\n \n #ifndef __HAVE_ARCH_HUGE_PTEP_GET\n-static inline pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr, pte_t *ptep)\n+static inline pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr,\n+\t\t\t\t hw_pte_t *ptep)\n {\n \treturn ptep_get(ptep);\n }\ndiff --git a/include/asm-generic/pgalloc.h b/include/asm-generic/pgalloc.h\nindex 051aa1331051c6..b35e5a2158adaf 100644\n--- a/include/asm-generic/pgalloc.h\n+++ b/include/asm-generic/pgalloc.h\n@@ -16,7 +16,7 @@\n *\n * Return: pointer to the allocated memory or %NULL on error\n */\n-static inline pte_t *__pte_alloc_one_kernel_noprof(struct mm_struct *mm)\n+static inline hw_pte_t *__pte_alloc_one_kernel_noprof(struct mm_struct *mm)\n {\n \tstruct ptdesc *ptdesc = pagetable_alloc_noprof(GFP_PGTABLE_KERNEL, 0);\n \n@@ -40,7 +40,7 @@ static inline pte_t *__pte_alloc_one_kernel_noprof(struct mm_struct *mm)\n *\n * Return: pointer to the allocated memory or %NULL on error\n */\n-static inline pte_t *pte_alloc_one_kernel_noprof(struct mm_struct *mm)\n+static inline hw_pte_t *pte_alloc_one_kernel_noprof(struct mm_struct *mm)\n {\n \treturn __pte_alloc_one_kernel_noprof(mm);\n }\n@@ -52,7 +52,7 @@ static inline pte_t *pte_alloc_one_kernel_noprof(struct mm_struct *mm)\n * @mm: the mm_struct of the current context\n * @pte: pointer to the memory containing the page table\n */\n-static inline void pte_free_kernel(struct mm_struct *mm, pte_t *pte)\n+static inline void pte_free_kernel(struct mm_struct *mm, hw_pte_t *pte)\n {\n \tpagetable_dtor_free(virt_to_ptdesc(pte));\n }\ndiff --git a/include/asm-generic/tlb.h b/include/asm-generic/tlb.h\nindex bdcc2778ac64f4..8cbc9cbf2ea041 100644\n--- a/include/asm-generic/tlb.h\n+++ b/include/asm-generic/tlb.h\n@@ -644,7 +644,9 @@ static inline void tlb_flush_p4d_range(struct mmu_gather *tlb,\n }\n \n #ifndef __tlb_remove_tlb_entry\n-static inline void __tlb_remove_tlb_entry(struct mmu_gather *tlb, pte_t *ptep, unsigned long address)\n+static inline void __tlb_remove_tlb_entry(struct mmu_gather *tlb,\n+\t\t\t\t\t hw_pte_t *ptep,\n+\t\t\t\t\t unsigned long address)\n {\n }\n #endif\n@@ -670,7 +672,7 @@ static inline void __tlb_remove_tlb_entry(struct mmu_gather *tlb, pte_t *ptep, u\n * consecutive ptes instead of only a single one.\n */\n static inline void tlb_remove_tlb_entries(struct mmu_gather *tlb,\n-\t\tpte_t *ptep, unsigned int nr, unsigned long address)\n+\t\thw_pte_t *ptep, unsigned int nr, unsigned long address)\n {\n \ttlb_flush_pte_range(tlb, address, PAGE_SIZE * nr);\n \tfor (;;) {\ndiff --git a/include/linux/hugetlb.h b/include/linux/hugetlb.h\nindex 16c4c4caa126ce..bc0b9c65aa1d0f 100644\n--- a/include/linux/hugetlb.h\n+++ b/include/linux/hugetlb.h\n@@ -141,7 +141,7 @@ unsigned long hugetlb_total_pages(void);\n vm_fault_t hugetlb_fault(struct mm_struct *mm, struct vm_area_struct *vma,\n \t\t\tunsigned long address, unsigned int flags);\n #ifdef CONFIG_USERFAULTFD\n-int hugetlb_mfill_atomic_pte(pte_t *dst_pte,\n+int hugetlb_mfill_atomic_pte(hw_pte_t *dst_pte,\n \t\t\t struct vm_area_struct *dst_vma,\n \t\t\t unsigned long dst_addr,\n \t\t\t unsigned long src_addr,\n@@ -161,7 +161,7 @@ void hugetlb_fix_reserve_counts(struct inode *inode);\n extern struct mutex *hugetlb_fault_mutex_table;\n u32 hugetlb_fault_mutex_hash(struct address_space *mapping, pgoff_t idx);\n \n-pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n+hw_pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n \t\t unsigned long addr, pud_t *pud);\n bool hugetlbfs_pagecache_present(struct hstate *h,\n \t\t\t\t struct vm_area_struct *vma,\n@@ -186,22 +186,22 @@ void hugetlb_bootmem_set_nodes(void);\n * which may go down to the lowest PTE level in their huge_pte_offset() and\n * huge_pte_alloc(): to avoid reliance on pte_offset_map() without pte_unmap().\n */\n-static inline pte_t *pte_offset_huge(pmd_t *pmd, unsigned long address)\n+static inline hw_pte_t *pte_offset_huge(pmd_t *pmd, unsigned long address)\n {\n \treturn pte_offset_kernel(pmd, address);\n }\n-static inline pte_t *pte_alloc_huge(struct mm_struct *mm, pmd_t *pmd,\n+static inline hw_pte_t *pte_alloc_huge(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\t unsigned long address)\n {\n \treturn pte_alloc(mm, pmd) ? NULL : pte_offset_huge(pmd, address);\n }\n #endif\n \n-pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n+hw_pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n \t\t\tunsigned long addr, unsigned long sz);\n /*\n * huge_pte_offset(): Walk the hugetlb pgtable until the last level PTE.\n- * Returns the pte_t* if found, or NULL if the address is not mapped.\n+ * Returns the hw_pte_t* if found, or NULL if the address is not mapped.\n *\n * IMPORTANT: we should normally not directly call this function, instead\n * this is only a common interface to implement arch-specific\n@@ -236,11 +236,11 @@ pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n * a concurrent pmd unshare, but it makes sure the pgtable page is safe to\n * access.\n */\n-pte_t *huge_pte_offset(struct mm_struct *mm,\n+hw_pte_t *huge_pte_offset(struct mm_struct *mm,\n \t\t unsigned long addr, unsigned long sz);\n unsigned long hugetlb_mask_last_page(struct hstate *h);\n int huge_pmd_unshare(struct mmu_gather *tlb, struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep);\n+\t\tunsigned long addr, hw_pte_t *ptep);\n void huge_pmd_unshare_flush(struct mmu_gather *tlb, struct vm_area_struct *vma);\n void adjust_range_if_pmd_sharing_possible(struct vm_area_struct *vma,\n \t\t\t\tunsigned long *start, unsigned long *end);\n@@ -302,7 +302,8 @@ static inline struct address_space *hugetlb_folio_mapping_lock_write(\n }\n \n static inline int huge_pmd_unshare(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, unsigned long addr, pte_t *ptep)\n+\t\tstruct vm_area_struct *vma, unsigned long addr,\n+\t\thw_pte_t *ptep)\n {\n \treturn 0;\n }\n@@ -394,7 +395,7 @@ static inline int is_hugepage_only_range(struct mm_struct *mm,\n }\n \n #ifdef CONFIG_USERFAULTFD\n-static inline int hugetlb_mfill_atomic_pte(pte_t *dst_pte,\n+static inline int hugetlb_mfill_atomic_pte(hw_pte_t *dst_pte,\n \t\t\t\t\t struct vm_area_struct *dst_vma,\n \t\t\t\t\t unsigned long dst_addr,\n \t\t\t\t\t unsigned long src_addr,\n@@ -406,7 +407,7 @@ static inline int hugetlb_mfill_atomic_pte(pte_t *dst_pte,\n }\n #endif /* CONFIG_USERFAULTFD */\n \n-static inline pte_t *huge_pte_offset(struct mm_struct *mm, unsigned long addr,\n+static inline hw_pte_t *huge_pte_offset(struct mm_struct *mm, unsigned long addr,\n \t\t\t\t\tunsigned long sz)\n {\n \treturn NULL;\n@@ -989,7 +990,8 @@ static inline bool htlb_allow_alloc_fallback(enum migrate_reason reason)\n }\n \n static inline spinlock_t *huge_pte_lockptr(struct hstate *h,\n-\t\t\t\t\t struct mm_struct *mm, pte_t *pte)\n+\t\t\t\t\t struct mm_struct *mm,\n+\t\t\t\t\t hw_pte_t *pte)\n {\n \tconst unsigned long size = huge_page_size(h);\n \n@@ -1053,7 +1055,8 @@ static inline void hugetlb_count_sub(long l, struct mm_struct *mm)\n #ifndef huge_ptep_modify_prot_start\n #define huge_ptep_modify_prot_start huge_ptep_modify_prot_start\n static inline pte_t huge_ptep_modify_prot_start(struct vm_area_struct *vma,\n-\t\t\t\t\t\tunsigned long addr, pte_t *ptep)\n+\t\t\t\t\t\tunsigned long addr,\n+\t\t\t\t\t\thw_pte_t *ptep)\n {\n \tunsigned long psize = huge_page_size(hstate_vma(vma));\n \n@@ -1064,7 +1067,8 @@ static inline pte_t huge_ptep_modify_prot_start(struct vm_area_struct *vma,\n #ifndef huge_ptep_modify_prot_commit\n #define huge_ptep_modify_prot_commit huge_ptep_modify_prot_commit\n static inline void huge_ptep_modify_prot_commit(struct vm_area_struct *vma,\n-\t\t\t\t\t\tunsigned long addr, pte_t *ptep,\n+\t\t\t\t\t\tunsigned long addr,\n+\t\t\t\t\t\thw_pte_t *ptep,\n \t\t\t\t\t\tpte_t old_pte, pte_t pte)\n {\n \tunsigned long psize = huge_page_size(hstate_vma(vma));\n@@ -1252,7 +1256,8 @@ static inline bool htlb_allow_alloc_fallback(enum migrate_reason reason)\n }\n \n static inline spinlock_t *huge_pte_lockptr(struct hstate *h,\n-\t\t\t\t\t struct mm_struct *mm, pte_t *pte)\n+\t\t\t\t\t struct mm_struct *mm,\n+\t\t\t\t\t hw_pte_t *pte)\n {\n \treturn \u0026mm-\u003epage_table_lock;\n }\n@@ -1269,11 +1274,11 @@ static inline void hugetlb_count_sub(long l, struct mm_struct *mm)\n {\n }\n \n-pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr, pte_t *ptep);\n+pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr, hw_pte_t *ptep);\n unsigned long huge_pte_dirty(pte_t pte);\n \n static inline pte_t huge_ptep_clear_flush(struct vm_area_struct *vma,\n-\t\t\t\t\t unsigned long addr, pte_t *ptep)\n+\t\t\t\t\t unsigned long addr, hw_pte_t *ptep)\n {\n #ifdef CONFIG_MMU\n \treturn ptep_get(ptep);\n@@ -1283,7 +1288,8 @@ static inline pte_t huge_ptep_clear_flush(struct vm_area_struct *vma,\n }\n \n static inline void set_huge_pte_at(struct mm_struct *mm, unsigned long addr,\n-\t\t\t\t pte_t *ptep, pte_t pte, unsigned long sz)\n+\t\t\t\t hw_pte_t *ptep, pte_t pte,\n+\t\t\t\t unsigned long sz)\n {\n }\n \n@@ -1311,7 +1317,7 @@ static inline void hugetlb_bootmem_struct_page_init(void)\n #endif\t/* CONFIG_HUGETLB_PAGE */\n \n static inline spinlock_t *huge_pte_lock(struct hstate *h,\n-\t\t\t\t\tstruct mm_struct *mm, pte_t *pte)\n+\t\t\t\t\tstruct mm_struct *mm, hw_pte_t *pte)\n {\n \tspinlock_t *ptl;\n \n@@ -1329,12 +1335,12 @@ static inline __init void hugetlb_cma_reserve(void)\n #endif\n \n #ifdef CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING\n-static inline bool hugetlb_pmd_shared(pte_t *pte)\n+static inline bool hugetlb_pmd_shared(hw_pte_t *pte)\n {\n \treturn ptdesc_pmd_is_shared(virt_to_ptdesc(pte));\n }\n #else\n-static inline bool hugetlb_pmd_shared(pte_t *pte)\n+static inline bool hugetlb_pmd_shared(hw_pte_t *pte)\n {\n \treturn false;\n }\n@@ -1361,7 +1367,7 @@ bool __vma_private_lock(struct vm_area_struct *vma);\n * Safe version of huge_pte_offset() to check the locks. See comments\n * above huge_pte_offset().\n */\n-static inline pte_t *\n+static inline hw_pte_t *\n hugetlb_walk(struct vm_area_struct *vma, unsigned long addr, unsigned long sz)\n {\n #if defined(CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING) \u0026\u0026 defined(CONFIG_LOCKDEP)\ndiff --git a/include/linux/kasan.h b/include/linux/kasan.h\nindex bf233bde68c7eb..ff41949c0ac08f 100644\n--- a/include/linux/kasan.h\n+++ b/include/linux/kasan.h\n@@ -51,7 +51,7 @@ typedef unsigned int __bitwise kasan_vmalloc_flags_t;\n #endif\n \n extern unsigned char kasan_early_shadow_page[PAGE_SIZE];\n-extern pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS];\n+extern hw_pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS];\n extern pmd_t kasan_early_shadow_pmd[MAX_PTRS_PER_PMD];\n extern pud_t kasan_early_shadow_pud[MAX_PTRS_PER_PUD];\n extern p4d_t kasan_early_shadow_p4d[MAX_PTRS_PER_P4D];\ndiff --git a/include/linux/mm.h b/include/linux/mm.h\nindex 7fabe6c66b4b73..f41441c4a5a3b4 100644\n--- a/include/linux/mm.h\n+++ b/include/linux/mm.h\n@@ -782,7 +782,7 @@ struct vm_fault {\n \t\t\t\t\t * VM_FAULT_ERROR).\n \t\t\t\t\t */\n \t/* These three entries are valid only while holding ptl lock */\n-\tpte_t *pte;\t\t\t/* Pointer to pte entry matching\n+\thw_pte_t *pte;\t\t\t/* Pointer to pte entry matching\n \t\t\t\t\t * the 'address'. NULL if the page\n \t\t\t\t\t * table hasn't been allocated.\n \t\t\t\t\t */\n@@ -3188,7 +3188,7 @@ struct follow_pfnmap_args {\n \t * The caller shouldn't touch any of these.\n \t */\n \tspinlock_t *lock;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \t/**\n \t * Outputs:\n \t *\n@@ -3525,7 +3525,7 @@ static inline pud_t pud_mkspecial(pud_t pud)\n }\n #endif\t/* CONFIG_ARCH_SUPPORTS_PUD_PFNMAP */\n \n-extern pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,\n+extern hw_pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,\n \t\t\t spinlock_t **ptl);\n \n #ifdef __PAGETABLE_P4D_FOLDED\n@@ -3803,7 +3803,7 @@ static inline spinlock_t *pte_lockptr(struct mm_struct *mm, pmd_t *pmd)\n \treturn ptlock_ptr(page_ptdesc(pmd_page(*pmd)));\n }\n \n-static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, pte_t *pte)\n+static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, hw_pte_t *pte)\n {\n \tBUILD_BUG_ON(IS_ENABLED(CONFIG_HIGHPTE));\n \tBUILD_BUG_ON(MAX_PTRS_PER_PTE * sizeof(pte_t) \u003e PAGE_SIZE);\n@@ -3834,7 +3834,7 @@ static inline spinlock_t *pte_lockptr(struct mm_struct *mm, pmd_t *pmd)\n {\n \treturn \u0026mm-\u003epage_table_lock;\n }\n-static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, pte_t *pte)\n+static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, hw_pte_t *pte)\n {\n \treturn \u0026mm-\u003epage_table_lock;\n }\n@@ -3875,19 +3875,19 @@ static inline bool pagetable_pte_ctor(struct mm_struct *mm,\n \treturn true;\n }\n \n-pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp);\n+hw_pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp);\n \n-static inline pte_t *pte_offset_map(pmd_t *pmd, unsigned long addr)\n+static inline hw_pte_t *pte_offset_map(pmd_t *pmd, unsigned long addr)\n {\n \treturn __pte_offset_map(pmd, addr, NULL);\n }\n \n-pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,\n+hw_pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t unsigned long addr, spinlock_t **ptlp);\n \n-pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,\n+hw_pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\tunsigned long addr, spinlock_t **ptlp);\n-pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,\n+hw_pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\tunsigned long addr, pmd_t *pmdvalp,\n \t\t\t\tspinlock_t **ptlp);\n \n@@ -4836,7 +4836,7 @@ static inline bool gup_can_follow_protnone(const struct vm_area_struct *vma,\n \treturn !vma_is_accessible(vma);\n }\n \n-typedef int (*pte_fn_t)(pte_t *pte, unsigned long addr, void *data);\n+typedef int (*pte_fn_t)(hw_pte_t *pte, unsigned long addr, void *data);\n extern int apply_to_page_range(struct mm_struct *mm, unsigned long address,\n \t\t\t unsigned long size, pte_fn_t fn, void *data);\n extern int apply_to_existing_page_range(struct mm_struct *mm,\n@@ -5086,7 +5086,7 @@ void *vmemmap_alloc_block(unsigned long size, int node);\n struct vmem_altmap;\n void *vmemmap_alloc_block_buf(unsigned long size, int node,\n \t\t\t struct vmem_altmap *altmap);\n-void vmemmap_verify(pte_t *, int, unsigned long, unsigned long);\n+void vmemmap_verify(hw_pte_t *, int, unsigned long, unsigned long);\n void vmemmap_set_pmd(pmd_t *pmd, void *p, int node,\n \t\t unsigned long addr, unsigned long next);\n int vmemmap_check_pmd(pmd_t *pmd, int node,\n@@ -5454,7 +5454,7 @@ static inline bool snapshot_page_is_faithful(const struct page_snapshot *ps)\n \n void snapshot_page(struct page_snapshot *ps, const struct page *page);\n \n-void map_anon_folio_pte_nopf(struct folio *folio, pte_t *pte,\n+void map_anon_folio_pte_nopf(struct folio *folio, hw_pte_t *pte,\n \t\tstruct vm_area_struct *vma, unsigned long addr,\n \t\tbool uffd_wp);\n \ndiff --git a/include/linux/page_table_check.h b/include/linux/page_table_check.h\nindex 12268a32e8be15..933c1028c22326 100644\n--- a/include/linux/page_table_check.h\n+++ b/include/linux/page_table_check.h\n@@ -7,6 +7,8 @@\n #ifndef __LINUX_PAGE_TABLE_CHECK_H\n #define __LINUX_PAGE_TABLE_CHECK_H\n \n+#include \u003clinux/pgtable_types.h\u003e\n+\n #ifdef CONFIG_PAGE_TABLE_CHECK\n #include \u003clinux/jump_label.h\u003e\n \n@@ -21,7 +23,7 @@ void __page_table_check_pmd_clear(struct mm_struct *mm, unsigned long addr,\n void __page_table_check_pud_clear(struct mm_struct *mm, unsigned long addr,\n \t\t\t\t pud_t pud);\n void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, pte_t pte, unsigned int nr);\n+\t\thw_pte_t *ptep, pte_t pte, unsigned int nr);\n void __page_table_check_pmds_set(struct mm_struct *mm, unsigned long addr,\n \t\tpmd_t *pmdp, pmd_t pmd, unsigned int nr);\n void __page_table_check_puds_set(struct mm_struct *mm, unsigned long addr,\n@@ -74,7 +76,8 @@ static inline void page_table_check_pud_clear(struct mm_struct *mm,\n }\n \n static inline void page_table_check_ptes_set(struct mm_struct *mm,\n-\t\t\t\t\t unsigned long addr, pte_t *ptep,\n+\t\t\t\t\t unsigned long addr,\n+\t\t\t\t\t hw_pte_t *ptep,\n \t\t\t\t\t pte_t pte, unsigned int nr)\n {\n \tif (static_branch_likely(\u0026page_table_check_disabled))\n@@ -137,7 +140,8 @@ static inline void page_table_check_pud_clear(struct mm_struct *mm,\n }\n \n static inline void page_table_check_ptes_set(struct mm_struct *mm,\n-\t\t\t\t\t unsigned long addr, pte_t *ptep,\n+\t\t\t\t\t unsigned long addr,\n+\t\t\t\t\t hw_pte_t *ptep,\n \t\t\t\t\t pte_t pte, unsigned int nr)\n {\n }\ndiff --git a/include/linux/pagewalk.h b/include/linux/pagewalk.h\nindex b41d7265c01bc2..7ab2eb39e02c0e 100644\n--- a/include/linux/pagewalk.h\n+++ b/include/linux/pagewalk.h\n@@ -38,7 +38,7 @@ enum page_walk_lock {\n *\t\t\tnot trigger for any populated ranges.\n * @hugetlb_entry:\tif set, called for each hugetlb entry. This hook\n *\t\t\tfunction is called with the vma lock held, in order to\n- *\t\t\tprotect against a concurrent freeing of the pte_t* or\n+ *\t\t\tprotect against a concurrent freeing of the hw_pte_t* or\n *\t\t\tthe ptl. In some cases, the hook function needs to drop\n *\t\t\tand retake the vma lock in order to avoid deadlocks\n *\t\t\twhile calling other functions. In such cases the hook\n@@ -76,11 +76,11 @@ struct mm_walk_ops {\n \t\t\t unsigned long next, struct mm_walk *walk);\n \tint (*pmd_entry)(pmd_t *pmd, unsigned long addr,\n \t\t\t unsigned long next, struct mm_walk *walk);\n-\tint (*pte_entry)(pte_t *pte, unsigned long addr,\n+\tint (*pte_entry)(hw_pte_t *pte, unsigned long addr,\n \t\t\t unsigned long next, struct mm_walk *walk);\n \tint (*pte_hole)(unsigned long addr, unsigned long next,\n \t\t\tint depth, struct mm_walk *walk);\n-\tint (*hugetlb_entry)(pte_t *pte, unsigned long hmask,\n+\tint (*hugetlb_entry)(hw_pte_t *pte, unsigned long hmask,\n \t\t\t unsigned long addr, unsigned long next,\n \t\t\t struct mm_walk *walk);\n \tint (*test_walk)(unsigned long addr, unsigned long next,\n@@ -89,7 +89,7 @@ struct mm_walk_ops {\n \t\t struct mm_walk *walk);\n \tvoid (*post_vma)(struct mm_walk *walk);\n \tint (*install_pte)(unsigned long addr, unsigned long next,\n-\t\t\t pte_t *ptep, struct mm_walk *walk);\n+\t\t\t pte_t *ptentp, struct mm_walk *walk);\n \tenum page_walk_lock walk_lock;\n };\n \n@@ -173,7 +173,7 @@ struct folio_walk {\n \tstruct page *page;\n \tenum folio_walk_level level;\n \tunion {\n-\t\tpte_t *ptep;\n+\t\thw_pte_t *ptep;\n \t\tpud_t *pudp;\n \t\tpmd_t *pmdp;\n \t};\ndiff --git a/include/linux/pgtable.h b/include/linux/pgtable.h\nindex 8c093c119e5a82..3003ac9cd81fe3 100644\n--- a/include/linux/pgtable.h\n+++ b/include/linux/pgtable.h\n@@ -4,6 +4,7 @@\n \n #include \u003clinux/pfn.h\u003e\n #include \u003casm/pgtable.h\u003e\n+#include \u003clinux/pgtable_types.h\u003e\n \n #define PMD_ORDER\t(PMD_SHIFT - PAGE_SHIFT)\n #define PUD_ORDER\t(PUD_SHIFT - PAGE_SHIFT)\n@@ -93,26 +94,26 @@ static inline void pud_init(void *addr)\n #endif\n \n #ifndef pte_offset_kernel\n-static inline pte_t *pte_offset_kernel(pmd_t *pmd, unsigned long address)\n+static inline hw_pte_t *pte_offset_kernel(pmd_t *pmd, unsigned long address)\n {\n-\treturn (pte_t *)pmd_page_vaddr(*pmd) + pte_index(address);\n+\treturn (hw_pte_t *)pmd_page_vaddr(*pmd) + pte_index(address);\n }\n #define pte_offset_kernel pte_offset_kernel\n #endif\n \n #ifdef CONFIG_HIGHPTE\n #define __pte_map(pmd, address) \\\n-\t((pte_t *)kmap_local_page(pmd_page(*(pmd))) + pte_index((address)))\n+\t((hw_pte_t *)kmap_local_page(pmd_page(*(pmd))) + pte_index((address)))\n #define pte_unmap(pte)\tdo {\t\\\n \tkunmap_local((pte));\t\\\n \trcu_read_unlock();\t\\\n } while (0)\n #else\n-static inline pte_t *__pte_map(pmd_t *pmd, unsigned long address)\n+static inline hw_pte_t *__pte_map(pmd_t *pmd, unsigned long address)\n {\n \treturn pte_offset_kernel(pmd, address);\n }\n-static inline void pte_unmap(pte_t *pte)\n+static inline void pte_unmap(hw_pte_t *pte)\n {\n \trcu_read_unlock();\n }\n@@ -172,7 +173,7 @@ static inline pmd_t *pmd_off_k(unsigned long va)\n \treturn pmd_offset(pud_offset(p4d_offset(pgd_offset_k(va), va), va), va);\n }\n \n-static inline pte_t *virt_to_kpte(unsigned long vaddr)\n+static inline hw_pte_t *virt_to_kpte(unsigned long vaddr)\n {\n \tpmd_t *pmd = pmd_off_k(vaddr);\n \n@@ -407,7 +408,7 @@ static inline void lazy_mmu_mode_resume(void) {}\n *\n * May be overridden by the architecture, else pte_batch_hint is always 1.\n */\n-static inline unsigned int pte_batch_hint(pte_t *ptep, pte_t pte)\n+static inline unsigned int pte_batch_hint(hw_pte_t *ptep, pte_t pte)\n {\n \treturn 1;\n }\n@@ -442,7 +443,7 @@ static inline pte_t pte_advance_pfn(pte_t pte, unsigned long nr)\n * to the same folio. The PTEs are all in the same PMD.\n */\n static inline void set_ptes(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, pte_t pte, unsigned int nr)\n+\t\thw_pte_t *ptep, pte_t pte, unsigned int nr)\n {\n \tpage_table_check_ptes_set(mm, addr, ptep, pte, nr);\n \n@@ -459,7 +460,7 @@ static inline void set_ptes(struct mm_struct *mm, unsigned long addr,\n \n #ifndef __HAVE_ARCH_PTEP_SET_ACCESS_FLAGS\n extern int ptep_set_access_flags(struct vm_area_struct *vma,\n-\t\t\t\t unsigned long address, pte_t *ptep,\n+\t\t\t\t unsigned long address, hw_pte_t *ptep,\n \t\t\t\t pte_t entry, int dirty);\n #endif\n \n@@ -490,9 +491,9 @@ static inline int pudp_set_access_flags(struct vm_area_struct *vma,\n #endif\n \n #ifndef ptep_get\n-static inline pte_t ptep_get(pte_t *ptep)\n+static inline pte_t ptep_get(hw_pte_t *ptep)\n {\n-\treturn READ_ONCE(*ptep);\n+\treturn READ_ONCE(__pte_from_hw(*ptep));\n }\n #endif\n \n@@ -526,7 +527,7 @@ static inline pgd_t pgdp_get(pgd_t *pgdp)\n \n #ifndef __HAVE_ARCH_PTEP_TEST_AND_CLEAR_YOUNG\n static inline bool ptep_test_and_clear_young(struct vm_area_struct *vma,\n-\t\tunsigned long address, pte_t *ptep)\n+\t\tunsigned long address, hw_pte_t *ptep)\n {\n \tpte_t pte = ptep_get(ptep);\n \tbool young = true;\n@@ -565,7 +566,7 @@ static inline bool pmdp_test_and_clear_young(struct vm_area_struct *vma,\n \n #ifndef __HAVE_ARCH_PTEP_CLEAR_YOUNG_FLUSH\n bool ptep_clear_flush_young(struct vm_area_struct *vma,\n-\t\tunsigned long address, pte_t *ptep);\n+\t\tunsigned long address, hw_pte_t *ptep);\n #endif\n \n #ifndef __HAVE_ARCH_PMDP_CLEAR_YOUNG_FLUSH\n@@ -644,7 +645,7 @@ static inline void arch_check_zapped_pud(struct vm_area_struct *vma, pud_t pud)\n #ifndef __HAVE_ARCH_PTEP_GET_AND_CLEAR\n static inline pte_t ptep_get_and_clear(struct mm_struct *mm,\n \t\t\t\t unsigned long address,\n-\t\t\t\t pte_t *ptep)\n+\t\t\t\t hw_pte_t *ptep)\n {\n \tpte_t pte = ptep_get(ptep);\n \tpte_clear(mm, address, ptep);\n@@ -673,7 +674,7 @@ static inline pte_t ptep_get_and_clear(struct mm_struct *mm,\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline void clear_young_dirty_ptes(struct vm_area_struct *vma,\n-\t\t\t\t\t unsigned long addr, pte_t *ptep,\n+\t\t\t\t\t unsigned long addr, hw_pte_t *ptep,\n \t\t\t\t\t unsigned int nr, cydp_t flags)\n {\n \tpte_t pte;\n@@ -698,7 +699,7 @@ static inline void clear_young_dirty_ptes(struct vm_area_struct *vma,\n #endif\n \n static inline void ptep_clear(struct mm_struct *mm, unsigned long addr,\n-\t\t\t pte_t *ptep)\n+\t\t\t hw_pte_t *ptep)\n {\n \tpte_t pte = ptep_get(ptep);\n \n@@ -739,7 +740,7 @@ static inline void ptep_clear(struct mm_struct *mm, unsigned long addr,\n * present bit set *unless* it is 'l'. Because get_user_pages_fast() only\n * operates on present ptes we're safe.\n */\n-static inline pte_t ptep_get_lockless(pte_t *ptep)\n+static inline pte_t ptep_get_lockless(hw_pte_t *ptep)\n {\n \tpte_t pte;\n \n@@ -777,7 +778,7 @@ static inline pmd_t pmdp_get_lockless(pmd_t *pmdp)\n * We require that the PTE can be read atomically.\n */\n #ifndef ptep_get_lockless\n-static inline pte_t ptep_get_lockless(pte_t *ptep)\n+static inline pte_t ptep_get_lockless(hw_pte_t *ptep)\n {\n \treturn ptep_get(ptep);\n }\n@@ -844,7 +845,8 @@ static inline pud_t pudp_huge_get_and_clear_full(struct vm_area_struct *vma,\n \n #ifndef __HAVE_ARCH_PTEP_GET_AND_CLEAR_FULL\n static inline pte_t ptep_get_and_clear_full(struct mm_struct *mm,\n-\t\t\t\t\t unsigned long address, pte_t *ptep,\n+\t\t\t\t\t unsigned long address,\n+\t\t\t\t\t hw_pte_t *ptep,\n \t\t\t\t\t int full)\n {\n \treturn ptep_get_and_clear(mm, address, ptep);\n@@ -872,7 +874,7 @@ static inline pte_t ptep_get_and_clear_full(struct mm_struct *mm,\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline pte_t get_and_clear_full_ptes(struct mm_struct *mm,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr, int full)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr, int full)\n {\n \tpte_t pte, tmp_pte;\n \n@@ -908,7 +910,7 @@ static inline pte_t get_and_clear_full_ptes(struct mm_struct *mm,\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline pte_t get_and_clear_ptes(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, unsigned int nr)\n+\t\thw_pte_t *ptep, unsigned int nr)\n {\n \treturn get_and_clear_full_ptes(mm, addr, ptep, nr, 0);\n }\n@@ -933,7 +935,7 @@ static inline pte_t get_and_clear_ptes(struct mm_struct *mm, unsigned long addr,\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline void clear_full_ptes(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, unsigned int nr, int full)\n+\t\thw_pte_t *ptep, unsigned int nr, int full)\n {\n \tfor (;;) {\n \t\tptep_get_and_clear_full(mm, addr, ptep, full);\n@@ -962,7 +964,7 @@ static inline void clear_full_ptes(struct mm_struct *mm, unsigned long addr,\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline void clear_ptes(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, unsigned int nr)\n+\t\thw_pte_t *ptep, unsigned int nr)\n {\n \tclear_full_ptes(mm, addr, ptep, nr, 0);\n }\n@@ -977,13 +979,14 @@ static inline void clear_ptes(struct mm_struct *mm, unsigned long addr,\n */\n #ifndef update_mmu_tlb_range\n static inline void update_mmu_tlb_range(struct vm_area_struct *vma,\n-\t\t\t\tunsigned long address, pte_t *ptep, unsigned int nr)\n+\t\t\t\tunsigned long address, hw_pte_t *ptep,\n+\t\t\t\tunsigned int nr)\n {\n }\n #endif\n \n static inline void update_mmu_tlb(struct vm_area_struct *vma,\n-\t\t\t\tunsigned long address, pte_t *ptep)\n+\t\t\t\tunsigned long address, hw_pte_t *ptep)\n {\n \tupdate_mmu_tlb_range(vma, address, ptep, 1);\n }\n@@ -1000,7 +1003,7 @@ static inline void update_mmu_tlb(struct vm_area_struct *vma,\n * The PTEs are all in the same PMD.\n */\n static inline void clear_nonpresent_ptes(struct mm_struct *mm,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr)\n {\n \t(void)addr;\n \n@@ -1016,7 +1019,7 @@ static inline void clear_nonpresent_ptes(struct mm_struct *mm,\n #ifndef __HAVE_ARCH_PTEP_CLEAR_FLUSH\n extern pte_t ptep_clear_flush(struct vm_area_struct *vma,\n \t\t\t unsigned long address,\n-\t\t\t pte_t *ptep);\n+\t\t\t hw_pte_t *ptep);\n #endif\n \n #ifndef __HAVE_ARCH_PMDP_HUGE_CLEAR_FLUSH\n@@ -1044,7 +1047,8 @@ static inline pmd_t pmd_mkwrite(pmd_t pmd, struct vm_area_struct *vma)\n \n #ifndef __HAVE_ARCH_PTEP_SET_WRPROTECT\n struct mm_struct;\n-static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long address, pte_t *ptep)\n+static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long address,\n+\t\t\t\t hw_pte_t *ptep)\n {\n \tpte_t old_pte = ptep_get(ptep);\n \tset_pte_at(mm, address, ptep, pte_wrprotect(old_pte));\n@@ -1070,7 +1074,7 @@ static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long addres\n * ptep_try_set as an identity macro. The generic stub returns false, which is\n * correct for callers that fall through to oops on failure.\n */\n-static inline bool ptep_try_set(pte_t *ptep, pte_t new_pte)\n+static inline bool ptep_try_set(hw_pte_t *ptep, pte_t new_pte)\n {\n \treturn false;\n }\n@@ -1113,7 +1117,7 @@ static inline void flush_tlb_before_set(unsigned long addr)\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline void wrprotect_ptes(struct mm_struct *mm, unsigned long addr,\n-\t\tpte_t *ptep, unsigned int nr)\n+\t\thw_pte_t *ptep, unsigned int nr)\n {\n \tfor (;;) {\n \t\tptep_set_wrprotect(mm, addr, ptep);\n@@ -1144,7 +1148,7 @@ static inline void wrprotect_ptes(struct mm_struct *mm, unsigned long addr,\n * pages that belong to the same folio. The PTEs are all in the same PMD.\n */\n static inline bool clear_flush_young_ptes(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr)\n {\n \tbool young = false;\n \n@@ -1181,7 +1185,7 @@ static inline bool clear_flush_young_ptes(struct vm_area_struct *vma,\n * Returns: whether any PTE was young.\n */\n static inline bool test_and_clear_young_ptes(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr)\n {\n \tbool young = false;\n \n@@ -1585,7 +1589,7 @@ static inline int pmd_none_or_clear_bad(pmd_t *pmd)\n \n static inline pte_t __ptep_modify_prot_start(struct vm_area_struct *vma,\n \t\t\t\t\t unsigned long addr,\n-\t\t\t\t\t pte_t *ptep)\n+\t\t\t\t\t hw_pte_t *ptep)\n {\n \t/*\n \t * Get the current pte state, but zero it out to make it\n@@ -1597,7 +1601,7 @@ static inline pte_t __ptep_modify_prot_start(struct vm_area_struct *vma,\n \n static inline void __ptep_modify_prot_commit(struct vm_area_struct *vma,\n \t\t\t\t\t unsigned long addr,\n-\t\t\t\t\t pte_t *ptep, pte_t pte)\n+\t\t\t\t\t hw_pte_t *ptep, pte_t pte)\n {\n \t/*\n \t * The pte is non-present, so there's no hardware state to\n@@ -1623,7 +1627,7 @@ static inline void __ptep_modify_prot_commit(struct vm_area_struct *vma,\n */\n static inline pte_t ptep_modify_prot_start(struct vm_area_struct *vma,\n \t\t\t\t\t unsigned long addr,\n-\t\t\t\t\t pte_t *ptep)\n+\t\t\t\t\t hw_pte_t *ptep)\n {\n \treturn __ptep_modify_prot_start(vma, addr, ptep);\n }\n@@ -1636,7 +1640,8 @@ static inline pte_t ptep_modify_prot_start(struct vm_area_struct *vma,\n */\n static inline void ptep_modify_prot_commit(struct vm_area_struct *vma,\n \t\t\t\t\t unsigned long addr,\n-\t\t\t\t\t pte_t *ptep, pte_t old_pte, pte_t pte)\n+\t\t\t\t\t hw_pte_t *ptep, pte_t old_pte,\n+\t\t\t\t\t pte_t pte)\n {\n \t__ptep_modify_prot_commit(vma, addr, ptep, pte);\n }\n@@ -1667,7 +1672,7 @@ static inline void ptep_modify_prot_commit(struct vm_area_struct *vma,\n */\n #ifndef modify_prot_start_ptes\n static inline pte_t modify_prot_start_ptes(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr)\n {\n \tpte_t pte, tmp_pte;\n \n@@ -1707,7 +1712,7 @@ static inline pte_t modify_prot_start_ptes(struct vm_area_struct *vma,\n */\n #ifndef modify_prot_commit_ptes\n static inline void modify_prot_commit_ptes(struct vm_area_struct *vma, unsigned long addr,\n-\t\tpte_t *ptep, pte_t old_pte, pte_t pte, unsigned int nr)\n+\t\thw_pte_t *ptep, pte_t old_pte, pte_t pte, unsigned int nr)\n {\n \tint i;\n \ndiff --git a/include/linux/pgtable_types.h b/include/linux/pgtable_types.h\nnew file mode 100644\nindex 00000000000000..61afe27307ec20\n--- /dev/null\n+++ b/include/linux/pgtable_types.h\n@@ -0,0 +1,12 @@\n+/* SPDX-License-Identifier: GPL-2.0 */\n+#ifndef _LINUX_PGTABLE_TYPES_H\n+#define _LINUX_PGTABLE_TYPES_H\n+\n+#include \u003casm/page.h\u003e\n+\n+#ifndef __HAVE_ARCH_HW_PTE_T\n+#define hw_pte_t pte_t\n+#define __pte_from_hw(pte)\t(pte)\n+#endif\n+\n+#endif /* _LINUX_PGTABLE_TYPES_H */\ndiff --git a/include/linux/rmap.h b/include/linux/rmap.h\nindex a174758f777753..1fc64074283d62 100644\n--- a/include/linux/rmap.h\n+++ b/include/linux/rmap.h\n@@ -868,7 +868,7 @@ struct page_vma_mapped_walk {\n \tstruct vm_area_struct *vma;\n \tunsigned long address;\n \tpmd_t *pmd;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tspinlock_t *ptl;\n \tunsigned int flags;\n \tbool is_anon_walk;\ndiff --git a/include/linux/swapops.h b/include/linux/swapops.h\nindex c956bc445ee013..aeba03c96da1f6 100644\n--- a/include/linux/swapops.h\n+++ b/include/linux/swapops.h\n@@ -215,7 +215,8 @@ static inline swp_entry_t make_migration_entry_dirty(swp_entry_t entry)\n \n extern void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\t\tunsigned long address);\n-extern void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr, pte_t *pte);\n+extern void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr,\n+\t\t\t\t hw_pte_t *pte);\n #else /* CONFIG_MIGRATION */\n static inline swp_entry_t make_readable_migration_entry(pgoff_t offset)\n {\n@@ -235,7 +236,8 @@ static inline swp_entry_t make_writable_migration_entry(pgoff_t offset)\n static inline void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\t\tunsigned long address) { }\n static inline void migration_entry_wait_huge(struct vm_area_struct *vma,\n-\t\t\t\t\t unsigned long addr, pte_t *pte) { }\n+\t\t\t\t\t unsigned long addr,\n+\t\t\t\t\t hw_pte_t *pte) { }\n \n static inline swp_entry_t make_migration_entry_young(swp_entry_t entry)\n {\ndiff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h\nindex e4d8d0a9f30f9f..993566c71d72c8 100644\n--- a/include/linux/vmalloc.h\n+++ b/include/linux/vmalloc.h\n@@ -8,7 +8,7 @@\n #include \u003clinux/init.h\u003e\n #include \u003clinux/list.h\u003e\n #include \u003clinux/llist.h\u003e\n-#include \u003casm/page.h\u003e\t\t/* pgprot_t */\n+#include \u003clinux/pgtable_types.h\u003e\t/* pgprot_t, hw_pte_t */\n #include \u003clinux/rbtree.h\u003e\n #include \u003clinux/overflow.h\u003e\n \n@@ -120,7 +120,7 @@ static inline unsigned long arch_vmap_pte_range_map_size(unsigned long addr, uns\n \n #ifndef arch_vmap_pte_range_unmap_size\n static inline unsigned long arch_vmap_pte_range_unmap_size(unsigned long addr,\n-\t\t\t\t\t\t\t pte_t *ptep)\n+\t\t\t\t\t\t\t hw_pte_t *ptep)\n {\n \treturn PAGE_SIZE;\n }\ndiff --git a/include/trace/events/xen.h b/include/trace/events/xen.h\nindex ad384969e2cb2b..1972d50b043a52 100644\n--- a/include/trace/events/xen.h\n+++ b/include/trace/events/xen.h\n@@ -138,10 +138,10 @@ TRACE_EVENT(xen_mc_extend_args,\n TRACE_DEFINE_SIZEOF(pteval_t);\n \n TRACE_EVENT(xen_mmu_set_pte,\n-\t TP_PROTO(pte_t *ptep, pte_t pteval),\n+\t TP_PROTO(hw_pte_t *ptep, pte_t pteval),\n \t TP_ARGS(ptep, pteval),\n \t TP_STRUCT__entry(\n-\t\t __field(pte_t *, ptep)\n+\t\t __field(hw_pte_t *, ptep)\n \t\t __field(pteval_t, pteval)\n \t\t ),\n \t TP_fast_assign(__entry-\u003eptep = ptep;\n@@ -207,12 +207,12 @@ TRACE_EVENT(xen_mmu_set_p4d,\n \n DECLARE_EVENT_CLASS(xen_mmu_ptep_modify_prot,\n \t TP_PROTO(struct mm_struct *mm, unsigned long addr,\n-\t\t pte_t *ptep, pte_t pteval),\n+\t\t hw_pte_t *ptep, pte_t pteval),\n \t TP_ARGS(mm, addr, ptep, pteval),\n \t TP_STRUCT__entry(\n \t\t __field(struct mm_struct *, mm)\n \t\t __field(unsigned long, addr)\n-\t\t __field(pte_t *, ptep)\n+\t\t __field(hw_pte_t *, ptep)\n \t\t __field(pteval_t, pteval)\n \t\t ),\n \t TP_fast_assign(__entry-\u003emm = mm;\n@@ -227,7 +227,7 @@ DECLARE_EVENT_CLASS(xen_mmu_ptep_modify_prot,\n #define DEFINE_XEN_MMU_PTEP_MODIFY_PROT(name)\t\t\t\t\\\n \tDEFINE_EVENT(xen_mmu_ptep_modify_prot, name,\t\t\t\\\n \t\t TP_PROTO(struct mm_struct *mm, unsigned long addr,\t\\\n-\t\t\t pte_t *ptep, pte_t pteval),\t\t\\\n+\t\t\t hw_pte_t *ptep, pte_t pteval),\t\t\\\n \t\t TP_ARGS(mm, addr, ptep, pteval))\n \n DEFINE_XEN_MMU_PTEP_MODIFY_PROT(xen_mmu_ptep_modify_prot_start);\ndiff --git a/kernel/bpf/arena.c b/kernel/bpf/arena.c\nindex 80b7b8a6944645..c554c07b155925 100644\n--- a/kernel/bpf/arena.c\n+++ b/kernel/bpf/arena.c\n@@ -153,7 +153,7 @@ struct clear_range_data {\n \tstruct page *scratch_page;\n };\n \n-static int apply_range_set_cb(pte_t *pte, unsigned long addr, void *data)\n+static int apply_range_set_cb(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tstruct apply_range_data *d = data;\n \tstruct page *page;\n@@ -204,7 +204,7 @@ static void flush_vmap_cache(unsigned long start, unsigned long size)\n \tflush_cache_vmap(start, start + size);\n }\n \n-static int apply_range_clear_cb(pte_t *pte, unsigned long addr, void *data)\n+static int apply_range_clear_cb(hw_pte_t *pte, unsigned long addr, void *data)\n {\n \tstruct clear_range_data *d = data;\n \tpte_t old_pte;\n@@ -234,7 +234,8 @@ static int apply_range_clear_cb(pte_t *pte, unsigned long addr, void *data)\n \treturn 0;\n }\n \n-static int apply_range_set_scratch_cb(pte_t *pte, unsigned long addr, void *data)\n+static int apply_range_set_scratch_cb(hw_pte_t *pte, unsigned long addr,\n+\t\t\t\t void *data)\n {\n \tstruct page *scratch_page = data;\n \n@@ -336,7 +337,7 @@ static struct bpf_map *arena_map_alloc(union bpf_attr *attr)\n \treturn ERR_PTR(err);\n }\n \n-static int existing_page_cb(pte_t *ptep, unsigned long addr, void *data)\n+static int existing_page_cb(hw_pte_t *ptep, unsigned long addr, void *data)\n {\n \tstruct bpf_arena *arena = data;\n \tstruct page *page;\ndiff --git a/kernel/events/core.c b/kernel/events/core.c\nindex cf78e892a4bb0a..5413c3919935c1 100644\n--- a/kernel/events/core.c\n+++ b/kernel/events/core.c\n@@ -8488,7 +8488,8 @@ static u64 perf_get_pgtable_size(struct mm_struct *mm, unsigned long addr)\n \tp4d_t *p4dp, p4d;\n \tpud_t *pudp, pud;\n \tpmd_t *pmdp, pmd;\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \n \tpgdp = pgd_offset(mm, addr);\n \tpgd = pgdp_get(pgdp);\ndiff --git a/mm/damon/ops-common.c b/mm/damon/ops-common.c\nindex e59f77eca83b2b..8f6ac4223c76e2 100644\n--- a/mm/damon/ops-common.c\n+++ b/mm/damon/ops-common.c\n@@ -39,7 +39,7 @@ struct folio *damon_get_folio(unsigned long pfn)\n \treturn folio;\n }\n \n-void damon_ptep_mkold(pte_t *pte, struct vm_area_struct *vma, unsigned long addr)\n+void damon_ptep_mkold(hw_pte_t *pte, struct vm_area_struct *vma, unsigned long addr)\n {\n \tpte_t pteval = ptep_get(pte);\n \tstruct folio *folio;\ndiff --git a/mm/damon/ops-common.h b/mm/damon/ops-common.h\nindex 38d295488fa181..34b7e5715fcf96 100644\n--- a/mm/damon/ops-common.h\n+++ b/mm/damon/ops-common.h\n@@ -7,7 +7,7 @@\n \n struct folio *damon_get_folio(unsigned long pfn);\n \n-void damon_ptep_mkold(pte_t *pte, struct vm_area_struct *vma, unsigned long addr);\n+void damon_ptep_mkold(hw_pte_t *pte, struct vm_area_struct *vma, unsigned long addr);\n void damon_pmdp_mkold(pmd_t *pmd, struct vm_area_struct *vma, unsigned long addr);\n void damon_folio_mkold(struct folio *folio);\n bool damon_folio_young(struct folio *folio);\ndiff --git a/mm/damon/vaddr.c b/mm/damon/vaddr.c\nindex 4976775fe2762a..ee29aec5a20cde 100644\n--- a/mm/damon/vaddr.c\n+++ b/mm/damon/vaddr.c\n@@ -268,7 +268,7 @@ static void damon_va_walk_page_range(struct mm_struct *mm, unsigned long start,\n static int damon_mkold_pmd_entry(pmd_t *pmd, unsigned long addr,\n \t\tunsigned long next, struct mm_walk *walk)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tspinlock_t *ptl;\n \n \tptl = pmd_trans_huge_lock(pmd, walk-\u003evma);\n@@ -293,7 +293,7 @@ static int damon_mkold_pmd_entry(pmd_t *pmd, unsigned long addr,\n }\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static void damon_hugetlb_mkold(pte_t *pte, struct mm_struct *mm,\n+static void damon_hugetlb_mkold(hw_pte_t *pte, struct mm_struct *mm,\n \t\t\t\tstruct vm_area_struct *vma, unsigned long addr)\n {\n \tbool referenced = false;\n@@ -320,7 +320,7 @@ static void damon_hugetlb_mkold(pte_t *pte, struct mm_struct *mm,\n \tfolio_put(folio);\n }\n \n-static int damon_mkold_hugetlb_entry(pte_t *pte, unsigned long hmask,\n+static int damon_mkold_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,\n \t\t\t\t unsigned long addr, unsigned long end,\n \t\t\t\t struct mm_walk *walk)\n {\n@@ -389,7 +389,7 @@ struct damon_young_walk_private {\n static int damon_young_pmd_entry(pmd_t *pmd, unsigned long addr,\n \t\tunsigned long next, struct mm_walk *walk)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tpte_t ptent;\n \tspinlock_t *ptl;\n \tstruct folio *folio;\n@@ -433,7 +433,7 @@ static int damon_young_pmd_entry(pmd_t *pmd, unsigned long addr,\n }\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static int damon_young_hugetlb_entry(pte_t *pte, unsigned long hmask,\n+static int damon_young_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,\n \t\t\t\t unsigned long addr, unsigned long end,\n \t\t\t\t struct mm_walk *walk)\n {\n@@ -522,7 +522,7 @@ static unsigned int damon_va_check_accesses(struct damon_ctx *ctx)\n \n static bool damos_va_filter_young_match(struct damos_filter *filter,\n \t\tstruct folio *folio, struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, pmd_t *pmdp)\n+\t\tunsigned long addr, hw_pte_t *ptep, pmd_t *pmdp)\n {\n \tbool young = false;\n \n@@ -544,7 +544,7 @@ static bool damos_va_filter_young_match(struct damos_filter *filter,\n \n static bool damos_va_filter_out(struct damos *scheme, struct folio *folio,\n \t\tstruct vm_area_struct *vma, unsigned long addr,\n-\t\tpte_t *ptep, pmd_t *pmdp)\n+\t\thw_pte_t *ptep, pmd_t *pmdp)\n {\n \tstruct damos_filter *filter;\n \tbool matched;\n@@ -640,7 +640,8 @@ static int damos_va_migrate_pmd_entry(pmd_t *pmd, unsigned long addr,\n \tstruct damos_migrate_dests *dests = \u0026s-\u003emigrate_dests;\n \tstruct folio *folio;\n \tspinlock_t *ptl;\n-\tpte_t *start_pte, *pte, ptent;\n+\thw_pte_t *start_pte, *pte;\n+\tpte_t ptent;\n \tint nr;\n \n #ifdef CONFIG_TRANSPARENT_HUGEPAGE\n@@ -800,7 +801,8 @@ static int damos_va_stat_pmd_entry(pmd_t *pmd, unsigned long addr,\n \tstruct vm_area_struct *vma = walk-\u003evma;\n \tstruct folio *folio;\n \tspinlock_t *ptl;\n-\tpte_t *start_pte, *pte, ptent;\n+\thw_pte_t *start_pte, *pte;\n+\tpte_t ptent;\n \tint nr;\n \n #ifdef CONFIG_TRANSPARENT_HUGEPAGE\ndiff --git a/mm/debug_vm_pgtable.c b/mm/debug_vm_pgtable.c\nindex 2875fd22d7bb02..54e194d2a58543 100644\n--- a/mm/debug_vm_pgtable.c\n+++ b/mm/debug_vm_pgtable.c\n@@ -50,7 +50,7 @@ struct pgtable_debug_args {\n \tp4d_t\t\t\t*p4dp;\n \tpud_t\t\t\t*pudp;\n \tpmd_t\t\t\t*pmdp;\n-\tpte_t\t\t\t*ptep;\n+\thw_pte_t\t\t*ptep;\n \n \tp4d_t\t\t\t*start_p4dp;\n \tpud_t\t\t\t*start_pudp;\ndiff --git a/mm/filemap.c b/mm/filemap.c\nindex 1dbb4c6f824e9a..0757dc131d05c2 100644\n--- a/mm/filemap.c\n+++ b/mm/filemap.c\n@@ -3484,7 +3484,7 @@ static vm_fault_t filemap_fault_recheck_pte_none(struct vm_fault *vmf)\n {\n \tstruct vm_area_struct *vma = vmf-\u003evma;\n \tvm_fault_t ret = 0;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \n \t/*\n \t * We might have COW'ed a pagecache folio and might now have an mlocked\n@@ -3790,7 +3790,7 @@ static vm_fault_t filemap_map_folio_range(struct vm_fault *vmf,\n \tvm_fault_t ret = 0;\n \tstruct page *page = folio_page(folio, start);\n \tunsigned int count = 0;\n-\tpte_t *old_ptep = vmf-\u003epte;\n+\thw_pte_t *old_ptep = vmf-\u003epte;\n \tunsigned long addr0;\n \n \t/*\ndiff --git a/mm/gup.c b/mm/gup.c\nindex 1d32e9a3dc79c9..425477d869b524 100644\n--- a/mm/gup.c\n+++ b/mm/gup.c\n@@ -761,7 +761,7 @@ static struct page *follow_huge_pmd(struct vm_area_struct *vma,\n #endif\t/* CONFIG_PGTABLE_HAS_HUGE_LEAVES */\n \n static int follow_pfn_pte(struct vm_area_struct *vma, unsigned long address,\n-\t\tpte_t *pte, unsigned int flags)\n+\t\thw_pte_t *pte, unsigned int flags)\n {\n \tif (flags \u0026 FOLL_TOUCH) {\n \t\tpte_t orig_entry = ptep_get(pte);\n@@ -806,7 +806,8 @@ static struct page *follow_page_pte(struct vm_area_struct *vma,\n \tstruct folio *folio;\n \tstruct page *page;\n \tspinlock_t *ptl;\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \tint ret;\n \n \tptep = pte_offset_map_lock(mm, pmd, address, \u0026ptl);\n@@ -1035,7 +1036,7 @@ static int get_gate_page(struct mm_struct *mm, unsigned long address,\n \tp4d_t *p4d;\n \tpud_t *pud;\n \tpmd_t *pmd;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tpte_t entry;\n \tint ret = -EFAULT;\n \n@@ -2843,7 +2844,7 @@ static int gup_fast_pte_range(pmd_t pmd, pmd_t *pmdp, unsigned long addr,\n \t\tint *nr)\n {\n \tint ret = 0;\n-\tpte_t *ptep, *ptem;\n+\thw_pte_t *ptep, *ptem;\n \n \tptem = ptep = pte_offset_map(\u0026pmd, addr);\n \tif (!ptep)\ndiff --git a/mm/highmem.c b/mm/highmem.c\nindex a33e4118395175..87f94cac6106b7 100644\n--- a/mm/highmem.c\n+++ b/mm/highmem.c\n@@ -141,7 +141,7 @@ EXPORT_SYMBOL(__totalhigh_pages);\n static int pkmap_count[LAST_PKMAP];\n static __cacheline_aligned_in_smp DEFINE_SPINLOCK(kmap_lock);\n \n-pte_t *pkmap_page_table;\n+hw_pte_t *pkmap_page_table;\n \n /*\n * Most architectures have no use for kmap_high_get(), so let's abstract\n@@ -532,9 +532,9 @@ static inline bool kmap_high_unmap_local(unsigned long vaddr)\n \treturn false;\n }\n \n-static pte_t *__kmap_pte;\n+static hw_pte_t *__kmap_pte;\n \n-static pte_t *kmap_get_pte(unsigned long vaddr, int idx)\n+static hw_pte_t *kmap_get_pte(unsigned long vaddr, int idx)\n {\n \tif (IS_ENABLED(CONFIG_KMAP_LOCAL_NON_LINEAR_PTE_ARRAY))\n \t\t/*\n@@ -549,8 +549,9 @@ static pte_t *kmap_get_pte(unsigned long vaddr, int idx)\n \n void *__kmap_local_pfn_prot(unsigned long pfn, pgprot_t prot)\n {\n-\tpte_t pteval, *kmap_pte;\n \tunsigned long vaddr;\n+\thw_pte_t *kmap_pte;\n+\tpte_t pteval;\n \tint idx;\n \n \t/*\n@@ -597,7 +598,7 @@ EXPORT_SYMBOL(__kmap_local_page_prot);\n void kunmap_local_indexed(const void *vaddr)\n {\n \tunsigned long addr = (unsigned long) vaddr \u0026 PAGE_MASK;\n-\tpte_t *kmap_pte;\n+\thw_pte_t *kmap_pte;\n \tint idx;\n \n \tif (addr \u003c __fix_to_virt(FIX_KMAP_END) ||\n@@ -646,7 +647,7 @@ EXPORT_SYMBOL(kunmap_local_indexed);\n void __kmap_local_sched_out(void)\n {\n \tstruct task_struct *tsk = current;\n-\tpte_t *kmap_pte;\n+\thw_pte_t *kmap_pte;\n \tint i;\n \n \t/* Clear kmaps */\n@@ -683,7 +684,7 @@ void __kmap_local_sched_out(void)\n void __kmap_local_sched_in(void)\n {\n \tstruct task_struct *tsk = current;\n-\tpte_t *kmap_pte;\n+\thw_pte_t *kmap_pte;\n \tint i;\n \n \t/* Restore kmaps */\ndiff --git a/mm/hmm.c b/mm/hmm.c\nindex 2b05c53b82dc3a..56208cd603c2a6 100644\n--- a/mm/hmm.c\n+++ b/mm/hmm.c\n@@ -240,7 +240,7 @@ static inline unsigned long pte_to_hmm_pfn_flags(struct hmm_range *range,\n }\n \n static int hmm_vma_handle_pte(struct mm_walk *walk, unsigned long addr,\n-\t\t\t unsigned long end, pmd_t *pmdp, pte_t *ptep,\n+\t\t\t unsigned long end, pmd_t *pmdp, hw_pte_t *ptep,\n \t\t\t unsigned long *hmm_pfn)\n {\n \tstruct hmm_vma_walk *hmm_vma_walk = walk-\u003eprivate;\n@@ -411,7 +411,7 @@ static int hmm_vma_walk_pmd(pmd_t *pmdp,\n \t\t\u0026range-\u003ehmm_pfns[(start - range-\u003estart) \u003e\u003e PAGE_SHIFT];\n \tunsigned long npages = (end - start) \u003e\u003e PAGE_SHIFT;\n \tunsigned long addr = start;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpmd_t pmd;\n \n again:\n@@ -547,7 +547,7 @@ static int hmm_vma_walk_pud(pud_t *pudp, unsigned long start, unsigned long end,\n #endif\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static int hmm_vma_walk_hugetlb_entry(pte_t *pte, unsigned long hmask,\n+static int hmm_vma_walk_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,\n \t\t\t\t unsigned long start, unsigned long end,\n \t\t\t\t struct mm_walk *walk)\n {\ndiff --git a/mm/huge_memory.c b/mm/huge_memory.c\nindex 73522f296cee2d..7f29b397b003ba 100644\n--- a/mm/huge_memory.c\n+++ b/mm/huge_memory.c\n@@ -3056,7 +3056,7 @@ static void __split_huge_zero_page_pmd(struct vm_area_struct *vma,\n \tpgtable_t pgtable;\n \tpmd_t _pmd, old_pmd;\n \tunsigned long addr;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint i;\n \n \t/*\n@@ -3106,7 +3106,7 @@ static void __split_huge_pmd_locked(struct vm_area_struct *vma, pmd_t *pmd,\n \tbool soft_dirty, uffd_wp = false, young = false, write = false;\n \tbool anon_exclusive = false, dirty = false;\n \tunsigned long addr;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint i;\n \n \tVM_BUG_ON(haddr \u0026 ~HPAGE_PMD_MASK);\ndiff --git a/mm/hugetlb.c b/mm/hugetlb.c\nindex 566ce53c154f92..7454b026b92bfa 100644\n--- a/mm/hugetlb.c\n+++ b/mm/hugetlb.c\n@@ -120,7 +120,7 @@ static void hugetlb_vma_lock_free(struct vm_area_struct *vma);\n static void hugetlb_vma_lock_alloc(struct vm_area_struct *vma);\n static void __hugetlb_vma_unlock_write_free(struct vm_area_struct *vma);\n static int __huge_pmd_unshare(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, unsigned long addr, pte_t *ptep,\n+\t\tstruct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,\n \t\tbool check_locks);\n static void hugetlb_unshare_pmds(struct vm_area_struct *vma,\n \t\tunsigned long start, unsigned long end, bool take_locks);\n@@ -4864,7 +4864,7 @@ static pte_t make_huge_pte(struct vm_area_struct *vma, struct folio *folio,\n }\n \n static void set_huge_ptep_writable(struct vm_area_struct *vma,\n-\t\t\t\t unsigned long address, pte_t *ptep)\n+\t\t\t\t unsigned long address, hw_pte_t *ptep)\n {\n \tpte_t entry;\n \n@@ -4874,14 +4874,14 @@ static void set_huge_ptep_writable(struct vm_area_struct *vma,\n }\n \n static void set_huge_ptep_maybe_writable(struct vm_area_struct *vma,\n-\t\t\t\t\t unsigned long address, pte_t *ptep)\n+\t\t\t\t\t unsigned long address, hw_pte_t *ptep)\n {\n \tif (vma-\u003evm_flags \u0026 VM_WRITE)\n \t\tset_huge_ptep_writable(vma, address, ptep);\n }\n \n static void\n-hugetlb_install_folio(struct vm_area_struct *vma, pte_t *ptep, unsigned long addr,\n+hugetlb_install_folio(struct vm_area_struct *vma, hw_pte_t *ptep, unsigned long addr,\n \t\t struct folio *new_folio, pte_t old, unsigned long sz)\n {\n \tpte_t newpte = make_huge_pte(vma, new_folio, true);\n@@ -4907,7 +4907,8 @@ int copy_hugetlb_page_range(struct mm_struct *dst, struct mm_struct *src,\n \t\t\t struct vm_area_struct *dst_vma,\n \t\t\t struct vm_area_struct *src_vma)\n {\n-\tpte_t *src_pte, *dst_pte, entry;\n+\thw_pte_t *src_pte, *dst_pte;\n+\tpte_t entry;\n \tstruct folio *pte_folio;\n \tunsigned long addr;\n \tbool cow = is_cow_mapping(src_vma-\u003evm_flags);\n@@ -5099,7 +5100,8 @@ int copy_hugetlb_page_range(struct mm_struct *dst, struct mm_struct *src,\n }\n \n static void move_huge_pte(struct vm_area_struct *vma, unsigned long old_addr,\n-\t\t\t unsigned long new_addr, pte_t *src_pte, pte_t *dst_pte,\n+\t\t\t unsigned long new_addr, hw_pte_t *src_pte,\n+\t\t\t hw_pte_t *dst_pte,\n \t\t\t unsigned long sz)\n {\n \tbool need_clear_uffd_wp = vma_has_uffd_without_event_remap(vma);\n@@ -5161,7 +5163,7 @@ int move_hugetlb_page_tables(struct vm_area_struct *vma,\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n \tunsigned long old_end = old_addr + len;\n \tunsigned long last_addr_mask;\n-\tpte_t *src_pte, *dst_pte;\n+\thw_pte_t *src_pte, *dst_pte;\n \tstruct mmu_notifier_range range;\n \tstruct mmu_gather tlb;\n \n@@ -5222,7 +5224,7 @@ void __unmap_hugepage_range(struct mmu_gather *tlb, struct vm_area_struct *vma,\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n \tconst bool folio_provided = !!folio;\n \tunsigned long address;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpte_t pte;\n \tspinlock_t *ptl;\n \tstruct hstate *h = hstate_vma(vma);\n@@ -5752,7 +5754,7 @@ static inline vm_fault_t hugetlb_handle_userfault(struct vm_fault *vmf,\n * false if pte changed or is changing.\n */\n static bool hugetlb_pte_stable(struct hstate *h, struct mm_struct *mm, unsigned long addr,\n-\t\t\t pte_t *ptep, pte_t old_pte)\n+\t\t\t hw_pte_t *ptep, pte_t old_pte)\n {\n \tspinlock_t *ptl;\n \tbool same;\n@@ -6277,7 +6279,7 @@ static struct folio *alloc_hugetlb_folio_vma(struct hstate *h,\n * Used by userfaultfd UFFDIO_* ioctls. Based on userfaultfd's mfill_atomic_pte\n * with modifications for hugetlb pages.\n */\n-int hugetlb_mfill_atomic_pte(pte_t *dst_pte,\n+int hugetlb_mfill_atomic_pte(hw_pte_t *dst_pte,\n \t\t\t struct vm_area_struct *dst_vma,\n \t\t\t unsigned long dst_addr,\n \t\t\t unsigned long src_addr,\n@@ -6336,7 +6338,7 @@ int hugetlb_mfill_atomic_pte(pte_t *dst_pte,\n \n \t\tfolio = alloc_hugetlb_folio(dst_vma, dst_addr, false);\n \t\tif (IS_ERR(folio)) {\n-\t\t\tpte_t *actual_pte = hugetlb_walk(dst_vma, dst_addr, PMD_SIZE);\n+\t\t\thw_pte_t *actual_pte = hugetlb_walk(dst_vma, dst_addr, PMD_SIZE);\n \t\t\tif (actual_pte) {\n \t\t\t\tret = -EEXIST;\n \t\t\t\tgoto out;\n@@ -6504,7 +6506,7 @@ long hugetlb_change_protection(struct vm_area_struct *vma,\n {\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n \tunsigned long start = address;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpte_t pte;\n \tstruct hstate *h = hstate_vma(vma);\n \tlong pages = 0, psize = huge_page_size(h);\n@@ -6989,15 +6991,15 @@ void adjust_range_if_pmd_sharing_possible(struct vm_area_struct *vma,\n * racing tasks could either miss the sharing (see huge_pte_offset) or select a\n * bad pmd for sharing.\n */\n-pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n+hw_pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n \t\t unsigned long addr, pud_t *pud)\n {\n \tstruct address_space *mapping = vma-\u003evm_file-\u003ef_mapping;\n \tconst pgoff_t idx = linear_page_index(vma, addr);\n \tstruct vm_area_struct *svma;\n \tunsigned long saddr;\n-\tpte_t *spte = NULL;\n-\tpte_t *pte;\n+\thw_pte_t *spte = NULL;\n+\thw_pte_t *pte;\n \n \ti_mmap_lock_read(mapping);\n \tmapping_rmap_tree_foreach(svma, mapping, idx, idx) {\n@@ -7028,13 +7030,13 @@ pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n \t}\n \tspin_unlock(\u0026mm-\u003epage_table_lock);\n out:\n-\tpte = (pte_t *)pmd_alloc(mm, pud, addr);\n+\tpte = (hw_pte_t *)pmd_alloc(mm, pud, addr);\n \ti_mmap_unlock_read(mapping);\n \treturn pte;\n }\n \n static int __huge_pmd_unshare(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, unsigned long addr, pte_t *ptep,\n+\t\tstruct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,\n \t\tbool check_locks)\n {\n \tunsigned long sz = huge_page_size(hstate_vma(vma));\n@@ -7075,7 +7077,7 @@ static int __huge_pmd_unshare(struct mmu_gather *tlb,\n *\t was not a shared PMD table.\n */\n int huge_pmd_unshare(struct mmu_gather *tlb, struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep)\n+\t\tunsigned long addr, hw_pte_t *ptep)\n {\n \treturn __huge_pmd_unshare(tlb, vma, addr, ptep, /*check_locks=*/true);\n }\n@@ -7105,21 +7107,21 @@ void huge_pmd_unshare_flush(struct mmu_gather *tlb, struct vm_area_struct *vma)\n \n #else /* !CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING */\n \n-pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n+hw_pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,\n \t\t unsigned long addr, pud_t *pud)\n {\n \treturn NULL;\n }\n \n static int __huge_pmd_unshare(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, unsigned long addr, pte_t *ptep,\n+\t\tstruct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,\n \t\tbool check_locks)\n {\n \treturn 0;\n }\n \n int huge_pmd_unshare(struct mmu_gather *tlb, struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep)\n+\t\tunsigned long addr, hw_pte_t *ptep)\n {\n \treturn 0;\n }\n@@ -7140,13 +7142,13 @@ bool want_pmd_share(struct vm_area_struct *vma, unsigned long addr)\n #endif /* CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING */\n \n #ifdef CONFIG_ARCH_WANT_GENERAL_HUGETLB\n-pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n+hw_pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n \t\t\tunsigned long addr, unsigned long sz)\n {\n \tpgd_t *pgd;\n \tp4d_t *p4d;\n \tpud_t *pud;\n-\tpte_t *pte = NULL;\n+\thw_pte_t *pte = NULL;\n \n \tpgd = pgd_offset(mm, addr);\n \tp4d = p4d_alloc(mm, pgd, addr);\n@@ -7155,13 +7157,13 @@ pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n \tpud = pud_alloc(mm, p4d, addr);\n \tif (pud) {\n \t\tif (sz == PUD_SIZE) {\n-\t\t\tpte = (pte_t *)pud;\n+\t\t\tpte = (hw_pte_t *)pud;\n \t\t} else {\n \t\t\tBUG_ON(sz != PMD_SIZE);\n \t\t\tif (want_pmd_share(vma, addr) \u0026\u0026 pud_none(*pud))\n \t\t\t\tpte = huge_pmd_share(mm, vma, addr, pud);\n \t\t\telse\n-\t\t\t\tpte = (pte_t *)pmd_alloc(mm, pud, addr);\n+\t\t\t\tpte = (hw_pte_t *)pmd_alloc(mm, pud, addr);\n \t\t}\n \t}\n \n@@ -7183,7 +7185,7 @@ pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,\n * size @sz doesn't match the hugepage size at this level of the page\n * table.\n */\n-pte_t *huge_pte_offset(struct mm_struct *mm,\n+hw_pte_t *huge_pte_offset(struct mm_struct *mm,\n \t\t unsigned long addr, unsigned long sz)\n {\n \tpgd_t *pgd;\n@@ -7201,14 +7203,14 @@ pte_t *huge_pte_offset(struct mm_struct *mm,\n \tpud = pud_offset(p4d, addr);\n \tif (sz == PUD_SIZE)\n \t\t/* must be pud huge, non-present or none */\n-\t\treturn (pte_t *)pud;\n+\t\treturn (hw_pte_t *)pud;\n \tif (!pud_present(*pud))\n \t\treturn NULL;\n \t/* must have a valid entry and size to go further */\n \n \tpmd = pmd_offset(pud, addr);\n \t/* must be pmd huge, non-present or none */\n-\treturn (pte_t *)pmd;\n+\treturn (hw_pte_t *)pmd;\n }\n \n /*\n@@ -7387,7 +7389,7 @@ static void hugetlb_unshare_pmds(struct vm_area_struct *vma,\n \tstruct mmu_gather tlb;\n \tunsigned long address;\n \tspinlock_t *ptl;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \n \tif (!(vma-\u003evm_flags \u0026 VM_MAYSHARE))\n \t\treturn;\ndiff --git a/mm/hugetlb_vmemmap.c b/mm/hugetlb_vmemmap.c\nindex 917db0984143c2..2850c19c452872 100644\n--- a/mm/hugetlb_vmemmap.c\n+++ b/mm/hugetlb_vmemmap.c\n@@ -33,7 +33,7 @@\n *\t\t\toperations.\n */\n struct vmemmap_remap_walk {\n-\tvoid\t\t\t(*remap_pte)(pte_t *pte, unsigned long addr,\n+\tvoid\t\t\t(*remap_pte)(hw_pte_t *pte, unsigned long addr,\n \t\t\t\t\t struct vmemmap_remap_walk *walk);\n \n \tunsigned long\t\tnr_walked;\n@@ -55,7 +55,7 @@ static int vmemmap_split_pmd(pmd_t *pmd, struct page *head, unsigned long start,\n \tpmd_t __pmd;\n \tint i;\n \tunsigned long addr = start;\n-\tpte_t *pgtable;\n+\thw_pte_t *pgtable;\n \n \tpgtable = pte_alloc_one_kernel(\u0026init_mm);\n \tif (!pgtable)\n@@ -64,7 +64,8 @@ static int vmemmap_split_pmd(pmd_t *pmd, struct page *head, unsigned long start,\n \tpmd_populate_kernel(\u0026init_mm, \u0026__pmd, pgtable);\n \n \tfor (i = 0; i \u003c PTRS_PER_PTE; i++, addr += PAGE_SIZE) {\n-\t\tpte_t entry, *pte;\n+\t\tpte_t entry;\n+\t\thw_pte_t *pte;\n \t\tpgprot_t pgprot = PAGE_KERNEL;\n \n \t\tentry = mk_pte(head + i, pgprot);\n@@ -136,7 +137,7 @@ static int vmemmap_pmd_entry(pmd_t *pmd, unsigned long addr,\n \treturn vmemmap_split_pmd(pmd, head, addr \u0026 PMD_MASK, vmemmap_walk);\n }\n \n-static int vmemmap_pte_entry(pte_t *pte, unsigned long addr,\n+static int vmemmap_pte_entry(hw_pte_t *pte, unsigned long addr,\n \t\t\t unsigned long next, struct mm_walk *walk)\n {\n \tstruct vmemmap_remap_walk *vmemmap_walk = walk-\u003eprivate;\n@@ -198,7 +199,7 @@ static void free_vmemmap_page_list(struct list_head *list)\n \t\tfree_vmemmap_page(page);\n }\n \n-static void vmemmap_remap_pte(pte_t *pte, unsigned long addr,\n+static void vmemmap_remap_pte(hw_pte_t *pte, unsigned long addr,\n \t\t\t struct vmemmap_remap_walk *walk)\n {\n \tstruct page *page = pte_page(ptep_get(pte));\n@@ -232,7 +233,7 @@ static void vmemmap_remap_pte(pte_t *pte, unsigned long addr,\n \tset_pte_at(\u0026init_mm, addr, pte, entry);\n }\n \n-static void vmemmap_restore_pte(pte_t *pte, unsigned long addr,\n+static void vmemmap_restore_pte(hw_pte_t *pte, unsigned long addr,\n \t\t\t\tstruct vmemmap_remap_walk *walk)\n {\n \tstruct page *src = pte_page(ptep_get(pte)), *dst;\ndiff --git a/mm/internal.h b/mm/internal.h\nindex f47f06c555481a..46039190db8bff 100644\n--- a/mm/internal.h\n+++ b/mm/internal.h\n@@ -278,7 +278,7 @@ void unmap_vmas(struct mmu_gather *tlb, struct unmap_desc *unmap);\n #ifdef CONFIG_MMU\n \n bool cond_install_uffd_wp_ptes(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, pte_t pte,\n+\t\tunsigned long addr, hw_pte_t *ptep, pte_t pte,\n \t\tunsigned long nr_ptes);\n \n static inline void get_anon_vma(struct anon_vma *anon_vma)\n@@ -414,7 +414,7 @@ static inline pte_t __pte_batch_clear_ignored(pte_t pte, fpb_t flags)\n * Return: the number of table entries in the batch.\n */\n static inline unsigned int folio_pte_batch_flags(struct folio *folio,\n-\t\tstruct vm_area_struct *vma, pte_t *ptep, pte_t *ptentp,\n+\t\tstruct vm_area_struct *vma, hw_pte_t *ptep, pte_t *ptentp,\n \t\tunsigned int max_nr, fpb_t flags)\n {\n \tbool any_writable = false, any_young = false, any_dirty = false;\n@@ -468,7 +468,7 @@ static inline unsigned int folio_pte_batch_flags(struct folio *folio,\n \treturn min(nr, max_nr);\n }\n \n-unsigned int folio_pte_batch(struct folio *folio, pte_t *ptep, pte_t pte,\n+unsigned int folio_pte_batch(struct folio *folio, hw_pte_t *ptep, pte_t pte,\n \t\tunsigned int max_nr);\n \n /**\n@@ -525,11 +525,11 @@ static inline pte_t pte_next_swp_offset(pte_t pte)\n *\n * Return: the number of table entries in the batch.\n */\n-static inline int swap_pte_batch(pte_t *start_ptep, int max_nr, pte_t pte)\n+static inline int swap_pte_batch(hw_pte_t *start_ptep, int max_nr, pte_t pte)\n {\n \tpte_t expected_pte = pte_next_swp_offset(pte);\n-\tconst pte_t *end_ptep = start_ptep + max_nr;\n-\tpte_t *ptep = start_ptep + 1;\n+\tconst hw_pte_t *end_ptep = start_ptep + max_nr;\n+\thw_pte_t *ptep = start_ptep + 1;\n \n \tVM_WARN_ON(max_nr \u003c 1);\n \tVM_WARN_ON(!softleaf_is_swap(softleaf_from_pte(pte)));\n@@ -1569,7 +1569,7 @@ static inline void maybe_rmap_unlock_action(struct vm_area_struct *vma,\n \n #ifdef CONFIG_MMU_NOTIFIER\n static inline bool clear_flush_young_ptes_notify(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr)\n {\n \tbool young;\n \n@@ -1590,7 +1590,7 @@ static inline bool pmdp_clear_flush_young_notify(struct vm_area_struct *vma,\n }\n \n static inline bool test_and_clear_young_ptes_notify(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, unsigned int nr)\n+\t\tunsigned long addr, hw_pte_t *ptep, unsigned int nr)\n {\n \tbool young;\n \ndiff --git a/mm/kasan/init.c b/mm/kasan/init.c\nindex 66a88388798768..9bbc2a41d23f04 100644\n--- a/mm/kasan/init.c\n+++ b/mm/kasan/init.c\n@@ -64,7 +64,7 @@ static inline bool kasan_pmd_table(pud_t pud)\n \treturn false;\n }\n #endif\n-pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS]\n+hw_pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS]\n \t__bss_pgtbl;\n \n static inline bool kasan_pte_table(pmd_t pmd)\n@@ -92,7 +92,7 @@ static __init void *early_alloc(size_t size, int node)\n static void __ref zero_pte_populate(pmd_t *pmd, unsigned long addr,\n \t\t\t\tunsigned long end)\n {\n-\tpte_t *pte = pte_offset_kernel(pmd, addr);\n+\thw_pte_t *pte = pte_offset_kernel(pmd, addr);\n \tpte_t zero_pte;\n \n \tzero_pte = pfn_pte(PFN_DOWN(__pa_symbol(kasan_early_shadow_page)),\n@@ -122,7 +122,7 @@ static int __ref zero_pmd_populate(pud_t *pud, unsigned long addr,\n \t\t}\n \n \t\tif (pmd_none(*pmd)) {\n-\t\t\tpte_t *p;\n+\t\t\thw_pte_t *p;\n \n \t\t\tif (slab_is_available())\n \t\t\t\tp = pte_alloc_one_kernel(\u0026init_mm);\n@@ -281,9 +281,9 @@ int __ref kasan_populate_early_shadow(const void *shadow_start,\n \treturn 0;\n }\n \n-static void kasan_free_pte(pte_t *pte_start, pmd_t *pmd)\n+static void kasan_free_pte(hw_pte_t *pte_start, pmd_t *pmd)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint i;\n \n \tfor (i = 0; i \u003c PTRS_PER_PTE; i++) {\n@@ -341,7 +341,7 @@ static void kasan_free_p4d(p4d_t *p4d_start, pgd_t *pgd)\n \tpgd_clear(pgd);\n }\n \n-static void kasan_remove_pte_table(pte_t *pte, unsigned long addr,\n+static void kasan_remove_pte_table(hw_pte_t *pte, unsigned long addr,\n \t\t\t\tunsigned long end)\n {\n \tunsigned long next;\n@@ -369,7 +369,7 @@ static void kasan_remove_pmd_table(pmd_t *pmd, unsigned long addr,\n \tunsigned long next;\n \n \tfor (; addr \u003c end; addr = next, pmd++) {\n-\t\tpte_t *pte;\n+\t\thw_pte_t *pte;\n \n \t\tnext = pmd_addr_end(addr, end);\n \ndiff --git a/mm/kasan/shadow.c b/mm/kasan/shadow.c\nindex d286e0a0454370..86fc7ed45dcd02 100644\n--- a/mm/kasan/shadow.c\n+++ b/mm/kasan/shadow.c\n@@ -189,7 +189,7 @@ static bool shadow_mapped(unsigned long addr)\n \tp4d_t *p4d;\n \tpud_t *pud;\n \tpmd_t *pmd;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \tif (pgd_none(*pgd))\n \t\treturn false;\n@@ -297,7 +297,7 @@ struct vmalloc_populate_data {\n \tstruct page **pages;\n };\n \n-static int kasan_populate_vmalloc_pte(pte_t *ptep, unsigned long addr,\n+static int kasan_populate_vmalloc_pte(hw_pte_t *ptep, unsigned long addr,\n \t\t\t\t void *_data)\n {\n \tstruct vmalloc_populate_data *data = _data;\n@@ -465,7 +465,7 @@ int __kasan_populate_vmalloc(unsigned long addr, unsigned long size, gfp_t gfp_m\n \treturn 0;\n }\n \n-static int kasan_depopulate_vmalloc_pte(pte_t *ptep, unsigned long addr,\n+static int kasan_depopulate_vmalloc_pte(hw_pte_t *ptep, unsigned long addr,\n \t\t\t\t\tvoid *unused)\n {\n \tpte_t pte;\ndiff --git a/mm/khugepaged.c b/mm/khugepaged.c\nindex 27e8f3077e80fe..8cbe6943fea062 100644\n--- a/mm/khugepaged.c\n+++ b/mm/khugepaged.c\n@@ -637,7 +637,7 @@ static void release_pte_folio(struct folio *folio)\n \tfolio_putback_lru(folio);\n }\n \n-static void release_pte_pages(pte_t *pte, pte_t *_pte,\n+static void release_pte_pages(hw_pte_t *pte, hw_pte_t *_pte,\n \t\tstruct list_head *compound_pagelist)\n {\n \tstruct folio *folio, *tmp;\n@@ -665,7 +665,7 @@ static void release_pte_pages(pte_t *pte, pte_t *_pte,\n }\n \n static enum scan_result __collapse_huge_page_isolate(struct vm_area_struct *vma,\n-\t\tunsigned long start_addr, pte_t *pte, struct collapse_control *cc,\n+\t\tunsigned long start_addr, hw_pte_t *pte, struct collapse_control *cc,\n \t\tunsigned int order, struct list_head *compound_pagelist)\n {\n \tconst unsigned int max_ptes_none = collapse_max_ptes_none(cc, vma, order);\n@@ -674,7 +674,7 @@ static enum scan_result __collapse_huge_page_isolate(struct vm_area_struct *vma,\n \tstruct page *page = NULL;\n \tstruct folio *folio = NULL;\n \tunsigned long addr = start_addr;\n-\tpte_t *_pte;\n+\thw_pte_t *_pte;\n \tint none_or_zero = 0, shared = 0, referenced = 0;\n \tenum scan_result result = SCAN_FAIL;\n \n@@ -828,7 +828,7 @@ static enum scan_result __collapse_huge_page_isolate(struct vm_area_struct *vma,\n \treturn result;\n }\n \n-static void __collapse_huge_page_copy_succeeded(pte_t *pte,\n+static void __collapse_huge_page_copy_succeeded(hw_pte_t *pte,\n \t\tstruct vm_area_struct *vma, unsigned long address,\n \t\tspinlock_t *ptl, unsigned int order,\n \t\tstruct list_head *compound_pagelist)\n@@ -837,7 +837,7 @@ static void __collapse_huge_page_copy_succeeded(pte_t *pte,\n \tunsigned long end = address + (PAGE_SIZE * nr_pages);\n \tstruct folio *src, *tmp;\n \tpte_t pteval;\n-\tpte_t *_pte;\n+\thw_pte_t *_pte;\n \tunsigned int nr_ptes;\n \n \tfor (_pte = pte; _pte \u003c pte + nr_pages; _pte += nr_ptes,\n@@ -892,7 +892,7 @@ static void __collapse_huge_page_copy_succeeded(pte_t *pte,\n \t}\n }\n \n-static void __collapse_huge_page_copy_failed(pte_t *pte,\n+static void __collapse_huge_page_copy_failed(hw_pte_t *pte,\n \t\tpmd_t *pmd, pmd_t orig_pmd, struct vm_area_struct *vma,\n \t\tunsigned int order, struct list_head *compound_pagelist)\n {\n@@ -930,7 +930,7 @@ static void __collapse_huge_page_copy_failed(pte_t *pte,\n * @ptl: lock on raw pages' PTEs\n * @compound_pagelist: list that stores compound pages\n */\n-static enum scan_result __collapse_huge_page_copy(pte_t *pte, struct folio *folio,\n+static enum scan_result __collapse_huge_page_copy(hw_pte_t *pte, struct folio *folio,\n \t\tpmd_t *pmd, pmd_t orig_pmd, struct vm_area_struct *vma,\n \t\tunsigned long address, spinlock_t *ptl, unsigned int order,\n \t\tstruct list_head *compound_pagelist)\n@@ -1152,7 +1152,7 @@ static enum scan_result __collapse_huge_page_swapin(struct mm_struct *mm,\n \tvm_fault_t ret = 0;\n \tunsigned long addr, end = start_addr + (PAGE_SIZE \u003c\u003c order);\n \tenum scan_result result;\n-\tpte_t *pte = NULL;\n+\thw_pte_t *pte = NULL;\n \tspinlock_t *ptl;\n \n \tfor (addr = start_addr; addr \u003c end; addr += PAGE_SIZE) {\n@@ -1283,7 +1283,7 @@ static enum scan_result collapse_huge_page(struct mm_struct *mm, unsigned long s\n \tconst unsigned long end_addr = start_addr + (PAGE_SIZE \u003c\u003c order);\n \tLIST_HEAD(compound_pagelist);\n \tpmd_t *pmd, _pmd;\n-\tpte_t *pte = NULL;\n+\thw_pte_t *pte = NULL;\n \tpgtable_t pgtable;\n \tstruct folio *folio;\n \tspinlock_t *pmd_ptl, *pte_ptl;\n@@ -1597,7 +1597,8 @@ static enum scan_result collapse_scan_pmd(struct mm_struct *mm,\n \tunsigned int max_ptes_none = collapse_max_ptes_none(cc, vma, HPAGE_PMD_ORDER);\n \tenum tva_type tva_flags = cc-\u003eis_khugepaged ? TVA_KHUGEPAGED : TVA_FORCED_COLLAPSE;\n \tpmd_t *pmd;\n-\tpte_t *pte, *_pte, pteval;\n+\thw_pte_t *pte, *_pte;\n+\tpte_t pteval;\n \tint i;\n \tint none_or_zero = 0, shared = 0, referenced = 0;\n \tenum scan_result result = SCAN_FAIL;\n@@ -1864,7 +1865,7 @@ static enum scan_result try_collapse_pte_mapped_thp(struct mm_struct *mm, unsign\n \tunsigned long end = haddr + HPAGE_PMD_SIZE;\n \tstruct vm_area_struct *vma = vma_lookup(mm, haddr);\n \tstruct folio *folio;\n-\tpte_t *start_pte, *pte;\n+\thw_pte_t *start_pte, *pte;\n \tpmd_t *pmd, pgt_pmd;\n \tspinlock_t *pml = NULL, *ptl;\n \tint i;\ndiff --git a/mm/ksm.c b/mm/ksm.c\nindex b9b32f7bfb691e..1234e6c8b636cd 100644\n--- a/mm/ksm.c\n+++ b/mm/ksm.c\n@@ -618,7 +618,7 @@ static int break_ksm_pmd_entry(pmd_t *pmdp, unsigned long addr, unsigned long en\n {\n \tunsigned long *found_addr = (unsigned long *) walk-\u003eprivate;\n \tstruct mm_struct *mm = walk-\u003emm;\n-\tpte_t *start_ptep, *ptep;\n+\thw_pte_t *start_ptep, *ptep;\n \tspinlock_t *ptl;\n \tint found = 0;\n \n@@ -1292,7 +1292,7 @@ static u32 calc_checksum(struct page *page)\n }\n \n static int write_protect_page(struct vm_area_struct *vma, struct folio *folio,\n-\t\t\t pte_t *orig_pte)\n+\t\t\t pte_t *ptentp)\n {\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n \tDEFINE_FOLIO_VMA_WALK(pvmw, folio, vma, 0, 0);\n@@ -1371,7 +1371,7 @@ static int write_protect_page(struct vm_area_struct *vma, struct folio *folio,\n \n \t\tset_pte_at(mm, pvmw.address, pvmw.pte, entry);\n \t}\n-\t*orig_pte = entry;\n+\t*ptentp = entry;\n \terr = 0;\n \n out_unlock:\n@@ -1399,7 +1399,7 @@ static int replace_page(struct vm_area_struct *vma, struct page *page,\n \tstruct folio *folio = page_folio(page);\n \tpmd_t *pmd;\n \tpmd_t pmde;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpte_t newpte;\n \tspinlock_t *ptl;\n \tunsigned long addr;\n@@ -2531,7 +2531,8 @@ static int ksm_next_page_pmd_entry(pmd_t *pmdp, unsigned long addr, unsigned lon\n {\n \tstruct ksm_next_page_arg *private = walk-\u003eprivate;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n-\tpte_t *start_ptep = NULL, *ptep, pte;\n+\thw_pte_t *start_ptep = NULL, *ptep;\n+\tpte_t pte;\n \tstruct mm_struct *mm = walk-\u003emm;\n \tstruct folio *folio;\n \tstruct page *page;\ndiff --git a/mm/madvise.c b/mm/madvise.c\nindex 07a21ca31bad4d..6f99cef91b6bd8 100644\n--- a/mm/madvise.c\n+++ b/mm/madvise.c\n@@ -189,7 +189,7 @@ static int swapin_walk_pmd_entry(pmd_t *pmd, unsigned long start,\n {\n \tstruct vm_area_struct *vma = walk-\u003eprivate;\n \tstruct swap_io_ctx ctx = {};\n-\tpte_t *ptep = NULL;\n+\thw_pte_t *ptep = NULL;\n \tspinlock_t *ptl;\n \tunsigned long addr;\n \n@@ -341,7 +341,7 @@ static inline bool can_do_file_pageout(struct vm_area_struct *vma)\n }\n \n static inline int madvise_folio_pte_batch(unsigned long addr, unsigned long end,\n-\t\t\t\t\t struct folio *folio, pte_t *ptep,\n+\t\t\t\t\t struct folio *folio, hw_pte_t *ptep,\n \t\t\t\t\t pte_t *ptentp)\n {\n \tint max_nr = (end - addr) / PAGE_SIZE;\n@@ -359,7 +359,8 @@ static int madvise_cold_or_pageout_pte_range(pmd_t *pmd,\n \tbool pageout = private-\u003epageout;\n \tstruct mm_struct *mm = tlb-\u003emm;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n-\tpte_t *start_pte, *pte, ptent;\n+\thw_pte_t *start_pte, *pte;\n+\tpte_t ptent;\n \tspinlock_t *ptl;\n \tstruct folio *folio = NULL;\n \tLIST_HEAD(folio_list);\n@@ -658,7 +659,8 @@ static int madvise_free_pte_range(pmd_t *pmd, unsigned long addr,\n \tstruct mm_struct *mm = tlb-\u003emm;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n \tspinlock_t *ptl;\n-\tpte_t *start_pte, *pte, ptent;\n+\thw_pte_t *start_pte, *pte;\n+\tpte_t ptent;\n \tstruct folio *folio;\n \tint nr_swap = 0;\n \tunsigned long next;\n@@ -1083,7 +1085,7 @@ static int guard_install_pmd_entry(pmd_t *pmd, unsigned long addr,\n \treturn pmd_trans_huge(pmdval);\n }\n \n-static int guard_install_pte_entry(pte_t *pte, unsigned long addr,\n+static int guard_install_pte_entry(hw_pte_t *pte, unsigned long addr,\n \t\t\t\t unsigned long next, struct mm_walk *walk)\n {\n \tpte_t pteval = ptep_get(pte);\n@@ -1101,12 +1103,12 @@ static int guard_install_pte_entry(pte_t *pte, unsigned long addr,\n }\n \n static int guard_install_set_pte(unsigned long addr, unsigned long next,\n-\t\t\t\t pte_t *ptep, struct mm_walk *walk)\n+\t\t\t\t pte_t *ptentp, struct mm_walk *walk)\n {\n \tunsigned long *nr_pages = (unsigned long *)walk-\u003eprivate;\n \n \t/* Simply install a PTE marker, this causes segfault on access. */\n-\t*ptep = make_pte_marker(PTE_MARKER_GUARD);\n+\t*ptentp = make_pte_marker(PTE_MARKER_GUARD);\n \t(*nr_pages)++;\n \n \treturn 0;\n@@ -1226,7 +1228,7 @@ static int guard_remove_pmd_entry(pmd_t *pmd, unsigned long addr,\n \treturn 0;\n }\n \n-static int guard_remove_pte_entry(pte_t *pte, unsigned long addr,\n+static int guard_remove_pte_entry(hw_pte_t *pte, unsigned long addr,\n \t\t\t\t unsigned long next, struct mm_walk *walk)\n {\n \tpte_t ptent = ptep_get(pte);\ndiff --git a/mm/mapping_dirty_helpers.c b/mm/mapping_dirty_helpers.c\nindex e0efa36e0a0767..dcbd39912f8194 100644\n--- a/mm/mapping_dirty_helpers.c\n+++ b/mm/mapping_dirty_helpers.c\n@@ -31,7 +31,7 @@ struct wp_walk {\n * The function write-protects a pte and records the range in\n * virtual address space of touched ptes for efficient range TLB flushes.\n */\n-static int wp_pte(pte_t *pte, unsigned long addr, unsigned long end,\n+static int wp_pte(hw_pte_t *pte, unsigned long addr, unsigned long end,\n \t\t struct mm_walk *walk)\n {\n \tstruct wp_walk *wpwalk = walk-\u003eprivate;\n@@ -86,7 +86,7 @@ struct clean_walk {\n * in the address_space, as well as the first and last of the bits\n * touched.\n */\n-static int clean_record_pte(pte_t *pte, unsigned long addr,\n+static int clean_record_pte(hw_pte_t *pte, unsigned long addr,\n \t\t\t unsigned long end, struct mm_walk *walk)\n {\n \tstruct wp_walk *wpwalk = walk-\u003eprivate;\ndiff --git a/mm/memory-failure.c b/mm/memory-failure.c\nindex a8b03e2920ba8a..a89f3fde47a5d2 100644\n--- a/mm/memory-failure.c\n+++ b/mm/memory-failure.c\n@@ -342,7 +342,7 @@ static unsigned long dev_pagemap_mapping_shift(struct vm_area_struct *vma,\n \tp4d_t *p4d;\n \tpud_t *pud;\n \tpmd_t *pmd;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tpte_t ptent;\n \n \tVM_BUG_ON_VMA(address == -EFAULT, vma);\n@@ -742,7 +742,7 @@ static int hwpoison_pte_range(pmd_t *pmdp, unsigned long addr,\n {\n \tstruct hwpoison_walk *hwp = walk-\u003eprivate;\n \tint ret = 0;\n-\tpte_t *ptep, *mapped_pte;\n+\thw_pte_t *ptep, *mapped_pte;\n \tspinlock_t *ptl;\n \n \tptl = pmd_trans_huge_lock(pmdp, walk-\u003evma);\n@@ -770,7 +770,7 @@ static int hwpoison_pte_range(pmd_t *pmdp, unsigned long addr,\n }\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static int hwpoison_hugetlb_range(pte_t *ptep, unsigned long hmask,\n+static int hwpoison_hugetlb_range(hw_pte_t *ptep, unsigned long hmask,\n \t\t\t unsigned long addr, unsigned long end,\n \t\t\t struct mm_walk *walk)\n {\ndiff --git a/mm/memory.c b/mm/memory.c\nindex a73af1fccb3d0d..8e89fddd0c4ba1 100644\n--- a/mm/memory.c\n+++ b/mm/memory.c\n@@ -462,7 +462,7 @@ int __pte_alloc(struct mm_struct *mm, pmd_t *pmd)\n \n int __pte_alloc_kernel(pmd_t *pmd)\n {\n-\tpte_t *new = pte_alloc_one_kernel(\u0026init_mm);\n+\thw_pte_t *new = pte_alloc_one_kernel(\u0026init_mm);\n \tif (!new)\n \t\treturn -ENOMEM;\n \n@@ -941,7 +941,7 @@ struct page *vm_normal_page_pud(struct vm_area_struct *vma,\n */\n static void restore_exclusive_pte(struct vm_area_struct *vma,\n \t\tstruct folio *folio, struct page *page, unsigned long address,\n-\t\tpte_t *ptep, pte_t orig_pte)\n+\t\thw_pte_t *ptep, pte_t orig_pte)\n {\n \tpte_t pte;\n \n@@ -978,7 +978,7 @@ static void restore_exclusive_pte(struct vm_area_struct *vma,\n * sleeping.\n */\n static int try_restore_exclusive_pte(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, pte_t orig_pte)\n+\t\tunsigned long addr, hw_pte_t *ptep, pte_t orig_pte)\n {\n \tconst softleaf_t entry = softleaf_from_pte(orig_pte);\n \tstruct page *page = softleaf_to_page(entry);\n@@ -1001,7 +1001,7 @@ static int try_restore_exclusive_pte(struct vm_area_struct *vma,\n \n static unsigned long\n copy_nonpresent_pte(struct mm_struct *dst_mm, struct mm_struct *src_mm,\n-\t\tpte_t *dst_pte, pte_t *src_pte, struct vm_area_struct *dst_vma,\n+\t\thw_pte_t *dst_pte, hw_pte_t *src_pte, struct vm_area_struct *dst_vma,\n \t\tstruct vm_area_struct *src_vma, unsigned long addr, int *rss)\n {\n \tvm_flags_t vm_flags = dst_vma-\u003evm_flags;\n@@ -1116,7 +1116,7 @@ copy_nonpresent_pte(struct mm_struct *dst_mm, struct mm_struct *src_mm,\n */\n static inline int\n copy_present_page(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma,\n-\t\t pte_t *dst_pte, pte_t *src_pte, unsigned long addr, int *rss,\n+\t\t hw_pte_t *dst_pte, hw_pte_t *src_pte, unsigned long addr, int *rss,\n \t\t struct folio **prealloc, struct page *page)\n {\n \tstruct folio *new_folio;\n@@ -1155,7 +1155,7 @@ copy_present_page(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma\n }\n \n static __always_inline void __copy_present_ptes(struct vm_area_struct *dst_vma,\n-\t\tstruct vm_area_struct *src_vma, pte_t *dst_pte, pte_t *src_pte,\n+\t\tstruct vm_area_struct *src_vma, hw_pte_t *dst_pte, hw_pte_t *src_pte,\n \t\tpte_t pte, unsigned long addr, int nr)\n {\n \tstruct mm_struct *src_mm = src_vma-\u003evm_mm;\n@@ -1205,7 +1205,7 @@ static __always_inline void __copy_present_ptes(struct vm_area_struct *dst_vma,\n */\n static inline int\n copy_present_ptes(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma,\n-\t\t pte_t *dst_pte, pte_t *src_pte, pte_t pte, unsigned long addr,\n+\t\t hw_pte_t *dst_pte, hw_pte_t *src_pte, pte_t pte, unsigned long addr,\n \t\t int max_nr, int *rss, struct folio **prealloc)\n {\n \tfpb_t flags = FPB_MERGE_WRITE;\n@@ -1305,8 +1305,8 @@ copy_pte_range(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma,\n {\n \tstruct mm_struct *dst_mm = dst_vma-\u003evm_mm;\n \tstruct mm_struct *src_mm = src_vma-\u003evm_mm;\n-\tpte_t *orig_src_pte, *orig_dst_pte;\n-\tpte_t *src_pte, *dst_pte;\n+\thw_pte_t *orig_src_pte, *orig_dst_pte;\n+\thw_pte_t *src_pte, *dst_pte;\n \tpmd_t dummy_pmdval;\n \tpte_t ptent;\n \tspinlock_t *src_ptl, *dst_ptl;\n@@ -1699,7 +1699,7 @@ static inline bool zap_drop_markers(struct zap_details *details)\n * Returns true if uffd-wp PTEs were installed, false otherwise.\n */\n bool cond_install_uffd_wp_ptes(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, pte_t pte,\n+\t\tunsigned long addr, hw_pte_t *ptep, pte_t pte,\n \t\tunsigned long nr_ptes)\n {\n \tbool arm_uffd_pte = false;\n@@ -1753,7 +1753,7 @@ bool cond_install_uffd_wp_ptes(struct vm_area_struct *vma,\n */\n static inline bool\n zap_install_uffd_wp_if_needed(struct vm_area_struct *vma,\n-\t\t\t unsigned long addr, pte_t *pte, int nr,\n+\t\t\t unsigned long addr, hw_pte_t *pte, int nr,\n \t\t\t struct zap_details *details, pte_t pteval)\n {\n \tif (zap_drop_markers(details))\n@@ -1764,7 +1764,7 @@ zap_install_uffd_wp_if_needed(struct vm_area_struct *vma,\n \n static __always_inline void zap_present_folio_ptes(struct mmu_gather *tlb,\n \t\tstruct vm_area_struct *vma, struct folio *folio,\n-\t\tstruct page *page, pte_t *pte, pte_t ptent, unsigned int nr,\n+\t\tstruct page *page, hw_pte_t *pte, pte_t ptent, unsigned int nr,\n \t\tunsigned long addr, struct zap_details *details, int *rss,\n \t\tbool *force_flush, bool *force_break, bool *any_skipped)\n {\n@@ -1814,7 +1814,7 @@ static __always_inline void zap_present_folio_ptes(struct mmu_gather *tlb,\n * Returns the number of processed (skipped or zapped) PTEs (at least 1).\n */\n static inline int zap_present_ptes(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, pte_t *pte, pte_t ptent,\n+\t\tstruct vm_area_struct *vma, hw_pte_t *pte, pte_t ptent,\n \t\tunsigned int max_nr, unsigned long addr,\n \t\tstruct zap_details *details, int *rss, bool *force_flush,\n \t\tbool *force_break, bool *any_skipped)\n@@ -1860,7 +1860,7 @@ static inline int zap_present_ptes(struct mmu_gather *tlb,\n }\n \n static inline int zap_nonpresent_ptes(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, pte_t *pte, pte_t ptent,\n+\t\tstruct vm_area_struct *vma, hw_pte_t *pte, pte_t ptent,\n \t\tunsigned int max_nr, unsigned long addr,\n \t\tstruct zap_details *details, int *rss, bool *any_skipped)\n {\n@@ -1931,7 +1931,7 @@ static inline int zap_nonpresent_ptes(struct mmu_gather *tlb,\n }\n \n static inline int do_zap_pte_range(struct mmu_gather *tlb,\n-\t\t\t\t struct vm_area_struct *vma, pte_t *pte,\n+\t\t\t\t struct vm_area_struct *vma, hw_pte_t *pte,\n \t\t\t\t unsigned long addr, unsigned long end,\n \t\t\t\t struct zap_details *details, int *rss,\n \t\t\t\t bool *force_flush, bool *force_break,\n@@ -1994,7 +1994,7 @@ static bool zap_pte_table_if_empty(struct mm_struct *mm, pmd_t *pmd,\n \t\tunsigned long addr, pmd_t *pmdval)\n {\n \tspinlock_t *pml, *ptl = NULL;\n-\tpte_t *start_pte, *pte;\n+\thw_pte_t *start_pte, *pte;\n \tint i;\n \n \tpml = pmd_lock(mm, pmd);\n@@ -2034,8 +2034,8 @@ static unsigned long zap_pte_range(struct mmu_gather *tlb,\n \tstruct mm_struct *mm = tlb-\u003emm;\n \tint rss[NR_MM_COUNTERS];\n \tspinlock_t *ptl;\n-\tpte_t *start_pte;\n-\tpte_t *pte;\n+\thw_pte_t *start_pte;\n+\thw_pte_t *pte;\n \tpmd_t pmdval;\n \tunsigned long start = addr;\n \tbool direct_reclaim = true;\n@@ -2417,7 +2417,7 @@ static pmd_t *walk_to_pmd(struct mm_struct *mm, unsigned long addr)\n \treturn pmd;\n }\n \n-pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,\n+hw_pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,\n \t\t spinlock_t **ptl)\n {\n \tpmd_t *pmd = walk_to_pmd(mm, addr);\n@@ -2475,7 +2475,7 @@ static int validate_page_before_insert(struct vm_area_struct *vma,\n \treturn 0;\n }\n \n-static int insert_page_into_pte_locked(struct vm_area_struct *vma, pte_t *pte,\n+static int insert_page_into_pte_locked(struct vm_area_struct *vma, hw_pte_t *pte,\n \t\t\t\tunsigned long addr, struct page *page,\n \t\t\t\tpgprot_t prot, bool mkwrite)\n {\n@@ -2520,7 +2520,7 @@ static int insert_page(struct vm_area_struct *vma, unsigned long addr,\n \t\t\tstruct page *page, pgprot_t prot, bool mkwrite)\n {\n \tint retval;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tspinlock_t *ptl;\n \n \tretval = validate_page_before_insert(vma, page);\n@@ -2537,7 +2537,7 @@ static int insert_page(struct vm_area_struct *vma, unsigned long addr,\n \treturn retval;\n }\n \n-static int insert_page_in_batch_locked(struct vm_area_struct *vma, pte_t *pte,\n+static int insert_page_in_batch_locked(struct vm_area_struct *vma, hw_pte_t *pte,\n \t\t\tunsigned long addr, struct page *page, pgprot_t prot)\n {\n \tint err;\n@@ -2555,7 +2555,7 @@ static int insert_pages(struct vm_area_struct *vma, unsigned long addr,\n \t\t\tstruct page **pages, unsigned long *num, pgprot_t prot)\n {\n \tpmd_t *pmd = NULL;\n-\tpte_t *start_pte, *pte;\n+\thw_pte_t *start_pte, *pte;\n \tspinlock_t *pte_lock;\n \tstruct mm_struct *const mm = vma-\u003evm_mm;\n \tunsigned long curr_page_idx = 0;\n@@ -2798,7 +2798,8 @@ static vm_fault_t insert_pfn(struct vm_area_struct *vma, unsigned long addr,\n \t\t\tunsigned long pfn, pgprot_t prot, bool mkwrite)\n {\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n-\tpte_t *pte, entry;\n+\thw_pte_t *pte;\n+\tpte_t entry;\n \tspinlock_t *ptl;\n \n \tpte = get_locked_pte(mm, addr, \u0026ptl);\n@@ -3039,7 +3040,7 @@ static int remap_pte_range(struct mm_struct *mm, pmd_t *pmd,\n \t\t\tunsigned long addr, unsigned long end,\n \t\t\tunsigned long pfn, pgprot_t prot)\n {\n-\tpte_t *pte, *mapped_pte;\n+\thw_pte_t *pte, *mapped_pte;\n \tspinlock_t *ptl;\n \tint err = 0;\n \n@@ -3440,7 +3441,7 @@ static int apply_to_pte_range(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\t pte_fn_t fn, void *data, bool create,\n \t\t\t\t pgtbl_mod_mask *mask)\n {\n-\tpte_t *pte, *mapped_pte;\n+\thw_pte_t *pte, *mapped_pte;\n \tint err = 0;\n \tspinlock_t *ptl;\n \n@@ -4743,7 +4744,7 @@ static vm_fault_t handle_pte_marker(struct vm_fault *vmf)\n /*\n * Check if the PTEs within a range are contiguous swap entries.\n */\n-static bool can_swapin_thp(struct vm_fault *vmf, pte_t *ptep, int nr_pages)\n+static bool can_swapin_thp(struct vm_fault *vmf, hw_pte_t *ptep, int nr_pages)\n {\n \tunsigned long addr;\n \tint idx;\n@@ -4795,7 +4796,7 @@ static unsigned long thp_swapin_suitable_orders(struct vm_fault *vmf)\n \tunsigned long addr;\n \tsoftleaf_t entry;\n \tspinlock_t *ptl;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint order;\n \n \t/*\n@@ -4957,7 +4958,7 @@ vm_fault_t do_swap_page(struct vm_fault *vmf)\n \tint nr_pages;\n \tunsigned long page_idx;\n \tunsigned long address;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \n \tif (!pte_unmap_same(vmf))\n \t\tgoto out;\n@@ -5071,7 +5072,7 @@ vm_fault_t do_swap_page(struct vm_fault *vmf)\n \t\tunsigned long idx = folio_page_idx(folio, page);\n \t\tunsigned long folio_start = address - idx * PAGE_SIZE;\n \t\tunsigned long folio_end = folio_start + nr * PAGE_SIZE;\n-\t\tpte_t *folio_ptep;\n+\t\thw_pte_t *folio_ptep;\n \t\tpte_t folio_pte;\n \n \t\tif (unlikely(folio_start \u003c max(address \u0026 PMD_MASK, vma-\u003evm_start)))\n@@ -5301,7 +5302,7 @@ vm_fault_t do_swap_page(struct vm_fault *vmf)\n \treturn ret;\n }\n \n-static bool pte_range_none(pte_t *pte, int nr_pages)\n+static bool pte_range_none(hw_pte_t *pte, int nr_pages)\n {\n \tint i;\n \n@@ -5320,7 +5321,7 @@ static struct folio *alloc_anon_folio(struct vm_fault *vmf)\n \tunsigned long orders;\n \tstruct folio *folio;\n \tunsigned long addr;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tgfp_t gfp;\n \tint order;\n \n@@ -5402,7 +5403,7 @@ static struct folio *alloc_anon_folio(struct vm_fault *vmf)\n \treturn folio_prealloc(vma-\u003evm_mm, vma, vmf-\u003eaddress, true);\n }\n \n-void map_anon_folio_pte_nopf(struct folio *folio, pte_t *pte,\n+void map_anon_folio_pte_nopf(struct folio *folio, hw_pte_t *pte,\n \t\tstruct vm_area_struct *vma, unsigned long addr,\n \t\tbool uffd_wp)\n {\n@@ -5423,7 +5424,7 @@ void map_anon_folio_pte_nopf(struct folio *folio, pte_t *pte,\n \tupdate_mmu_cache_range(NULL, vma, addr, pte, nr_pages);\n }\n \n-static void map_anon_folio_pte_pf(struct folio *folio, pte_t *pte,\n+static void map_anon_folio_pte_pf(struct folio *folio, hw_pte_t *pte,\n \t\tstruct vm_area_struct *vma, unsigned long addr, bool uffd_wp)\n {\n \tconst unsigned int order = folio_order(folio);\n@@ -6208,7 +6209,7 @@ int numa_migrate_check(struct folio *folio, struct vm_fault *vmf,\n }\n \n static void numa_rebuild_single_mapping(struct vm_fault *vmf, struct vm_area_struct *vma,\n-\t\t\t\t\tunsigned long fault_addr, pte_t *fault_pte,\n+\t\t\t\t\tunsigned long fault_addr, hw_pte_t *fault_pte,\n \t\t\t\t\tbool writable)\n {\n \tpte_t pte, old_pte;\n@@ -6230,7 +6231,7 @@ static void numa_rebuild_large_mapping(struct vm_fault *vmf, struct vm_area_stru\n \tunsigned long start, end, addr = vmf-\u003eaddress;\n \tunsigned long addr_start = addr - (nr \u003c\u003c PAGE_SHIFT);\n \tunsigned long pt_start = ALIGN_DOWN(addr, PMD_SIZE);\n-\tpte_t *start_ptep;\n+\thw_pte_t *start_ptep;\n \n \t/* Stay within the VMA and within the page table. */\n \tstart = max3(addr_start, pt_start, vma-\u003evm_start);\n@@ -6992,7 +6993,7 @@ int __pmd_alloc(struct mm_struct *mm, pud_t *pud, unsigned long address)\n #endif /* __PAGETABLE_PMD_FOLDED */\n \n static inline void pfnmap_args_setup(struct follow_pfnmap_args *args,\n-\t\t\t\t spinlock_t *lock, pte_t *ptep,\n+\t\t\t\t spinlock_t *lock, hw_pte_t *ptep,\n \t\t\t\t pgprot_t pgprot, unsigned long pfn_base,\n \t\t\t\t unsigned long addr_mask, bool writable,\n \t\t\t\t bool special)\n@@ -7061,7 +7062,8 @@ int follow_pfnmap_start(struct follow_pfnmap_args *args)\n \tp4d_t *p4dp, p4d;\n \tpud_t *pudp, pud;\n \tpmd_t *pmdp, pmd;\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \n \tpfnmap_lockdep_assert(vma);\n \ndiff --git a/mm/mempolicy.c b/mm/mempolicy.c\nindex 5720f7f54d942f..729a6001323869 100644\n--- a/mm/mempolicy.c\n+++ b/mm/mempolicy.c\n@@ -691,7 +691,7 @@ static int queue_folios_pte_range(pmd_t *pmd, unsigned long addr,\n \tstruct folio *folio;\n \tstruct queue_pages *qp = walk-\u003eprivate;\n \tunsigned long flags = qp-\u003eflags;\n-\tpte_t *pte, *mapped_pte;\n+\thw_pte_t *pte, *mapped_pte;\n \tpte_t ptent;\n \tspinlock_t *ptl;\n \tint max_nr, nr;\n@@ -771,7 +771,7 @@ static int queue_folios_pte_range(pmd_t *pmd, unsigned long addr,\n \treturn 0;\n }\n \n-static int queue_folios_hugetlb(pte_t *pte, unsigned long hmask,\n+static int queue_folios_hugetlb(hw_pte_t *pte, unsigned long hmask,\n \t\t\t unsigned long addr, unsigned long end,\n \t\t\t struct mm_walk *walk)\n {\ndiff --git a/mm/migrate.c b/mm/migrate.c\nindex ab15a4dddd0471..327fde599be4af 100644\n--- a/mm/migrate.c\n+++ b/mm/migrate.c\n@@ -497,7 +497,7 @@ void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t unsigned long address)\n {\n \tspinlock_t *ptl;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpte_t pte;\n \tsoftleaf_t entry;\n \n@@ -528,7 +528,7 @@ void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,\n *\n * This function will release the vma lock before returning.\n */\n-void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr, pte_t *ptep)\n+void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep)\n {\n \tspinlock_t *ptl = huge_pte_lockptr(hstate_vma(vma), vma-\u003evm_mm, ptep);\n \tsoftleaf_t entry;\ndiff --git a/mm/migrate_device.c b/mm/migrate_device.c\nindex 18d097c3885303..5669a2d760c5e9 100644\n--- a/mm/migrate_device.c\n+++ b/mm/migrate_device.c\n@@ -254,7 +254,7 @@ static int migrate_vma_collect_pmd(pmd_t *pmdp,\n \tspinlock_t *ptl;\n \tstruct folio *fault_folio = migrate-\u003efault_page ?\n \t\tpage_folio(migrate-\u003efault_page) : NULL;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \n again:\n \tif (pmd_trans_huge(*pmdp) || !pmd_present(*pmdp)) {\n@@ -989,7 +989,7 @@ static void migrate_vma_insert_page(struct migrate_vma *migrate,\n \tp4d_t *p4dp;\n \tpud_t *pudp;\n \tpmd_t *pmdp;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tpte_t orig_pte;\n \n \t/* Only allow populating anonymous memory */\ndiff --git a/mm/mincore.c b/mm/mincore.c\nindex ff4ac828176837..15454ced345ab7 100644\n--- a/mm/mincore.c\n+++ b/mm/mincore.c\n@@ -24,7 +24,7 @@\n #include \"swap.h\"\n #include \"internal.h\"\n \n-static int mincore_hugetlb(pte_t *pte, unsigned long hmask, unsigned long addr,\n+static int mincore_hugetlb(hw_pte_t *pte, unsigned long hmask, unsigned long addr,\n \t\t\tunsigned long end, struct mm_walk *walk)\n {\n #ifdef CONFIG_HUGETLB_PAGE\n@@ -164,7 +164,7 @@ static int mincore_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,\n {\n \tspinlock_t *ptl;\n \tstruct vm_area_struct *vma = walk-\u003evma;\n-\tpte_t *ptep;\n+\thw_pte_t *ptep;\n \tunsigned char *vec = walk-\u003eprivate;\n \tint nr = (end - addr) \u003e\u003e PAGE_SHIFT;\n \tint step, i;\ndiff --git a/mm/mlock.c b/mm/mlock.c\nindex efa6716e4dfbdf..36002b80382a96 100644\n--- a/mm/mlock.c\n+++ b/mm/mlock.c\n@@ -305,7 +305,7 @@ void munlock_folio(struct folio *folio)\n }\n \n static inline unsigned int folio_mlock_step(struct folio *folio,\n-\t\tpte_t *pte, unsigned long addr, unsigned long end)\n+\t\thw_pte_t *pte, unsigned long addr, unsigned long end)\n {\n \tunsigned int count = (end - addr) \u003e\u003e PAGE_SHIFT;\n \tpte_t ptent = ptep_get(pte);\n@@ -353,7 +353,7 @@ static int mlock_pte_range(pmd_t *pmd, unsigned long addr,\n {\n \tstruct vm_area_struct *vma = walk-\u003evma;\n \tspinlock_t *ptl;\n-\tpte_t *start_pte, *pte;\n+\thw_pte_t *start_pte, *pte;\n \tpte_t ptent;\n \tstruct folio *folio;\n \tunsigned int step = 1;\ndiff --git a/mm/mprotect.c b/mm/mprotect.c\nindex 2888ee638d872a..1d23475e0bb76c 100644\n--- a/mm/mprotect.c\n+++ b/mm/mprotect.c\n@@ -103,7 +103,7 @@ bool can_change_pte_writable(struct vm_area_struct *vma, unsigned long addr,\n \treturn can_change_shared_pte_writable(vma, pte);\n }\n \n-static int mprotect_folio_pte_batch(struct folio *folio, pte_t *ptep,\n+static int mprotect_folio_pte_batch(struct folio *folio, hw_pte_t *ptep,\n \t\t\t\t pte_t pte, int max_nr_ptes, fpb_t flags)\n {\n \t/* No underlying folio, so cannot batch */\n@@ -118,7 +118,7 @@ static int mprotect_folio_pte_batch(struct folio *folio, pte_t *ptep,\n \n /* Set nr_ptes number of ptes, starting from idx */\n static __always_inline void prot_commit_flush_ptes(struct vm_area_struct *vma,\n-\t\tunsigned long addr, pte_t *ptep, pte_t oldpte, pte_t ptent,\n+\t\tunsigned long addr, hw_pte_t *ptep, pte_t oldpte, pte_t ptent,\n \t\tint nr_ptes, int idx, bool set_write, struct mmu_gather *tlb)\n {\n \t/*\n@@ -170,7 +170,7 @@ static __always_inline int page_anon_exclusive_batch(int start_idx, int max_len,\n * retrieve sub-batches.\n */\n static __always_inline void commit_anon_folio_batch(struct vm_area_struct *vma,\n-\t\tstruct folio *folio, struct page *first_page, unsigned long addr, pte_t *ptep,\n+\t\tstruct folio *folio, struct page *first_page, unsigned long addr, hw_pte_t *ptep,\n \t\tpte_t oldpte, pte_t ptent, int nr_ptes, struct mmu_gather *tlb)\n {\n \tbool expected_anon_exclusive;\n@@ -189,7 +189,7 @@ static __always_inline void commit_anon_folio_batch(struct vm_area_struct *vma,\n }\n \n static __always_inline void set_write_prot_commit_flush_ptes(struct vm_area_struct *vma,\n-\t\tstruct folio *folio, struct page *page, unsigned long addr, pte_t *ptep,\n+\t\tstruct folio *folio, struct page *page, unsigned long addr, hw_pte_t *ptep,\n \t\tpte_t oldpte, pte_t ptent, int nr_ptes, struct mmu_gather *tlb)\n {\n \tbool set_write;\n@@ -212,7 +212,7 @@ static __always_inline void set_write_prot_commit_flush_ptes(struct vm_area_stru\n }\n \n static long change_softleaf_pte(struct vm_area_struct *vma,\n-\tunsigned long addr, pte_t *pte, pte_t oldpte, unsigned long cp_flags)\n+\tunsigned long addr, hw_pte_t *pte, pte_t oldpte, unsigned long cp_flags)\n {\n \tconst bool uffd_prot = cp_flags \u0026 (MM_CP_UFFD_WP | MM_CP_UFFD_RWP);\n \tconst bool uffd_prot_resolve = cp_flags \u0026\n@@ -279,7 +279,7 @@ static long change_softleaf_pte(struct vm_area_struct *vma,\n }\n \n static __always_inline void change_present_ptes(struct mmu_gather *tlb,\n-\t\tstruct vm_area_struct *vma, unsigned long addr, pte_t *ptep,\n+\t\tstruct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,\n \t\tint nr_ptes, unsigned long end, pgprot_t newprot,\n \t\tstruct folio *folio, struct page *page, unsigned long cp_flags)\n {\n@@ -332,7 +332,8 @@ static long change_pte_range(struct mmu_gather *tlb,\n \t\tstruct vm_area_struct *vma, pmd_t *pmd, unsigned long addr,\n \t\tunsigned long end, pgprot_t newprot, unsigned long cp_flags)\n {\n-\tpte_t *pte, oldpte;\n+\thw_pte_t *pte;\n+\tpte_t oldpte;\n \tspinlock_t *ptl;\n \tlong pages = 0;\n \tbool is_private_single_threaded;\n@@ -727,7 +728,7 @@ long change_protection(struct mmu_gather *tlb,\n \treturn pages;\n }\n \n-static int prot_none_pte_entry(pte_t *pte, unsigned long addr,\n+static int prot_none_pte_entry(hw_pte_t *pte, unsigned long addr,\n \t\t\t unsigned long next, struct mm_walk *walk)\n {\n \treturn pfn_modify_allowed(pte_pfn(ptep_get(pte)),\n@@ -736,7 +737,7 @@ static int prot_none_pte_entry(pte_t *pte, unsigned long addr,\n }\n \n #ifdef CONFIG_HUGETLB_PAGE\n-static int prot_none_hugetlb_entry(pte_t *pte, unsigned long hmask,\n+static int prot_none_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,\n \t\t\t\t unsigned long addr, unsigned long next,\n \t\t\t\t struct mm_walk *walk)\n {\ndiff --git a/mm/mremap.c b/mm/mremap.c\nindex f07fc4e3ef2e6c..ecb90ccee6fdda 100644\n--- a/mm/mremap.c\n+++ b/mm/mremap.c\n@@ -176,7 +176,7 @@ static pte_t move_soft_dirty_pte(pte_t pte)\n }\n \n static int mremap_folio_pte_batch(struct vm_area_struct *vma, unsigned long addr,\n-\t\tpte_t *ptep, pte_t pte, int max_nr)\n+\t\thw_pte_t *ptep, pte_t pte, int max_nr)\n {\n \tstruct folio *folio;\n \n@@ -200,7 +200,7 @@ static int move_ptes(struct pagetable_move_control *pmc,\n \tstruct vm_area_struct *vma = pmc-\u003eold;\n \tbool need_clear_uffd_wp = vma_has_uffd_without_event_remap(vma);\n \tstruct mm_struct *mm = vma-\u003evm_mm;\n-\tpte_t *old_ptep, *new_ptep;\n+\thw_pte_t *old_ptep, *new_ptep;\n \tpte_t old_pte, pte;\n \tpmd_t dummy_pmdval;\n \tspinlock_t *old_ptl, *new_ptl;\n@@ -264,7 +264,7 @@ static int move_ptes(struct pagetable_move_control *pmc,\n \n \tfor (; old_addr \u003c old_end; old_ptep += nr_ptes, old_addr += nr_ptes * PAGE_SIZE,\n \t\tnew_ptep += nr_ptes, new_addr += nr_ptes * PAGE_SIZE) {\n-\t\tVM_WARN_ON_ONCE(!pte_none(*new_ptep));\n+\t\tVM_WARN_ON_ONCE(!pte_none(ptep_get(new_ptep)));\n \n \t\tnr_ptes = 1;\n \t\tmax_nr_ptes = (old_end - old_addr) \u003e\u003e PAGE_SHIFT;\ndiff --git a/mm/page_table_check.c b/mm/page_table_check.c\nindex 6ffc536359cd06..70984b4e3cde37 100644\n--- a/mm/page_table_check.c\n+++ b/mm/page_table_check.c\n@@ -208,7 +208,7 @@ static void page_table_check_pte_flags(pte_t pte)\n }\n \n void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,\n-\t\t\t\t pte_t *ptep, pte_t pte, unsigned int nr)\n+\t\t\t\t hw_pte_t *ptep, pte_t pte, unsigned int nr)\n {\n \tunsigned int i;\n \n@@ -279,7 +279,7 @@ void __page_table_check_pte_clear_range(struct mm_struct *mm,\n \t\treturn;\n \n \tif (!pmd_bad(pmd) \u0026\u0026 !pmd_leaf(pmd)) {\n-\t\tpte_t *ptep = pte_offset_map(\u0026pmd, addr);\n+\t\thw_pte_t *ptep = pte_offset_map(\u0026pmd, addr);\n \t\tunsigned long i;\n \n \t\tif (WARN_ON(!ptep))\ndiff --git a/mm/pagewalk.c b/mm/pagewalk.c\nindex ed4860c01936c6..172addf9e65581 100644\n--- a/mm/pagewalk.c\n+++ b/mm/pagewalk.c\n@@ -26,7 +26,7 @@ static int real_depth(int depth)\n \treturn depth;\n }\n \n-static int walk_pte_range_inner(pte_t *pte, unsigned long addr,\n+static int walk_pte_range_inner(hw_pte_t *pte, unsigned long addr,\n \t\t\t\tunsigned long end, struct mm_walk *walk)\n {\n \tconst struct mm_walk_ops *ops = walk-\u003eops;\n@@ -61,7 +61,7 @@ static int walk_pte_range_inner(pte_t *pte, unsigned long addr,\n static int walk_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,\n \t\t\t struct mm_walk *walk)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint err = 0;\n \tspinlock_t *ptl;\n \n@@ -343,7 +343,7 @@ static int walk_hugetlb_range(unsigned long addr, unsigned long end,\n \tunsigned long next;\n \tunsigned long hmask = huge_page_mask(h);\n \tunsigned long sz = huge_page_size(h);\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tconst struct mm_walk_ops *ops = walk-\u003eops;\n \tint err = 0;\n \n@@ -909,7 +909,8 @@ struct folio *folio_walk_start(struct folio_walk *fw,\n \tstruct page *page;\n \tpud_t *pudp, pud;\n \tpmd_t *pmdp, pmd;\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \tspinlock_t *ptl;\n \tpgd_t *pgdp;\n \tp4d_t *p4dp;\ndiff --git a/mm/percpu.c b/mm/percpu.c\nindex a802d72c116fbb..fa79a1295c5bfc 100644\n--- a/mm/percpu.c\n+++ b/mm/percpu.c\n@@ -3176,7 +3176,7 @@ void __init __weak pcpu_populate_pte(unsigned long addr)\n \n \tpmd = pmd_offset(pud, addr);\n \tif (!pmd_present(*pmd)) {\n-\t\tpte_t *new;\n+\t\thw_pte_t *new;\n \n \t\tnew = memblock_alloc_or_panic(PTE_TABLE_SIZE, PTE_TABLE_SIZE);\n \t\tpmd_populate_kernel(\u0026init_mm, pmd, new);\ndiff --git a/mm/pgtable-generic.c b/mm/pgtable-generic.c\nindex b91b1a98029c7f..52f286da3eec61 100644\n--- a/mm/pgtable-generic.c\n+++ b/mm/pgtable-generic.c\n@@ -68,7 +68,7 @@ void pmd_clear_bad(pmd_t *pmd)\n * force that call on sun4c so we changed this macro slightly\n */\n int ptep_set_access_flags(struct vm_area_struct *vma,\n-\t\t\t unsigned long address, pte_t *ptep,\n+\t\t\t unsigned long address, hw_pte_t *ptep,\n \t\t\t pte_t entry, int dirty)\n {\n \tint changed = !pte_same(ptep_get(ptep), entry);\n@@ -82,7 +82,7 @@ int ptep_set_access_flags(struct vm_area_struct *vma,\n \n #ifndef __HAVE_ARCH_PTEP_CLEAR_YOUNG_FLUSH\n bool ptep_clear_flush_young(struct vm_area_struct *vma,\n-\t\tunsigned long address, pte_t *ptep)\n+\t\tunsigned long address, hw_pte_t *ptep)\n {\n \tbool young;\n \n@@ -95,7 +95,7 @@ bool ptep_clear_flush_young(struct vm_area_struct *vma,\n \n #ifndef __HAVE_ARCH_PTEP_CLEAR_FLUSH\n pte_t ptep_clear_flush(struct vm_area_struct *vma, unsigned long address,\n-\t\t pte_t *ptep)\n+\t\t hw_pte_t *ptep)\n {\n \tstruct mm_struct *mm = (vma)-\u003evm_mm;\n \tpte_t pte;\n@@ -282,7 +282,7 @@ static unsigned long pmdp_get_lockless_start(void) { return 0; }\n static void pmdp_get_lockless_end(unsigned long irqflags) { }\n #endif\n \n-pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp)\n+hw_pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp)\n {\n \tunsigned long irqflags;\n \tpmd_t pmdval;\n@@ -308,11 +308,11 @@ pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp)\n \treturn NULL;\n }\n \n-pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,\n+hw_pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\tunsigned long addr, spinlock_t **ptlp)\n {\n \tpmd_t pmdval;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \tpte = __pte_offset_map(pmd, addr, \u0026pmdval);\n \tif (likely(pte))\n@@ -320,11 +320,11 @@ pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,\n \treturn pte;\n }\n \n-pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,\n+hw_pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t\tunsigned long addr, pmd_t *pmdvalp,\n \t\t\t\tspinlock_t **ptlp)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \tVM_WARN_ON_ONCE(!pmdvalp);\n \tpte = __pte_offset_map(pmd, addr, pmdvalp);\n@@ -390,12 +390,12 @@ pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,\n * table, and may not use RCU at all: \"outsiders\" like khugepaged should avoid\n * pte_offset_map() and co once the vma is detached from mm or mm_users is zero.\n */\n-pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,\n+hw_pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,\n \t\t\t unsigned long addr, spinlock_t **ptlp)\n {\n \tspinlock_t *ptl;\n \tpmd_t pmdval;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n again:\n \tpte = __pte_offset_map(pmd, addr, \u0026pmdval);\n \tif (unlikely(!pte))\ndiff --git a/mm/ptdump.c b/mm/ptdump.c\nindex 5851096e6f656c..8f19f20be3c445 100644\n--- a/mm/ptdump.c\n+++ b/mm/ptdump.c\n@@ -19,7 +19,7 @@ static inline int note_kasan_page_table(struct mm_walk *walk,\n {\n \tstruct ptdump_state *st = walk-\u003eprivate;\n \n-\tst-\u003enote_page_pte(st, addr, kasan_early_shadow_pte[0]);\n+\tst-\u003enote_page_pte(st, addr, ptep_get(kasan_early_shadow_pte));\n \n \twalk-\u003eaction = ACTION_CONTINUE;\n \n@@ -117,7 +117,7 @@ static int ptdump_pmd_entry(pmd_t *pmd, unsigned long addr,\n \treturn 0;\n }\n \n-static int ptdump_pte_entry(pte_t *pte, unsigned long addr,\n+static int ptdump_pte_entry(hw_pte_t *pte, unsigned long addr,\n \t\t\t unsigned long next, struct mm_walk *walk)\n {\n \tstruct ptdump_state *st = walk-\u003eprivate;\ndiff --git a/mm/rmap.c b/mm/rmap.c\nindex b7ead3e9f06412..591793d11ed1bf 100644\n--- a/mm/rmap.c\n+++ b/mm/rmap.c\n@@ -1124,7 +1124,7 @@ static int page_vma_mkclean_one(struct page_vma_mapped_walk *pvmw)\n \n \t\taddress = pvmw-\u003eaddress;\n \t\tif (pvmw-\u003epte) {\n-\t\t\tpte_t *pte = pvmw-\u003epte;\n+\t\t\thw_pte_t *pte = pvmw-\u003epte;\n \t\t\tpte_t entry = ptep_get(pte);\n \n \t\t\t/*\n@@ -2141,7 +2141,7 @@ static pte_t swp_pte_prepare(swp_entry_t entry, pte_t old_pte,\n \n static bool ttu_anon_swapbacked_folio(struct vm_area_struct *vma,\n \t\tstruct folio *folio, struct page *page, unsigned long address,\n-\t\tpte_t *ptep, pte_t pteval)\n+\t\thw_pte_t *ptep, pte_t pteval)\n {\n \tconst bool anon_exclusive = folio_test_anon(folio) \u0026\u0026\n \t\t\t\t PageAnonExclusive(page);\n@@ -2176,7 +2176,7 @@ static bool ttu_anon_swapbacked_folio(struct vm_area_struct *vma,\n }\n \n static bool ttu_anon_folio(struct vm_area_struct *vma, struct folio *folio,\n-\t\tstruct page *page, unsigned long address, pte_t *ptep,\n+\t\tstruct page *page, unsigned long address, hw_pte_t *ptep,\n \t\tpte_t pteval, unsigned long nr_pages)\n {\n \t/*\ndiff --git a/mm/sparse-vmemmap.c b/mm/sparse-vmemmap.c\nindex 5a2469fb1838c7..2bbf7adef511d7 100644\n--- a/mm/sparse-vmemmap.c\n+++ b/mm/sparse-vmemmap.c\n@@ -137,7 +137,7 @@ static void * __meminit altmap_alloc_block_buf(unsigned long size,\n \treturn __va(__pfn_to_phys(pfn));\n }\n \n-void __meminit vmemmap_verify(pte_t *pte, int node,\n+void __meminit vmemmap_verify(hw_pte_t *pte, int node,\n \t\t\t\tunsigned long start, unsigned long end)\n {\n \tunsigned long pfn = pte_pfn(ptep_get(pte));\n@@ -148,11 +148,11 @@ void __meminit vmemmap_verify(pte_t *pte, int node,\n \t\t\tstart, end - 1);\n }\n \n-static pte_t * __meminit vmemmap_pte_populate(pmd_t *pmd, unsigned long addr, int node,\n+static hw_pte_t * __meminit vmemmap_pte_populate(pmd_t *pmd, unsigned long addr, int node,\n \t\t\t\t struct vmem_altmap *altmap,\n \t\t\t\t unsigned long ptpfn, unsigned long flags)\n {\n-\tpte_t *pte = pte_offset_kernel(pmd, addr);\n+\thw_pte_t *pte = pte_offset_kernel(pmd, addr);\n \tif (pte_none(ptep_get(pte))) {\n \t\tpte_t entry;\n \t\tvoid *p;\n@@ -243,7 +243,7 @@ static pgd_t * __meminit vmemmap_pgd_populate(unsigned long addr, int node)\n \treturn pgd;\n }\n \n-static pte_t * __meminit vmemmap_populate_address(unsigned long addr, int node,\n+static hw_pte_t * __meminit vmemmap_populate_address(unsigned long addr, int node,\n \t\t\t\t\t struct vmem_altmap *altmap,\n \t\t\t\t\t unsigned long ptpfn,\n \t\t\t\t\t unsigned long flags)\n@@ -252,7 +252,7 @@ static pte_t * __meminit vmemmap_populate_address(unsigned long addr, int node,\n \tp4d_t *p4d;\n \tpud_t *pud;\n \tpmd_t *pmd;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \tpgd = vmemmap_pgd_populate(addr, node);\n \tif (!pgd)\n@@ -281,7 +281,7 @@ static int __meminit vmemmap_populate_range(unsigned long start,\n \t\t\t\t\t unsigned long flags)\n {\n \tunsigned long addr = start;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \tfor (; addr \u003c end; addr += PAGE_SIZE) {\n \t\tpte = vmemmap_populate_address(addr, node, altmap,\n@@ -314,7 +314,7 @@ void vmemmap_wrprotect_hvo(unsigned long addr, unsigned long end,\n \t\t\t\t int node, unsigned long headsize)\n {\n \tunsigned long maddr;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \tfor (maddr = addr + headsize; maddr \u003c end; maddr += PAGE_SIZE) {\n \t\tpte = virt_to_kpte(maddr);\n@@ -364,7 +364,7 @@ int __meminit vmemmap_populate_hvo(unsigned long addr, unsigned long end,\n {\n \tunsigned long maddr;\n \tstruct page *tail;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint node = zone_to_nid(zone);\n \n \ttail = vmemmap_get_tail(order, zone);\n@@ -396,7 +396,7 @@ int __weak __meminit vmemmap_check_pmd(pmd_t *pmd, int node,\n {\n \tif (!pmd_leaf(pmdp_get(pmd)))\n \t\treturn 0;\n-\tvmemmap_verify((pte_t *)pmd, node, addr, next);\n+\tvmemmap_verify((hw_pte_t *)pmd, node, addr, next);\n \n \treturn 1;\n }\n@@ -474,9 +474,9 @@ static bool __meminit reuse_compound_section(unsigned long start_pfn,\n \treturn !IS_ALIGNED(offset, nr_pages) \u0026\u0026 nr_pages \u003e PAGES_PER_SUBSECTION;\n }\n \n-static pte_t * __meminit compound_section_tail_page(unsigned long addr)\n+static hw_pte_t * __meminit compound_section_tail_page(unsigned long addr)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \taddr -= PAGE_SIZE;\n \n@@ -497,7 +497,7 @@ static int __meminit vmemmap_populate_compound_pages(unsigned long start_pfn,\n \t\t\t\t\t\t struct dev_pagemap *pgmap)\n {\n \tunsigned long size, addr;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tint rc;\n \n \tif (reuse_compound_section(start_pfn, pgmap)) {\ndiff --git a/mm/swap_state.c b/mm/swap_state.c\nindex 5be825911e645e..cb1b2d434a5813 100644\n--- a/mm/swap_state.c\n+++ b/mm/swap_state.c\n@@ -917,7 +917,8 @@ static struct folio *swap_vma_readahead(swp_entry_t targ_entry, gfp_t gfp_mask,\n \tstruct swap_io_ctx ctx = {};\n \tstruct blk_plug plug;\n \tstruct folio *folio;\n-\tpte_t *pte = NULL, pentry;\n+\thw_pte_t *pte = NULL;\n+\tpte_t pentry;\n \tint win;\n \tunsigned long start, end, addr;\n \tpgoff_t ilx = targ_ilx;\ndiff --git a/mm/swapfile.c b/mm/swapfile.c\nindex 5d15913dcf8631..50f06a444ec1d1 100644\n--- a/mm/swapfile.c\n+++ b/mm/swapfile.c\n@@ -2476,7 +2476,8 @@ static int unuse_pte(struct vm_area_struct *vma, pmd_t *pmd,\n \tstruct page *page;\n \tstruct folio *swapcache;\n \tspinlock_t *ptl;\n-\tpte_t *pte, new_pte, old_pte;\n+\thw_pte_t *pte;\n+\tpte_t new_pte, old_pte;\n \tbool hwpoisoned = false;\n \tint ret = 1;\n \n@@ -2587,7 +2588,7 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd,\n \t\t\tunsigned long addr, unsigned long end,\n \t\t\tunsigned int type)\n {\n-\tpte_t *pte = NULL;\n+\thw_pte_t *pte = NULL;\n \n \tdo {\n \t\tstruct folio *folio;\ndiff --git a/mm/userfaultfd.c b/mm/userfaultfd.c\nindex 258b03182a780b..f22cfb2ccb07d8 100644\n--- a/mm/userfaultfd.c\n+++ b/mm/userfaultfd.c\n@@ -361,13 +361,13 @@ static int mfill_atomic_install_pte(pmd_t *dst_pmd,\n {\n \tint ret;\n \tstruct mm_struct *dst_mm = dst_vma-\u003evm_mm;\n-\tpte_t _dst_pte, *dst_pte;\n+\thw_pte_t *dst_pte;\n \tbool writable = dst_vma-\u003evm_flags \u0026 VM_WRITE;\n \tbool vm_shared = dst_vma-\u003evm_flags \u0026 VM_SHARED;\n \tspinlock_t *ptl;\n \tstruct folio *folio = page_folio(page);\n \tbool page_in_cache = folio_mapping(folio);\n-\tpte_t dst_ptep;\n+\tpte_t _dst_pte, dst_ptep;\n \n \t_dst_pte = mk_pte(page, dst_vma-\u003evm_page_prot);\n \t_dst_pte = pte_mkdirty(_dst_pte);\n@@ -656,7 +656,8 @@ static int mfill_atomic_pte_zeropage(struct mfill_state *state)\n \tstruct vm_area_struct *dst_vma = state-\u003evma;\n \tunsigned long dst_addr = state-\u003edst_addr;\n \tpmd_t *dst_pmd = state-\u003epmd;\n-\tpte_t _dst_pte, *dst_pte;\n+\thw_pte_t *dst_pte;\n+\tpte_t _dst_pte;\n \tspinlock_t *ptl;\n \tint ret;\n \n@@ -737,7 +738,8 @@ static int mfill_atomic_pte_poison(struct mfill_state *state)\n \tstruct mm_struct *dst_mm = dst_vma-\u003evm_mm;\n \tunsigned long dst_addr = state-\u003edst_addr;\n \tpmd_t *dst_pmd = state-\u003epmd;\n-\tpte_t _dst_pte, *dst_pte;\n+\thw_pte_t *dst_pte;\n+\tpte_t _dst_pte;\n \tspinlock_t *ptl;\n \tint ret;\n \n@@ -784,7 +786,7 @@ static __always_inline ssize_t mfill_atomic_hugetlb(\n {\n \tstruct mm_struct *dst_mm = dst_vma-\u003evm_mm;\n \tssize_t err;\n-\tpte_t *dst_pte;\n+\thw_pte_t *dst_pte;\n \tunsigned long src_addr, dst_addr;\n \tlong copied;\n \tstruct folio *folio;\n@@ -1261,7 +1263,7 @@ void double_pt_unlock(spinlock_t *ptl1,\n \t\t__release(ptl2);\n }\n \n-static inline bool is_pte_pages_stable(pte_t *dst_pte, pte_t *src_pte,\n+static inline bool is_pte_pages_stable(hw_pte_t *dst_pte, hw_pte_t *src_pte,\n \t\t\t\t pte_t orig_dst_pte, pte_t orig_src_pte,\n \t\t\t\t pmd_t *dst_pmd, pmd_t dst_pmdval)\n {\n@@ -1279,7 +1281,8 @@ static inline bool is_pte_pages_stable(pte_t *dst_pte, pte_t *src_pte,\n */\n static struct folio *check_ptes_for_batched_move(struct vm_area_struct *src_vma,\n \t\t\t\t\t\t unsigned long src_addr,\n-\t\t\t\t\t\t pte_t *src_pte, pte_t *dst_pte)\n+\t\t\t\t\t\t hw_pte_t *src_pte,\n+\t\t\t\t\t\t hw_pte_t *dst_pte)\n {\n \tpte_t orig_dst_pte, orig_src_pte;\n \tstruct folio *folio;\n@@ -1310,7 +1313,7 @@ static long move_present_ptes(struct mm_struct *mm,\n \t\t\t struct vm_area_struct *dst_vma,\n \t\t\t struct vm_area_struct *src_vma,\n \t\t\t unsigned long dst_addr, unsigned long src_addr,\n-\t\t\t pte_t *dst_pte, pte_t *src_pte,\n+\t\t\t hw_pte_t *dst_pte, hw_pte_t *src_pte,\n \t\t\t pte_t orig_dst_pte, pte_t orig_src_pte,\n \t\t\t pmd_t *dst_pmd, pmd_t dst_pmdval,\n \t\t\t spinlock_t *dst_ptl, spinlock_t *src_ptl,\n@@ -1398,7 +1401,7 @@ static long move_present_ptes(struct mm_struct *mm,\n \n static int move_swap_pte(struct mm_struct *mm, struct vm_area_struct *dst_vma,\n \t\t\t unsigned long dst_addr, unsigned long src_addr,\n-\t\t\t pte_t *dst_pte, pte_t *src_pte,\n+\t\t\t hw_pte_t *dst_pte, hw_pte_t *src_pte,\n \t\t\t pte_t orig_dst_pte, pte_t orig_src_pte,\n \t\t\t pmd_t *dst_pmd, pmd_t dst_pmdval,\n \t\t\t spinlock_t *dst_ptl, spinlock_t *src_ptl,\n@@ -1464,7 +1467,7 @@ static int move_zeropage_pte(struct mm_struct *mm,\n \t\t\t struct vm_area_struct *dst_vma,\n \t\t\t struct vm_area_struct *src_vma,\n \t\t\t unsigned long dst_addr, unsigned long src_addr,\n-\t\t\t pte_t *dst_pte, pte_t *src_pte,\n+\t\t\t hw_pte_t *dst_pte, hw_pte_t *src_pte,\n \t\t\t pte_t orig_dst_pte, pte_t orig_src_pte,\n \t\t\t pmd_t *dst_pmd, pmd_t dst_pmdval,\n \t\t\t spinlock_t *dst_ptl, spinlock_t *src_ptl)\n@@ -1510,8 +1513,8 @@ static long move_pages_ptes(struct mm_struct *mm, pmd_t *dst_pmd, pmd_t *src_pmd\n \tpte_t orig_src_pte, orig_dst_pte;\n \tpte_t src_folio_pte;\n \tspinlock_t *src_ptl, *dst_ptl;\n-\tpte_t *src_pte = NULL;\n-\tpte_t *dst_pte = NULL;\n+\thw_pte_t *src_pte = NULL;\n+\thw_pte_t *dst_pte = NULL;\n \tpmd_t dummy_pmdval;\n \tpmd_t dst_pmdval;\n \tstruct folio *src_folio = NULL;\n@@ -2658,7 +2661,8 @@ static inline bool userfaultfd_huge_must_wait(struct userfaultfd_ctx *ctx,\n \t\t\t\t\t unsigned long reason)\n {\n \tstruct vm_area_struct *vma = vmf-\u003evma;\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \n \tassert_fault_locked(vmf);\n \n@@ -2731,7 +2735,7 @@ static inline bool userfaultfd_must_wait(struct userfaultfd_ctx *ctx,\n \tp4d_t *p4d;\n \tpud_t *pud;\n \tpmd_t *pmd, _pmd;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tpte_t ptent;\n \tbool ret;\n \ndiff --git a/mm/util.c b/mm/util.c\nindex bf0513d1d3d086..cc253050f68923 100644\n--- a/mm/util.c\n+++ b/mm/util.c\n@@ -1564,7 +1564,7 @@ EXPORT_SYMBOL(mmap_action_complete);\n *\n * Return: the number of table entries in the batch.\n */\n-unsigned int folio_pte_batch(struct folio *folio, pte_t *ptep, pte_t pte,\n+unsigned int folio_pte_batch(struct folio *folio, hw_pte_t *ptep, pte_t pte,\n \t\tunsigned int max_nr)\n {\n \treturn folio_pte_batch_flags(folio, NULL, ptep, \u0026pte, max_nr, 0);\ndiff --git a/mm/vmalloc.c b/mm/vmalloc.c\nindex 26f32949c2f2ea..711bb192af59f1 100644\n--- a/mm/vmalloc.c\n+++ b/mm/vmalloc.c\n@@ -100,7 +100,7 @@ static DEFINE_PER_CPU(struct vfree_deferred, vfree_deferred);\n *\n * Return: mapping size.\n */\n-static __always_inline unsigned long vmap_set_ptes(pte_t *pte,\n+static __always_inline unsigned long vmap_set_ptes(hw_pte_t *pte,\n \t\tunsigned long addr, unsigned long end, u64 pfn,\n \t\tpgprot_t prot, unsigned int max_page_shift)\n {\n@@ -124,7 +124,7 @@ static int vmap_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,\n \t\t\tphys_addr_t phys_addr, pgprot_t prot,\n \t\t\tunsigned int max_page_shift, pgtbl_mod_mask *mask)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tu64 pfn;\n \tstruct page *page;\n \tunsigned long size;\n@@ -406,7 +406,7 @@ int ioremap_page_range(unsigned long addr, unsigned long end,\n static void vunmap_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,\n \t\t\t pgtbl_mod_mask *mask)\n {\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tpte_t ptent;\n \tunsigned long size = PAGE_SIZE;\n \n@@ -569,7 +569,7 @@ static int vmap_pages_pte_range(pmd_t *pmd, unsigned long addr,\n \tunsigned long pfn, size;\n \tunsigned int steps;\n \tint err = 0;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \n \t/*\n \t * nr is a running index into the array which helps higher level\n@@ -862,7 +862,8 @@ struct page *vmalloc_to_page(const void *vmalloc_addr)\n \tp4d_t *p4d;\n \tpud_t *pud;\n \tpmd_t *pmd;\n-\tpte_t *ptep, pte;\n+\thw_pte_t *ptep;\n+\tpte_t pte;\n \n \t/*\n \t * XXX we might need to change this if we add VIRTUAL_BUG_ON for\n@@ -3760,7 +3761,7 @@ struct vmap_pfn_data {\n \tunsigned int\tidx;\n };\n \n-static int vmap_pfn_apply(pte_t *pte, unsigned long addr, void *private)\n+static int vmap_pfn_apply(hw_pte_t *pte, unsigned long addr, void *private)\n {\n \tstruct vmap_pfn_data *data = private;\n \tunsigned long pfn = data-\u003epfns[data-\u003eidx];\ndiff --git a/mm/vmscan.c b/mm/vmscan.c\nindex 17d2b793cbfc49..85b6ab60d830bd 100644\n--- a/mm/vmscan.c\n+++ b/mm/vmscan.c\n@@ -3539,7 +3539,7 @@ static bool walk_pte_range(pmd_t *pmd, unsigned long start, unsigned long end,\n {\n \tint i;\n \tbool dirty;\n-\tpte_t *pte;\n+\thw_pte_t *pte;\n \tspinlock_t *ptl;\n \tunsigned long addr;\n \tint total = 0;\n@@ -3572,7 +3572,7 @@ static bool walk_pte_range(pmd_t *pmd, unsigned long start, unsigned long end,\n \tfor (i = pte_index(start), addr = start; addr != end; i += nr, addr += nr * PAGE_SIZE) {\n \t\tunsigned long pfn;\n \t\tstruct folio *folio;\n-\t\tpte_t *cur_pte = pte + i;\n+\t\thw_pte_t *cur_pte = pte + i;\n \t\tpte_t ptent = ptep_get(cur_pte);\n \n \t\tnr = 1;\n@@ -4261,7 +4261,7 @@ bool lru_gen_look_around(struct page_vma_mapped_walk *pvmw, unsigned int nr)\n \tstruct lru_gen_mm_walk *walk;\n \tstruct folio *last = NULL;\n \tint young = 1;\n-\tpte_t *pte = pvmw-\u003epte;\n+\thw_pte_t *pte = pvmw-\u003epte;\n \tunsigned long addr = pvmw-\u003eaddress;\n \tstruct vm_area_struct *vma = pvmw-\u003evma;\n \tstruct folio *folio = pfn_folio(pvmw-\u003epfn);\n"
} |
| 2/1 | 2026/07/28 09:12 | agent | patch-evaluator |
0mModel:best-expensive Args: null Results: {
"EnableConfigs": null,
"FocusSymbols": [],
"Reasoning": "The patch is a tree-wide refactoring that introduces `hw_pte_t` as a typedef for `pte_t` (by default) and replaces `pte_t *` with `hw_pte_t *` in various page table manipulation functions. It also replaces direct pointer dereferences with `ptep_get()`. There are no functional changes to the execution flow or logic; it is purely a type renaming and cleanup preparation for future architecture-specific changes.",
"WorthFuzzing": false
}Instruction: You are an expert Linux kernel maintainer. Your job is to review a provided patch series and determine if it makes functional changes to the kernel that should be fuzzed. IMPORTANT: The changes have ALREADY been applied and committed as the HEAD commit in your workspace. Do NOT rely on your internal knowledge of the kernel. You must actively use your code access tools to examine the actual source code and confirm any assumptions. Return WorthFuzzing=false if the patch only contains: - Modifications to Documentation/, Kconfig files, or code comments. - Purely decorative changes, such as logging (e.g., pr_err, printk) or tracepoints. - Changes to numeric constants or macros that do not functionally alter execution flow. - Code paths that are impossible to reach in virtualized environments like GCE or QEMU, even when utilizing software-emulated hardware (e.g., usb gadget, mac80211_hwsim). - Code in vendor-specific PCIe switch, SmartNIC, or GPU drivers (e.g., mlxsw, pds_core, qed, ionic, amdgpu) that require physical PCIe hardware cards not emulated in standard QEMU. - Driver .remove, .shutdown, or pci_unregister_driver teardown callbacks (e.g., igb_remove) that are executed only during PCI hot-unplug or sysfs driver unbind operations. If it modifies reachable core kernel logic, drivers, or architectures, use your code search tools to verify the code can be executed, then return WorthFuzzing=true. When returning WorthFuzzing=true, you MUST ALSO: 1. Extract any specific kernel functions that should be heavily fuzzed into FocusSymbols. Avoid listing generic hot-path functions to prevent skewed test distributions. Prefer non-static, non-inlined API entrypoint functions over internal static helper functions (which are inlined by the compiler and do not have distinct symbol addresses). 2. Identify any specific CONFIG_ options required to properly test this new/modified feature. Go and look into the Kconfig files and check for ifdefs around the code, do not make assumptions. Also check "depends on" lines in Kconfig to include any non-standard parent subsystem configs needed for Kbuild to compile the code statically into vmlinux. List them in the EnableConfigs output array, and DO NOT add a 'CONFIG_' prefix (e.g., return "NET_IPV4" instead of "CONFIG_NET_IPV4"). Prefer calling several tools at the same time to save round-trips. Use set-results tool to provide results of the analysis. It must be called exactly once before the final reply. Ignore results of this tool. Prompt: For your convenience, here is the diff of the changes:
commit bedbb15f09a956bd5571f86925850f5feac4f333
Author: syz-cluster <triage@syzkaller.com>
Date: Tue Jul 28 09:11:56 2026 +0000
syz-cluster: applied patch under review
diff --git a/MAINTAINERS b/MAINTAINERS
index 15dd00c7ffec5d..78aac059498295 100644
--- a/MAINTAINERS
+++ b/MAINTAINERS
@@ -16981,6 +16981,7 @@ F: include/linux/mmu_notifier.h
F: include/linux/pagewalk.h
F: include/linux/pgalloc.h
F: include/linux/pgtable.h
+F: include/linux/pgtable_types.h
F: include/linux/ptdump.h
F: include/linux/vmpressure.h
F: include/linux/vmstat.h
diff --git a/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c b/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c
index d01acfb7d93d09..056faf4a3618b0 100644
--- a/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c
+++ b/drivers/gpu/drm/i915/gem/selftests/i915_gem_mman.c
@@ -1690,7 +1690,7 @@ static int igt_mmap_gpu(void *arg)
return 0;
}
-static int check_present_pte(pte_t *pte, unsigned long addr, void *data)
+static int check_present_pte(hw_pte_t *pte, unsigned long addr, void *data)
{
pte_t ptent = ptep_get(pte);
@@ -1703,7 +1703,7 @@ static int check_present_pte(pte_t *pte, unsigned long addr, void *data)
return 0;
}
-static int check_absent_pte(pte_t *pte, unsigned long addr, void *data)
+static int check_absent_pte(hw_pte_t *pte, unsigned long addr, void *data)
{
pte_t ptent = ptep_get(pte);
diff --git a/drivers/gpu/drm/i915/i915_mm.c b/drivers/gpu/drm/i915/i915_mm.c
index fd89e7c7d8d6f7..aab88e8edf9465 100644
--- a/drivers/gpu/drm/i915/i915_mm.c
+++ b/drivers/gpu/drm/i915/i915_mm.c
@@ -48,7 +48,7 @@ static inline unsigned long sgt_pfn(const struct remap_pfn *r)
return r->sgt.pfn + (r->sgt.curr >> PAGE_SHIFT);
}
-static int remap_sg(pte_t *pte, unsigned long addr, void *data)
+static int remap_sg(hw_pte_t *pte, unsigned long addr, void *data)
{
struct remap_pfn *r = data;
@@ -70,7 +70,7 @@ static int remap_sg(pte_t *pte, unsigned long addr, void *data)
#define EXPECTED_FLAGS (VM_PFNMAP | VM_DONTEXPAND | VM_DONTDUMP)
#if IS_ENABLED(CONFIG_X86)
-static int remap_pfn(pte_t *pte, unsigned long addr, void *data)
+static int remap_pfn(hw_pte_t *pte, unsigned long addr, void *data)
{
struct remap_pfn *r = data;
diff --git a/drivers/misc/sgi-gru/grufault.c b/drivers/misc/sgi-gru/grufault.c
index 3557d78ee47a27..ff89d34ad2aa4f 100644
--- a/drivers/misc/sgi-gru/grufault.c
+++ b/drivers/misc/sgi-gru/grufault.c
@@ -228,10 +228,10 @@ static int atomic_pte_lookup(struct vm_area_struct *vma, unsigned long vaddr,
goto err;
#ifdef CONFIG_X86_64
if (unlikely(pmd_leaf(*pmdp)))
- pte = ptep_get((pte_t *)pmdp);
+ pte = ptep_get((hw_pte_t *)pmdp);
else
#endif
- pte = *pte_offset_kernel(pmdp, vaddr);
+ pte = ptep_get(pte_offset_kernel(pmdp, vaddr));
if (unlikely(!pte_present(pte) ||
(write && (!pte_write(pte) || !pte_dirty(pte)))))
diff --git a/drivers/parisc/sba_iommu.c b/drivers/parisc/sba_iommu.c
index d9339dd5082629..27a7efe3e0a707 100644
--- a/drivers/parisc/sba_iommu.c
+++ b/drivers/parisc/sba_iommu.c
@@ -1697,9 +1697,9 @@ sba_common_init(struct sba_device *sba_dev)
int res_size;
#ifdef DEBUG_DMB_TRAP
extern void iterate_pages(unsigned long , unsigned long ,
- void (*)(pte_t * , unsigned long),
+ void (*)(hw_pte_t *, unsigned long),
unsigned long );
- void set_data_memory_break(pte_t * , unsigned long);
+ void set_data_memory_break(hw_pte_t *, unsigned long);
#endif
/* resource map size dictated by pdir_size */
res_size = sba_dev->ioc[i].pdir_size/sizeof(u64); /* entries */
diff --git a/drivers/xen/gntdev.c b/drivers/xen/gntdev.c
index 1dcc4675580ed1..b013bcad99b5bd 100644
--- a/drivers/xen/gntdev.c
+++ b/drivers/xen/gntdev.c
@@ -301,7 +301,7 @@ void gntdev_put_map(struct gntdev_priv *priv, struct gntdev_grant_map *map)
/* ------------------------------------------------------------------ */
-static int find_grant_ptes(pte_t *pte, unsigned long addr, void *data)
+static int find_grant_ptes(hw_pte_t *pte, unsigned long addr, void *data)
{
struct gntdev_grant_map *map = data;
unsigned int pgnr = (addr - map->pages_vm_start) >> PAGE_SHIFT;
diff --git a/drivers/xen/privcmd.c b/drivers/xen/privcmd.c
index 725a49a0eee72e..b4a487dcc9ecb8 100644
--- a/drivers/xen/privcmd.c
+++ b/drivers/xen/privcmd.c
@@ -1658,7 +1658,7 @@ static int privcmd_mmap(struct file *file, struct vm_area_struct *vma)
* on a per pfn/pte basis. Mapping calls that fail with ENOENT
* can be then retried until success.
*/
-static int is_mapped_fn(pte_t *pte, unsigned long addr, void *data)
+static int is_mapped_fn(hw_pte_t *pte, unsigned long addr, void *data)
{
return pte_none(ptep_get(pte)) ? 0 : -EBUSY;
}
diff --git a/drivers/xen/xenbus/xenbus_client.c b/drivers/xen/xenbus/xenbus_client.c
index 27682cb5e58ab5..387f97a5555945 100644
--- a/drivers/xen/xenbus/xenbus_client.c
+++ b/drivers/xen/xenbus/xenbus_client.c
@@ -749,7 +749,7 @@ int xenbus_unmap_ring_vfree(struct xenbus_device *dev, void *vaddr)
EXPORT_SYMBOL_GPL(xenbus_unmap_ring_vfree);
#ifdef CONFIG_XEN_PV
-static int map_ring_apply(pte_t *pte, unsigned long addr, void *data)
+static int map_ring_apply(hw_pte_t *pte, unsigned long addr, void *data)
{
struct map_ring_valloc *info = data;
diff --git a/drivers/xen/xlate_mmu.c b/drivers/xen/xlate_mmu.c
index 8efd7b55223fbd..d7244f9f9a545a 100644
--- a/drivers/xen/xlate_mmu.c
+++ b/drivers/xen/xlate_mmu.c
@@ -93,7 +93,7 @@ static void setup_hparams(unsigned long gfn, void *data)
info->fgfn++;
}
-static int remap_pte_fn(pte_t *ptep, unsigned long addr, void *data)
+static int remap_pte_fn(hw_pte_t *ptep, unsigned long addr, void *data)
{
struct remap_data *info = data;
struct page *page = info->pages[info->index++];
@@ -269,7 +269,7 @@ struct remap_pfn {
unsigned long i;
};
-static int remap_pfn_fn(pte_t *ptep, unsigned long addr, void *data)
+static int remap_pfn_fn(hw_pte_t *ptep, unsigned long addr, void *data)
{
struct remap_pfn *r = data;
struct page *page = r->pages[r->i];
diff --git a/fs/hugetlbfs/inode.c b/fs/hugetlbfs/inode.c
index a578fba8e2fcad..03a538352229b8 100644
--- a/fs/hugetlbfs/inode.c
+++ b/fs/hugetlbfs/inode.c
@@ -328,7 +328,8 @@ static void hugetlb_delete_from_page_cache(struct folio *folio)
static bool hugetlb_vma_maps_pfn(struct vm_area_struct *vma,
unsigned long addr, unsigned long pfn)
{
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
ptep = hugetlb_walk(vma, addr, huge_page_size(hstate_vma(vma)));
if (!ptep)
diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c
index 817e3e0f919430..ff5ef88148b8a1 100644
--- a/fs/proc/task_mmu.c
+++ b/fs/proc/task_mmu.c
@@ -1046,7 +1046,7 @@ static void smaps_pte_hole_lookup(unsigned long addr, struct mm_walk *walk)
#endif
}
-static void smaps_pte_entry(pte_t *pte, unsigned long addr,
+static void smaps_pte_entry(hw_pte_t *pte, unsigned long addr,
struct mm_walk *walk)
{
struct mem_size_stats *mss = walk->private;
@@ -1140,7 +1140,7 @@ static int smaps_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
struct vm_area_struct *vma = walk->vma;
- pte_t *pte;
+ hw_pte_t *pte;
spinlock_t *ptl;
ptl = pmd_trans_huge_lock(pmd, vma);
@@ -1263,7 +1263,7 @@ static void show_smap_vma_flags(struct seq_file *m, struct vm_area_struct *vma)
}
#ifdef CONFIG_HUGETLB_PAGE
-static int smaps_hugetlb_range(pte_t *pte, unsigned long hmask,
+static int smaps_hugetlb_range(hw_pte_t *pte, unsigned long hmask,
unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
@@ -1704,7 +1704,7 @@ static inline bool pte_is_pinned(struct vm_area_struct *vma, unsigned long addr,
}
static inline void clear_soft_dirty(struct vm_area_struct *vma,
- unsigned long addr, pte_t *pte)
+ unsigned long addr, hw_pte_t *pte)
{
if (!pgtable_supports_soft_dirty())
return;
@@ -1772,7 +1772,8 @@ static int clear_refs_pte_range(pmd_t *pmd, unsigned long addr,
{
struct clear_refs_private *cp = walk->private;
struct vm_area_struct *vma = walk->vma;
- pte_t *pte, ptent;
+ hw_pte_t *pte;
+ pte_t ptent;
spinlock_t *ptl;
struct folio *folio;
@@ -2172,7 +2173,7 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end,
struct vm_area_struct *vma = walk->vma;
struct pagemapread *pm = walk->private;
spinlock_t *ptl;
- pte_t *pte, *orig_pte;
+ hw_pte_t *pte, *orig_pte;
int err = 0;
#ifdef CONFIG_TRANSPARENT_HUGEPAGE
@@ -2210,7 +2211,7 @@ static int pagemap_pmd_range(pmd_t *pmdp, unsigned long addr, unsigned long end,
#ifdef CONFIG_HUGETLB_PAGE
/* This function walks within one hugetlb entry in the single call */
-static int pagemap_hugetlb_range(pte_t *ptep, unsigned long hmask,
+static int pagemap_hugetlb_range(hw_pte_t *ptep, unsigned long hmask,
unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
@@ -2501,7 +2502,7 @@ static unsigned long pagemap_page_category(struct pagemap_scan_private *p,
}
static void make_uffd_wp_pte(struct vm_area_struct *vma,
- unsigned long addr, pte_t *pte, pte_t ptent)
+ unsigned long addr, hw_pte_t *pte, pte_t ptent)
{
if (pte_present(ptent)) {
pte_t old_pte;
@@ -2634,7 +2635,7 @@ static unsigned long pagemap_hugetlb_category(struct vm_area_struct *vma,
}
static void make_uffd_wp_huge_pte(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep,
+ unsigned long addr, hw_pte_t *ptep,
pte_t ptent)
{
const unsigned long psize = huge_page_size(hstate_vma(vma));
@@ -2868,7 +2869,7 @@ static int pagemap_scan_pmd_entry(pmd_t *pmd, unsigned long start,
struct pagemap_scan_private *p = walk->private;
struct vm_area_struct *vma = walk->vma;
unsigned long addr, flush_end = 0;
- pte_t *pte, *start_pte;
+ hw_pte_t *pte, *start_pte;
spinlock_t *ptl;
int ret;
@@ -2962,7 +2963,7 @@ static int pagemap_scan_pmd_entry(pmd_t *pmd, unsigned long start,
}
#ifdef CONFIG_HUGETLB_PAGE
-static int pagemap_scan_hugetlb_entry(pte_t *ptep, unsigned long hmask,
+static int pagemap_scan_hugetlb_entry(hw_pte_t *ptep, unsigned long hmask,
unsigned long start, unsigned long end,
struct mm_walk *walk)
{
@@ -3043,7 +3044,7 @@ static int pagemap_scan_hugetlb_hole_wp(struct vm_area_struct *vma,
unsigned long psize = huge_page_size(h);
struct mm_struct *mm = vma->vm_mm;
spinlock_t *ptl;
- pte_t *ptep;
+ hw_pte_t *ptep;
pte_t pte;
for (addr = ALIGN_DOWN(addr, psize); addr < end; addr += psize) {
@@ -3427,8 +3428,8 @@ static int gather_pte_stats(pmd_t *pmd, unsigned long addr,
struct numa_maps *md = walk->private;
struct vm_area_struct *vma = walk->vma;
spinlock_t *ptl;
- pte_t *orig_pte;
- pte_t *pte;
+ hw_pte_t *orig_pte;
+ hw_pte_t *pte;
#ifdef CONFIG_TRANSPARENT_HUGEPAGE
ptl = pmd_trans_huge_lock(pmd, vma);
@@ -3461,8 +3462,9 @@ static int gather_pte_stats(pmd_t *pmd, unsigned long addr,
return 0;
}
#ifdef CONFIG_HUGETLB_PAGE
-static int gather_hugetlb_stats(pte_t *pte, unsigned long hmask,
- unsigned long addr, unsigned long end, struct mm_walk *walk)
+static int gather_hugetlb_stats(hw_pte_t *pte, unsigned long hmask,
+ unsigned long addr, unsigned long end,
+ struct mm_walk *walk)
{
pte_t huge_pte;
struct numa_maps *md;
@@ -3484,8 +3486,9 @@ static int gather_hugetlb_stats(pte_t *pte, unsigned long hmask,
}
#else
-static int gather_hugetlb_stats(pte_t *pte, unsigned long hmask,
- unsigned long addr, unsigned long end, struct mm_walk *walk)
+static int gather_hugetlb_stats(hw_pte_t *pte, unsigned long hmask,
+ unsigned long addr, unsigned long end,
+ struct mm_walk *walk)
{
return 0;
}
diff --git a/include/asm-generic/hugetlb.h b/include/asm-generic/hugetlb.h
index 635c41cc34797b..07dc4acd8eec86 100644
--- a/include/asm-generic/hugetlb.h
+++ b/include/asm-generic/hugetlb.h
@@ -60,7 +60,7 @@ static inline int huge_pte_uffd(pte_t pte)
#ifndef __HAVE_ARCH_HUGE_PTE_CLEAR
static inline void huge_pte_clear(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, unsigned long sz)
+ hw_pte_t *ptep, unsigned long sz)
{
pte_clear(mm, addr, ptep);
}
@@ -68,7 +68,7 @@ static inline void huge_pte_clear(struct mm_struct *mm, unsigned long addr,
#ifndef __HAVE_ARCH_HUGE_SET_HUGE_PTE_AT
static inline void set_huge_pte_at(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t pte, unsigned long sz)
+ hw_pte_t *ptep, pte_t pte, unsigned long sz)
{
set_pte_at(mm, addr, ptep, pte);
}
@@ -76,7 +76,7 @@ static inline void set_huge_pte_at(struct mm_struct *mm, unsigned long addr,
#ifndef __HAVE_ARCH_HUGE_PTEP_GET_AND_CLEAR
static inline pte_t huge_ptep_get_and_clear(struct mm_struct *mm,
- unsigned long addr, pte_t *ptep, unsigned long sz)
+ unsigned long addr, hw_pte_t *ptep, unsigned long sz)
{
return ptep_get_and_clear(mm, addr, ptep);
}
@@ -84,7 +84,7 @@ static inline pte_t huge_ptep_get_and_clear(struct mm_struct *mm,
#ifndef __HAVE_ARCH_HUGE_PTEP_CLEAR_FLUSH
static inline pte_t huge_ptep_clear_flush(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep)
+ unsigned long addr, hw_pte_t *ptep)
{
return ptep_clear_flush(vma, addr, ptep);
}
@@ -99,7 +99,7 @@ static inline int huge_pte_none(pte_t pte)
#ifndef __HAVE_ARCH_HUGE_PTEP_SET_WRPROTECT
static inline void huge_ptep_set_wrprotect(struct mm_struct *mm,
- unsigned long addr, pte_t *ptep)
+ unsigned long addr, hw_pte_t *ptep)
{
ptep_set_wrprotect(mm, addr, ptep);
}
@@ -107,7 +107,7 @@ static inline void huge_ptep_set_wrprotect(struct mm_struct *mm,
#ifndef __HAVE_ARCH_HUGE_PTEP_SET_ACCESS_FLAGS
static inline int huge_ptep_set_access_flags(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep,
+ unsigned long addr, hw_pte_t *ptep,
pte_t pte, int dirty)
{
return ptep_set_access_flags(vma, addr, ptep, pte, dirty);
@@ -115,7 +115,8 @@ static inline int huge_ptep_set_access_flags(struct vm_area_struct *vma,
#endif
#ifndef __HAVE_ARCH_HUGE_PTEP_GET
-static inline pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr, pte_t *ptep)
+static inline pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr,
+ hw_pte_t *ptep)
{
return ptep_get(ptep);
}
diff --git a/include/asm-generic/pgalloc.h b/include/asm-generic/pgalloc.h
index 051aa1331051c6..b35e5a2158adaf 100644
--- a/include/asm-generic/pgalloc.h
+++ b/include/asm-generic/pgalloc.h
@@ -16,7 +16,7 @@
*
* Return: pointer to the allocated memory or %NULL on error
*/
-static inline pte_t *__pte_alloc_one_kernel_noprof(struct mm_struct *mm)
+static inline hw_pte_t *__pte_alloc_one_kernel_noprof(struct mm_struct *mm)
{
struct ptdesc *ptdesc = pagetable_alloc_noprof(GFP_PGTABLE_KERNEL, 0);
@@ -40,7 +40,7 @@ static inline pte_t *__pte_alloc_one_kernel_noprof(struct mm_struct *mm)
*
* Return: pointer to the allocated memory or %NULL on error
*/
-static inline pte_t *pte_alloc_one_kernel_noprof(struct mm_struct *mm)
+static inline hw_pte_t *pte_alloc_one_kernel_noprof(struct mm_struct *mm)
{
return __pte_alloc_one_kernel_noprof(mm);
}
@@ -52,7 +52,7 @@ static inline pte_t *pte_alloc_one_kernel_noprof(struct mm_struct *mm)
* @mm: the mm_struct of the current context
* @pte: pointer to the memory containing the page table
*/
-static inline void pte_free_kernel(struct mm_struct *mm, pte_t *pte)
+static inline void pte_free_kernel(struct mm_struct *mm, hw_pte_t *pte)
{
pagetable_dtor_free(virt_to_ptdesc(pte));
}
diff --git a/include/asm-generic/tlb.h b/include/asm-generic/tlb.h
index bdcc2778ac64f4..8cbc9cbf2ea041 100644
--- a/include/asm-generic/tlb.h
+++ b/include/asm-generic/tlb.h
@@ -644,7 +644,9 @@ static inline void tlb_flush_p4d_range(struct mmu_gather *tlb,
}
#ifndef __tlb_remove_tlb_entry
-static inline void __tlb_remove_tlb_entry(struct mmu_gather *tlb, pte_t *ptep, unsigned long address)
+static inline void __tlb_remove_tlb_entry(struct mmu_gather *tlb,
+ hw_pte_t *ptep,
+ unsigned long address)
{
}
#endif
@@ -670,7 +672,7 @@ static inline void __tlb_remove_tlb_entry(struct mmu_gather *tlb, pte_t *ptep, u
* consecutive ptes instead of only a single one.
*/
static inline void tlb_remove_tlb_entries(struct mmu_gather *tlb,
- pte_t *ptep, unsigned int nr, unsigned long address)
+ hw_pte_t *ptep, unsigned int nr, unsigned long address)
{
tlb_flush_pte_range(tlb, address, PAGE_SIZE * nr);
for (;;) {
diff --git a/include/linux/hugetlb.h b/include/linux/hugetlb.h
index 16c4c4caa126ce..bc0b9c65aa1d0f 100644
--- a/include/linux/hugetlb.h
+++ b/include/linux/hugetlb.h
@@ -141,7 +141,7 @@ unsigned long hugetlb_total_pages(void);
vm_fault_t hugetlb_fault(struct mm_struct *mm, struct vm_area_struct *vma,
unsigned long address, unsigned int flags);
#ifdef CONFIG_USERFAULTFD
-int hugetlb_mfill_atomic_pte(pte_t *dst_pte,
+int hugetlb_mfill_atomic_pte(hw_pte_t *dst_pte,
struct vm_area_struct *dst_vma,
unsigned long dst_addr,
unsigned long src_addr,
@@ -161,7 +161,7 @@ void hugetlb_fix_reserve_counts(struct inode *inode);
extern struct mutex *hugetlb_fault_mutex_table;
u32 hugetlb_fault_mutex_hash(struct address_space *mapping, pgoff_t idx);
-pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
+hw_pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
unsigned long addr, pud_t *pud);
bool hugetlbfs_pagecache_present(struct hstate *h,
struct vm_area_struct *vma,
@@ -186,22 +186,22 @@ void hugetlb_bootmem_set_nodes(void);
* which may go down to the lowest PTE level in their huge_pte_offset() and
* huge_pte_alloc(): to avoid reliance on pte_offset_map() without pte_unmap().
*/
-static inline pte_t *pte_offset_huge(pmd_t *pmd, unsigned long address)
+static inline hw_pte_t *pte_offset_huge(pmd_t *pmd, unsigned long address)
{
return pte_offset_kernel(pmd, address);
}
-static inline pte_t *pte_alloc_huge(struct mm_struct *mm, pmd_t *pmd,
+static inline hw_pte_t *pte_alloc_huge(struct mm_struct *mm, pmd_t *pmd,
unsigned long address)
{
return pte_alloc(mm, pmd) ? NULL : pte_offset_huge(pmd, address);
}
#endif
-pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
+hw_pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
unsigned long addr, unsigned long sz);
/*
* huge_pte_offset(): Walk the hugetlb pgtable until the last level PTE.
- * Returns the pte_t* if found, or NULL if the address is not mapped.
+ * Returns the hw_pte_t* if found, or NULL if the address is not mapped.
*
* IMPORTANT: we should normally not directly call this function, instead
* this is only a common interface to implement arch-specific
@@ -236,11 +236,11 @@ pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
* a concurrent pmd unshare, but it makes sure the pgtable page is safe to
* access.
*/
-pte_t *huge_pte_offset(struct mm_struct *mm,
+hw_pte_t *huge_pte_offset(struct mm_struct *mm,
unsigned long addr, unsigned long sz);
unsigned long hugetlb_mask_last_page(struct hstate *h);
int huge_pmd_unshare(struct mmu_gather *tlb, struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep);
+ unsigned long addr, hw_pte_t *ptep);
void huge_pmd_unshare_flush(struct mmu_gather *tlb, struct vm_area_struct *vma);
void adjust_range_if_pmd_sharing_possible(struct vm_area_struct *vma,
unsigned long *start, unsigned long *end);
@@ -302,7 +302,8 @@ static inline struct address_space *hugetlb_folio_mapping_lock_write(
}
static inline int huge_pmd_unshare(struct mmu_gather *tlb,
- struct vm_area_struct *vma, unsigned long addr, pte_t *ptep)
+ struct vm_area_struct *vma, unsigned long addr,
+ hw_pte_t *ptep)
{
return 0;
}
@@ -394,7 +395,7 @@ static inline int is_hugepage_only_range(struct mm_struct *mm,
}
#ifdef CONFIG_USERFAULTFD
-static inline int hugetlb_mfill_atomic_pte(pte_t *dst_pte,
+static inline int hugetlb_mfill_atomic_pte(hw_pte_t *dst_pte,
struct vm_area_struct *dst_vma,
unsigned long dst_addr,
unsigned long src_addr,
@@ -406,7 +407,7 @@ static inline int hugetlb_mfill_atomic_pte(pte_t *dst_pte,
}
#endif /* CONFIG_USERFAULTFD */
-static inline pte_t *huge_pte_offset(struct mm_struct *mm, unsigned long addr,
+static inline hw_pte_t *huge_pte_offset(struct mm_struct *mm, unsigned long addr,
unsigned long sz)
{
return NULL;
@@ -989,7 +990,8 @@ static inline bool htlb_allow_alloc_fallback(enum migrate_reason reason)
}
static inline spinlock_t *huge_pte_lockptr(struct hstate *h,
- struct mm_struct *mm, pte_t *pte)
+ struct mm_struct *mm,
+ hw_pte_t *pte)
{
const unsigned long size = huge_page_size(h);
@@ -1053,7 +1055,8 @@ static inline void hugetlb_count_sub(long l, struct mm_struct *mm)
#ifndef huge_ptep_modify_prot_start
#define huge_ptep_modify_prot_start huge_ptep_modify_prot_start
static inline pte_t huge_ptep_modify_prot_start(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep)
+ unsigned long addr,
+ hw_pte_t *ptep)
{
unsigned long psize = huge_page_size(hstate_vma(vma));
@@ -1064,7 +1067,8 @@ static inline pte_t huge_ptep_modify_prot_start(struct vm_area_struct *vma,
#ifndef huge_ptep_modify_prot_commit
#define huge_ptep_modify_prot_commit huge_ptep_modify_prot_commit
static inline void huge_ptep_modify_prot_commit(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep,
+ unsigned long addr,
+ hw_pte_t *ptep,
pte_t old_pte, pte_t pte)
{
unsigned long psize = huge_page_size(hstate_vma(vma));
@@ -1252,7 +1256,8 @@ static inline bool htlb_allow_alloc_fallback(enum migrate_reason reason)
}
static inline spinlock_t *huge_pte_lockptr(struct hstate *h,
- struct mm_struct *mm, pte_t *pte)
+ struct mm_struct *mm,
+ hw_pte_t *pte)
{
return &mm->page_table_lock;
}
@@ -1269,11 +1274,11 @@ static inline void hugetlb_count_sub(long l, struct mm_struct *mm)
{
}
-pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr, pte_t *ptep);
+pte_t huge_ptep_get(struct mm_struct *mm, unsigned long addr, hw_pte_t *ptep);
unsigned long huge_pte_dirty(pte_t pte);
static inline pte_t huge_ptep_clear_flush(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep)
+ unsigned long addr, hw_pte_t *ptep)
{
#ifdef CONFIG_MMU
return ptep_get(ptep);
@@ -1283,7 +1288,8 @@ static inline pte_t huge_ptep_clear_flush(struct vm_area_struct *vma,
}
static inline void set_huge_pte_at(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t pte, unsigned long sz)
+ hw_pte_t *ptep, pte_t pte,
+ unsigned long sz)
{
}
@@ -1311,7 +1317,7 @@ static inline void hugetlb_bootmem_struct_page_init(void)
#endif /* CONFIG_HUGETLB_PAGE */
static inline spinlock_t *huge_pte_lock(struct hstate *h,
- struct mm_struct *mm, pte_t *pte)
+ struct mm_struct *mm, hw_pte_t *pte)
{
spinlock_t *ptl;
@@ -1329,12 +1335,12 @@ static inline __init void hugetlb_cma_reserve(void)
#endif
#ifdef CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING
-static inline bool hugetlb_pmd_shared(pte_t *pte)
+static inline bool hugetlb_pmd_shared(hw_pte_t *pte)
{
return ptdesc_pmd_is_shared(virt_to_ptdesc(pte));
}
#else
-static inline bool hugetlb_pmd_shared(pte_t *pte)
+static inline bool hugetlb_pmd_shared(hw_pte_t *pte)
{
return false;
}
@@ -1361,7 +1367,7 @@ bool __vma_private_lock(struct vm_area_struct *vma);
* Safe version of huge_pte_offset() to check the locks. See comments
* above huge_pte_offset().
*/
-static inline pte_t *
+static inline hw_pte_t *
hugetlb_walk(struct vm_area_struct *vma, unsigned long addr, unsigned long sz)
{
#if defined(CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING) && defined(CONFIG_LOCKDEP)
diff --git a/include/linux/kasan.h b/include/linux/kasan.h
index bf233bde68c7eb..ff41949c0ac08f 100644
--- a/include/linux/kasan.h
+++ b/include/linux/kasan.h
@@ -51,7 +51,7 @@ typedef unsigned int __bitwise kasan_vmalloc_flags_t;
#endif
extern unsigned char kasan_early_shadow_page[PAGE_SIZE];
-extern pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS];
+extern hw_pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS];
extern pmd_t kasan_early_shadow_pmd[MAX_PTRS_PER_PMD];
extern pud_t kasan_early_shadow_pud[MAX_PTRS_PER_PUD];
extern p4d_t kasan_early_shadow_p4d[MAX_PTRS_PER_P4D];
diff --git a/include/linux/mm.h b/include/linux/mm.h
index 7fabe6c66b4b73..f41441c4a5a3b4 100644
--- a/include/linux/mm.h
+++ b/include/linux/mm.h
@@ -782,7 +782,7 @@ struct vm_fault {
* VM_FAULT_ERROR).
*/
/* These three entries are valid only while holding ptl lock */
- pte_t *pte; /* Pointer to pte entry matching
+ hw_pte_t *pte; /* Pointer to pte entry matching
* the 'address'. NULL if the page
* table hasn't been allocated.
*/
@@ -3188,7 +3188,7 @@ struct follow_pfnmap_args {
* The caller shouldn't touch any of these.
*/
spinlock_t *lock;
- pte_t *ptep;
+ hw_pte_t *ptep;
/**
* Outputs:
*
@@ -3525,7 +3525,7 @@ static inline pud_t pud_mkspecial(pud_t pud)
}
#endif /* CONFIG_ARCH_SUPPORTS_PUD_PFNMAP */
-extern pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,
+extern hw_pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,
spinlock_t **ptl);
#ifdef __PAGETABLE_P4D_FOLDED
@@ -3803,7 +3803,7 @@ static inline spinlock_t *pte_lockptr(struct mm_struct *mm, pmd_t *pmd)
return ptlock_ptr(page_ptdesc(pmd_page(*pmd)));
}
-static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, pte_t *pte)
+static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, hw_pte_t *pte)
{
BUILD_BUG_ON(IS_ENABLED(CONFIG_HIGHPTE));
BUILD_BUG_ON(MAX_PTRS_PER_PTE * sizeof(pte_t) > PAGE_SIZE);
@@ -3834,7 +3834,7 @@ static inline spinlock_t *pte_lockptr(struct mm_struct *mm, pmd_t *pmd)
{
return &mm->page_table_lock;
}
-static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, pte_t *pte)
+static inline spinlock_t *ptep_lockptr(struct mm_struct *mm, hw_pte_t *pte)
{
return &mm->page_table_lock;
}
@@ -3875,19 +3875,19 @@ static inline bool pagetable_pte_ctor(struct mm_struct *mm,
return true;
}
-pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp);
+hw_pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp);
-static inline pte_t *pte_offset_map(pmd_t *pmd, unsigned long addr)
+static inline hw_pte_t *pte_offset_map(pmd_t *pmd, unsigned long addr)
{
return __pte_offset_map(pmd, addr, NULL);
}
-pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,
+hw_pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, spinlock_t **ptlp);
-pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,
+hw_pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, spinlock_t **ptlp);
-pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,
+hw_pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, pmd_t *pmdvalp,
spinlock_t **ptlp);
@@ -4836,7 +4836,7 @@ static inline bool gup_can_follow_protnone(const struct vm_area_struct *vma,
return !vma_is_accessible(vma);
}
-typedef int (*pte_fn_t)(pte_t *pte, unsigned long addr, void *data);
+typedef int (*pte_fn_t)(hw_pte_t *pte, unsigned long addr, void *data);
extern int apply_to_page_range(struct mm_struct *mm, unsigned long address,
unsigned long size, pte_fn_t fn, void *data);
extern int apply_to_existing_page_range(struct mm_struct *mm,
@@ -5086,7 +5086,7 @@ void *vmemmap_alloc_block(unsigned long size, int node);
struct vmem_altmap;
void *vmemmap_alloc_block_buf(unsigned long size, int node,
struct vmem_altmap *altmap);
-void vmemmap_verify(pte_t *, int, unsigned long, unsigned long);
+void vmemmap_verify(hw_pte_t *, int, unsigned long, unsigned long);
void vmemmap_set_pmd(pmd_t *pmd, void *p, int node,
unsigned long addr, unsigned long next);
int vmemmap_check_pmd(pmd_t *pmd, int node,
@@ -5454,7 +5454,7 @@ static inline bool snapshot_page_is_faithful(const struct page_snapshot *ps)
void snapshot_page(struct page_snapshot *ps, const struct page *page);
-void map_anon_folio_pte_nopf(struct folio *folio, pte_t *pte,
+void map_anon_folio_pte_nopf(struct folio *folio, hw_pte_t *pte,
struct vm_area_struct *vma, unsigned long addr,
bool uffd_wp);
diff --git a/include/linux/page_table_check.h b/include/linux/page_table_check.h
index 12268a32e8be15..933c1028c22326 100644
--- a/include/linux/page_table_check.h
+++ b/include/linux/page_table_check.h
@@ -7,6 +7,8 @@
#ifndef __LINUX_PAGE_TABLE_CHECK_H
#define __LINUX_PAGE_TABLE_CHECK_H
+#include <linux/pgtable_types.h>
+
#ifdef CONFIG_PAGE_TABLE_CHECK
#include <linux/jump_label.h>
@@ -21,7 +23,7 @@ void __page_table_check_pmd_clear(struct mm_struct *mm, unsigned long addr,
void __page_table_check_pud_clear(struct mm_struct *mm, unsigned long addr,
pud_t pud);
void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t pte, unsigned int nr);
+ hw_pte_t *ptep, pte_t pte, unsigned int nr);
void __page_table_check_pmds_set(struct mm_struct *mm, unsigned long addr,
pmd_t *pmdp, pmd_t pmd, unsigned int nr);
void __page_table_check_puds_set(struct mm_struct *mm, unsigned long addr,
@@ -74,7 +76,8 @@ static inline void page_table_check_pud_clear(struct mm_struct *mm,
}
static inline void page_table_check_ptes_set(struct mm_struct *mm,
- unsigned long addr, pte_t *ptep,
+ unsigned long addr,
+ hw_pte_t *ptep,
pte_t pte, unsigned int nr)
{
if (static_branch_likely(&page_table_check_disabled))
@@ -137,7 +140,8 @@ static inline void page_table_check_pud_clear(struct mm_struct *mm,
}
static inline void page_table_check_ptes_set(struct mm_struct *mm,
- unsigned long addr, pte_t *ptep,
+ unsigned long addr,
+ hw_pte_t *ptep,
pte_t pte, unsigned int nr)
{
}
diff --git a/include/linux/pagewalk.h b/include/linux/pagewalk.h
index b41d7265c01bc2..7ab2eb39e02c0e 100644
--- a/include/linux/pagewalk.h
+++ b/include/linux/pagewalk.h
@@ -38,7 +38,7 @@ enum page_walk_lock {
* not trigger for any populated ranges.
* @hugetlb_entry: if set, called for each hugetlb entry. This hook
* function is called with the vma lock held, in order to
- * protect against a concurrent freeing of the pte_t* or
+ * protect against a concurrent freeing of the hw_pte_t* or
* the ptl. In some cases, the hook function needs to drop
* and retake the vma lock in order to avoid deadlocks
* while calling other functions. In such cases the hook
@@ -76,11 +76,11 @@ struct mm_walk_ops {
unsigned long next, struct mm_walk *walk);
int (*pmd_entry)(pmd_t *pmd, unsigned long addr,
unsigned long next, struct mm_walk *walk);
- int (*pte_entry)(pte_t *pte, unsigned long addr,
+ int (*pte_entry)(hw_pte_t *pte, unsigned long addr,
unsigned long next, struct mm_walk *walk);
int (*pte_hole)(unsigned long addr, unsigned long next,
int depth, struct mm_walk *walk);
- int (*hugetlb_entry)(pte_t *pte, unsigned long hmask,
+ int (*hugetlb_entry)(hw_pte_t *pte, unsigned long hmask,
unsigned long addr, unsigned long next,
struct mm_walk *walk);
int (*test_walk)(unsigned long addr, unsigned long next,
@@ -89,7 +89,7 @@ struct mm_walk_ops {
struct mm_walk *walk);
void (*post_vma)(struct mm_walk *walk);
int (*install_pte)(unsigned long addr, unsigned long next,
- pte_t *ptep, struct mm_walk *walk);
+ pte_t *ptentp, struct mm_walk *walk);
enum page_walk_lock walk_lock;
};
@@ -173,7 +173,7 @@ struct folio_walk {
struct page *page;
enum folio_walk_level level;
union {
- pte_t *ptep;
+ hw_pte_t *ptep;
pud_t *pudp;
pmd_t *pmdp;
};
diff --git a/include/linux/pgtable.h b/include/linux/pgtable.h
index 8c093c119e5a82..3003ac9cd81fe3 100644
--- a/include/linux/pgtable.h
+++ b/include/linux/pgtable.h
@@ -4,6 +4,7 @@
#include <linux/pfn.h>
#include <asm/pgtable.h>
+#include <linux/pgtable_types.h>
#define PMD_ORDER (PMD_SHIFT - PAGE_SHIFT)
#define PUD_ORDER (PUD_SHIFT - PAGE_SHIFT)
@@ -93,26 +94,26 @@ static inline void pud_init(void *addr)
#endif
#ifndef pte_offset_kernel
-static inline pte_t *pte_offset_kernel(pmd_t *pmd, unsigned long address)
+static inline hw_pte_t *pte_offset_kernel(pmd_t *pmd, unsigned long address)
{
- return (pte_t *)pmd_page_vaddr(*pmd) + pte_index(address);
+ return (hw_pte_t *)pmd_page_vaddr(*pmd) + pte_index(address);
}
#define pte_offset_kernel pte_offset_kernel
#endif
#ifdef CONFIG_HIGHPTE
#define __pte_map(pmd, address) \
- ((pte_t *)kmap_local_page(pmd_page(*(pmd))) + pte_index((address)))
+ ((hw_pte_t *)kmap_local_page(pmd_page(*(pmd))) + pte_index((address)))
#define pte_unmap(pte) do { \
kunmap_local((pte)); \
rcu_read_unlock(); \
} while (0)
#else
-static inline pte_t *__pte_map(pmd_t *pmd, unsigned long address)
+static inline hw_pte_t *__pte_map(pmd_t *pmd, unsigned long address)
{
return pte_offset_kernel(pmd, address);
}
-static inline void pte_unmap(pte_t *pte)
+static inline void pte_unmap(hw_pte_t *pte)
{
rcu_read_unlock();
}
@@ -172,7 +173,7 @@ static inline pmd_t *pmd_off_k(unsigned long va)
return pmd_offset(pud_offset(p4d_offset(pgd_offset_k(va), va), va), va);
}
-static inline pte_t *virt_to_kpte(unsigned long vaddr)
+static inline hw_pte_t *virt_to_kpte(unsigned long vaddr)
{
pmd_t *pmd = pmd_off_k(vaddr);
@@ -407,7 +408,7 @@ static inline void lazy_mmu_mode_resume(void) {}
*
* May be overridden by the architecture, else pte_batch_hint is always 1.
*/
-static inline unsigned int pte_batch_hint(pte_t *ptep, pte_t pte)
+static inline unsigned int pte_batch_hint(hw_pte_t *ptep, pte_t pte)
{
return 1;
}
@@ -442,7 +443,7 @@ static inline pte_t pte_advance_pfn(pte_t pte, unsigned long nr)
* to the same folio. The PTEs are all in the same PMD.
*/
static inline void set_ptes(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t pte, unsigned int nr)
+ hw_pte_t *ptep, pte_t pte, unsigned int nr)
{
page_table_check_ptes_set(mm, addr, ptep, pte, nr);
@@ -459,7 +460,7 @@ static inline void set_ptes(struct mm_struct *mm, unsigned long addr,
#ifndef __HAVE_ARCH_PTEP_SET_ACCESS_FLAGS
extern int ptep_set_access_flags(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep,
+ unsigned long address, hw_pte_t *ptep,
pte_t entry, int dirty);
#endif
@@ -490,9 +491,9 @@ static inline int pudp_set_access_flags(struct vm_area_struct *vma,
#endif
#ifndef ptep_get
-static inline pte_t ptep_get(pte_t *ptep)
+static inline pte_t ptep_get(hw_pte_t *ptep)
{
- return READ_ONCE(*ptep);
+ return READ_ONCE(__pte_from_hw(*ptep));
}
#endif
@@ -526,7 +527,7 @@ static inline pgd_t pgdp_get(pgd_t *pgdp)
#ifndef __HAVE_ARCH_PTEP_TEST_AND_CLEAR_YOUNG
static inline bool ptep_test_and_clear_young(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep)
+ unsigned long address, hw_pte_t *ptep)
{
pte_t pte = ptep_get(ptep);
bool young = true;
@@ -565,7 +566,7 @@ static inline bool pmdp_test_and_clear_young(struct vm_area_struct *vma,
#ifndef __HAVE_ARCH_PTEP_CLEAR_YOUNG_FLUSH
bool ptep_clear_flush_young(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep);
+ unsigned long address, hw_pte_t *ptep);
#endif
#ifndef __HAVE_ARCH_PMDP_CLEAR_YOUNG_FLUSH
@@ -644,7 +645,7 @@ static inline void arch_check_zapped_pud(struct vm_area_struct *vma, pud_t pud)
#ifndef __HAVE_ARCH_PTEP_GET_AND_CLEAR
static inline pte_t ptep_get_and_clear(struct mm_struct *mm,
unsigned long address,
- pte_t *ptep)
+ hw_pte_t *ptep)
{
pte_t pte = ptep_get(ptep);
pte_clear(mm, address, ptep);
@@ -673,7 +674,7 @@ static inline pte_t ptep_get_and_clear(struct mm_struct *mm,
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline void clear_young_dirty_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep,
+ unsigned long addr, hw_pte_t *ptep,
unsigned int nr, cydp_t flags)
{
pte_t pte;
@@ -698,7 +699,7 @@ static inline void clear_young_dirty_ptes(struct vm_area_struct *vma,
#endif
static inline void ptep_clear(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep)
+ hw_pte_t *ptep)
{
pte_t pte = ptep_get(ptep);
@@ -739,7 +740,7 @@ static inline void ptep_clear(struct mm_struct *mm, unsigned long addr,
* present bit set *unless* it is 'l'. Because get_user_pages_fast() only
* operates on present ptes we're safe.
*/
-static inline pte_t ptep_get_lockless(pte_t *ptep)
+static inline pte_t ptep_get_lockless(hw_pte_t *ptep)
{
pte_t pte;
@@ -777,7 +778,7 @@ static inline pmd_t pmdp_get_lockless(pmd_t *pmdp)
* We require that the PTE can be read atomically.
*/
#ifndef ptep_get_lockless
-static inline pte_t ptep_get_lockless(pte_t *ptep)
+static inline pte_t ptep_get_lockless(hw_pte_t *ptep)
{
return ptep_get(ptep);
}
@@ -844,7 +845,8 @@ static inline pud_t pudp_huge_get_and_clear_full(struct vm_area_struct *vma,
#ifndef __HAVE_ARCH_PTEP_GET_AND_CLEAR_FULL
static inline pte_t ptep_get_and_clear_full(struct mm_struct *mm,
- unsigned long address, pte_t *ptep,
+ unsigned long address,
+ hw_pte_t *ptep,
int full)
{
return ptep_get_and_clear(mm, address, ptep);
@@ -872,7 +874,7 @@ static inline pte_t ptep_get_and_clear_full(struct mm_struct *mm,
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline pte_t get_and_clear_full_ptes(struct mm_struct *mm,
- unsigned long addr, pte_t *ptep, unsigned int nr, int full)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr, int full)
{
pte_t pte, tmp_pte;
@@ -908,7 +910,7 @@ static inline pte_t get_and_clear_full_ptes(struct mm_struct *mm,
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline pte_t get_and_clear_ptes(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, unsigned int nr)
+ hw_pte_t *ptep, unsigned int nr)
{
return get_and_clear_full_ptes(mm, addr, ptep, nr, 0);
}
@@ -933,7 +935,7 @@ static inline pte_t get_and_clear_ptes(struct mm_struct *mm, unsigned long addr,
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline void clear_full_ptes(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, unsigned int nr, int full)
+ hw_pte_t *ptep, unsigned int nr, int full)
{
for (;;) {
ptep_get_and_clear_full(mm, addr, ptep, full);
@@ -962,7 +964,7 @@ static inline void clear_full_ptes(struct mm_struct *mm, unsigned long addr,
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline void clear_ptes(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, unsigned int nr)
+ hw_pte_t *ptep, unsigned int nr)
{
clear_full_ptes(mm, addr, ptep, nr, 0);
}
@@ -977,13 +979,14 @@ static inline void clear_ptes(struct mm_struct *mm, unsigned long addr,
*/
#ifndef update_mmu_tlb_range
static inline void update_mmu_tlb_range(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep, unsigned int nr)
+ unsigned long address, hw_pte_t *ptep,
+ unsigned int nr)
{
}
#endif
static inline void update_mmu_tlb(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep)
+ unsigned long address, hw_pte_t *ptep)
{
update_mmu_tlb_range(vma, address, ptep, 1);
}
@@ -1000,7 +1003,7 @@ static inline void update_mmu_tlb(struct vm_area_struct *vma,
* The PTEs are all in the same PMD.
*/
static inline void clear_nonpresent_ptes(struct mm_struct *mm,
- unsigned long addr, pte_t *ptep, unsigned int nr)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr)
{
(void)addr;
@@ -1016,7 +1019,7 @@ static inline void clear_nonpresent_ptes(struct mm_struct *mm,
#ifndef __HAVE_ARCH_PTEP_CLEAR_FLUSH
extern pte_t ptep_clear_flush(struct vm_area_struct *vma,
unsigned long address,
- pte_t *ptep);
+ hw_pte_t *ptep);
#endif
#ifndef __HAVE_ARCH_PMDP_HUGE_CLEAR_FLUSH
@@ -1044,7 +1047,8 @@ static inline pmd_t pmd_mkwrite(pmd_t pmd, struct vm_area_struct *vma)
#ifndef __HAVE_ARCH_PTEP_SET_WRPROTECT
struct mm_struct;
-static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long address, pte_t *ptep)
+static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long address,
+ hw_pte_t *ptep)
{
pte_t old_pte = ptep_get(ptep);
set_pte_at(mm, address, ptep, pte_wrprotect(old_pte));
@@ -1070,7 +1074,7 @@ static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long addres
* ptep_try_set as an identity macro. The generic stub returns false, which is
* correct for callers that fall through to oops on failure.
*/
-static inline bool ptep_try_set(pte_t *ptep, pte_t new_pte)
+static inline bool ptep_try_set(hw_pte_t *ptep, pte_t new_pte)
{
return false;
}
@@ -1113,7 +1117,7 @@ static inline void flush_tlb_before_set(unsigned long addr)
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline void wrprotect_ptes(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, unsigned int nr)
+ hw_pte_t *ptep, unsigned int nr)
{
for (;;) {
ptep_set_wrprotect(mm, addr, ptep);
@@ -1144,7 +1148,7 @@ static inline void wrprotect_ptes(struct mm_struct *mm, unsigned long addr,
* pages that belong to the same folio. The PTEs are all in the same PMD.
*/
static inline bool clear_flush_young_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, unsigned int nr)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr)
{
bool young = false;
@@ -1181,7 +1185,7 @@ static inline bool clear_flush_young_ptes(struct vm_area_struct *vma,
* Returns: whether any PTE was young.
*/
static inline bool test_and_clear_young_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, unsigned int nr)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr)
{
bool young = false;
@@ -1585,7 +1589,7 @@ static inline int pmd_none_or_clear_bad(pmd_t *pmd)
static inline pte_t __ptep_modify_prot_start(struct vm_area_struct *vma,
unsigned long addr,
- pte_t *ptep)
+ hw_pte_t *ptep)
{
/*
* Get the current pte state, but zero it out to make it
@@ -1597,7 +1601,7 @@ static inline pte_t __ptep_modify_prot_start(struct vm_area_struct *vma,
static inline void __ptep_modify_prot_commit(struct vm_area_struct *vma,
unsigned long addr,
- pte_t *ptep, pte_t pte)
+ hw_pte_t *ptep, pte_t pte)
{
/*
* The pte is non-present, so there's no hardware state to
@@ -1623,7 +1627,7 @@ static inline void __ptep_modify_prot_commit(struct vm_area_struct *vma,
*/
static inline pte_t ptep_modify_prot_start(struct vm_area_struct *vma,
unsigned long addr,
- pte_t *ptep)
+ hw_pte_t *ptep)
{
return __ptep_modify_prot_start(vma, addr, ptep);
}
@@ -1636,7 +1640,8 @@ static inline pte_t ptep_modify_prot_start(struct vm_area_struct *vma,
*/
static inline void ptep_modify_prot_commit(struct vm_area_struct *vma,
unsigned long addr,
- pte_t *ptep, pte_t old_pte, pte_t pte)
+ hw_pte_t *ptep, pte_t old_pte,
+ pte_t pte)
{
__ptep_modify_prot_commit(vma, addr, ptep, pte);
}
@@ -1667,7 +1672,7 @@ static inline void ptep_modify_prot_commit(struct vm_area_struct *vma,
*/
#ifndef modify_prot_start_ptes
static inline pte_t modify_prot_start_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, unsigned int nr)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr)
{
pte_t pte, tmp_pte;
@@ -1707,7 +1712,7 @@ static inline pte_t modify_prot_start_ptes(struct vm_area_struct *vma,
*/
#ifndef modify_prot_commit_ptes
static inline void modify_prot_commit_ptes(struct vm_area_struct *vma, unsigned long addr,
- pte_t *ptep, pte_t old_pte, pte_t pte, unsigned int nr)
+ hw_pte_t *ptep, pte_t old_pte, pte_t pte, unsigned int nr)
{
int i;
diff --git a/include/linux/pgtable_types.h b/include/linux/pgtable_types.h
new file mode 100644
index 00000000000000..61afe27307ec20
--- /dev/null
+++ b/include/linux/pgtable_types.h
@@ -0,0 +1,12 @@
+/* SPDX-License-Identifier: GPL-2.0 */
+#ifndef _LINUX_PGTABLE_TYPES_H
+#define _LINUX_PGTABLE_TYPES_H
+
+#include <asm/page.h>
+
+#ifndef __HAVE_ARCH_HW_PTE_T
+#define hw_pte_t pte_t
+#define __pte_from_hw(pte) (pte)
+#endif
+
+#endif /* _LINUX_PGTABLE_TYPES_H */
diff --git a/include/linux/rmap.h b/include/linux/rmap.h
index a174758f777753..1fc64074283d62 100644
--- a/include/linux/rmap.h
+++ b/include/linux/rmap.h
@@ -868,7 +868,7 @@ struct page_vma_mapped_walk {
struct vm_area_struct *vma;
unsigned long address;
pmd_t *pmd;
- pte_t *pte;
+ hw_pte_t *pte;
spinlock_t *ptl;
unsigned int flags;
bool is_anon_walk;
diff --git a/include/linux/swapops.h b/include/linux/swapops.h
index c956bc445ee013..aeba03c96da1f6 100644
--- a/include/linux/swapops.h
+++ b/include/linux/swapops.h
@@ -215,7 +215,8 @@ static inline swp_entry_t make_migration_entry_dirty(swp_entry_t entry)
extern void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,
unsigned long address);
-extern void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr, pte_t *pte);
+extern void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr,
+ hw_pte_t *pte);
#else /* CONFIG_MIGRATION */
static inline swp_entry_t make_readable_migration_entry(pgoff_t offset)
{
@@ -235,7 +236,8 @@ static inline swp_entry_t make_writable_migration_entry(pgoff_t offset)
static inline void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,
unsigned long address) { }
static inline void migration_entry_wait_huge(struct vm_area_struct *vma,
- unsigned long addr, pte_t *pte) { }
+ unsigned long addr,
+ hw_pte_t *pte) { }
static inline swp_entry_t make_migration_entry_young(swp_entry_t entry)
{
diff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h
index e4d8d0a9f30f9f..993566c71d72c8 100644
--- a/include/linux/vmalloc.h
+++ b/include/linux/vmalloc.h
@@ -8,7 +8,7 @@
#include <linux/init.h>
#include <linux/list.h>
#include <linux/llist.h>
-#include <asm/page.h> /* pgprot_t */
+#include <linux/pgtable_types.h> /* pgprot_t, hw_pte_t */
#include <linux/rbtree.h>
#include <linux/overflow.h>
@@ -120,7 +120,7 @@ static inline unsigned long arch_vmap_pte_range_map_size(unsigned long addr, uns
#ifndef arch_vmap_pte_range_unmap_size
static inline unsigned long arch_vmap_pte_range_unmap_size(unsigned long addr,
- pte_t *ptep)
+ hw_pte_t *ptep)
{
return PAGE_SIZE;
}
diff --git a/include/trace/events/xen.h b/include/trace/events/xen.h
index ad384969e2cb2b..1972d50b043a52 100644
--- a/include/trace/events/xen.h
+++ b/include/trace/events/xen.h
@@ -138,10 +138,10 @@ TRACE_EVENT(xen_mc_extend_args,
TRACE_DEFINE_SIZEOF(pteval_t);
TRACE_EVENT(xen_mmu_set_pte,
- TP_PROTO(pte_t *ptep, pte_t pteval),
+ TP_PROTO(hw_pte_t *ptep, pte_t pteval),
TP_ARGS(ptep, pteval),
TP_STRUCT__entry(
- __field(pte_t *, ptep)
+ __field(hw_pte_t *, ptep)
__field(pteval_t, pteval)
),
TP_fast_assign(__entry->ptep = ptep;
@@ -207,12 +207,12 @@ TRACE_EVENT(xen_mmu_set_p4d,
DECLARE_EVENT_CLASS(xen_mmu_ptep_modify_prot,
TP_PROTO(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t pteval),
+ hw_pte_t *ptep, pte_t pteval),
TP_ARGS(mm, addr, ptep, pteval),
TP_STRUCT__entry(
__field(struct mm_struct *, mm)
__field(unsigned long, addr)
- __field(pte_t *, ptep)
+ __field(hw_pte_t *, ptep)
__field(pteval_t, pteval)
),
TP_fast_assign(__entry->mm = mm;
@@ -227,7 +227,7 @@ DECLARE_EVENT_CLASS(xen_mmu_ptep_modify_prot,
#define DEFINE_XEN_MMU_PTEP_MODIFY_PROT(name) \
DEFINE_EVENT(xen_mmu_ptep_modify_prot, name, \
TP_PROTO(struct mm_struct *mm, unsigned long addr, \
- pte_t *ptep, pte_t pteval), \
+ hw_pte_t *ptep, pte_t pteval), \
TP_ARGS(mm, addr, ptep, pteval))
DEFINE_XEN_MMU_PTEP_MODIFY_PROT(xen_mmu_ptep_modify_prot_start);
diff --git a/kernel/bpf/arena.c b/kernel/bpf/arena.c
index 80b7b8a6944645..c554c07b155925 100644
--- a/kernel/bpf/arena.c
+++ b/kernel/bpf/arena.c
@@ -153,7 +153,7 @@ struct clear_range_data {
struct page *scratch_page;
};
-static int apply_range_set_cb(pte_t *pte, unsigned long addr, void *data)
+static int apply_range_set_cb(hw_pte_t *pte, unsigned long addr, void *data)
{
struct apply_range_data *d = data;
struct page *page;
@@ -204,7 +204,7 @@ static void flush_vmap_cache(unsigned long start, unsigned long size)
flush_cache_vmap(start, start + size);
}
-static int apply_range_clear_cb(pte_t *pte, unsigned long addr, void *data)
+static int apply_range_clear_cb(hw_pte_t *pte, unsigned long addr, void *data)
{
struct clear_range_data *d = data;
pte_t old_pte;
@@ -234,7 +234,8 @@ static int apply_range_clear_cb(pte_t *pte, unsigned long addr, void *data)
return 0;
}
-static int apply_range_set_scratch_cb(pte_t *pte, unsigned long addr, void *data)
+static int apply_range_set_scratch_cb(hw_pte_t *pte, unsigned long addr,
+ void *data)
{
struct page *scratch_page = data;
@@ -336,7 +337,7 @@ static struct bpf_map *arena_map_alloc(union bpf_attr *attr)
return ERR_PTR(err);
}
-static int existing_page_cb(pte_t *ptep, unsigned long addr, void *data)
+static int existing_page_cb(hw_pte_t *ptep, unsigned long addr, void *data)
{
struct bpf_arena *arena = data;
struct page *page;
diff --git a/kernel/events/core.c b/kernel/events/core.c
index cf78e892a4bb0a..5413c3919935c1 100644
--- a/kernel/events/core.c
+++ b/kernel/events/core.c
@@ -8488,7 +8488,8 @@ static u64 perf_get_pgtable_size(struct mm_struct *mm, unsigned long addr)
p4d_t *p4dp, p4d;
pud_t *pudp, pud;
pmd_t *pmdp, pmd;
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
pgdp = pgd_offset(mm, addr);
pgd = pgdp_get(pgdp);
diff --git a/mm/damon/ops-common.c b/mm/damon/ops-common.c
index e59f77eca83b2b..8f6ac4223c76e2 100644
--- a/mm/damon/ops-common.c
+++ b/mm/damon/ops-common.c
@@ -39,7 +39,7 @@ struct folio *damon_get_folio(unsigned long pfn)
return folio;
}
-void damon_ptep_mkold(pte_t *pte, struct vm_area_struct *vma, unsigned long addr)
+void damon_ptep_mkold(hw_pte_t *pte, struct vm_area_struct *vma, unsigned long addr)
{
pte_t pteval = ptep_get(pte);
struct folio *folio;
diff --git a/mm/damon/ops-common.h b/mm/damon/ops-common.h
index 38d295488fa181..34b7e5715fcf96 100644
--- a/mm/damon/ops-common.h
+++ b/mm/damon/ops-common.h
@@ -7,7 +7,7 @@
struct folio *damon_get_folio(unsigned long pfn);
-void damon_ptep_mkold(pte_t *pte, struct vm_area_struct *vma, unsigned long addr);
+void damon_ptep_mkold(hw_pte_t *pte, struct vm_area_struct *vma, unsigned long addr);
void damon_pmdp_mkold(pmd_t *pmd, struct vm_area_struct *vma, unsigned long addr);
void damon_folio_mkold(struct folio *folio);
bool damon_folio_young(struct folio *folio);
diff --git a/mm/damon/vaddr.c b/mm/damon/vaddr.c
index 4976775fe2762a..ee29aec5a20cde 100644
--- a/mm/damon/vaddr.c
+++ b/mm/damon/vaddr.c
@@ -268,7 +268,7 @@ static void damon_va_walk_page_range(struct mm_struct *mm, unsigned long start,
static int damon_mkold_pmd_entry(pmd_t *pmd, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
- pte_t *pte;
+ hw_pte_t *pte;
spinlock_t *ptl;
ptl = pmd_trans_huge_lock(pmd, walk->vma);
@@ -293,7 +293,7 @@ static int damon_mkold_pmd_entry(pmd_t *pmd, unsigned long addr,
}
#ifdef CONFIG_HUGETLB_PAGE
-static void damon_hugetlb_mkold(pte_t *pte, struct mm_struct *mm,
+static void damon_hugetlb_mkold(hw_pte_t *pte, struct mm_struct *mm,
struct vm_area_struct *vma, unsigned long addr)
{
bool referenced = false;
@@ -320,7 +320,7 @@ static void damon_hugetlb_mkold(pte_t *pte, struct mm_struct *mm,
folio_put(folio);
}
-static int damon_mkold_hugetlb_entry(pte_t *pte, unsigned long hmask,
+static int damon_mkold_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,
unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
@@ -389,7 +389,7 @@ struct damon_young_walk_private {
static int damon_young_pmd_entry(pmd_t *pmd, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
- pte_t *pte;
+ hw_pte_t *pte;
pte_t ptent;
spinlock_t *ptl;
struct folio *folio;
@@ -433,7 +433,7 @@ static int damon_young_pmd_entry(pmd_t *pmd, unsigned long addr,
}
#ifdef CONFIG_HUGETLB_PAGE
-static int damon_young_hugetlb_entry(pte_t *pte, unsigned long hmask,
+static int damon_young_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,
unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
@@ -522,7 +522,7 @@ static unsigned int damon_va_check_accesses(struct damon_ctx *ctx)
static bool damos_va_filter_young_match(struct damos_filter *filter,
struct folio *folio, struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, pmd_t *pmdp)
+ unsigned long addr, hw_pte_t *ptep, pmd_t *pmdp)
{
bool young = false;
@@ -544,7 +544,7 @@ static bool damos_va_filter_young_match(struct damos_filter *filter,
static bool damos_va_filter_out(struct damos *scheme, struct folio *folio,
struct vm_area_struct *vma, unsigned long addr,
- pte_t *ptep, pmd_t *pmdp)
+ hw_pte_t *ptep, pmd_t *pmdp)
{
struct damos_filter *filter;
bool matched;
@@ -640,7 +640,8 @@ static int damos_va_migrate_pmd_entry(pmd_t *pmd, unsigned long addr,
struct damos_migrate_dests *dests = &s->migrate_dests;
struct folio *folio;
spinlock_t *ptl;
- pte_t *start_pte, *pte, ptent;
+ hw_pte_t *start_pte, *pte;
+ pte_t ptent;
int nr;
#ifdef CONFIG_TRANSPARENT_HUGEPAGE
@@ -800,7 +801,8 @@ static int damos_va_stat_pmd_entry(pmd_t *pmd, unsigned long addr,
struct vm_area_struct *vma = walk->vma;
struct folio *folio;
spinlock_t *ptl;
- pte_t *start_pte, *pte, ptent;
+ hw_pte_t *start_pte, *pte;
+ pte_t ptent;
int nr;
#ifdef CONFIG_TRANSPARENT_HUGEPAGE
diff --git a/mm/debug_vm_pgtable.c b/mm/debug_vm_pgtable.c
index 2875fd22d7bb02..54e194d2a58543 100644
--- a/mm/debug_vm_pgtable.c
+++ b/mm/debug_vm_pgtable.c
@@ -50,7 +50,7 @@ struct pgtable_debug_args {
p4d_t *p4dp;
pud_t *pudp;
pmd_t *pmdp;
- pte_t *ptep;
+ hw_pte_t *ptep;
p4d_t *start_p4dp;
pud_t *start_pudp;
diff --git a/mm/filemap.c b/mm/filemap.c
index 1dbb4c6f824e9a..0757dc131d05c2 100644
--- a/mm/filemap.c
+++ b/mm/filemap.c
@@ -3484,7 +3484,7 @@ static vm_fault_t filemap_fault_recheck_pte_none(struct vm_fault *vmf)
{
struct vm_area_struct *vma = vmf->vma;
vm_fault_t ret = 0;
- pte_t *ptep;
+ hw_pte_t *ptep;
/*
* We might have COW'ed a pagecache folio and might now have an mlocked
@@ -3790,7 +3790,7 @@ static vm_fault_t filemap_map_folio_range(struct vm_fault *vmf,
vm_fault_t ret = 0;
struct page *page = folio_page(folio, start);
unsigned int count = 0;
- pte_t *old_ptep = vmf->pte;
+ hw_pte_t *old_ptep = vmf->pte;
unsigned long addr0;
/*
diff --git a/mm/gup.c b/mm/gup.c
index 1d32e9a3dc79c9..425477d869b524 100644
--- a/mm/gup.c
+++ b/mm/gup.c
@@ -761,7 +761,7 @@ static struct page *follow_huge_pmd(struct vm_area_struct *vma,
#endif /* CONFIG_PGTABLE_HAS_HUGE_LEAVES */
static int follow_pfn_pte(struct vm_area_struct *vma, unsigned long address,
- pte_t *pte, unsigned int flags)
+ hw_pte_t *pte, unsigned int flags)
{
if (flags & FOLL_TOUCH) {
pte_t orig_entry = ptep_get(pte);
@@ -806,7 +806,8 @@ static struct page *follow_page_pte(struct vm_area_struct *vma,
struct folio *folio;
struct page *page;
spinlock_t *ptl;
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
int ret;
ptep = pte_offset_map_lock(mm, pmd, address, &ptl);
@@ -1035,7 +1036,7 @@ static int get_gate_page(struct mm_struct *mm, unsigned long address,
p4d_t *p4d;
pud_t *pud;
pmd_t *pmd;
- pte_t *pte;
+ hw_pte_t *pte;
pte_t entry;
int ret = -EFAULT;
@@ -2843,7 +2844,7 @@ static int gup_fast_pte_range(pmd_t pmd, pmd_t *pmdp, unsigned long addr,
int *nr)
{
int ret = 0;
- pte_t *ptep, *ptem;
+ hw_pte_t *ptep, *ptem;
ptem = ptep = pte_offset_map(&pmd, addr);
if (!ptep)
diff --git a/mm/highmem.c b/mm/highmem.c
index a33e4118395175..87f94cac6106b7 100644
--- a/mm/highmem.c
+++ b/mm/highmem.c
@@ -141,7 +141,7 @@ EXPORT_SYMBOL(__totalhigh_pages);
static int pkmap_count[LAST_PKMAP];
static __cacheline_aligned_in_smp DEFINE_SPINLOCK(kmap_lock);
-pte_t *pkmap_page_table;
+hw_pte_t *pkmap_page_table;
/*
* Most architectures have no use for kmap_high_get(), so let's abstract
@@ -532,9 +532,9 @@ static inline bool kmap_high_unmap_local(unsigned long vaddr)
return false;
}
-static pte_t *__kmap_pte;
+static hw_pte_t *__kmap_pte;
-static pte_t *kmap_get_pte(unsigned long vaddr, int idx)
+static hw_pte_t *kmap_get_pte(unsigned long vaddr, int idx)
{
if (IS_ENABLED(CONFIG_KMAP_LOCAL_NON_LINEAR_PTE_ARRAY))
/*
@@ -549,8 +549,9 @@ static pte_t *kmap_get_pte(unsigned long vaddr, int idx)
void *__kmap_local_pfn_prot(unsigned long pfn, pgprot_t prot)
{
- pte_t pteval, *kmap_pte;
unsigned long vaddr;
+ hw_pte_t *kmap_pte;
+ pte_t pteval;
int idx;
/*
@@ -597,7 +598,7 @@ EXPORT_SYMBOL(__kmap_local_page_prot);
void kunmap_local_indexed(const void *vaddr)
{
unsigned long addr = (unsigned long) vaddr & PAGE_MASK;
- pte_t *kmap_pte;
+ hw_pte_t *kmap_pte;
int idx;
if (addr < __fix_to_virt(FIX_KMAP_END) ||
@@ -646,7 +647,7 @@ EXPORT_SYMBOL(kunmap_local_indexed);
void __kmap_local_sched_out(void)
{
struct task_struct *tsk = current;
- pte_t *kmap_pte;
+ hw_pte_t *kmap_pte;
int i;
/* Clear kmaps */
@@ -683,7 +684,7 @@ void __kmap_local_sched_out(void)
void __kmap_local_sched_in(void)
{
struct task_struct *tsk = current;
- pte_t *kmap_pte;
+ hw_pte_t *kmap_pte;
int i;
/* Restore kmaps */
diff --git a/mm/hmm.c b/mm/hmm.c
index 2b05c53b82dc3a..56208cd603c2a6 100644
--- a/mm/hmm.c
+++ b/mm/hmm.c
@@ -240,7 +240,7 @@ static inline unsigned long pte_to_hmm_pfn_flags(struct hmm_range *range,
}
static int hmm_vma_handle_pte(struct mm_walk *walk, unsigned long addr,
- unsigned long end, pmd_t *pmdp, pte_t *ptep,
+ unsigned long end, pmd_t *pmdp, hw_pte_t *ptep,
unsigned long *hmm_pfn)
{
struct hmm_vma_walk *hmm_vma_walk = walk->private;
@@ -411,7 +411,7 @@ static int hmm_vma_walk_pmd(pmd_t *pmdp,
&range->hmm_pfns[(start - range->start) >> PAGE_SHIFT];
unsigned long npages = (end - start) >> PAGE_SHIFT;
unsigned long addr = start;
- pte_t *ptep;
+ hw_pte_t *ptep;
pmd_t pmd;
again:
@@ -547,7 +547,7 @@ static int hmm_vma_walk_pud(pud_t *pudp, unsigned long start, unsigned long end,
#endif
#ifdef CONFIG_HUGETLB_PAGE
-static int hmm_vma_walk_hugetlb_entry(pte_t *pte, unsigned long hmask,
+static int hmm_vma_walk_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,
unsigned long start, unsigned long end,
struct mm_walk *walk)
{
diff --git a/mm/huge_memory.c b/mm/huge_memory.c
index 73522f296cee2d..7f29b397b003ba 100644
--- a/mm/huge_memory.c
+++ b/mm/huge_memory.c
@@ -3056,7 +3056,7 @@ static void __split_huge_zero_page_pmd(struct vm_area_struct *vma,
pgtable_t pgtable;
pmd_t _pmd, old_pmd;
unsigned long addr;
- pte_t *pte;
+ hw_pte_t *pte;
int i;
/*
@@ -3106,7 +3106,7 @@ static void __split_huge_pmd_locked(struct vm_area_struct *vma, pmd_t *pmd,
bool soft_dirty, uffd_wp = false, young = false, write = false;
bool anon_exclusive = false, dirty = false;
unsigned long addr;
- pte_t *pte;
+ hw_pte_t *pte;
int i;
VM_BUG_ON(haddr & ~HPAGE_PMD_MASK);
diff --git a/mm/hugetlb.c b/mm/hugetlb.c
index 566ce53c154f92..7454b026b92bfa 100644
--- a/mm/hugetlb.c
+++ b/mm/hugetlb.c
@@ -120,7 +120,7 @@ static void hugetlb_vma_lock_free(struct vm_area_struct *vma);
static void hugetlb_vma_lock_alloc(struct vm_area_struct *vma);
static void __hugetlb_vma_unlock_write_free(struct vm_area_struct *vma);
static int __huge_pmd_unshare(struct mmu_gather *tlb,
- struct vm_area_struct *vma, unsigned long addr, pte_t *ptep,
+ struct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,
bool check_locks);
static void hugetlb_unshare_pmds(struct vm_area_struct *vma,
unsigned long start, unsigned long end, bool take_locks);
@@ -4864,7 +4864,7 @@ static pte_t make_huge_pte(struct vm_area_struct *vma, struct folio *folio,
}
static void set_huge_ptep_writable(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep)
+ unsigned long address, hw_pte_t *ptep)
{
pte_t entry;
@@ -4874,14 +4874,14 @@ static void set_huge_ptep_writable(struct vm_area_struct *vma,
}
static void set_huge_ptep_maybe_writable(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep)
+ unsigned long address, hw_pte_t *ptep)
{
if (vma->vm_flags & VM_WRITE)
set_huge_ptep_writable(vma, address, ptep);
}
static void
-hugetlb_install_folio(struct vm_area_struct *vma, pte_t *ptep, unsigned long addr,
+hugetlb_install_folio(struct vm_area_struct *vma, hw_pte_t *ptep, unsigned long addr,
struct folio *new_folio, pte_t old, unsigned long sz)
{
pte_t newpte = make_huge_pte(vma, new_folio, true);
@@ -4907,7 +4907,8 @@ int copy_hugetlb_page_range(struct mm_struct *dst, struct mm_struct *src,
struct vm_area_struct *dst_vma,
struct vm_area_struct *src_vma)
{
- pte_t *src_pte, *dst_pte, entry;
+ hw_pte_t *src_pte, *dst_pte;
+ pte_t entry;
struct folio *pte_folio;
unsigned long addr;
bool cow = is_cow_mapping(src_vma->vm_flags);
@@ -5099,7 +5100,8 @@ int copy_hugetlb_page_range(struct mm_struct *dst, struct mm_struct *src,
}
static void move_huge_pte(struct vm_area_struct *vma, unsigned long old_addr,
- unsigned long new_addr, pte_t *src_pte, pte_t *dst_pte,
+ unsigned long new_addr, hw_pte_t *src_pte,
+ hw_pte_t *dst_pte,
unsigned long sz)
{
bool need_clear_uffd_wp = vma_has_uffd_without_event_remap(vma);
@@ -5161,7 +5163,7 @@ int move_hugetlb_page_tables(struct vm_area_struct *vma,
struct mm_struct *mm = vma->vm_mm;
unsigned long old_end = old_addr + len;
unsigned long last_addr_mask;
- pte_t *src_pte, *dst_pte;
+ hw_pte_t *src_pte, *dst_pte;
struct mmu_notifier_range range;
struct mmu_gather tlb;
@@ -5222,7 +5224,7 @@ void __unmap_hugepage_range(struct mmu_gather *tlb, struct vm_area_struct *vma,
struct mm_struct *mm = vma->vm_mm;
const bool folio_provided = !!folio;
unsigned long address;
- pte_t *ptep;
+ hw_pte_t *ptep;
pte_t pte;
spinlock_t *ptl;
struct hstate *h = hstate_vma(vma);
@@ -5752,7 +5754,7 @@ static inline vm_fault_t hugetlb_handle_userfault(struct vm_fault *vmf,
* false if pte changed or is changing.
*/
static bool hugetlb_pte_stable(struct hstate *h, struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t old_pte)
+ hw_pte_t *ptep, pte_t old_pte)
{
spinlock_t *ptl;
bool same;
@@ -6277,7 +6279,7 @@ static struct folio *alloc_hugetlb_folio_vma(struct hstate *h,
* Used by userfaultfd UFFDIO_* ioctls. Based on userfaultfd's mfill_atomic_pte
* with modifications for hugetlb pages.
*/
-int hugetlb_mfill_atomic_pte(pte_t *dst_pte,
+int hugetlb_mfill_atomic_pte(hw_pte_t *dst_pte,
struct vm_area_struct *dst_vma,
unsigned long dst_addr,
unsigned long src_addr,
@@ -6336,7 +6338,7 @@ int hugetlb_mfill_atomic_pte(pte_t *dst_pte,
folio = alloc_hugetlb_folio(dst_vma, dst_addr, false);
if (IS_ERR(folio)) {
- pte_t *actual_pte = hugetlb_walk(dst_vma, dst_addr, PMD_SIZE);
+ hw_pte_t *actual_pte = hugetlb_walk(dst_vma, dst_addr, PMD_SIZE);
if (actual_pte) {
ret = -EEXIST;
goto out;
@@ -6504,7 +6506,7 @@ long hugetlb_change_protection(struct vm_area_struct *vma,
{
struct mm_struct *mm = vma->vm_mm;
unsigned long start = address;
- pte_t *ptep;
+ hw_pte_t *ptep;
pte_t pte;
struct hstate *h = hstate_vma(vma);
long pages = 0, psize = huge_page_size(h);
@@ -6989,15 +6991,15 @@ void adjust_range_if_pmd_sharing_possible(struct vm_area_struct *vma,
* racing tasks could either miss the sharing (see huge_pte_offset) or select a
* bad pmd for sharing.
*/
-pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
+hw_pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
unsigned long addr, pud_t *pud)
{
struct address_space *mapping = vma->vm_file->f_mapping;
const pgoff_t idx = linear_page_index(vma, addr);
struct vm_area_struct *svma;
unsigned long saddr;
- pte_t *spte = NULL;
- pte_t *pte;
+ hw_pte_t *spte = NULL;
+ hw_pte_t *pte;
i_mmap_lock_read(mapping);
mapping_rmap_tree_foreach(svma, mapping, idx, idx) {
@@ -7028,13 +7030,13 @@ pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
}
spin_unlock(&mm->page_table_lock);
out:
- pte = (pte_t *)pmd_alloc(mm, pud, addr);
+ pte = (hw_pte_t *)pmd_alloc(mm, pud, addr);
i_mmap_unlock_read(mapping);
return pte;
}
static int __huge_pmd_unshare(struct mmu_gather *tlb,
- struct vm_area_struct *vma, unsigned long addr, pte_t *ptep,
+ struct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,
bool check_locks)
{
unsigned long sz = huge_page_size(hstate_vma(vma));
@@ -7075,7 +7077,7 @@ static int __huge_pmd_unshare(struct mmu_gather *tlb,
* was not a shared PMD table.
*/
int huge_pmd_unshare(struct mmu_gather *tlb, struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep)
+ unsigned long addr, hw_pte_t *ptep)
{
return __huge_pmd_unshare(tlb, vma, addr, ptep, /*check_locks=*/true);
}
@@ -7105,21 +7107,21 @@ void huge_pmd_unshare_flush(struct mmu_gather *tlb, struct vm_area_struct *vma)
#else /* !CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING */
-pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
+hw_pte_t *huge_pmd_share(struct mm_struct *mm, struct vm_area_struct *vma,
unsigned long addr, pud_t *pud)
{
return NULL;
}
static int __huge_pmd_unshare(struct mmu_gather *tlb,
- struct vm_area_struct *vma, unsigned long addr, pte_t *ptep,
+ struct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,
bool check_locks)
{
return 0;
}
int huge_pmd_unshare(struct mmu_gather *tlb, struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep)
+ unsigned long addr, hw_pte_t *ptep)
{
return 0;
}
@@ -7140,13 +7142,13 @@ bool want_pmd_share(struct vm_area_struct *vma, unsigned long addr)
#endif /* CONFIG_HUGETLB_PMD_PAGE_TABLE_SHARING */
#ifdef CONFIG_ARCH_WANT_GENERAL_HUGETLB
-pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
+hw_pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
unsigned long addr, unsigned long sz)
{
pgd_t *pgd;
p4d_t *p4d;
pud_t *pud;
- pte_t *pte = NULL;
+ hw_pte_t *pte = NULL;
pgd = pgd_offset(mm, addr);
p4d = p4d_alloc(mm, pgd, addr);
@@ -7155,13 +7157,13 @@ pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
pud = pud_alloc(mm, p4d, addr);
if (pud) {
if (sz == PUD_SIZE) {
- pte = (pte_t *)pud;
+ pte = (hw_pte_t *)pud;
} else {
BUG_ON(sz != PMD_SIZE);
if (want_pmd_share(vma, addr) && pud_none(*pud))
pte = huge_pmd_share(mm, vma, addr, pud);
else
- pte = (pte_t *)pmd_alloc(mm, pud, addr);
+ pte = (hw_pte_t *)pmd_alloc(mm, pud, addr);
}
}
@@ -7183,7 +7185,7 @@ pte_t *huge_pte_alloc(struct mm_struct *mm, struct vm_area_struct *vma,
* size @sz doesn't match the hugepage size at this level of the page
* table.
*/
-pte_t *huge_pte_offset(struct mm_struct *mm,
+hw_pte_t *huge_pte_offset(struct mm_struct *mm,
unsigned long addr, unsigned long sz)
{
pgd_t *pgd;
@@ -7201,14 +7203,14 @@ pte_t *huge_pte_offset(struct mm_struct *mm,
pud = pud_offset(p4d, addr);
if (sz == PUD_SIZE)
/* must be pud huge, non-present or none */
- return (pte_t *)pud;
+ return (hw_pte_t *)pud;
if (!pud_present(*pud))
return NULL;
/* must have a valid entry and size to go further */
pmd = pmd_offset(pud, addr);
/* must be pmd huge, non-present or none */
- return (pte_t *)pmd;
+ return (hw_pte_t *)pmd;
}
/*
@@ -7387,7 +7389,7 @@ static void hugetlb_unshare_pmds(struct vm_area_struct *vma,
struct mmu_gather tlb;
unsigned long address;
spinlock_t *ptl;
- pte_t *ptep;
+ hw_pte_t *ptep;
if (!(vma->vm_flags & VM_MAYSHARE))
return;
diff --git a/mm/hugetlb_vmemmap.c b/mm/hugetlb_vmemmap.c
index 917db0984143c2..2850c19c452872 100644
--- a/mm/hugetlb_vmemmap.c
+++ b/mm/hugetlb_vmemmap.c
@@ -33,7 +33,7 @@
* operations.
*/
struct vmemmap_remap_walk {
- void (*remap_pte)(pte_t *pte, unsigned long addr,
+ void (*remap_pte)(hw_pte_t *pte, unsigned long addr,
struct vmemmap_remap_walk *walk);
unsigned long nr_walked;
@@ -55,7 +55,7 @@ static int vmemmap_split_pmd(pmd_t *pmd, struct page *head, unsigned long start,
pmd_t __pmd;
int i;
unsigned long addr = start;
- pte_t *pgtable;
+ hw_pte_t *pgtable;
pgtable = pte_alloc_one_kernel(&init_mm);
if (!pgtable)
@@ -64,7 +64,8 @@ static int vmemmap_split_pmd(pmd_t *pmd, struct page *head, unsigned long start,
pmd_populate_kernel(&init_mm, &__pmd, pgtable);
for (i = 0; i < PTRS_PER_PTE; i++, addr += PAGE_SIZE) {
- pte_t entry, *pte;
+ pte_t entry;
+ hw_pte_t *pte;
pgprot_t pgprot = PAGE_KERNEL;
entry = mk_pte(head + i, pgprot);
@@ -136,7 +137,7 @@ static int vmemmap_pmd_entry(pmd_t *pmd, unsigned long addr,
return vmemmap_split_pmd(pmd, head, addr & PMD_MASK, vmemmap_walk);
}
-static int vmemmap_pte_entry(pte_t *pte, unsigned long addr,
+static int vmemmap_pte_entry(hw_pte_t *pte, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
struct vmemmap_remap_walk *vmemmap_walk = walk->private;
@@ -198,7 +199,7 @@ static void free_vmemmap_page_list(struct list_head *list)
free_vmemmap_page(page);
}
-static void vmemmap_remap_pte(pte_t *pte, unsigned long addr,
+static void vmemmap_remap_pte(hw_pte_t *pte, unsigned long addr,
struct vmemmap_remap_walk *walk)
{
struct page *page = pte_page(ptep_get(pte));
@@ -232,7 +233,7 @@ static void vmemmap_remap_pte(pte_t *pte, unsigned long addr,
set_pte_at(&init_mm, addr, pte, entry);
}
-static void vmemmap_restore_pte(pte_t *pte, unsigned long addr,
+static void vmemmap_restore_pte(hw_pte_t *pte, unsigned long addr,
struct vmemmap_remap_walk *walk)
{
struct page *src = pte_page(ptep_get(pte)), *dst;
diff --git a/mm/internal.h b/mm/internal.h
index f47f06c555481a..46039190db8bff 100644
--- a/mm/internal.h
+++ b/mm/internal.h
@@ -278,7 +278,7 @@ void unmap_vmas(struct mmu_gather *tlb, struct unmap_desc *unmap);
#ifdef CONFIG_MMU
bool cond_install_uffd_wp_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, pte_t pte,
+ unsigned long addr, hw_pte_t *ptep, pte_t pte,
unsigned long nr_ptes);
static inline void get_anon_vma(struct anon_vma *anon_vma)
@@ -414,7 +414,7 @@ static inline pte_t __pte_batch_clear_ignored(pte_t pte, fpb_t flags)
* Return: the number of table entries in the batch.
*/
static inline unsigned int folio_pte_batch_flags(struct folio *folio,
- struct vm_area_struct *vma, pte_t *ptep, pte_t *ptentp,
+ struct vm_area_struct *vma, hw_pte_t *ptep, pte_t *ptentp,
unsigned int max_nr, fpb_t flags)
{
bool any_writable = false, any_young = false, any_dirty = false;
@@ -468,7 +468,7 @@ static inline unsigned int folio_pte_batch_flags(struct folio *folio,
return min(nr, max_nr);
}
-unsigned int folio_pte_batch(struct folio *folio, pte_t *ptep, pte_t pte,
+unsigned int folio_pte_batch(struct folio *folio, hw_pte_t *ptep, pte_t pte,
unsigned int max_nr);
/**
@@ -525,11 +525,11 @@ static inline pte_t pte_next_swp_offset(pte_t pte)
*
* Return: the number of table entries in the batch.
*/
-static inline int swap_pte_batch(pte_t *start_ptep, int max_nr, pte_t pte)
+static inline int swap_pte_batch(hw_pte_t *start_ptep, int max_nr, pte_t pte)
{
pte_t expected_pte = pte_next_swp_offset(pte);
- const pte_t *end_ptep = start_ptep + max_nr;
- pte_t *ptep = start_ptep + 1;
+ const hw_pte_t *end_ptep = start_ptep + max_nr;
+ hw_pte_t *ptep = start_ptep + 1;
VM_WARN_ON(max_nr < 1);
VM_WARN_ON(!softleaf_is_swap(softleaf_from_pte(pte)));
@@ -1569,7 +1569,7 @@ static inline void maybe_rmap_unlock_action(struct vm_area_struct *vma,
#ifdef CONFIG_MMU_NOTIFIER
static inline bool clear_flush_young_ptes_notify(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, unsigned int nr)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr)
{
bool young;
@@ -1590,7 +1590,7 @@ static inline bool pmdp_clear_flush_young_notify(struct vm_area_struct *vma,
}
static inline bool test_and_clear_young_ptes_notify(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, unsigned int nr)
+ unsigned long addr, hw_pte_t *ptep, unsigned int nr)
{
bool young;
diff --git a/mm/kasan/init.c b/mm/kasan/init.c
index 66a88388798768..9bbc2a41d23f04 100644
--- a/mm/kasan/init.c
+++ b/mm/kasan/init.c
@@ -64,7 +64,7 @@ static inline bool kasan_pmd_table(pud_t pud)
return false;
}
#endif
-pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS]
+hw_pte_t kasan_early_shadow_pte[MAX_PTRS_PER_PTE + PTE_HWTABLE_PTRS]
__bss_pgtbl;
static inline bool kasan_pte_table(pmd_t pmd)
@@ -92,7 +92,7 @@ static __init void *early_alloc(size_t size, int node)
static void __ref zero_pte_populate(pmd_t *pmd, unsigned long addr,
unsigned long end)
{
- pte_t *pte = pte_offset_kernel(pmd, addr);
+ hw_pte_t *pte = pte_offset_kernel(pmd, addr);
pte_t zero_pte;
zero_pte = pfn_pte(PFN_DOWN(__pa_symbol(kasan_early_shadow_page)),
@@ -122,7 +122,7 @@ static int __ref zero_pmd_populate(pud_t *pud, unsigned long addr,
}
if (pmd_none(*pmd)) {
- pte_t *p;
+ hw_pte_t *p;
if (slab_is_available())
p = pte_alloc_one_kernel(&init_mm);
@@ -281,9 +281,9 @@ int __ref kasan_populate_early_shadow(const void *shadow_start,
return 0;
}
-static void kasan_free_pte(pte_t *pte_start, pmd_t *pmd)
+static void kasan_free_pte(hw_pte_t *pte_start, pmd_t *pmd)
{
- pte_t *pte;
+ hw_pte_t *pte;
int i;
for (i = 0; i < PTRS_PER_PTE; i++) {
@@ -341,7 +341,7 @@ static void kasan_free_p4d(p4d_t *p4d_start, pgd_t *pgd)
pgd_clear(pgd);
}
-static void kasan_remove_pte_table(pte_t *pte, unsigned long addr,
+static void kasan_remove_pte_table(hw_pte_t *pte, unsigned long addr,
unsigned long end)
{
unsigned long next;
@@ -369,7 +369,7 @@ static void kasan_remove_pmd_table(pmd_t *pmd, unsigned long addr,
unsigned long next;
for (; addr < end; addr = next, pmd++) {
- pte_t *pte;
+ hw_pte_t *pte;
next = pmd_addr_end(addr, end);
diff --git a/mm/kasan/shadow.c b/mm/kasan/shadow.c
index d286e0a0454370..86fc7ed45dcd02 100644
--- a/mm/kasan/shadow.c
+++ b/mm/kasan/shadow.c
@@ -189,7 +189,7 @@ static bool shadow_mapped(unsigned long addr)
p4d_t *p4d;
pud_t *pud;
pmd_t *pmd;
- pte_t *pte;
+ hw_pte_t *pte;
if (pgd_none(*pgd))
return false;
@@ -297,7 +297,7 @@ struct vmalloc_populate_data {
struct page **pages;
};
-static int kasan_populate_vmalloc_pte(pte_t *ptep, unsigned long addr,
+static int kasan_populate_vmalloc_pte(hw_pte_t *ptep, unsigned long addr,
void *_data)
{
struct vmalloc_populate_data *data = _data;
@@ -465,7 +465,7 @@ int __kasan_populate_vmalloc(unsigned long addr, unsigned long size, gfp_t gfp_m
return 0;
}
-static int kasan_depopulate_vmalloc_pte(pte_t *ptep, unsigned long addr,
+static int kasan_depopulate_vmalloc_pte(hw_pte_t *ptep, unsigned long addr,
void *unused)
{
pte_t pte;
diff --git a/mm/khugepaged.c b/mm/khugepaged.c
index 27e8f3077e80fe..8cbe6943fea062 100644
--- a/mm/khugepaged.c
+++ b/mm/khugepaged.c
@@ -637,7 +637,7 @@ static void release_pte_folio(struct folio *folio)
folio_putback_lru(folio);
}
-static void release_pte_pages(pte_t *pte, pte_t *_pte,
+static void release_pte_pages(hw_pte_t *pte, hw_pte_t *_pte,
struct list_head *compound_pagelist)
{
struct folio *folio, *tmp;
@@ -665,7 +665,7 @@ static void release_pte_pages(pte_t *pte, pte_t *_pte,
}
static enum scan_result __collapse_huge_page_isolate(struct vm_area_struct *vma,
- unsigned long start_addr, pte_t *pte, struct collapse_control *cc,
+ unsigned long start_addr, hw_pte_t *pte, struct collapse_control *cc,
unsigned int order, struct list_head *compound_pagelist)
{
const unsigned int max_ptes_none = collapse_max_ptes_none(cc, vma, order);
@@ -674,7 +674,7 @@ static enum scan_result __collapse_huge_page_isolate(struct vm_area_struct *vma,
struct page *page = NULL;
struct folio *folio = NULL;
unsigned long addr = start_addr;
- pte_t *_pte;
+ hw_pte_t *_pte;
int none_or_zero = 0, shared = 0, referenced = 0;
enum scan_result result = SCAN_FAIL;
@@ -828,7 +828,7 @@ static enum scan_result __collapse_huge_page_isolate(struct vm_area_struct *vma,
return result;
}
-static void __collapse_huge_page_copy_succeeded(pte_t *pte,
+static void __collapse_huge_page_copy_succeeded(hw_pte_t *pte,
struct vm_area_struct *vma, unsigned long address,
spinlock_t *ptl, unsigned int order,
struct list_head *compound_pagelist)
@@ -837,7 +837,7 @@ static void __collapse_huge_page_copy_succeeded(pte_t *pte,
unsigned long end = address + (PAGE_SIZE * nr_pages);
struct folio *src, *tmp;
pte_t pteval;
- pte_t *_pte;
+ hw_pte_t *_pte;
unsigned int nr_ptes;
for (_pte = pte; _pte < pte + nr_pages; _pte += nr_ptes,
@@ -892,7 +892,7 @@ static void __collapse_huge_page_copy_succeeded(pte_t *pte,
}
}
-static void __collapse_huge_page_copy_failed(pte_t *pte,
+static void __collapse_huge_page_copy_failed(hw_pte_t *pte,
pmd_t *pmd, pmd_t orig_pmd, struct vm_area_struct *vma,
unsigned int order, struct list_head *compound_pagelist)
{
@@ -930,7 +930,7 @@ static void __collapse_huge_page_copy_failed(pte_t *pte,
* @ptl: lock on raw pages' PTEs
* @compound_pagelist: list that stores compound pages
*/
-static enum scan_result __collapse_huge_page_copy(pte_t *pte, struct folio *folio,
+static enum scan_result __collapse_huge_page_copy(hw_pte_t *pte, struct folio *folio,
pmd_t *pmd, pmd_t orig_pmd, struct vm_area_struct *vma,
unsigned long address, spinlock_t *ptl, unsigned int order,
struct list_head *compound_pagelist)
@@ -1152,7 +1152,7 @@ static enum scan_result __collapse_huge_page_swapin(struct mm_struct *mm,
vm_fault_t ret = 0;
unsigned long addr, end = start_addr + (PAGE_SIZE << order);
enum scan_result result;
- pte_t *pte = NULL;
+ hw_pte_t *pte = NULL;
spinlock_t *ptl;
for (addr = start_addr; addr < end; addr += PAGE_SIZE) {
@@ -1283,7 +1283,7 @@ static enum scan_result collapse_huge_page(struct mm_struct *mm, unsigned long s
const unsigned long end_addr = start_addr + (PAGE_SIZE << order);
LIST_HEAD(compound_pagelist);
pmd_t *pmd, _pmd;
- pte_t *pte = NULL;
+ hw_pte_t *pte = NULL;
pgtable_t pgtable;
struct folio *folio;
spinlock_t *pmd_ptl, *pte_ptl;
@@ -1597,7 +1597,8 @@ static enum scan_result collapse_scan_pmd(struct mm_struct *mm,
unsigned int max_ptes_none = collapse_max_ptes_none(cc, vma, HPAGE_PMD_ORDER);
enum tva_type tva_flags = cc->is_khugepaged ? TVA_KHUGEPAGED : TVA_FORCED_COLLAPSE;
pmd_t *pmd;
- pte_t *pte, *_pte, pteval;
+ hw_pte_t *pte, *_pte;
+ pte_t pteval;
int i;
int none_or_zero = 0, shared = 0, referenced = 0;
enum scan_result result = SCAN_FAIL;
@@ -1864,7 +1865,7 @@ static enum scan_result try_collapse_pte_mapped_thp(struct mm_struct *mm, unsign
unsigned long end = haddr + HPAGE_PMD_SIZE;
struct vm_area_struct *vma = vma_lookup(mm, haddr);
struct folio *folio;
- pte_t *start_pte, *pte;
+ hw_pte_t *start_pte, *pte;
pmd_t *pmd, pgt_pmd;
spinlock_t *pml = NULL, *ptl;
int i;
diff --git a/mm/ksm.c b/mm/ksm.c
index b9b32f7bfb691e..1234e6c8b636cd 100644
--- a/mm/ksm.c
+++ b/mm/ksm.c
@@ -618,7 +618,7 @@ static int break_ksm_pmd_entry(pmd_t *pmdp, unsigned long addr, unsigned long en
{
unsigned long *found_addr = (unsigned long *) walk->private;
struct mm_struct *mm = walk->mm;
- pte_t *start_ptep, *ptep;
+ hw_pte_t *start_ptep, *ptep;
spinlock_t *ptl;
int found = 0;
@@ -1292,7 +1292,7 @@ static u32 calc_checksum(struct page *page)
}
static int write_protect_page(struct vm_area_struct *vma, struct folio *folio,
- pte_t *orig_pte)
+ pte_t *ptentp)
{
struct mm_struct *mm = vma->vm_mm;
DEFINE_FOLIO_VMA_WALK(pvmw, folio, vma, 0, 0);
@@ -1371,7 +1371,7 @@ static int write_protect_page(struct vm_area_struct *vma, struct folio *folio,
set_pte_at(mm, pvmw.address, pvmw.pte, entry);
}
- *orig_pte = entry;
+ *ptentp = entry;
err = 0;
out_unlock:
@@ -1399,7 +1399,7 @@ static int replace_page(struct vm_area_struct *vma, struct page *page,
struct folio *folio = page_folio(page);
pmd_t *pmd;
pmd_t pmde;
- pte_t *ptep;
+ hw_pte_t *ptep;
pte_t newpte;
spinlock_t *ptl;
unsigned long addr;
@@ -2531,7 +2531,8 @@ static int ksm_next_page_pmd_entry(pmd_t *pmdp, unsigned long addr, unsigned lon
{
struct ksm_next_page_arg *private = walk->private;
struct vm_area_struct *vma = walk->vma;
- pte_t *start_ptep = NULL, *ptep, pte;
+ hw_pte_t *start_ptep = NULL, *ptep;
+ pte_t pte;
struct mm_struct *mm = walk->mm;
struct folio *folio;
struct page *page;
diff --git a/mm/madvise.c b/mm/madvise.c
index 07a21ca31bad4d..6f99cef91b6bd8 100644
--- a/mm/madvise.c
+++ b/mm/madvise.c
@@ -189,7 +189,7 @@ static int swapin_walk_pmd_entry(pmd_t *pmd, unsigned long start,
{
struct vm_area_struct *vma = walk->private;
struct swap_io_ctx ctx = {};
- pte_t *ptep = NULL;
+ hw_pte_t *ptep = NULL;
spinlock_t *ptl;
unsigned long addr;
@@ -341,7 +341,7 @@ static inline bool can_do_file_pageout(struct vm_area_struct *vma)
}
static inline int madvise_folio_pte_batch(unsigned long addr, unsigned long end,
- struct folio *folio, pte_t *ptep,
+ struct folio *folio, hw_pte_t *ptep,
pte_t *ptentp)
{
int max_nr = (end - addr) / PAGE_SIZE;
@@ -359,7 +359,8 @@ static int madvise_cold_or_pageout_pte_range(pmd_t *pmd,
bool pageout = private->pageout;
struct mm_struct *mm = tlb->mm;
struct vm_area_struct *vma = walk->vma;
- pte_t *start_pte, *pte, ptent;
+ hw_pte_t *start_pte, *pte;
+ pte_t ptent;
spinlock_t *ptl;
struct folio *folio = NULL;
LIST_HEAD(folio_list);
@@ -658,7 +659,8 @@ static int madvise_free_pte_range(pmd_t *pmd, unsigned long addr,
struct mm_struct *mm = tlb->mm;
struct vm_area_struct *vma = walk->vma;
spinlock_t *ptl;
- pte_t *start_pte, *pte, ptent;
+ hw_pte_t *start_pte, *pte;
+ pte_t ptent;
struct folio *folio;
int nr_swap = 0;
unsigned long next;
@@ -1083,7 +1085,7 @@ static int guard_install_pmd_entry(pmd_t *pmd, unsigned long addr,
return pmd_trans_huge(pmdval);
}
-static int guard_install_pte_entry(pte_t *pte, unsigned long addr,
+static int guard_install_pte_entry(hw_pte_t *pte, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
pte_t pteval = ptep_get(pte);
@@ -1101,12 +1103,12 @@ static int guard_install_pte_entry(pte_t *pte, unsigned long addr,
}
static int guard_install_set_pte(unsigned long addr, unsigned long next,
- pte_t *ptep, struct mm_walk *walk)
+ pte_t *ptentp, struct mm_walk *walk)
{
unsigned long *nr_pages = (unsigned long *)walk->private;
/* Simply install a PTE marker, this causes segfault on access. */
- *ptep = make_pte_marker(PTE_MARKER_GUARD);
+ *ptentp = make_pte_marker(PTE_MARKER_GUARD);
(*nr_pages)++;
return 0;
@@ -1226,7 +1228,7 @@ static int guard_remove_pmd_entry(pmd_t *pmd, unsigned long addr,
return 0;
}
-static int guard_remove_pte_entry(pte_t *pte, unsigned long addr,
+static int guard_remove_pte_entry(hw_pte_t *pte, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
pte_t ptent = ptep_get(pte);
diff --git a/mm/mapping_dirty_helpers.c b/mm/mapping_dirty_helpers.c
index e0efa36e0a0767..dcbd39912f8194 100644
--- a/mm/mapping_dirty_helpers.c
+++ b/mm/mapping_dirty_helpers.c
@@ -31,7 +31,7 @@ struct wp_walk {
* The function write-protects a pte and records the range in
* virtual address space of touched ptes for efficient range TLB flushes.
*/
-static int wp_pte(pte_t *pte, unsigned long addr, unsigned long end,
+static int wp_pte(hw_pte_t *pte, unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
struct wp_walk *wpwalk = walk->private;
@@ -86,7 +86,7 @@ struct clean_walk {
* in the address_space, as well as the first and last of the bits
* touched.
*/
-static int clean_record_pte(pte_t *pte, unsigned long addr,
+static int clean_record_pte(hw_pte_t *pte, unsigned long addr,
unsigned long end, struct mm_walk *walk)
{
struct wp_walk *wpwalk = walk->private;
diff --git a/mm/memory-failure.c b/mm/memory-failure.c
index a8b03e2920ba8a..a89f3fde47a5d2 100644
--- a/mm/memory-failure.c
+++ b/mm/memory-failure.c
@@ -342,7 +342,7 @@ static unsigned long dev_pagemap_mapping_shift(struct vm_area_struct *vma,
p4d_t *p4d;
pud_t *pud;
pmd_t *pmd;
- pte_t *pte;
+ hw_pte_t *pte;
pte_t ptent;
VM_BUG_ON_VMA(address == -EFAULT, vma);
@@ -742,7 +742,7 @@ static int hwpoison_pte_range(pmd_t *pmdp, unsigned long addr,
{
struct hwpoison_walk *hwp = walk->private;
int ret = 0;
- pte_t *ptep, *mapped_pte;
+ hw_pte_t *ptep, *mapped_pte;
spinlock_t *ptl;
ptl = pmd_trans_huge_lock(pmdp, walk->vma);
@@ -770,7 +770,7 @@ static int hwpoison_pte_range(pmd_t *pmdp, unsigned long addr,
}
#ifdef CONFIG_HUGETLB_PAGE
-static int hwpoison_hugetlb_range(pte_t *ptep, unsigned long hmask,
+static int hwpoison_hugetlb_range(hw_pte_t *ptep, unsigned long hmask,
unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
diff --git a/mm/memory.c b/mm/memory.c
index a73af1fccb3d0d..8e89fddd0c4ba1 100644
--- a/mm/memory.c
+++ b/mm/memory.c
@@ -462,7 +462,7 @@ int __pte_alloc(struct mm_struct *mm, pmd_t *pmd)
int __pte_alloc_kernel(pmd_t *pmd)
{
- pte_t *new = pte_alloc_one_kernel(&init_mm);
+ hw_pte_t *new = pte_alloc_one_kernel(&init_mm);
if (!new)
return -ENOMEM;
@@ -941,7 +941,7 @@ struct page *vm_normal_page_pud(struct vm_area_struct *vma,
*/
static void restore_exclusive_pte(struct vm_area_struct *vma,
struct folio *folio, struct page *page, unsigned long address,
- pte_t *ptep, pte_t orig_pte)
+ hw_pte_t *ptep, pte_t orig_pte)
{
pte_t pte;
@@ -978,7 +978,7 @@ static void restore_exclusive_pte(struct vm_area_struct *vma,
* sleeping.
*/
static int try_restore_exclusive_pte(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, pte_t orig_pte)
+ unsigned long addr, hw_pte_t *ptep, pte_t orig_pte)
{
const softleaf_t entry = softleaf_from_pte(orig_pte);
struct page *page = softleaf_to_page(entry);
@@ -1001,7 +1001,7 @@ static int try_restore_exclusive_pte(struct vm_area_struct *vma,
static unsigned long
copy_nonpresent_pte(struct mm_struct *dst_mm, struct mm_struct *src_mm,
- pte_t *dst_pte, pte_t *src_pte, struct vm_area_struct *dst_vma,
+ hw_pte_t *dst_pte, hw_pte_t *src_pte, struct vm_area_struct *dst_vma,
struct vm_area_struct *src_vma, unsigned long addr, int *rss)
{
vm_flags_t vm_flags = dst_vma->vm_flags;
@@ -1116,7 +1116,7 @@ copy_nonpresent_pte(struct mm_struct *dst_mm, struct mm_struct *src_mm,
*/
static inline int
copy_present_page(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma,
- pte_t *dst_pte, pte_t *src_pte, unsigned long addr, int *rss,
+ hw_pte_t *dst_pte, hw_pte_t *src_pte, unsigned long addr, int *rss,
struct folio **prealloc, struct page *page)
{
struct folio *new_folio;
@@ -1155,7 +1155,7 @@ copy_present_page(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma
}
static __always_inline void __copy_present_ptes(struct vm_area_struct *dst_vma,
- struct vm_area_struct *src_vma, pte_t *dst_pte, pte_t *src_pte,
+ struct vm_area_struct *src_vma, hw_pte_t *dst_pte, hw_pte_t *src_pte,
pte_t pte, unsigned long addr, int nr)
{
struct mm_struct *src_mm = src_vma->vm_mm;
@@ -1205,7 +1205,7 @@ static __always_inline void __copy_present_ptes(struct vm_area_struct *dst_vma,
*/
static inline int
copy_present_ptes(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma,
- pte_t *dst_pte, pte_t *src_pte, pte_t pte, unsigned long addr,
+ hw_pte_t *dst_pte, hw_pte_t *src_pte, pte_t pte, unsigned long addr,
int max_nr, int *rss, struct folio **prealloc)
{
fpb_t flags = FPB_MERGE_WRITE;
@@ -1305,8 +1305,8 @@ copy_pte_range(struct vm_area_struct *dst_vma, struct vm_area_struct *src_vma,
{
struct mm_struct *dst_mm = dst_vma->vm_mm;
struct mm_struct *src_mm = src_vma->vm_mm;
- pte_t *orig_src_pte, *orig_dst_pte;
- pte_t *src_pte, *dst_pte;
+ hw_pte_t *orig_src_pte, *orig_dst_pte;
+ hw_pte_t *src_pte, *dst_pte;
pmd_t dummy_pmdval;
pte_t ptent;
spinlock_t *src_ptl, *dst_ptl;
@@ -1699,7 +1699,7 @@ static inline bool zap_drop_markers(struct zap_details *details)
* Returns true if uffd-wp PTEs were installed, false otherwise.
*/
bool cond_install_uffd_wp_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, pte_t pte,
+ unsigned long addr, hw_pte_t *ptep, pte_t pte,
unsigned long nr_ptes)
{
bool arm_uffd_pte = false;
@@ -1753,7 +1753,7 @@ bool cond_install_uffd_wp_ptes(struct vm_area_struct *vma,
*/
static inline bool
zap_install_uffd_wp_if_needed(struct vm_area_struct *vma,
- unsigned long addr, pte_t *pte, int nr,
+ unsigned long addr, hw_pte_t *pte, int nr,
struct zap_details *details, pte_t pteval)
{
if (zap_drop_markers(details))
@@ -1764,7 +1764,7 @@ zap_install_uffd_wp_if_needed(struct vm_area_struct *vma,
static __always_inline void zap_present_folio_ptes(struct mmu_gather *tlb,
struct vm_area_struct *vma, struct folio *folio,
- struct page *page, pte_t *pte, pte_t ptent, unsigned int nr,
+ struct page *page, hw_pte_t *pte, pte_t ptent, unsigned int nr,
unsigned long addr, struct zap_details *details, int *rss,
bool *force_flush, bool *force_break, bool *any_skipped)
{
@@ -1814,7 +1814,7 @@ static __always_inline void zap_present_folio_ptes(struct mmu_gather *tlb,
* Returns the number of processed (skipped or zapped) PTEs (at least 1).
*/
static inline int zap_present_ptes(struct mmu_gather *tlb,
- struct vm_area_struct *vma, pte_t *pte, pte_t ptent,
+ struct vm_area_struct *vma, hw_pte_t *pte, pte_t ptent,
unsigned int max_nr, unsigned long addr,
struct zap_details *details, int *rss, bool *force_flush,
bool *force_break, bool *any_skipped)
@@ -1860,7 +1860,7 @@ static inline int zap_present_ptes(struct mmu_gather *tlb,
}
static inline int zap_nonpresent_ptes(struct mmu_gather *tlb,
- struct vm_area_struct *vma, pte_t *pte, pte_t ptent,
+ struct vm_area_struct *vma, hw_pte_t *pte, pte_t ptent,
unsigned int max_nr, unsigned long addr,
struct zap_details *details, int *rss, bool *any_skipped)
{
@@ -1931,7 +1931,7 @@ static inline int zap_nonpresent_ptes(struct mmu_gather *tlb,
}
static inline int do_zap_pte_range(struct mmu_gather *tlb,
- struct vm_area_struct *vma, pte_t *pte,
+ struct vm_area_struct *vma, hw_pte_t *pte,
unsigned long addr, unsigned long end,
struct zap_details *details, int *rss,
bool *force_flush, bool *force_break,
@@ -1994,7 +1994,7 @@ static bool zap_pte_table_if_empty(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, pmd_t *pmdval)
{
spinlock_t *pml, *ptl = NULL;
- pte_t *start_pte, *pte;
+ hw_pte_t *start_pte, *pte;
int i;
pml = pmd_lock(mm, pmd);
@@ -2034,8 +2034,8 @@ static unsigned long zap_pte_range(struct mmu_gather *tlb,
struct mm_struct *mm = tlb->mm;
int rss[NR_MM_COUNTERS];
spinlock_t *ptl;
- pte_t *start_pte;
- pte_t *pte;
+ hw_pte_t *start_pte;
+ hw_pte_t *pte;
pmd_t pmdval;
unsigned long start = addr;
bool direct_reclaim = true;
@@ -2417,7 +2417,7 @@ static pmd_t *walk_to_pmd(struct mm_struct *mm, unsigned long addr)
return pmd;
}
-pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,
+hw_pte_t *get_locked_pte(struct mm_struct *mm, unsigned long addr,
spinlock_t **ptl)
{
pmd_t *pmd = walk_to_pmd(mm, addr);
@@ -2475,7 +2475,7 @@ static int validate_page_before_insert(struct vm_area_struct *vma,
return 0;
}
-static int insert_page_into_pte_locked(struct vm_area_struct *vma, pte_t *pte,
+static int insert_page_into_pte_locked(struct vm_area_struct *vma, hw_pte_t *pte,
unsigned long addr, struct page *page,
pgprot_t prot, bool mkwrite)
{
@@ -2520,7 +2520,7 @@ static int insert_page(struct vm_area_struct *vma, unsigned long addr,
struct page *page, pgprot_t prot, bool mkwrite)
{
int retval;
- pte_t *pte;
+ hw_pte_t *pte;
spinlock_t *ptl;
retval = validate_page_before_insert(vma, page);
@@ -2537,7 +2537,7 @@ static int insert_page(struct vm_area_struct *vma, unsigned long addr,
return retval;
}
-static int insert_page_in_batch_locked(struct vm_area_struct *vma, pte_t *pte,
+static int insert_page_in_batch_locked(struct vm_area_struct *vma, hw_pte_t *pte,
unsigned long addr, struct page *page, pgprot_t prot)
{
int err;
@@ -2555,7 +2555,7 @@ static int insert_pages(struct vm_area_struct *vma, unsigned long addr,
struct page **pages, unsigned long *num, pgprot_t prot)
{
pmd_t *pmd = NULL;
- pte_t *start_pte, *pte;
+ hw_pte_t *start_pte, *pte;
spinlock_t *pte_lock;
struct mm_struct *const mm = vma->vm_mm;
unsigned long curr_page_idx = 0;
@@ -2798,7 +2798,8 @@ static vm_fault_t insert_pfn(struct vm_area_struct *vma, unsigned long addr,
unsigned long pfn, pgprot_t prot, bool mkwrite)
{
struct mm_struct *mm = vma->vm_mm;
- pte_t *pte, entry;
+ hw_pte_t *pte;
+ pte_t entry;
spinlock_t *ptl;
pte = get_locked_pte(mm, addr, &ptl);
@@ -3039,7 +3040,7 @@ static int remap_pte_range(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, unsigned long end,
unsigned long pfn, pgprot_t prot)
{
- pte_t *pte, *mapped_pte;
+ hw_pte_t *pte, *mapped_pte;
spinlock_t *ptl;
int err = 0;
@@ -3440,7 +3441,7 @@ static int apply_to_pte_range(struct mm_struct *mm, pmd_t *pmd,
pte_fn_t fn, void *data, bool create,
pgtbl_mod_mask *mask)
{
- pte_t *pte, *mapped_pte;
+ hw_pte_t *pte, *mapped_pte;
int err = 0;
spinlock_t *ptl;
@@ -4743,7 +4744,7 @@ static vm_fault_t handle_pte_marker(struct vm_fault *vmf)
/*
* Check if the PTEs within a range are contiguous swap entries.
*/
-static bool can_swapin_thp(struct vm_fault *vmf, pte_t *ptep, int nr_pages)
+static bool can_swapin_thp(struct vm_fault *vmf, hw_pte_t *ptep, int nr_pages)
{
unsigned long addr;
int idx;
@@ -4795,7 +4796,7 @@ static unsigned long thp_swapin_suitable_orders(struct vm_fault *vmf)
unsigned long addr;
softleaf_t entry;
spinlock_t *ptl;
- pte_t *pte;
+ hw_pte_t *pte;
int order;
/*
@@ -4957,7 +4958,7 @@ vm_fault_t do_swap_page(struct vm_fault *vmf)
int nr_pages;
unsigned long page_idx;
unsigned long address;
- pte_t *ptep;
+ hw_pte_t *ptep;
if (!pte_unmap_same(vmf))
goto out;
@@ -5071,7 +5072,7 @@ vm_fault_t do_swap_page(struct vm_fault *vmf)
unsigned long idx = folio_page_idx(folio, page);
unsigned long folio_start = address - idx * PAGE_SIZE;
unsigned long folio_end = folio_start + nr * PAGE_SIZE;
- pte_t *folio_ptep;
+ hw_pte_t *folio_ptep;
pte_t folio_pte;
if (unlikely(folio_start < max(address & PMD_MASK, vma->vm_start)))
@@ -5301,7 +5302,7 @@ vm_fault_t do_swap_page(struct vm_fault *vmf)
return ret;
}
-static bool pte_range_none(pte_t *pte, int nr_pages)
+static bool pte_range_none(hw_pte_t *pte, int nr_pages)
{
int i;
@@ -5320,7 +5321,7 @@ static struct folio *alloc_anon_folio(struct vm_fault *vmf)
unsigned long orders;
struct folio *folio;
unsigned long addr;
- pte_t *pte;
+ hw_pte_t *pte;
gfp_t gfp;
int order;
@@ -5402,7 +5403,7 @@ static struct folio *alloc_anon_folio(struct vm_fault *vmf)
return folio_prealloc(vma->vm_mm, vma, vmf->address, true);
}
-void map_anon_folio_pte_nopf(struct folio *folio, pte_t *pte,
+void map_anon_folio_pte_nopf(struct folio *folio, hw_pte_t *pte,
struct vm_area_struct *vma, unsigned long addr,
bool uffd_wp)
{
@@ -5423,7 +5424,7 @@ void map_anon_folio_pte_nopf(struct folio *folio, pte_t *pte,
update_mmu_cache_range(NULL, vma, addr, pte, nr_pages);
}
-static void map_anon_folio_pte_pf(struct folio *folio, pte_t *pte,
+static void map_anon_folio_pte_pf(struct folio *folio, hw_pte_t *pte,
struct vm_area_struct *vma, unsigned long addr, bool uffd_wp)
{
const unsigned int order = folio_order(folio);
@@ -6208,7 +6209,7 @@ int numa_migrate_check(struct folio *folio, struct vm_fault *vmf,
}
static void numa_rebuild_single_mapping(struct vm_fault *vmf, struct vm_area_struct *vma,
- unsigned long fault_addr, pte_t *fault_pte,
+ unsigned long fault_addr, hw_pte_t *fault_pte,
bool writable)
{
pte_t pte, old_pte;
@@ -6230,7 +6231,7 @@ static void numa_rebuild_large_mapping(struct vm_fault *vmf, struct vm_area_stru
unsigned long start, end, addr = vmf->address;
unsigned long addr_start = addr - (nr << PAGE_SHIFT);
unsigned long pt_start = ALIGN_DOWN(addr, PMD_SIZE);
- pte_t *start_ptep;
+ hw_pte_t *start_ptep;
/* Stay within the VMA and within the page table. */
start = max3(addr_start, pt_start, vma->vm_start);
@@ -6992,7 +6993,7 @@ int __pmd_alloc(struct mm_struct *mm, pud_t *pud, unsigned long address)
#endif /* __PAGETABLE_PMD_FOLDED */
static inline void pfnmap_args_setup(struct follow_pfnmap_args *args,
- spinlock_t *lock, pte_t *ptep,
+ spinlock_t *lock, hw_pte_t *ptep,
pgprot_t pgprot, unsigned long pfn_base,
unsigned long addr_mask, bool writable,
bool special)
@@ -7061,7 +7062,8 @@ int follow_pfnmap_start(struct follow_pfnmap_args *args)
p4d_t *p4dp, p4d;
pud_t *pudp, pud;
pmd_t *pmdp, pmd;
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
pfnmap_lockdep_assert(vma);
diff --git a/mm/mempolicy.c b/mm/mempolicy.c
index 5720f7f54d942f..729a6001323869 100644
--- a/mm/mempolicy.c
+++ b/mm/mempolicy.c
@@ -691,7 +691,7 @@ static int queue_folios_pte_range(pmd_t *pmd, unsigned long addr,
struct folio *folio;
struct queue_pages *qp = walk->private;
unsigned long flags = qp->flags;
- pte_t *pte, *mapped_pte;
+ hw_pte_t *pte, *mapped_pte;
pte_t ptent;
spinlock_t *ptl;
int max_nr, nr;
@@ -771,7 +771,7 @@ static int queue_folios_pte_range(pmd_t *pmd, unsigned long addr,
return 0;
}
-static int queue_folios_hugetlb(pte_t *pte, unsigned long hmask,
+static int queue_folios_hugetlb(hw_pte_t *pte, unsigned long hmask,
unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
diff --git a/mm/migrate.c b/mm/migrate.c
index ab15a4dddd0471..327fde599be4af 100644
--- a/mm/migrate.c
+++ b/mm/migrate.c
@@ -497,7 +497,7 @@ void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,
unsigned long address)
{
spinlock_t *ptl;
- pte_t *ptep;
+ hw_pte_t *ptep;
pte_t pte;
softleaf_t entry;
@@ -528,7 +528,7 @@ void migration_entry_wait(struct mm_struct *mm, pmd_t *pmd,
*
* This function will release the vma lock before returning.
*/
-void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr, pte_t *ptep)
+void migration_entry_wait_huge(struct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep)
{
spinlock_t *ptl = huge_pte_lockptr(hstate_vma(vma), vma->vm_mm, ptep);
softleaf_t entry;
diff --git a/mm/migrate_device.c b/mm/migrate_device.c
index 18d097c3885303..5669a2d760c5e9 100644
--- a/mm/migrate_device.c
+++ b/mm/migrate_device.c
@@ -254,7 +254,7 @@ static int migrate_vma_collect_pmd(pmd_t *pmdp,
spinlock_t *ptl;
struct folio *fault_folio = migrate->fault_page ?
page_folio(migrate->fault_page) : NULL;
- pte_t *ptep;
+ hw_pte_t *ptep;
again:
if (pmd_trans_huge(*pmdp) || !pmd_present(*pmdp)) {
@@ -989,7 +989,7 @@ static void migrate_vma_insert_page(struct migrate_vma *migrate,
p4d_t *p4dp;
pud_t *pudp;
pmd_t *pmdp;
- pte_t *ptep;
+ hw_pte_t *ptep;
pte_t orig_pte;
/* Only allow populating anonymous memory */
diff --git a/mm/mincore.c b/mm/mincore.c
index ff4ac828176837..15454ced345ab7 100644
--- a/mm/mincore.c
+++ b/mm/mincore.c
@@ -24,7 +24,7 @@
#include "swap.h"
#include "internal.h"
-static int mincore_hugetlb(pte_t *pte, unsigned long hmask, unsigned long addr,
+static int mincore_hugetlb(hw_pte_t *pte, unsigned long hmask, unsigned long addr,
unsigned long end, struct mm_walk *walk)
{
#ifdef CONFIG_HUGETLB_PAGE
@@ -164,7 +164,7 @@ static int mincore_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,
{
spinlock_t *ptl;
struct vm_area_struct *vma = walk->vma;
- pte_t *ptep;
+ hw_pte_t *ptep;
unsigned char *vec = walk->private;
int nr = (end - addr) >> PAGE_SHIFT;
int step, i;
diff --git a/mm/mlock.c b/mm/mlock.c
index efa6716e4dfbdf..36002b80382a96 100644
--- a/mm/mlock.c
+++ b/mm/mlock.c
@@ -305,7 +305,7 @@ void munlock_folio(struct folio *folio)
}
static inline unsigned int folio_mlock_step(struct folio *folio,
- pte_t *pte, unsigned long addr, unsigned long end)
+ hw_pte_t *pte, unsigned long addr, unsigned long end)
{
unsigned int count = (end - addr) >> PAGE_SHIFT;
pte_t ptent = ptep_get(pte);
@@ -353,7 +353,7 @@ static int mlock_pte_range(pmd_t *pmd, unsigned long addr,
{
struct vm_area_struct *vma = walk->vma;
spinlock_t *ptl;
- pte_t *start_pte, *pte;
+ hw_pte_t *start_pte, *pte;
pte_t ptent;
struct folio *folio;
unsigned int step = 1;
diff --git a/mm/mprotect.c b/mm/mprotect.c
index 2888ee638d872a..1d23475e0bb76c 100644
--- a/mm/mprotect.c
+++ b/mm/mprotect.c
@@ -103,7 +103,7 @@ bool can_change_pte_writable(struct vm_area_struct *vma, unsigned long addr,
return can_change_shared_pte_writable(vma, pte);
}
-static int mprotect_folio_pte_batch(struct folio *folio, pte_t *ptep,
+static int mprotect_folio_pte_batch(struct folio *folio, hw_pte_t *ptep,
pte_t pte, int max_nr_ptes, fpb_t flags)
{
/* No underlying folio, so cannot batch */
@@ -118,7 +118,7 @@ static int mprotect_folio_pte_batch(struct folio *folio, pte_t *ptep,
/* Set nr_ptes number of ptes, starting from idx */
static __always_inline void prot_commit_flush_ptes(struct vm_area_struct *vma,
- unsigned long addr, pte_t *ptep, pte_t oldpte, pte_t ptent,
+ unsigned long addr, hw_pte_t *ptep, pte_t oldpte, pte_t ptent,
int nr_ptes, int idx, bool set_write, struct mmu_gather *tlb)
{
/*
@@ -170,7 +170,7 @@ static __always_inline int page_anon_exclusive_batch(int start_idx, int max_len,
* retrieve sub-batches.
*/
static __always_inline void commit_anon_folio_batch(struct vm_area_struct *vma,
- struct folio *folio, struct page *first_page, unsigned long addr, pte_t *ptep,
+ struct folio *folio, struct page *first_page, unsigned long addr, hw_pte_t *ptep,
pte_t oldpte, pte_t ptent, int nr_ptes, struct mmu_gather *tlb)
{
bool expected_anon_exclusive;
@@ -189,7 +189,7 @@ static __always_inline void commit_anon_folio_batch(struct vm_area_struct *vma,
}
static __always_inline void set_write_prot_commit_flush_ptes(struct vm_area_struct *vma,
- struct folio *folio, struct page *page, unsigned long addr, pte_t *ptep,
+ struct folio *folio, struct page *page, unsigned long addr, hw_pte_t *ptep,
pte_t oldpte, pte_t ptent, int nr_ptes, struct mmu_gather *tlb)
{
bool set_write;
@@ -212,7 +212,7 @@ static __always_inline void set_write_prot_commit_flush_ptes(struct vm_area_stru
}
static long change_softleaf_pte(struct vm_area_struct *vma,
- unsigned long addr, pte_t *pte, pte_t oldpte, unsigned long cp_flags)
+ unsigned long addr, hw_pte_t *pte, pte_t oldpte, unsigned long cp_flags)
{
const bool uffd_prot = cp_flags & (MM_CP_UFFD_WP | MM_CP_UFFD_RWP);
const bool uffd_prot_resolve = cp_flags &
@@ -279,7 +279,7 @@ static long change_softleaf_pte(struct vm_area_struct *vma,
}
static __always_inline void change_present_ptes(struct mmu_gather *tlb,
- struct vm_area_struct *vma, unsigned long addr, pte_t *ptep,
+ struct vm_area_struct *vma, unsigned long addr, hw_pte_t *ptep,
int nr_ptes, unsigned long end, pgprot_t newprot,
struct folio *folio, struct page *page, unsigned long cp_flags)
{
@@ -332,7 +332,8 @@ static long change_pte_range(struct mmu_gather *tlb,
struct vm_area_struct *vma, pmd_t *pmd, unsigned long addr,
unsigned long end, pgprot_t newprot, unsigned long cp_flags)
{
- pte_t *pte, oldpte;
+ hw_pte_t *pte;
+ pte_t oldpte;
spinlock_t *ptl;
long pages = 0;
bool is_private_single_threaded;
@@ -727,7 +728,7 @@ long change_protection(struct mmu_gather *tlb,
return pages;
}
-static int prot_none_pte_entry(pte_t *pte, unsigned long addr,
+static int prot_none_pte_entry(hw_pte_t *pte, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
return pfn_modify_allowed(pte_pfn(ptep_get(pte)),
@@ -736,7 +737,7 @@ static int prot_none_pte_entry(pte_t *pte, unsigned long addr,
}
#ifdef CONFIG_HUGETLB_PAGE
-static int prot_none_hugetlb_entry(pte_t *pte, unsigned long hmask,
+static int prot_none_hugetlb_entry(hw_pte_t *pte, unsigned long hmask,
unsigned long addr, unsigned long next,
struct mm_walk *walk)
{
diff --git a/mm/mremap.c b/mm/mremap.c
index f07fc4e3ef2e6c..ecb90ccee6fdda 100644
--- a/mm/mremap.c
+++ b/mm/mremap.c
@@ -176,7 +176,7 @@ static pte_t move_soft_dirty_pte(pte_t pte)
}
static int mremap_folio_pte_batch(struct vm_area_struct *vma, unsigned long addr,
- pte_t *ptep, pte_t pte, int max_nr)
+ hw_pte_t *ptep, pte_t pte, int max_nr)
{
struct folio *folio;
@@ -200,7 +200,7 @@ static int move_ptes(struct pagetable_move_control *pmc,
struct vm_area_struct *vma = pmc->old;
bool need_clear_uffd_wp = vma_has_uffd_without_event_remap(vma);
struct mm_struct *mm = vma->vm_mm;
- pte_t *old_ptep, *new_ptep;
+ hw_pte_t *old_ptep, *new_ptep;
pte_t old_pte, pte;
pmd_t dummy_pmdval;
spinlock_t *old_ptl, *new_ptl;
@@ -264,7 +264,7 @@ static int move_ptes(struct pagetable_move_control *pmc,
for (; old_addr < old_end; old_ptep += nr_ptes, old_addr += nr_ptes * PAGE_SIZE,
new_ptep += nr_ptes, new_addr += nr_ptes * PAGE_SIZE) {
- VM_WARN_ON_ONCE(!pte_none(*new_ptep));
+ VM_WARN_ON_ONCE(!pte_none(ptep_get(new_ptep)));
nr_ptes = 1;
max_nr_ptes = (old_end - old_addr) >> PAGE_SHIFT;
diff --git a/mm/page_table_check.c b/mm/page_table_check.c
index 6ffc536359cd06..70984b4e3cde37 100644
--- a/mm/page_table_check.c
+++ b/mm/page_table_check.c
@@ -208,7 +208,7 @@ static void page_table_check_pte_flags(pte_t pte)
}
void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,
- pte_t *ptep, pte_t pte, unsigned int nr)
+ hw_pte_t *ptep, pte_t pte, unsigned int nr)
{
unsigned int i;
@@ -279,7 +279,7 @@ void __page_table_check_pte_clear_range(struct mm_struct *mm,
return;
if (!pmd_bad(pmd) && !pmd_leaf(pmd)) {
- pte_t *ptep = pte_offset_map(&pmd, addr);
+ hw_pte_t *ptep = pte_offset_map(&pmd, addr);
unsigned long i;
if (WARN_ON(!ptep))
diff --git a/mm/pagewalk.c b/mm/pagewalk.c
index ed4860c01936c6..172addf9e65581 100644
--- a/mm/pagewalk.c
+++ b/mm/pagewalk.c
@@ -26,7 +26,7 @@ static int real_depth(int depth)
return depth;
}
-static int walk_pte_range_inner(pte_t *pte, unsigned long addr,
+static int walk_pte_range_inner(hw_pte_t *pte, unsigned long addr,
unsigned long end, struct mm_walk *walk)
{
const struct mm_walk_ops *ops = walk->ops;
@@ -61,7 +61,7 @@ static int walk_pte_range_inner(pte_t *pte, unsigned long addr,
static int walk_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,
struct mm_walk *walk)
{
- pte_t *pte;
+ hw_pte_t *pte;
int err = 0;
spinlock_t *ptl;
@@ -343,7 +343,7 @@ static int walk_hugetlb_range(unsigned long addr, unsigned long end,
unsigned long next;
unsigned long hmask = huge_page_mask(h);
unsigned long sz = huge_page_size(h);
- pte_t *pte;
+ hw_pte_t *pte;
const struct mm_walk_ops *ops = walk->ops;
int err = 0;
@@ -909,7 +909,8 @@ struct folio *folio_walk_start(struct folio_walk *fw,
struct page *page;
pud_t *pudp, pud;
pmd_t *pmdp, pmd;
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
spinlock_t *ptl;
pgd_t *pgdp;
p4d_t *p4dp;
diff --git a/mm/percpu.c b/mm/percpu.c
index a802d72c116fbb..fa79a1295c5bfc 100644
--- a/mm/percpu.c
+++ b/mm/percpu.c
@@ -3176,7 +3176,7 @@ void __init __weak pcpu_populate_pte(unsigned long addr)
pmd = pmd_offset(pud, addr);
if (!pmd_present(*pmd)) {
- pte_t *new;
+ hw_pte_t *new;
new = memblock_alloc_or_panic(PTE_TABLE_SIZE, PTE_TABLE_SIZE);
pmd_populate_kernel(&init_mm, pmd, new);
diff --git a/mm/pgtable-generic.c b/mm/pgtable-generic.c
index b91b1a98029c7f..52f286da3eec61 100644
--- a/mm/pgtable-generic.c
+++ b/mm/pgtable-generic.c
@@ -68,7 +68,7 @@ void pmd_clear_bad(pmd_t *pmd)
* force that call on sun4c so we changed this macro slightly
*/
int ptep_set_access_flags(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep,
+ unsigned long address, hw_pte_t *ptep,
pte_t entry, int dirty)
{
int changed = !pte_same(ptep_get(ptep), entry);
@@ -82,7 +82,7 @@ int ptep_set_access_flags(struct vm_area_struct *vma,
#ifndef __HAVE_ARCH_PTEP_CLEAR_YOUNG_FLUSH
bool ptep_clear_flush_young(struct vm_area_struct *vma,
- unsigned long address, pte_t *ptep)
+ unsigned long address, hw_pte_t *ptep)
{
bool young;
@@ -95,7 +95,7 @@ bool ptep_clear_flush_young(struct vm_area_struct *vma,
#ifndef __HAVE_ARCH_PTEP_CLEAR_FLUSH
pte_t ptep_clear_flush(struct vm_area_struct *vma, unsigned long address,
- pte_t *ptep)
+ hw_pte_t *ptep)
{
struct mm_struct *mm = (vma)->vm_mm;
pte_t pte;
@@ -282,7 +282,7 @@ static unsigned long pmdp_get_lockless_start(void) { return 0; }
static void pmdp_get_lockless_end(unsigned long irqflags) { }
#endif
-pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp)
+hw_pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp)
{
unsigned long irqflags;
pmd_t pmdval;
@@ -308,11 +308,11 @@ pte_t *__pte_offset_map(pmd_t *pmd, unsigned long addr, pmd_t *pmdvalp)
return NULL;
}
-pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,
+hw_pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, spinlock_t **ptlp)
{
pmd_t pmdval;
- pte_t *pte;
+ hw_pte_t *pte;
pte = __pte_offset_map(pmd, addr, &pmdval);
if (likely(pte))
@@ -320,11 +320,11 @@ pte_t *pte_offset_map_ro_nolock(struct mm_struct *mm, pmd_t *pmd,
return pte;
}
-pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,
+hw_pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, pmd_t *pmdvalp,
spinlock_t **ptlp)
{
- pte_t *pte;
+ hw_pte_t *pte;
VM_WARN_ON_ONCE(!pmdvalp);
pte = __pte_offset_map(pmd, addr, pmdvalp);
@@ -390,12 +390,12 @@ pte_t *pte_offset_map_rw_nolock(struct mm_struct *mm, pmd_t *pmd,
* table, and may not use RCU at all: "outsiders" like khugepaged should avoid
* pte_offset_map() and co once the vma is detached from mm or mm_users is zero.
*/
-pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,
+hw_pte_t *pte_offset_map_lock(struct mm_struct *mm, pmd_t *pmd,
unsigned long addr, spinlock_t **ptlp)
{
spinlock_t *ptl;
pmd_t pmdval;
- pte_t *pte;
+ hw_pte_t *pte;
again:
pte = __pte_offset_map(pmd, addr, &pmdval);
if (unlikely(!pte))
diff --git a/mm/ptdump.c b/mm/ptdump.c
index 5851096e6f656c..8f19f20be3c445 100644
--- a/mm/ptdump.c
+++ b/mm/ptdump.c
@@ -19,7 +19,7 @@ static inline int note_kasan_page_table(struct mm_walk *walk,
{
struct ptdump_state *st = walk->private;
- st->note_page_pte(st, addr, kasan_early_shadow_pte[0]);
+ st->note_page_pte(st, addr, ptep_get(kasan_early_shadow_pte));
walk->action = ACTION_CONTINUE;
@@ -117,7 +117,7 @@ static int ptdump_pmd_entry(pmd_t *pmd, unsigned long addr,
return 0;
}
-static int ptdump_pte_entry(pte_t *pte, unsigned long addr,
+static int ptdump_pte_entry(hw_pte_t *pte, unsigned long addr,
unsigned long next, struct mm_walk *walk)
{
struct ptdump_state *st = walk->private;
diff --git a/mm/rmap.c b/mm/rmap.c
index b7ead3e9f06412..591793d11ed1bf 100644
--- a/mm/rmap.c
+++ b/mm/rmap.c
@@ -1124,7 +1124,7 @@ static int page_vma_mkclean_one(struct page_vma_mapped_walk *pvmw)
address = pvmw->address;
if (pvmw->pte) {
- pte_t *pte = pvmw->pte;
+ hw_pte_t *pte = pvmw->pte;
pte_t entry = ptep_get(pte);
/*
@@ -2141,7 +2141,7 @@ static pte_t swp_pte_prepare(swp_entry_t entry, pte_t old_pte,
static bool ttu_anon_swapbacked_folio(struct vm_area_struct *vma,
struct folio *folio, struct page *page, unsigned long address,
- pte_t *ptep, pte_t pteval)
+ hw_pte_t *ptep, pte_t pteval)
{
const bool anon_exclusive = folio_test_anon(folio) &&
PageAnonExclusive(page);
@@ -2176,7 +2176,7 @@ static bool ttu_anon_swapbacked_folio(struct vm_area_struct *vma,
}
static bool ttu_anon_folio(struct vm_area_struct *vma, struct folio *folio,
- struct page *page, unsigned long address, pte_t *ptep,
+ struct page *page, unsigned long address, hw_pte_t *ptep,
pte_t pteval, unsigned long nr_pages)
{
/*
diff --git a/mm/sparse-vmemmap.c b/mm/sparse-vmemmap.c
index 5a2469fb1838c7..2bbf7adef511d7 100644
--- a/mm/sparse-vmemmap.c
+++ b/mm/sparse-vmemmap.c
@@ -137,7 +137,7 @@ static void * __meminit altmap_alloc_block_buf(unsigned long size,
return __va(__pfn_to_phys(pfn));
}
-void __meminit vmemmap_verify(pte_t *pte, int node,
+void __meminit vmemmap_verify(hw_pte_t *pte, int node,
unsigned long start, unsigned long end)
{
unsigned long pfn = pte_pfn(ptep_get(pte));
@@ -148,11 +148,11 @@ void __meminit vmemmap_verify(pte_t *pte, int node,
start, end - 1);
}
-static pte_t * __meminit vmemmap_pte_populate(pmd_t *pmd, unsigned long addr, int node,
+static hw_pte_t * __meminit vmemmap_pte_populate(pmd_t *pmd, unsigned long addr, int node,
struct vmem_altmap *altmap,
unsigned long ptpfn, unsigned long flags)
{
- pte_t *pte = pte_offset_kernel(pmd, addr);
+ hw_pte_t *pte = pte_offset_kernel(pmd, addr);
if (pte_none(ptep_get(pte))) {
pte_t entry;
void *p;
@@ -243,7 +243,7 @@ static pgd_t * __meminit vmemmap_pgd_populate(unsigned long addr, int node)
return pgd;
}
-static pte_t * __meminit vmemmap_populate_address(unsigned long addr, int node,
+static hw_pte_t * __meminit vmemmap_populate_address(unsigned long addr, int node,
struct vmem_altmap *altmap,
unsigned long ptpfn,
unsigned long flags)
@@ -252,7 +252,7 @@ static pte_t * __meminit vmemmap_populate_address(unsigned long addr, int node,
p4d_t *p4d;
pud_t *pud;
pmd_t *pmd;
- pte_t *pte;
+ hw_pte_t *pte;
pgd = vmemmap_pgd_populate(addr, node);
if (!pgd)
@@ -281,7 +281,7 @@ static int __meminit vmemmap_populate_range(unsigned long start,
unsigned long flags)
{
unsigned long addr = start;
- pte_t *pte;
+ hw_pte_t *pte;
for (; addr < end; addr += PAGE_SIZE) {
pte = vmemmap_populate_address(addr, node, altmap,
@@ -314,7 +314,7 @@ void vmemmap_wrprotect_hvo(unsigned long addr, unsigned long end,
int node, unsigned long headsize)
{
unsigned long maddr;
- pte_t *pte;
+ hw_pte_t *pte;
for (maddr = addr + headsize; maddr < end; maddr += PAGE_SIZE) {
pte = virt_to_kpte(maddr);
@@ -364,7 +364,7 @@ int __meminit vmemmap_populate_hvo(unsigned long addr, unsigned long end,
{
unsigned long maddr;
struct page *tail;
- pte_t *pte;
+ hw_pte_t *pte;
int node = zone_to_nid(zone);
tail = vmemmap_get_tail(order, zone);
@@ -396,7 +396,7 @@ int __weak __meminit vmemmap_check_pmd(pmd_t *pmd, int node,
{
if (!pmd_leaf(pmdp_get(pmd)))
return 0;
- vmemmap_verify((pte_t *)pmd, node, addr, next);
+ vmemmap_verify((hw_pte_t *)pmd, node, addr, next);
return 1;
}
@@ -474,9 +474,9 @@ static bool __meminit reuse_compound_section(unsigned long start_pfn,
return !IS_ALIGNED(offset, nr_pages) && nr_pages > PAGES_PER_SUBSECTION;
}
-static pte_t * __meminit compound_section_tail_page(unsigned long addr)
+static hw_pte_t * __meminit compound_section_tail_page(unsigned long addr)
{
- pte_t *pte;
+ hw_pte_t *pte;
addr -= PAGE_SIZE;
@@ -497,7 +497,7 @@ static int __meminit vmemmap_populate_compound_pages(unsigned long start_pfn,
struct dev_pagemap *pgmap)
{
unsigned long size, addr;
- pte_t *pte;
+ hw_pte_t *pte;
int rc;
if (reuse_compound_section(start_pfn, pgmap)) {
diff --git a/mm/swap_state.c b/mm/swap_state.c
index 5be825911e645e..cb1b2d434a5813 100644
--- a/mm/swap_state.c
+++ b/mm/swap_state.c
@@ -917,7 +917,8 @@ static struct folio *swap_vma_readahead(swp_entry_t targ_entry, gfp_t gfp_mask,
struct swap_io_ctx ctx = {};
struct blk_plug plug;
struct folio *folio;
- pte_t *pte = NULL, pentry;
+ hw_pte_t *pte = NULL;
+ pte_t pentry;
int win;
unsigned long start, end, addr;
pgoff_t ilx = targ_ilx;
diff --git a/mm/swapfile.c b/mm/swapfile.c
index 5d15913dcf8631..50f06a444ec1d1 100644
--- a/mm/swapfile.c
+++ b/mm/swapfile.c
@@ -2476,7 +2476,8 @@ static int unuse_pte(struct vm_area_struct *vma, pmd_t *pmd,
struct page *page;
struct folio *swapcache;
spinlock_t *ptl;
- pte_t *pte, new_pte, old_pte;
+ hw_pte_t *pte;
+ pte_t new_pte, old_pte;
bool hwpoisoned = false;
int ret = 1;
@@ -2587,7 +2588,7 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd,
unsigned long addr, unsigned long end,
unsigned int type)
{
- pte_t *pte = NULL;
+ hw_pte_t *pte = NULL;
do {
struct folio *folio;
diff --git a/mm/userfaultfd.c b/mm/userfaultfd.c
index 258b03182a780b..f22cfb2ccb07d8 100644
--- a/mm/userfaultfd.c
+++ b/mm/userfaultfd.c
@@ -361,13 +361,13 @@ static int mfill_atomic_install_pte(pmd_t *dst_pmd,
{
int ret;
struct mm_struct *dst_mm = dst_vma->vm_mm;
- pte_t _dst_pte, *dst_pte;
+ hw_pte_t *dst_pte;
bool writable = dst_vma->vm_flags & VM_WRITE;
bool vm_shared = dst_vma->vm_flags & VM_SHARED;
spinlock_t *ptl;
struct folio *folio = page_folio(page);
bool page_in_cache = folio_mapping(folio);
- pte_t dst_ptep;
+ pte_t _dst_pte, dst_ptep;
_dst_pte = mk_pte(page, dst_vma->vm_page_prot);
_dst_pte = pte_mkdirty(_dst_pte);
@@ -656,7 +656,8 @@ static int mfill_atomic_pte_zeropage(struct mfill_state *state)
struct vm_area_struct *dst_vma = state->vma;
unsigned long dst_addr = state->dst_addr;
pmd_t *dst_pmd = state->pmd;
- pte_t _dst_pte, *dst_pte;
+ hw_pte_t *dst_pte;
+ pte_t _dst_pte;
spinlock_t *ptl;
int ret;
@@ -737,7 +738,8 @@ static int mfill_atomic_pte_poison(struct mfill_state *state)
struct mm_struct *dst_mm = dst_vma->vm_mm;
unsigned long dst_addr = state->dst_addr;
pmd_t *dst_pmd = state->pmd;
- pte_t _dst_pte, *dst_pte;
+ hw_pte_t *dst_pte;
+ pte_t _dst_pte;
spinlock_t *ptl;
int ret;
@@ -784,7 +786,7 @@ static __always_inline ssize_t mfill_atomic_hugetlb(
{
struct mm_struct *dst_mm = dst_vma->vm_mm;
ssize_t err;
- pte_t *dst_pte;
+ hw_pte_t *dst_pte;
unsigned long src_addr, dst_addr;
long copied;
struct folio *folio;
@@ -1261,7 +1263,7 @@ void double_pt_unlock(spinlock_t *ptl1,
__release(ptl2);
}
-static inline bool is_pte_pages_stable(pte_t *dst_pte, pte_t *src_pte,
+static inline bool is_pte_pages_stable(hw_pte_t *dst_pte, hw_pte_t *src_pte,
pte_t orig_dst_pte, pte_t orig_src_pte,
pmd_t *dst_pmd, pmd_t dst_pmdval)
{
@@ -1279,7 +1281,8 @@ static inline bool is_pte_pages_stable(pte_t *dst_pte, pte_t *src_pte,
*/
static struct folio *check_ptes_for_batched_move(struct vm_area_struct *src_vma,
unsigned long src_addr,
- pte_t *src_pte, pte_t *dst_pte)
+ hw_pte_t *src_pte,
+ hw_pte_t *dst_pte)
{
pte_t orig_dst_pte, orig_src_pte;
struct folio *folio;
@@ -1310,7 +1313,7 @@ static long move_present_ptes(struct mm_struct *mm,
struct vm_area_struct *dst_vma,
struct vm_area_struct *src_vma,
unsigned long dst_addr, unsigned long src_addr,
- pte_t *dst_pte, pte_t *src_pte,
+ hw_pte_t *dst_pte, hw_pte_t *src_pte,
pte_t orig_dst_pte, pte_t orig_src_pte,
pmd_t *dst_pmd, pmd_t dst_pmdval,
spinlock_t *dst_ptl, spinlock_t *src_ptl,
@@ -1398,7 +1401,7 @@ static long move_present_ptes(struct mm_struct *mm,
static int move_swap_pte(struct mm_struct *mm, struct vm_area_struct *dst_vma,
unsigned long dst_addr, unsigned long src_addr,
- pte_t *dst_pte, pte_t *src_pte,
+ hw_pte_t *dst_pte, hw_pte_t *src_pte,
pte_t orig_dst_pte, pte_t orig_src_pte,
pmd_t *dst_pmd, pmd_t dst_pmdval,
spinlock_t *dst_ptl, spinlock_t *src_ptl,
@@ -1464,7 +1467,7 @@ static int move_zeropage_pte(struct mm_struct *mm,
struct vm_area_struct *dst_vma,
struct vm_area_struct *src_vma,
unsigned long dst_addr, unsigned long src_addr,
- pte_t *dst_pte, pte_t *src_pte,
+ hw_pte_t *dst_pte, hw_pte_t *src_pte,
pte_t orig_dst_pte, pte_t orig_src_pte,
pmd_t *dst_pmd, pmd_t dst_pmdval,
spinlock_t *dst_ptl, spinlock_t *src_ptl)
@@ -1510,8 +1513,8 @@ static long move_pages_ptes(struct mm_struct *mm, pmd_t *dst_pmd, pmd_t *src_pmd
pte_t orig_src_pte, orig_dst_pte;
pte_t src_folio_pte;
spinlock_t *src_ptl, *dst_ptl;
- pte_t *src_pte = NULL;
- pte_t *dst_pte = NULL;
+ hw_pte_t *src_pte = NULL;
+ hw_pte_t *dst_pte = NULL;
pmd_t dummy_pmdval;
pmd_t dst_pmdval;
struct folio *src_folio = NULL;
@@ -2658,7 +2661,8 @@ static inline bool userfaultfd_huge_must_wait(struct userfaultfd_ctx *ctx,
unsigned long reason)
{
struct vm_area_struct *vma = vmf->vma;
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
assert_fault_locked(vmf);
@@ -2731,7 +2735,7 @@ static inline bool userfaultfd_must_wait(struct userfaultfd_ctx *ctx,
p4d_t *p4d;
pud_t *pud;
pmd_t *pmd, _pmd;
- pte_t *pte;
+ hw_pte_t *pte;
pte_t ptent;
bool ret;
diff --git a/mm/util.c b/mm/util.c
index bf0513d1d3d086..cc253050f68923 100644
--- a/mm/util.c
+++ b/mm/util.c
@@ -1564,7 +1564,7 @@ EXPORT_SYMBOL(mmap_action_complete);
*
* Return: the number of table entries in the batch.
*/
-unsigned int folio_pte_batch(struct folio *folio, pte_t *ptep, pte_t pte,
+unsigned int folio_pte_batch(struct folio *folio, hw_pte_t *ptep, pte_t pte,
unsigned int max_nr)
{
return folio_pte_batch_flags(folio, NULL, ptep, &pte, max_nr, 0);
diff --git a/mm/vmalloc.c b/mm/vmalloc.c
index 26f32949c2f2ea..711bb192af59f1 100644
--- a/mm/vmalloc.c
+++ b/mm/vmalloc.c
@@ -100,7 +100,7 @@ static DEFINE_PER_CPU(struct vfree_deferred, vfree_deferred);
*
* Return: mapping size.
*/
-static __always_inline unsigned long vmap_set_ptes(pte_t *pte,
+static __always_inline unsigned long vmap_set_ptes(hw_pte_t *pte,
unsigned long addr, unsigned long end, u64 pfn,
pgprot_t prot, unsigned int max_page_shift)
{
@@ -124,7 +124,7 @@ static int vmap_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,
phys_addr_t phys_addr, pgprot_t prot,
unsigned int max_page_shift, pgtbl_mod_mask *mask)
{
- pte_t *pte;
+ hw_pte_t *pte;
u64 pfn;
struct page *page;
unsigned long size;
@@ -406,7 +406,7 @@ int ioremap_page_range(unsigned long addr, unsigned long end,
static void vunmap_pte_range(pmd_t *pmd, unsigned long addr, unsigned long end,
pgtbl_mod_mask *mask)
{
- pte_t *pte;
+ hw_pte_t *pte;
pte_t ptent;
unsigned long size = PAGE_SIZE;
@@ -569,7 +569,7 @@ static int vmap_pages_pte_range(pmd_t *pmd, unsigned long addr,
unsigned long pfn, size;
unsigned int steps;
int err = 0;
- pte_t *pte;
+ hw_pte_t *pte;
/*
* nr is a running index into the array which helps higher level
@@ -862,7 +862,8 @@ struct page *vmalloc_to_page(const void *vmalloc_addr)
p4d_t *p4d;
pud_t *pud;
pmd_t *pmd;
- pte_t *ptep, pte;
+ hw_pte_t *ptep;
+ pte_t pte;
/*
* XXX we might need to change this if we add VIRTUAL_BUG_ON for
@@ -3760,7 +3761,7 @@ struct vmap_pfn_data {
unsigned int idx;
};
-static int vmap_pfn_apply(pte_t *pte, unsigned long addr, void *private)
+static int vmap_pfn_apply(hw_pte_t *pte, unsigned long addr, void *private)
{
struct vmap_pfn_data *data = private;
unsigned long pfn = data->pfns[data->idx];
diff --git a/mm/vmscan.c b/mm/vmscan.c
index 17d2b793cbfc49..85b6ab60d830bd 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -3539,7 +3539,7 @@ static bool walk_pte_range(pmd_t *pmd, unsigned long start, unsigned long end,
{
int i;
bool dirty;
- pte_t *pte;
+ hw_pte_t *pte;
spinlock_t *ptl;
unsigned long addr;
int total = 0;
@@ -3572,7 +3572,7 @@ static bool walk_pte_range(pmd_t *pmd, unsigned long start, unsigned long end,
for (i = pte_index(start), addr = start; addr != end; i += nr, addr += nr * PAGE_SIZE) {
unsigned long pfn;
struct folio *folio;
- pte_t *cur_pte = pte + i;
+ hw_pte_t *cur_pte = pte + i;
pte_t ptent = ptep_get(cur_pte);
nr = 1;
@@ -4261,7 +4261,7 @@ bool lru_gen_look_around(struct page_vma_mapped_walk *pvmw, unsigned int nr)
struct lru_gen_mm_walk *walk;
struct folio *last = NULL;
int young = 1;
- pte_t *pte = pvmw->pte;
+ hw_pte_t *pte = pvmw->pte;
unsigned long addr = pvmw->address;
struct vm_area_struct *vma = pvmw->vma;
struct folio *folio = pfn_folio(pvmw->pfn);
|
| 3/2 | 2026/07/28 09:12 | llm | patch-evaluator |
0mModel:gemini-3.1-pro-preview Args: null Results: null Tokens: input: 56366 output: 129 thoughts: 2768 Thoughts: **Refactoring of PTE Type and Access** Alright, let's break this down. It seems we've got a patch here that's systematically changing the type of PTE pointers (`pte_t *`) to a new type, `hw_pte_t *`, across the kernel. The introduction of `hw_pte_t` looks like a preparation step, potentially for architectures that might need a hardware-specific PTE representation in the future. Currently, though, `hw_pte_t` is simply defined as `pte_t`. So, for all practical purposes, this is a wholesale rename. The patch includes `include/linux/pgtable_types.h` and defines `hw_pte_t` to be the same as `pte_t` if `__HAVE_ARCH_HW_PTE_T` isn't defined. The `__pte_from_hw(pte)` macro is also defined to simply return the `pte`. Looking at `include/linux/pgtable.h`, the `ptep_get` function now uses `READ_ONCE` to get the PTE, which is a subtle change. For now it's merely making `ptep_get` use the `__pte_from_hw` macro to make this transparent, and prevent compiler tearing/reloading. Now, I've got to ensure there's no functional impact with this. Let's dig deeper: the changes are widespread, touching a huge number of files. However, a quick check of the diff doesn't reveal any architecture-specific headers defining `__HAVE_ARCH_HW_PTE_T`. That confirms that `hw_pte_t` remains identical to `pte_t` in the current context. Looking at the patch content, I'm seeing changes like this: - `pte_t *` -> `hw_pte_t *` everywhere, like in `pte_offset_kernel` and similar functions - Introducing `ptep_get()` where direct dereferencing (`*ptep`) was used before. With changes like these, this makes the patch mostly a search-and-replace, and mostly an effort to prepare for future hardware PTE representation or prevent compiler tearing/reloading. There is no added functional changes, features, or any new code paths that would require fuzzer input and testing. I think we can say, `WorthFuzzing = False` here. |
| 4/2 | 2026/07/28 09:12 | tool | set-results |
0mArgs:{
"EnableConfigs": [],
"FocusSymbols": [],
"Reasoning": "The patch is a tree-wide refactoring that introduces `hw_pte_t` as a typedef for `pte_t` (by default) and replaces `pte_t *` with `hw_pte_t *` in various page table manipulation functions. It also replaces direct pointer dereferences with `ptep_get()`. There are no functional changes to the execution flow or logic; it is purely a type renaming and cleanup preparation for future architecture-specific changes.",
"WorthFuzzing": false
}Results: {
"EnableConfigs": null,
"FocusSymbols": [],
"Reasoning": "The patch is a tree-wide refactoring that introduces `hw_pte_t` as a typedef for `pte_t` (by default) and replaces `pte_t *` with `hw_pte_t *` in various page table manipulation functions. It also replaces direct pointer dereferences with `ptep_get()`. There are no functional changes to the execution flow or logic; it is purely a type renaming and cleanup preparation for future architecture-specific changes.",
"WorthFuzzing": false
} |
| Total Calls | Total Tokens | Avg Tokens | Total Duration (Seconds) | Avg Duration (Seconds) |
|---|
| Total Calls | Total Duration (Seconds) | Avg Duration (Seconds) |
|---|