Jann Horn
588be4a04b
mm/khugepaged: fix GUP-fast interaction by sending IPI ...
commit 2ba99c5e08812494bc57f319fb562f527d9bacd8 upstream.
Since commit 70cbc3cc78a99 ("mm: gup: fix the fast GUP race against THP
collapse"), the lockless_pages_from_mm() fastpath rechecks the pmd_t to
ensure that the page table was not removed by khugepaged in between.
However, lockless_pages_from_mm() still requires that the page table is
not concurrently freed. Fix it by sending IPIs (if the architecture uses
semi-RCU-style page table freeing) before freeing/reusing page tables.
Link: https://lkml.kernel.org/r/20221129154730.2274278-2-jannh@google.com
Link: https://lkml.kernel.org/r/20221128180252.1684965-2-jannh@google.com
Link: https://lkml.kernel.org/r/20221125213714.4115729-2-jannh@google.com
Fixes: ba76149f47
2023-01-07 12:07:10 +01:00
bitops: Do not default to __clear_bit() for __clear_bit_unlock()
2016-03-21 10:50:48 +01:00
mm, asm-generic: define PUD_SHIFT in <asm-generic/4level-fixup.h>
2015-02-11 17:06:03 -08:00
asm-generic: Add common asm-offsets.h
2015-06-23 13:35:49 +09:00
asm-prototypes: Clear any CPP defines before declaring the functions
2017-01-12 11:39:07 +01:00
locking/atomic: Introduce inc/dec variants for the atomic_fetch_$op() API
2016-07-07 09:16:20 +02:00
locking/atomic: Remove linux/atomic.h:atomic_fetch_or()
2016-06-16 10:48:32 +02:00
locking/atomic: Implement atomic{,64,_long}_fetch_{add,sub,and,andnot,or,xor}{,_relaxed,_acquire,_release}()
2016-06-16 10:48:32 +02:00
audit: Modify a set of system calls in audit class definitions
2014-01-17 17:01:46 -05:00
audit: Modify a set of system calls in audit class definitions
2014-01-17 17:01:46 -05:00
locking/spinlock, arch: Update and fix spin_unlock_wait() implementations
2016-06-14 11:55:15 +02:00
arch: Prepare for smp_mb__{before,after}_atomic()
2014-04-18 11:40:30 +02:00
bug.h: work around GCC PR82365 in BUG()
2019-07-10 09:55:44 +02:00
ipv4: Update parameters for csum_tcpudp_magic to their original types
2016-03-13 23:55:13 -04:00
asm-generic: COMMON_CLK defines __clk_{get,put}
2014-09-25 18:00:45 -07:00
LLVMLinux: Remove warning about returning an uninitialized variable
2014-04-09 13:44:35 -07:00
asm-generic: cmpxchg: avoid warnings from macro-ized cmpxchg() implementations
2015-10-15 00:21:13 +02:00
sched, time: Fix build error with 64 bit cputime_t on 32 bit systems
2014-10-03 05:46:55 +02:00
sched/cputime: Count actually elapsed irq & softirq time
2016-07-14 10:42:34 +02:00
__div64_32(): make it overridable at compile time
2015-11-16 14:42:12 -05:00
asm-generic: Add dma-contiguous.h
2014-09-22 13:35:51 +02:00
Merge branch 'akpm' (patches from Andrew)
2015-09-08 17:52:23 -07:00
Revert "default exported asm symbols to zero"
2016-12-07 08:39:00 -08:00
asm-generic: Fix local variable shadow in __set_fixmap_offset
2016-02-16 15:10:44 +00:00
futex: Remove duplicated code and fix undefined behaviour
2018-05-19 10:27:00 +02:00
asm-generic: fix -Wtype-limits compiler warnings
2019-08-25 10:51:50 +02:00
gpio: allow setting ARCH_NR_GPIOS from Kconfig
2016-02-19 00:22:54 +01:00
mm: Fix generic hugetlb pte check return type.
2013-10-02 20:02:35 -04:00
asm-generic/io.h: add io{read,write}64 accessors
2016-05-31 16:41:50 +08:00
include/asm-generic/ioctl.h: fix _IOC_TYPECHECK sparse error
2014-06-06 16:08:13 -07:00
asm-generic/io.h: add io{read,write}64 accessors
2016-05-31 16:41:50 +08:00
irq_work: Introduce arch_irq_work_has_interrupt()
2014-09-13 18:38:07 +02:00
locking/mcs: Allow architecture specific asm files to be used for contended case
2014-02-09 21:18:52 +01:00
mm: add PHYS_PFN, use it in __phys_to_pfn()
2016-01-14 16:00:49 -08:00
mm: clean up per architecture MM hook header files
2015-07-17 16:39:53 -07:00
mm/core, x86/mm/pkeys: Differentiate instruction fetches
2016-02-18 19:46:29 +01:00
asm-generic: Remove asm-generic arch_bprm_mm_init()
2014-11-22 21:52:08 +01:00
asm-generic: Add msi.h
2014-11-23 13:01:47 +01:00
locking/mutex: Optimize mutex_trylock() fast-path
2016-06-08 15:17:01 +02:00
locking/mutex: Optimize mutex_trylock() fast-path
2016-06-08 15:17:01 +02:00
asm-generic: page.h: Remove useless get_user_page and free_user_page
2016-02-26 15:24:55 +01:00
PCI: Remove unused pcibios_select_root() (again)
2015-06-08 07:56:21 -05:00
PCI: Add pci_iomap_wc() variants
2015-08-25 09:59:45 +02:00
percpu: make this_cpu_generic_read() atomic w.r.t. interrupts
2017-10-12 11:51:23 +02:00
arch: pgtable: define MAX_POSSIBLE_PHYSMEM_BITS where needed
2021-11-12 13:18:01 +01:00
sched/preempt: Fix preempt_count manipulations
2016-05-17 12:24:21 +02:00
locking/qrwlock: Fix write unlock bug on big endian systems
2016-08-10 14:13:27 +02:00
locking/qrwlock: Rename ->lock to ->wait_lock
2015-09-18 09:27:29 +02:00
locking/qspinlock: Use atomic_sub_return_release() in queued_spin_unlock()
2016-06-08 15:17:01 +02:00
locking/qspinlock: Pull in asm/byteorder.h to ensure correct endianness
2019-01-26 09:38:36 +01:00
asm-generic: remove _STK_LIM_MAX
2014-05-15 00:32:09 +01:00
locking/rwsem: Remove rwsem_atomic_add() and rwsem_atomic_update()
2016-06-08 15:16:59 +02:00
seccomp: Get compat syscalls from asm-generic header
2016-05-13 14:02:00 +02:00
asm-generic: sections: refactor memory_intersects
2022-09-05 10:23:56 +02:00
SIGNAL: Move generic copy_siginfo() to signal.h
2016-05-13 14:02:10 +02:00
crypto: create generic version of ablk_helper
2013-09-24 06:02:24 +10:00
syscall.h: fix doc text for syscall_get_arch()
2014-09-23 16:20:00 -04:00
mm/khugepaged: fix GUP-fast interaction by sending IPI
2023-01-07 12:07:10 +01:00
include/asm-generic/topology.h: guard cpumask_of_node() macro argument
2020-06-03 08:16:42 +02:00
exceptions: detritus removal
2016-09-27 21:15:14 -04:00
asm-generic: allow generic unaligned access if the arch supports it
2014-05-08 10:22:23 +02:00
vmlinux.lds.h: Handle clang's module.{c,d}tor sections
2021-08-26 08:37:24 -04:00
include/asm-generic/vtime.h: avoid zero-length file
2013-09-30 14:31:02 -07:00
Make asm/word-at-a-time.h available on all architectures
2015-07-08 16:41:55 -04:00
588be4a04b