Fenghua Yu
5fb7dc37dc
define new percpu interface for shared data
...
per cpu data section contains two types of data. One set which is
exclusively accessed by the local cpu and the other set which is per cpu,
but also shared by remote cpus. In the current kernel, these two sets are
not clearely separated out. This can potentially cause the same data
cacheline shared between the two sets of data, which will result in
unnecessary bouncing of the cacheline between cpus.
One way to fix the problem is to cacheline align the remotely accessed per
cpu data, both at the beginning and at the end. Because of the padding at
both ends, this will likely cause some memory wastage and also the
interface to achieve this is not clean.
This patch:
Moves the remotely accessed per cpu data (which is currently marked
as ____cacheline_aligned_in_smp) into a different section, where all the data
elements are cacheline aligned. And as such, this differentiates the local
only data and remotely accessed data cleanly.
Signed-off-by: Fenghua Yu <fenghua.yu@intel.com>
Acked-by: Suresh Siddha <suresh.b.siddha@intel.com>
Cc: Rusty Russell <rusty@rustcorp.com.au>
Cc: Christoph Lameter <clameter@sgi.com>
Cc: <linux-arch@vger.kernel.org>
Cc: "Luck, Tony" <tony.luck@intel.com>
Cc: Andi Kleen <ak@suse.de>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
2007-07-19 10:04:44 -07:00
..
8250-platform.c
[MIPS] Put an end to <asm/serial.h>'s long and annyoing existence
2007-07-10 17:33:01 +01:00
asm-offsets.c
rename thread_info to stack
2007-05-09 12:30:56 -07:00
binfmt_elfn32.c
[PATCH] elf: Always define elf_addr_t in linux/elf.h
2006-12-07 08:39:38 -08:00
binfmt_elfo32.c
[PATCH] elf: Always define elf_addr_t in linux/elf.h
2006-12-07 08:39:38 -08:00
branch.c
[MIPS] Add some __user tags
2007-07-13 17:40:01 +01:00
cpu-bugs64.c
Remove obsolete #include <linux/config.h>
2006-06-30 19:25:36 +02:00
cpu-probe.c
[MIPS] PMC MSP71xx mips common
2007-07-10 17:33:03 +01:00
early_printk.c
[MIPS] early_printk: allow the early console to run earlier
2007-05-11 14:28:30 +01:00
entry.S
[MIPS] SMTC: Interrupt mask backstop hack
2007-07-12 17:41:17 +01:00
gdb-low.S
[MIPS] TRACE_IRQFLAGS_SUPPORT support.
2006-07-13 21:26:09 +01:00
gdb-stub.c
[MIPS] Whitespace cleanups.
2007-02-06 16:53:19 +00:00
genex.S
[MIPS] SMTC: Interrupt mask backstop hack
2007-07-12 17:41:17 +01:00
head.S
[MIPS] PMC MSP71xx mips common
2007-07-10 17:33:03 +01:00
i8259.c
[MIPS] Register PCI host bridge resource earlier
2007-04-27 16:20:25 +01:00
init_task.c
[PATCH] nsproxy: move init_nsproxy into kernel/nsproxy.c
2006-10-02 07:57:20 -07:00
irix5sys.S
Linux-2.6.12-rc2
2005-04-16 15:20:36 -07:00
irixelf.c
header cleaning: don't include smp_lock.h when not used
2007-05-08 11:15:07 -07:00
irixinv.c
Sparseify MIPS.
2005-10-29 19:30:50 +01:00
irixioctl.c
header cleaning: don't include smp_lock.h when not used
2007-05-08 11:15:07 -07:00
irixsig.c
header cleaning: don't include smp_lock.h when not used
2007-05-08 11:15:07 -07:00
irq-msc01.c
[MIPS] MT: Reenable EIC support and add support for SOCit SC.
2007-05-11 14:28:31 +01:00
irq-rm7000.c
[MIPS] use name instead of typename for each irq_chip
2007-02-06 16:53:14 +00:00
irq-rm9000.c
[MIPS] use name instead of typename for each irq_chip
2007-02-06 16:53:14 +00:00
irq.c
[MIPS] Drop __devinit tag from allocate_irqno() and free_irqno()
2007-05-11 14:28:31 +01:00
irq_cpu.c
[MIPS] use name instead of typename for each irq_chip
2007-02-06 16:53:14 +00:00
kspd.c
[MIPS] Fix AP/SP to work in the reality of modern kernels.
2007-04-27 16:20:23 +01:00
linux32.c
[MIPS] Fix some system calls with long long arguments
2007-06-06 19:34:32 +01:00
machine_kexec.c
Storage class should be before const qualifier
2007-02-17 20:11:19 +01:00
Makefile
[MIPS] Rename PC speaker code
2007-07-12 17:41:23 +01:00
mips-mt-fpaff.c
[MIPS] Move FPU affinity code into separate file.
2007-07-10 17:33:04 +01:00
mips-mt.c
[MIPS] Move FPU affinity code into separate file.
2007-07-10 17:33:04 +01:00
mips_ksyms.c
[MIPS] Export __copy_user_inatomic.
2007-03-07 00:07:17 +00:00
module.c
[MIPS] Load modules to CKSEG0 if CONFIG_BUILD_ELF64=n
2006-11-30 01:14:44 +00:00
pcspeaker.c
[MIPS] Rename PC speaker code
2007-07-12 17:41:23 +01:00
proc.c
[MIPS] define Hit_Invalidate_I to Index_Invalidate_I for loongson2
2007-07-10 17:33:02 +01:00
process.c
[MIPS] Transform old-style macros to newer "__noreturn"
2007-07-10 17:32:56 +01:00
ptrace.c
PTRACE_POKEDATA consolidation
2007-07-17 10:23:03 -07:00
ptrace32.c
[MIPS] Make sure cpu_has_fpu is used only in atomic context
2006-10-09 23:20:48 +01:00
r4k_fpu.S
[MIPS] Check FCSR for pending interrupts, alternative version
2007-03-17 01:03:25 +00:00
r4k_switch.S
[MIPS] Fix resume for 64K page size on R4000 class processors.
2007-07-12 17:41:05 +01:00
r2300_fpu.S
kbuild: mips use generic asm-offsets.h support
2005-09-09 22:32:31 +02:00
r2300_switch.S
[MIPS] Disallow CpU exception in kernel again.
2007-04-20 14:58:37 +01:00
r6000_fpu.S
kbuild: mips use generic asm-offsets.h support
2005-09-09 22:32:31 +02:00
relocate_kernel.S
[MIPS] Add support for kexec
2006-11-30 01:14:44 +00:00
reset.c
[MIPS] Export pm_power_off
2006-12-10 21:52:11 +00:00
rtlx.c
[MIPS] Fix AP/SP to work in the reality of modern kernels.
2007-04-27 16:20:23 +01:00
scall32-o32.S
[MIPS] Wire up utimensat, signalfd, timerfd, eventfd
2007-06-11 18:20:53 +01:00
scall64-64.S
[MIPS] Wire up utimensat, signalfd, timerfd, eventfd
2007-06-11 18:20:53 +01:00
scall64-n32.S
[MIPS] Wire up utimensat, signalfd, timerfd, eventfd
2007-06-11 18:20:53 +01:00
scall64-o32.S
[MIPS] Wire up utimensat, signalfd, timerfd, eventfd
2007-06-11 18:20:53 +01:00
semaphore.c
Always use ".set mips3" rather than select between "mips2" or "mips3"
2005-10-29 19:31:31 +01:00
setup.c
[MIPS] Add some debugfs files to debug unaligned accesses
2007-07-10 17:33:04 +01:00
signal-common.h
[MIPS] Retry {save,restore}_fp_context if failed in atomic context.
2007-04-20 14:58:37 +01:00
signal.c
header cleaning: don't include smp_lock.h when not used
2007-05-08 11:15:07 -07:00
signal32.c
[MIPS] use compat_siginfo in rt_sigframe_n32
2007-06-26 19:57:33 +02:00
signal_n32.c
[MIPS] use compat_siginfo in rt_sigframe_n32
2007-06-26 19:57:33 +02:00
smp-mt.c
[MIPS] VSMP: Fix initialization ordering bug.
2007-07-04 15:53:16 +01:00
smp.c
[MIPS] Transform old-style macros to newer "__noreturn"
2007-07-10 17:32:56 +01:00
smtc-asm.S
[MIPS] SMTC: Don't set and restore irqregs ptr from self_ipi.
2007-06-11 18:20:53 +01:00
smtc-proc.c
[MIPS] MT: Improved multithreading support.
2006-04-19 04:14:28 +02:00
smtc.c
[MIPS] SMTC: Use current_cpu_data instead of cpu_data[smp_processor_id]
2007-07-10 17:32:56 +01:00
stacktrace.c
simplify the stacktrace code
2007-05-08 11:14:58 -07:00
syscall.c
[MIPS] Enable support for the userlocal hardware register
2007-07-10 17:33:02 +01:00
sysirix.c
[MIPS] Whitespace cleanups.
2007-02-06 16:53:19 +00:00
time.c
[MIPS] Don't drag a platform specific header into generic arch code.
2007-06-20 22:27:10 +01:00
topology.c
[MIPS] Do topology_init even on uniprocessor kernels.
2006-11-29 16:21:34 +00:00
traps.c
Report that kernel is tainted if there was an OOPS
2007-07-17 10:23:02 -07:00
unaligned.c
[MIPS] Add some debugfs files to debug unaligned accesses
2007-07-10 17:33:04 +01:00
vmlinux.lds.S
define new percpu interface for shared data
2007-07-19 10:04:44 -07:00
vpe.c
[MIPS] AP/SP: Avoid triggering the 34K E125 performance issue
2007-07-06 16:17:10 +01:00