Scribd Logo
Fazer o upload

Bem-vindo(a) ao Scribd!

  • LinuxCon 2013: Practical Experiences with 'Tickless' Kernels

    Enviado por

    mim16
    46 visualizações15 páginas
    This document discusses the "tickless kernel" approach in Linux where the kernel does not rely on a periodic timer interrupt to perform tasks. It describes how Linux uses timer interrupts for various operations like time keeping and scheduling. Going tickless reduces CPU overhead and provides more deterministic performance. The document outlines how to configure a kernel to designate some CPUs as "sacrificial" to handle OS tasks while making others tickless. It shares results showing a 4 order of magnitude reduction in kernel latency and variability with a tickless 3.11 kernel compared to a default Red Hat 6.3 system. Remaining challenges are discussed along with a vision for asymmetric multiprocessing of dedicated cores.

    Descrição original:

    Linux Tickless Kernel

    Título original

    LinuxCon - TicklessKernel_revc

    Direitos autorais

    © © All Rights Reserved

    Formatos disponíveis

    PDF, TXT ou leia online no Scribd

    Você considera este documento útil?

    Este conteúdo é inapropriado?

    Denunciar este documento
    This document discusses the "tickless kernel" approach in Linux where the kernel does not rely on a periodic timer interrupt to perform tasks. It describes how Linux uses timer interrupts for various operations like time keeping and scheduling. Going tickless reduces CPU overhead and provides more deterministic performance. The document outlines how to configure a kernel to designate some CPUs as "sacrificial" to handle OS tasks while making others tickless. It shares results showing a 4 order of magnitude reduction in kernel latency and variability with a tickless 3.11 kernel compared to a default Red Hat 6.3 system. Remaining challenges are discussed along with a vision for asymmetric multiprocessing of dedicated cores.

    Direitos autorais:

    © All Rights Reserved
    Baixe no formato PDF, TXT ou leia online no Scribd
    Sinalizar o conteúdo como inadequado
    46 visualizações15 páginas

    LinuxCon 2013: Practical Experiences with 'Tickless' Kernels

    Enviado por

    mim16
    This document discusses the "tickless kernel" approach in Linux where the kernel does not rely on a periodic timer interrupt to perform tasks. It describes how Linux uses timer interrupts for various operations like time keeping and scheduling. Going tickless reduces CPU overhead and provides more deterministic performance. The document outlines how to configure a kernel to designate some CPUs as "sacrificial" to handle OS tasks while making others tickless. It shares results showing a 4 order of magnitude reduction in kernel latency and variability with a tickless 3.11 kernel compared to a default Red Hat 6.3 system. Remaining challenges are discussed along with a vision for asymmetric multiprocessing of dedicated cores.

    Direitos autorais:

    © All Rights Reserved
    Baixe no formato PDF, TXT ou leia online no Scribd
    Sinalizar o conteúdo como inadequado
    de 15

    TICKLESS KERNEL

    PRACTICAL EXPERIENCES
    LinuxCon 2013 New Orleans

    Fernando Garcia Christoph Lameter

    f@gentwo.org cl@linux.com

    Why is Linux ticking.

    Time keeping Scheduling OS maintenance Counter scaling Deferred free (lockless operations) Process statistics getrusage() Deferred processing

    Not tick related:


    User space daemons OS thread spawning IPIs Writeback / Filesystems Compaction/NUMA migration.

    Why it should not do that.


    Performance: Cache footprint increases. Cpu holdoffs. Applications experience seemingly random delays. Useless if only one app or none is running and the scheduler has nothing to do. Deterministic response (allows accurate Rendezvous for HPC application threads). Bare Metal performance (HPC and HFT requirements)

    How to configure a tickless kernel

    Dedicate Sacrificial or OS processors

    Minimum one per NUMA node. Considering processor cache affinity and I/O affinities.

    Tickless processors

    Configuring RCU NOHZ configuration Dealing with write back threads Other OS measures

    OS Noise in a Linux distribution

    Redhat distro as a reference point. Noise on an idle system Noise through file system operations Noise through operating system services on other processors Processor cache contention Hyperthreading: Processor units contention.

    Tools

    Latencytest (or other tools)


    Established base numbers for OS noise. Allows debugging of setup. You should see significantly reduced numbers once the config is right.

    turbostat

    Debug power state moves and frequency scaling

    perf

    Investigate reasons for OS activities that cause holdoffs.

    Holdoff on standard RHEL 6.3


    Defaults to 1000 HZ so > 1000 holdoffs per second. High number of short events (likely tick not doing anything. Events > 5usec likely related to context switches.

    RHEL 6.3 vs Linux 3.11 tickless


    o Reduction of events by 4 orders of magnitude o Kernel 3.11 has lower latency in general o Frequency of high latency events is also reduced. o There are still numerous enhancements pending.

    Tickless numbers
    o Nicer view of the tickless run

    Total Variances per second


    10000.00

    1000.00

    1000.62

    100.00

    10.00

    3.13
    1.00 Kernel

    RHEL 3.11

    Default RHEL

    Other issues

    Tests on an otherwise idle system. There will be more if OS services are in use. OS Spawning of threads
    Kthreadd Worker

    threads I/O related threads Usermodehelper (kmod, devices)

    IPIs
    Scheduling
    Flushing

    Easy configuration

    Bootup System auto configures sacrifical processor All processing moved off other processors Active system Only intervene on processors if required. Logging of the reasons why

    Work to be done

    Only run vmthreads if necessary

    Patch by Christoph exists Setup is weird right now.

    Autoconfig of system

    Move other stuff to OS cpus.

    Requires scripting right now.

    Stop kernel from spawning on tickless cpus.

    Patch by Christoph exists

    Grand Future Vision

    Assymmetric SMP Cores dedicated to tasks Configuration of cores for particular tasks.

    Conclusion

    Questions? Answers? Opinons?

    Você também pode gostar