RHEL6

Red Hat K.K. Solution Architect Satoshi Naito<snaito@redhat.com>

Red Hat K.K. Solution Architect Kazuo Moriwaka<kmoriwaka@redhat.com>
V1.0 2010.11.17

Red Hat K.K. All rights reserved.

Red Hat K.K. All rights reserved.

x86_64

RHEL5 RHEL6

Red Hat K.K. All rights reserved.

Red Hat Enterprise Linux

RHEL

Red Hat K.K. All rights reserved.

RHEL4

RHEL5

RHEL6

Kernel

2.6.9

2.6.18

2.6.32

GCC

3.4

4.1

4.4

arch

x86, x86_64
x86, x86_64
Ia64
Ia64
power,system Z power,system Z

Red Hat K.K. All rights reserved.

x86, x86_64
power,system Z

CPU

RHEL4

RHEL5

RHEL6

X86

32

32

32

x86_64

64 / 64

64 / 255

128 / 4096

power

64 / 128

128

128

System Z

64

64

80

xx / xx /

Red Hat K.K. All rights reserved.

RHEL4

RHEL5

RHEL6

X86

64GB

16GB

16GB

x86_64

256GB / 1TB

256GB / 1TB

2TB / 64TB

power

128GB / 1TB

512GB / 1TB

2TB

System Z

1.5TB

1.5TB

3TB

xx / xx /

Red Hat K.K. All rights reserved.

Ext3
Filesize max
Ext3
Filesystem max
Ext4
Filesize max
Ext4
Filesystem max
XFS
Filesize max
XFS
Filesystem max

RHEL4

RHEL5

RHEL6

2TB

2TB

2TB

8TB

16TB

16TB

16TB

16TB

100TB

100TB

Red Hat K.K. All rights reserved.

RHEL4

RHEL5

RHEL6

X86

256MB

512MB*

512MB*

x86_64

256MB

512MB*

1GB*

power

512MB

1GB

2GB

DISK space

800MB

1GB

1GB

* CPU 1GB

Red Hat K.K. All rights reserved.

SGI Altix UV1000

CPU
Intel Xeon 7500series
256 2048core

16TB

RHEL6 Certified

Red Hat K.K. All rights reserved.

10

kernel

Red Hat K.K. All rights reserved.

11

RHEL6

CPU
CFS Completely Fair Scheduler
NUMA
tickless kernel
ticket spin-lock

transparent hugepage

Multi-queue

ext4 xfs
Red Hat K.K. All rights reserved.

12

Kernel

kernel

2.6.18 2.6.32
2.6.33 2.6.34

diff
7,810,000 3,040,000
2.6.32 12,560,000

Red Hat K.K. All rights reserved.

13

CFS Completely Fair Scheduler

CFS basically models an "ideal, precise

multi-tasking CPU" on real hardware.
Ingo Molnar

Red Hat K.K. All rights reserved.

14

RHEL5 = O(1)

O(1)

nice

Red Hat K.K. All rights reserved.

15

O(1)

kernel nice

CPU
CFS Completely Fair Scheduler

Red Hat K.K. All rights reserved.

16

CFS

FIFO/RR
O(1)

red-black-tree
O(log n)

Red Hat K.K. All rights reserved.

17

Transparent Hugepage

you should apply and run the transparent

hugepage support on your systems.
Andrea Arcangeli

Red Hat K.K. All rights reserved.

18

Hugepage

page Linux

1page = 4KB 4096byte

Hugepage page

1page = 4MB or 1GB x86_64

Red Hat K.K. All rights reserved.

19

TLB )

CPU

Red Hat K.K. All rights reserved.

20

x86_64

1page
4KB
4
2MB
3
1GB
2
page TLB

Red Hat K.K. All rights reserved.

21

100GB

1page = 4KB 2621 4400page

page

1page = 2MB 1/512

Red Hat K.K. All rights reserved.

22

hugepage

TLB
page TLB
TLB
TLB

1/512

Red Hat K.K. All rights reserved.

23

hugepage

Hugetlbfs

hugetlbfs

Red Hat K.K. All rights reserved.

24

Transparent Hugepage

hugepage

Hugetlbfs
kernel
1page = 2MB

hugepage

Red Hat K.K. All rights reserved.

25

Transparent Hugepage
[root@r815-1 ~]# cat
/sys/kernel/mm/redhat_transparent_hugepage/enabled
[always] madvise never

4GB 100
[root@r815 ~]# cat /proc/meminfo
AnonHugePages:
Hugepagesize:

41,451,520 kB
2048 kB

Red Hat K.K. All rights reserved.

26

Multi-queue

Single queue model no longer works.

David S. Miller

Red Hat K.K. All rights reserved.

27

Single queue model no longer works

CPU

CPU

10GbEthernet

Red Hat K.K. All rights reserved.

28

Single-queue

CPU

lock
CPU

driver

NIC

CPU

Red Hat K.K. All rights reserved.

29

Multi-queue

CPU

lock
CPU

lock

driver

NIC

lock

CPU

Red Hat K.K. All rights reserved.

30

RHEL5 RHEL6

Red Hat K.K. All rights reserved.

31

DELL PowerEdge R815

AMD Opteron 6174(2.2GHz/12MB L3 ) x 4

256GB (32x8GB/2R/1333MHz/DDR3 RDIMM)

146GB 15000RPM(6Gbps SAS HDD/2.5 ) x 6

Broadcom NetXteme II 57711 10GbE NIC, Dual Port,

SFP+, PCIe-8 x2
RAID 0(H700 NVDIMM 512MB)

Red Hat K.K. All rights reserved.

32


/proc/cpuinfo
processor

: <logical cpu >

physical id

: <socket >

siblings

: <logical cpus per socket>

core id

: <core in socket>

cpu cores

: <physical cores per socket>

[root@r815-1 ~]# grep processor /proc/cpuinfo | wc -l

48

Red Hat K.K. All rights reserved.

33

10GbE-NIC

Red Hat K.K. All rights reserved.

34

= thread 1 5 50 100
50
10

CPU
Red Hat K.K. All rights reserved.

35


10

9.38 Gbps

Gbps

7.91 Gbps

8
7
6

RHEL5
RHEL6

5
4
3
2
1
0

50

Red Hat K.K. All rights reserved.

100

36

50 (100
10
9

Gbps
8
7
RHEL5
RHEL6

6
5
4
3
Red Hat K.K. All rights reserved.

37

CPU
100 50
CPU

40
35
30
25

system time
user time

20
15
10
5
0

RHEL5

RHEL6

Red Hat K.K. All rights reserved.

38

system time 100

100

CPU 90

80
70
60

RHEL5
RHEL6

50
40
30
20
10
0
Red Hat K.K. All rights reserved.

39

10GbE

Red Hat K.K. All rights reserved.

40


virtio
5
4.5

Gbps

4
3.5
3

RHEL5
RHEL6

2.5
2
1.5
1
0.5
0
1VCPU

4VCPU
Red Hat K.K. All rights reserved.

8VCPU

41


vhost-net 4vcpu
9

7.7 Gbps

Gbps

7
6

4.45 Gbps

5
4
3
2

1.52 Gbps

1
0

RHEL5 virtio

RHEL6 virtio

Red Hat K.K. All rights reserved.

RHEL6 vhost

42

 RHEL6

Red Hat K.K. All rights reserved.

43

Tickless kernel

tick =
OS jiffies

RHEL5 1000Hz
1 1000 tick
1000

divider
tickless = tick

Red Hat K.K. All rights reserved.

44

RHEL5 RHEL6

RHEL6

Red Hat K.K. All rights reserved.

45

virt-top

top

CSV

Red Hat K.K. All rights reserved.

46

 RHEL5 100 on RHEL6

vs
RHEL6 100 on RHEL6

Red Hat K.K. All rights reserved.

47

 CPU

100
90
80
70
60
50
40
30
20
10
0

RHEL5
Red Hat K.K. All rights reserved.

RHEL6
48

Tickless kernel

RHEL5 100 on RHEL6

CPU 25.22
Load average 23

RHEL6 100 on RHEL6

CPU 0.51
Load average 0.3

99.49%

Red Hat K.K. All rights reserved.

49

WE CAN DO MORE
WHEN WE WORK TOGETHER
THE OPEN SOURCE WAY

Red Hat K.K. All rights reserved.

50

WE CAN DO MORE
WHEN WE WORK TOGETHER
THE OPEN SOURCE WAY

Red Hat K.K. All rights reserved.

51

WE CAN DO MORE
WHEN WE WORK TOGETHER
THE OPEN SOURCE WAY

Red Hat K.K. All rights reserved.

52