Reimaging Compute & Cell nodes / Exadata V2

1/7

Exadata V2: Steps to create Compute & Cell

images.
This document contains the steps to create the Images (in 2GB usb Flash
Drives) for the compute & cell boxes.

1) Got the ImageMaker (cell & db) from:

http://exadatadev.us.oracle.com/Exadata/ACS/11.2.1.2.0/

=)> cellImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip 02-Nov-2009

13:05 1.0G
=)> computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip 02-Nov-
2009 13:05 821M

2) Transferred them to any available compute node (e.g. dmorldb01):

=================================
[root@dmorldb01 images]# ls -l
total 1937520
-rw-r--r-- 1 root root 1121707293 Feb 23 11:10
cellImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip
-rw-r--r-- 1 root root 860357998 Feb 23 11:11
computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip
=================================

3) Then unzipped them:

=================================
[root@dmorldb01 images]# unzip cellImageMaker_11.2.1.2.0_LINUX.X64_091102-
1.x86_64.tar.zip
Archive: cellImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip
inflating: cellImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar
=================================
[root@dmorldb01 images]# unzip
computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip
Archive: computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar.zip
inflating: computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar
=================================

-rw-rw-r-- 1 root root 1193758720 Nov 2 06:01

cellImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar
-rw-rw-r-- 1 root root 932157440 Nov 2 06:05
computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar
=================================

4) They need to be untar as follow:

=================================

Author: Esteban Bernal (Exadata Storage Team)

February -2010
 Reimaging Compute & Cell nodes / Exadata V2
2/7

[root@dmorldb01 images]# tar -pxvf cellImageMaker_11.2.1.2.0_LINUX.X64_091102-

1.x86_64.tar
=================================
[root@dmorldb01 images]# tar -pxvf
computeImageMaker_11.2.1.2.0_LINUX.X64_091102-1.x86_64.tar
=================================

5) Two directories were created:

=================================
[root@dmorldb01 images]# ls -l

drwxrwxr-x 7 root root 4096 Nov 2 06:01 dl180

drwxrwxr-x 7 root root 4096 Nov 2 06:04 dl360
=================================

=)> Cell node image extracts to dl180 (X4275)

=)> DB node image extracts to dl360 (X4170)

6) Insert the first usb Flash Drive (2GB) into the usb slot associated with the compute
node (e.g. dmorldb01) and then verify that usb flash drive is automatically detected (tail -
f /var/log/messages):
=================================
Feb 23 11:31:38 dmorldb01 kernel: usb 8-3.1: new high speed USB device using
ehci_hcd and address 4
Feb 23 11:31:38 dmorldb01 kernel: usb 8-3.1: configuration #1 chosen from 1 choice
Feb 23 11:31:38 dmorldb01 kernel: scsi7 : SCSI emulation for USB Mass Storage
devices
Feb 23 11:31:43 dmorldb01 kernel: Vendor: HP Model: v125w Rev: PMAP
Feb 23 11:31:43 dmorldb01 kernel: Type: Direct-Access ANSI SCSI
revision: 00
Feb 23 11:31:45 dmorldb01 kernel: SCSI device sdb: 3966976 512-byte hdwr sectors
(2031 MB)
Feb 23 11:31:45 dmorldb01 kernel: sdb: Write Protect is off
Feb 23 11:31:45 dmorldb01 kernel: sdb: assuming drive cache: write through
Feb 23 11:31:45 dmorldb01 kernel: SCSI device sdb: 3966976 512-byte hdwr sectors
(2031 MB)
Feb 23 11:31:45 dmorldb01 kernel: sdb: Write Protect is off
Feb 23 11:31:45 dmorldb01 kernel: sdb: assuming drive cache: write through
Feb 23 11:31:45 dmorldb01 kernel: sdb: sdb1
Feb 23 11:31:45 dmorldb01 kernel: sd 7:0:0:0: Attached scsi removable disk sdb
Feb 23 11:31:45 dmorldb01 kernel: sd 7:0:0:0: Attached scsi generic sg1 type 0
=================================

7) Change to the dl180 cell directory & execute the makeImageMedia.sh script to create
the cell.iso into the USB drive:
=================================
[root@dmorldb01 dl180]# ls
boot doc grub initrd makeImageMedia.sh patches README_FOR_FACTORY.txt

[root@dmorldb01 dl180]# pwd

Author: Esteban Bernal (Exadata Storage Team)

February -2010
 Reimaging Compute & Cell nodes / Exadata V2
3/7

/u01/images/dl180

[root@dmorldb01 dl180]# ./makeImageMedia.sh

Please wait. Calculating md5 checksums for cellbits ...
Please wait. Making initrd ...
180102 blocks
Please wait. Calculating md5 checksums for boot ...

Choose listed USB devices to set up the Oracle CELL installer

sdb Approximate capacity 1983 MB

Enter the comma separated (no spaces) list of devices or word 'ALL' for to select all:
ALL
sdb will be used as the Oracle CELL installer

All data on sdb will be erased. Proceed [y/n]? y

The number of cylinders for this disk is set to 7748.

There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)

Command (m for help): Building a new DOS disklabel. Changes will remain in memory
only,
until you decide to write them. After that, of course, the previous
content won't be recoverable.

The number of cylinders for this disk is set to 7748.

There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

Command (m for help): Command action

e extended
p primary partition (1-4)
Partition number (1-4): First cylinder (1-7748, default 1): Last cylinder or +size or +sizeM
or +sizeK (1-7748, default 7748):
Command (m for help): The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.
umount2: Invalid argument
umount: /dev/sdb1: not mounted
mke2fs 1.39 (29-May-2006)

Author: Esteban Bernal (Exadata Storage Team)

February -2010
 Reimaging Compute & Cell nodes / Exadata V2
4/7

Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
248320 inodes, 495804 blocks
24790 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=511705088
16 block groups
32768 blocks per group, 32768 fragments per group
15520 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912

Writing inode tables: done

Creating journal (8192 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 26 mounts or

180 days, whichever comes first. Use tune2fs -c or -i to override.
Copying files... will take several minutes

GNU GRUB version 0.97 (640K lower / 3072K upper memory)

[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... 15 sectors are embedded.
succeeded
Running "install /grub/stage1 (hd0) (hd0)1+15 p (hd0,0)/grub/stage2 /grub/grub.conf"...
succeeded
Done.
grub> Done creation of installation USB for DL180
=================================

8) Insert the second usb Flash Drive (2GB) into the usb slot associated with the
compute node (dmorldb01) and then verify that usb flash drive is automatically detected
(tail -f /var/log/messages):
=================================
Feb 23 11:49:48 dmorldb01 kernel: EXT3 FS on sdb1, internal journal

Author: Esteban Bernal (Exadata Storage Team)

February -2010
 Reimaging Compute & Cell nodes / Exadata V2
5/7

Feb 23 11:49:48 dmorldb01 kernel: EXT3-fs: mounted filesystem with ordered data
mode.
Feb 23 12:00:23 dmorldb01 kernel: usb 8-3.1: USB disconnect, address 5
Feb 23 12:02:42 dmorldb01 kernel: usb 8-3.1: new high speed USB device using
ehci_hcd and address 6
Feb 23 12:02:42 dmorldb01 kernel: usb 8-3.1: configuration #1 chosen from 1 choice
Feb 23 12:02:42 dmorldb01 kernel: scsi9 : SCSI emulation for USB Mass Storage
devices
Feb 23 12:02:47 dmorldb01 kernel: Vendor: HP Model: v125w Rev: PMAP
Feb 23 12:02:47 dmorldb01 kernel: Type: Direct-Access ANSI SCSI
revision: 00
Feb 23 12:02:49 dmorldb01 kernel: SCSI device sdb: 3966976 512-byte hdwr sectors
(2031 MB)
Feb 23 12:02:49 dmorldb01 kernel: sdb: Write Protect is off
Feb 23 12:02:49 dmorldb01 kernel: sdb: assuming drive cache: write through
Feb 23 12:02:49 dmorldb01 kernel: SCSI device sdb: 3966976 512-byte hdwr sectors
(2031 MB)
Feb 23 12:02:49 dmorldb01 kernel: sdb: Write Protect is off
Feb 23 12:02:49 dmorldb01 kernel: sdb: assuming drive cache: write through
Feb 23 12:02:49 dmorldb01 kernel: sdb: sdb1
Feb 23 12:02:49 dmorldb01 kernel: sd 9:0:0:0: Attached scsi removable disk sdb
Feb 23 12:02:49 dmorldb01 kernel: sd 9:0:0:0: Attached scsi generic sg1 type 0
=================================

9) Change to the dl360 db directory & execute the makeImageMedia.sh script to create
the db.iso into the USB drive:
=================================
[root@dmorldb01 images]# cd dl360

[root@dmorldb01 dl360]# ls
boot doc grub initrd makeImageMedia.sh patches README_FOR_FACTORY.txt

[root@dmorldb01 dl360]# ./makeImageMedia.sh

Please wait. Calculating md5 checksums for cellbits ...
Please wait. Making initrd ...
179996 blocks
Please wait. Calculating md5 checksums for boot ...

Choose listed USB devices to set up the Oracle CELL installer

sdb Approximate capacity 1983 MB

Enter the comma separated (no spaces) list of devices or word 'ALL' for to select all:
ALL
sdb will be used as the Oracle CELL installer

All data on sdb will be erased. Proceed [y/n]? y

The number of cylinders for this disk is set to 7748.

There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:

Author: Esteban Bernal (Exadata Storage Team)

February -2010
 Reimaging Compute & Cell nodes / Exadata V2
6/7

1) software that runs at boot time (e.g., old versions of LILO)

2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)

Command (m for help): Building a new DOS disklabel. Changes will remain in memory
only,
until you decide to write them. After that, of course, the previous
content won't be recoverable.

The number of cylinders for this disk is set to 7748.

There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

Command (m for help): Command action

e extended
p primary partition (1-4)
Partition number (1-4): First cylinder (1-7748, default 1): Last cylinder or +size or +sizeM
or +sizeK (1-7748, default 7748):
Command (m for help): The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.
umount2: Invalid argument
umount: /dev/sdb1: not mounted
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
248320 inodes, 495804 blocks
24790 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=511705088
16 block groups
32768 blocks per group, 32768 fragments per group
15520 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912

Writing inode tables: done

Creating journal (8192 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 25 mounts or

180 days, whichever comes first. Use tune2fs -c or -i to override.

Author: Esteban Bernal (Exadata Storage Team)

February -2010
 Reimaging Compute & Cell nodes / Exadata V2
7/7

Copying files... will take several minutes

GNU GRUB version 0.97 (640K lower / 3072K upper memory)

[ Minimal BASH-like line editing is supported. For the first word, TAB
lists possible command completions. Anywhere else TAB lists the possible
completions of a device/filename.]
grub> root (hd0,0)
Filesystem type is ext2fs, partition type 0x83
grub> setup (hd0)
Checking if "/boot/grub/stage1" exists... no
Checking if "/grub/stage1" exists... yes
Checking if "/grub/stage2" exists... yes
Checking if "/grub/e2fs_stage1_5" exists... yes
Running "embed /grub/e2fs_stage1_5 (hd0)"... 15 sectors are embedded.
succeeded
Running "install /grub/stage1 (hd0) (hd0)1+15 p (hd0,0)/grub/stage2 /grub/grub.conf"...
succeeded
Done.
grub> Done creation of installation USB for DL360
=================================

Author: Esteban Bernal (Exadata Storage Team)

February -2010