NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.

1 Cluster-Mode

How to setup FCP in Data ONTAP 8.1 ClusterMode

KB ID: 1013341 Version: 5.0 Published date: 06/20/2014 Views: 7279

Description
This article describes the steps to be performed to setup FCP in Data ONTAP 8.1 Cluster-Mode.

Procedure
Perform the following steps:
1.Check your FC hardware; we are using the 0c onboard ports of four nodes:
cluster1::*> system node run -node * fcadmin config 4 entries were acted on.
Node: cluster1-01
Local Adapter Type
State
Status--------------------------------------------------- 0a
CONFIGURED.
online
0b
initiator CONFIGURED.
0c
target
CONFIGURED
online
0d
initiator
CONFIGURED.
online

initiator
online

Node: cluster1-02
Local Adapter Type
State
Status--------------------------------------------------- 0a
CONFIGURED.
online
0b
initiator CONFIGURED.
0c
target
CONFIGURED
online
0d
initiator
CONFIGURED.
online

initiator
online

Node: cluster1-03
Local Adapter Type
State
Status--------------------------------------------------- 0a
CONFIGURED.
online
0b
initiator CONFIGURED.
0c
target
CONFIGURED
online
0d
initiator
CONFIGURED.
offline
Node: cluster1-04

initiator
online

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 1 of 11
8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

Local Adapter Type
State
Status--------------------------------------------------- 0a
CONFIGURED.
online
0b
initiator CONFIGURED.
0c
target
CONFIGURED
online
0d
initiator
CONFIGURED.
online

initiator
online

cluster1::fcp> adapter show -instance

Node: cluster1-01
Adapter: 0c
Description: Fibre Channel Target Adapter 0c (rev. 2)
Physical Protocol:
fibre-channel
Maximum Speed: 4
Status: online
Substatus: ADAPTER UP
Host Port Address: 810d00
Firmware
Revision: 5.5.2
PCI Bus Width: 64
PCI Clock Speed: 33
Cacheline Size: 16
FC Packet Size: 2048
SRAM Parity: true
External GBIC: false
Data Link Rate (Gbit): 2
Fabric Established:
true
Connection Established: ptp
Mediatype: ptp
Configured
Speed: auto
Configured State: up
Node: cluster1-02
Adapter: 0c
Description: Fibre Channel Target Adapter 0c (rev. 2)
Physical Protocol:
fibre-channel
Maximum Speed: 4
Status: online
Substatus: ADAPTER UP
Host Port Address: 810c00
Firmware
Revision: 5.5.2
PCI Bus Width: 64
PCI Clock Speed: 33
Cacheline Size: 16
FC Packet Size: 2048
SRAM Parity: true
External GBIC: false
Data Link Rate (Gbit): 4
Fabric Established:
true
Connection Established: ptp
Mediatype: ptp
Configured
Speed: auto
Configured State: up
Node: cluster1-03
Adapter: 0c
Description: Fibre Channel Target Adapter 0c (rev. 2)
Physical Protocol:
fibre-channel
Maximum Speed: 4
Status: online
Substatus: ADAPTER UP
Host Port Address: 810f00
Firmware
Revision: 5.5.2
PCI Bus Width: 64

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 2 of 11
8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

PCI Clock Speed: 33
Cacheline Size: 16
FC Packet Size:
2048
SRAM Parity: true
External GBIC: false
Data Link Rate
(Gbit): 4
Fabric Established: true
Connection Established: ptp
Mediatype: ptp
Configured Speed: auto
Configured State: up
Node: cluster1-04
Adapter: 0c
Description: Fibre Channel Target Adapter 0c (rev. 2)
Physical Protocol:
fibre-channel
Maximum Speed: 4
Status: online
Substatus: ADAPTER UP
Host Port Address: 810e00
Firmware
Revision: 5.5.2
PCI Bus Width: 64
PCI Clock Speed: 33
Cacheline Size: 16
FC Packet Size: 2048
SRAM Parity: true
External GBIC: false
Data Link Rate (Gbit): 4
Fabric Established:
true
Connection Established: ptp
Mediatype: ptp
Configured
Speed: auto
Configured State: up 4 entries were displayed.
cluster1::*> system node run -node cluster1-01 fcp topology show
Switches connected on adapter 0c:
Switch Name: sdt-fcswitch2
Switch Vendor: Brocade Communications, Inc. Switch
Release: v6.2.0g
Switch Domain: 129
Switch WWN: 10:00:00:05:1e:03:a4:6e

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 3 of 11
Port
Port WWPN
State
Type
Attached WWPN
Port
ID----------------------------------------------------------------------------------0
20:00:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:82:86:57:d5:58
0x810000 1
20:01:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:83:96:57:d5:58 0x810100 2
20:02:00:05:1e:03:a4:6e Online
FPort
50:0a:09:81:95:44:8b:86 0x810200 3
20:03:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:85:44:8b:86 0x810300 4
20:04:00:05:1e:03:a4:6e
Online
F-Port
50:0a:09:81:97:f9:43:7b 0x810400 5
20:05:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:f9:43:7b 0x810500
6
20:06:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:82:87:f9:43:7b
0x810600 7
20:07:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:82:97:f9:43:7b 0x810700 8
20:08:00:05:1e:03:a4:6e Offline
none
-9
20:09:00:05:1e:03:a4:6e Offline
none
-10
20:0a:00:05:1e:03:a4:6e Online
F-Port
10:00:00:00:c9:39:a6:1a 0x810a00 11
20:0b:00:05:1e:03:a4:6e
Online
F-Port
21:00:00:e0:8b:12:fe:5e 0x810b00 12
20:0c:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:f9:71:c0 0x810c00
13
20:0d:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:39:75:f8

0x810d00 14
20:0e:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:e9:3d:38 0x810e00 15
20:0f:00:05:1e:03:a4:6e
Port
50:0a:09:81:87:99:37:9d 0x810f00

8/20/2015

Online

F-

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

2.Set up your FC VServer:
cluster1::> vserver setup Welcome to the Vserver Setup Wizard, which will lead you
through the steps to create a virtual storage server that serves data to clients.
You can enter the following commands at any time: "help" or "?" if you want to
have a question clarified, "back" if you want to change your answers to previous
questions, and "exit" if you want to quit the Vserver Setup Wizard. Any changes you
made before typing "exit" will be applied.
You can restart the Vserver Setup Wizard by typing "vserver setup". To accept a
default or omit a question, do not enter a value.
Step 1. Create a Vserver. You can type "back", "exit", or "help" at any question.
Enter the Vserver name: pod2vs9 Choose the Vserver data protocols to be configured
{nfs, cifs, fcp, iscsi}: fcp Choose the Vserver client services to be configured
{ldap, nis, dns}: Enter the Vserver's root volume aggregate {aggr1_c01n01,
aggr1_c01n02, aggr1_c01n03, aggr1_c01n04} [aggr1_c01n04]: aggr1_c01n04 Enter the
Vserver language setting, or "help" to see all languages [C]: Vserver creation
might take some time to finish....
Step 2: Create a data volume You can type "back", "exit", or "help" at any
question.
Step 3: Create a logical interface. You can type "back", "exit", or "help" at any
question.
Configuring a SAN interface on all cluster nodes is recommended because it
accommodates volume moves without subsequent path re-config, re-zoning, or rediscovery of new paths on the host MPIO. Do you want to create an additional LIF
now? {yes, no} [no]: yes Enter the LIF name [lif2]: pod2vs9_fc2

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 4 of 11
DOT is plugged into 12/13/14/15. Note they are just F-ports at this point, since we do not have a
FCP Vserver started yet.
Vserver pod2vs9 with language set to C created.

The permitted protocols are fcp.

Do you want to create a data volume? {yes, no} [yes]: Enter the volume name
[vol1]: pod2vs9_vol01 Enter the name of the aggregate to contain this volume
{aggr1_c01n01, aggr1_c01n02, aggr1_c01n03, aggr1_c01n04} [aggr1_c01n04]: Enter the
volume size: 100g Enter the volume junction path [/vol/pod2vs9_vol01]: It can take
up to a minute to create a volume...
Volume pod2vs9_vol01 of size 100GB created on aggregate aggr1_c01n04 successfully.
Do you want to create an additional data volume? {yes, no} [no]:
Do you want to create a logical interface? {yes, no} [yes]: Enter the LIF name
[lif1]: pod2vs9_fc1 Enter the home node {cluster1-01, cluster1-02, cluster1-03,
cluster1-04} [cluster1-04]: cluster1-01 Enter the home port [0c]: FCP lif
pod2vs9_fc1 configured on Vserver pod2vs9

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

Step 4: Configure FCP. You can type "back", "exit", or "help" at any question.
Do you want to configure FCP? {yes, no} [yes]: Enter the igroup name [ig1]: back Do
you want to configure FCP? {yes, no} [yes]: no
Vserver pod2vs9 has been configured successfully.
cluster1::> set -vserver pod2vs

3.Check the Vservers FC network ports:

cluster1::> network interface show
Logical
Status
Network
Current
Current Is Vserver
Interface Admin/Oper
Address/Mask
Node
Port
Home----------- ---------- --------------------------- ------------- ------- ----pod2vs9
pod2vs9_fc1
up/down 20:00:00:a0:98:0a:b7:0b
cluster1-01
0c
true
pod2vs9_fc2 up/down 20:01:00:a0:98:0a:b7:0b
cluster1-02
0c
true
pod2vs9_fc3 up/down 20:02:00:a0:98:0a:b7:0b
cluster1-03
0c
true
pod2vs9_fc4 up/down 20:03:00:a0:98:0a:b7:0b
cluster1-04
0c
true 4
entries were displayed.

4.Add an alias for your initiator (optional):

cluster1::> wwpn-alias set -alias sdt_win_real2_p0 -wwpn 10:00:00:00:c9:39:a6:1a
(vserver fcp wwpn-alias set)
cluster1::> wwpn-alias show
(vserver fcp wwpn-alias show) Vserver
WWPN
Alias--------- ----------------------------------------pod2vs9
10:00:00:00:c9:39:a6:1a sdt_win_real2_p0

5.Create your FC service:

cluster1::fcp*> fcp create
cluster1::fcp*> fcp show

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...

Page 5 of 11
Enter the home node {cluster1-01, cluster1-02, cluster1-03, cluster1-04}
[cluster1-04]: cluster1-02 Enter the home port [0c]: FCP lif pod2vs9_fc2
configured on Vserver pod2vs9 Do you want to create an additional LIF now? {yes,
no} [no]: yes Enter the LIF name [lif3]: pod2vs9_fc3 Enter the home node {cluster101, cluster1-02, cluster1-03, cluster1-04} [cluster1-02]: cluster1-03 Enter the
home port [0c]: FCP lif pod2vs9_fc3 configured on Vserver pod2vs9 Do you want to
create an additional LIF now? {yes, no} [no]: yes Enter the LIF name [lif4]:
pod2vs9_fc4 Enter the home node {cluster1-01, cluster1-02, cluster1-03, cluster104} [cluster1-01]: cluster1-04 Enter the home port [0c]: FCP lif pod2vs9_fc4
configured on Vserver pod2vs9 Do you want to create an additional LIF now? {yes,
no} [no]:

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

Name
------pod2vs9

Status Vserver
Target
Admin---------- ---------------------------20:04:00:a0:98:0a:b7:0b
up

6.Create your igroup:

cluster1::*> igroup create -igroup sdt_win_real2 -ostype windows -initiator
sdt_win_real2_p0
cluster1::*> igroup show Vserver
Igroup
Protocol OS Type
Initiators--------- ------------ -------- -------------------------------------------pod2vs9
sdt_win_real2
mixed
windows 10:00:00:00:c9:39:a6:1a

7.Create your LUN:

cluster1::*> lun create -volume pod2vs9_vol01 -lun lun0 -size 20g -ostype
windows_2008 -space-reserve disabled
Created a LUN of size 20.0g (21476206080)
cluster1::*> lun show Vserver
Volume
Qtree
LUN
State
Mapped
Type
Size--------- ---------- ---------- ---------- ------- --------------- --------pod2vs9
pod2vs9_vol01
""
lun0
online mapped
windows_2008
20.00GB
cluster1::*> lun show -instance
Vserver Name: pod2vs9
LUN Path:
/vol/pod2vs9_vol01/lun0
Volume Name: pod2vs9_vol01
Qtree Name: ""
LUN Name: lun0
LUN Size: 20.00GB
Prefix Size: 0B
Extent Size: 0B
Suffix
Size: 0B
OS Type: windows_2008
Space Reservation:
disabled
Serial Number: 1kZxD$-pP/f1
Comment: Space
Reservations Honored: true
Space Allocation: disabled
State: online
LUN UUID: c494a202-e518-11e09590-123478563412
Mapped: mapped
Vdisk ID:
8000047e00000000000000000000006000f6083f
Block Size: 512B
Device Legacy ID: Device Binary ID: Device Text ID:
Read Only: false
Inconsistent Filesystem: Inconsistent Blocks: NVFAIL: false
Used
Size: 0B

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 6 of 11
cluster1::*> lun map -path /vol/pod2vs9_vol01/lun0 -lun-id 0 -igroup sdt_win_real2

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

Creation Time: 9/22/2011 14:45:36
cluster1::*> system node run -node cluster1-01 fcp topology show
Switches connected on adapter 0c:
Switch Name: sdt-fcswitch2
Switch Vendor: Brocade Communications, Inc. Switch
Release: v6.2.0g
Switch Domain: 129
Switch WWN: 10:00:00:05:1e:03:a4:6e

8.Check your FC switch and note the NPIV ports:

sdt-fcswitch2:admin> switchshow switchName:
sdt-fcswitch2 switchType:
34.0
switchState:
Online switchMode:
Native switchRole:
Principal
switchDomain:
129 switchId:
fffc81 switchWwn:
10:00:00:05:1e:03:a4:6e
zoning:
ON (c_20110922) switchBeacon:
OFF
Area Port Media Speed State
Proto =====================================
0
0
id
N2
Online
F-Port 50:0a:09:82:86:57:d5:58
1
1
id
N2
Online
F-Port 50:0a:09:83:96:57:d5:58
2
2
id
N2
Online
F-Port 50:0a:09:81:95:44:8b:86
3
3
id
N2
Online
F-Port 50:0a:09:81:85:44:8b:86
4
4
id
N4
Online
F-Port 50:0a:09:81:97:f9:43:7b
5
5
id
N4
Online
F-Port 50:0a:09:81:87:f9:43:7b
6
6
id
N4
Online
F-Port 50:0a:09:82:87:f9:43:7b
7
7
id
N4
Online
F-Port 50:0a:09:82:97:f9:43:7b
8
8
id
N4
No_Light
9
9
id
N4
No_Light
10 10
id
N2
Online
F-Port
10:00:00:00:c9:39:a6:1a
11 11
id
N2
Online
F-Port
21:00:00:e0:8b:12:fe:5e

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 7 of 11
Port
Port WWPN
State
Type
Attached WWPN
Port
ID----------------------------------------------------------------------------------0
20:00:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:82:86:57:d5:58
0x810000 1
20:01:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:83:96:57:d5:58 0x810100 2
20:02:00:05:1e:03:a4:6e Online
FPort
50:0a:09:81:95:44:8b:86 0x810200 3
20:03:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:85:44:8b:86 0x810300 4
20:04:00:05:1e:03:a4:6e
Online
F-Port
50:0a:09:81:97:f9:43:7b 0x810400 5
20:05:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:f9:43:7b 0x810500
6
20:06:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:82:87:f9:43:7b
0x810600 7
20:07:00:05:1e:03:a4:6e Online
F-Port

50:0a:09:82:97:f9:43:7b 0x810700 8
20:08:00:05:1e:03:a4:6e Offline
none
-9
20:09:00:05:1e:03:a4:6e Offline
none
-10
20:0a:00:05:1e:03:a4:6e Online
F-Port
10:00:00:00:c9:39:a6:1a 0x810a00 11
20:0b:00:05:1e:03:a4:6e
Online
F-Port
21:00:00:e0:8b:12:fe:5e 0x810b00 12
20:0c:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:f9:71:c0 0x810c00
20:01:00:a0:98:0a:b7:0b
0x810c01 13
20:0d:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:39:75:f8 0x810d00
20:00:00:a0:98:0a:b7:0b
0x810d01 14
20:0e:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:e9:3d:38 0x810e00
20:03:00:a0:98:0a:b7:0b
0x810e01 15
20:0f:00:05:1e:03:a4:6e Online
F-Port
50:0a:09:81:87:99:37:9d 0x810f00
20:02:00:a0:98:0a:b7:0b
0x810f01

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

12 12
id
N4
Online
F-Port 2 NPIV public
13 13
id
N2
Online
F-Port 2 NPIV public
14 14
id
N4
Online
FPort 2 NPIV public
15 15
id
N4
Online
F-Port 2 NPIV public
sdt-fcswitch2:admin> portshow 15 portName: portHealth: HEALTHY
LE domain: 0 FC Fastwrite: OFF Interrupts:
0
Frjt:
0 Unknown:
Fbsy:
0 Lli:
5
31
Protocol_err: 0 Timed_out:
Rx_flushed:
0
Invalid_crc:
Delim_err:
0 Free_buffer:
0
0
Lr_in:
1 Suspended:
Parity_err:
0
Ols_in:
Ols_out:
1 CMI_bus_err:
0

5
Link_failure:
1
Loss_of_sync: 1
Loss_of_sig: 2 Proc_rqrd:
0
Invalid_word: 0
0 Tx_unavail:
0
Address_err: 0 Overrun:
0
Lr_out:
0
0 2_parity_err:
0

Port part of other ADs: No

sdt-fcswitch2:admin> nsshow N
810f01;
3;20:02:00:a0:98:0a:b7:0b;20:04:00:a0:98:0a:b7:0b; na
FC4s: FCP PortSymb: [48]
"NetApp FC Target Port (2432) pod2vs9:pod2vs9_fc3"
NodeSymb: [22] "NetApp
Vserver pod2vs9"
Fabric Port Name: 20:0f:00:05:1e:03:a4:6e
Permanent Port
Name: 50:0a:09:81:87:99:37:9d
Port Index: 15
Share Area: No
Device
Shared in Other AD: No
Redirect: No
sdt-fcswitch2:admin> zoneshow Effective configuration:
cfg:
c_20110922 zone:
z_sdt_win_real2_to_pod2vs9
20:00:00:a0:98:0a:b7:0b

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 8 of 11
Authentication: None portDisableReason: None portCFlags: 0x1 portFlags:
0x20b03
PRESENT ACTIVE F_PORT G_PORT U_PORT NPIV LOGICAL_ONLINE LOGIN NOELP
ACCEPT FLOGI portType: 11.0 POD Port: Port is licensed portState: 1
Online
portPhys: 6
In_Sync portScn:
32
F_Port port generation number:
0
portId:
810f00 portIfId:
4302000f portWwn:
20:0f:00:05:1e:03:a4:6e portWwn
of device(s) connected: 20:02:00:a0:98:0a:b7:0b
50:0a:09:81:87:99:37:9d
Distance: normal portSpeed: N4Gbps

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

20:01:00:a0:98:0a:b7:0b
20:03:00:a0:98:0a:b7:0b

20:02:00:a0:98:0a:b7:0b
10:00:00:00:c9:39:a6:1a

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 9 of 11
9.On Windows 2008 host, enable MPIO for the LUN type. Run the MPIO Properties and enable it
for the NetApp LUN C-mode (Click the SPC-3 compliant NETAPP LUN C-Mode entry, an then
click Add):
10.After a reboot, the following is displayed, showing that the NetApp LUN C-Mode will be
managed by MPIO:

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

11.Format the disk, mount as drive, etc, using Windows tooling (by using disk management).
12.Start some workload on the host:
E:\>sio_ntap_win32.exe 50 50 64k 5g 6000 16 img.iso Version: 3.00

13.Check the baseline performance seen by DOT:

Node: cluster1-04
Object.Instance.Counter
Value
Delta
----------------------------------------------------------- ------------volume.pod2vs9_vol01.read_data
8.70GB
85.5MB/s:8s
volume.pod2vs9_vol01.write_data
8.65GB
84.7MB/s:8s 2
entries were displayed.

14.Perform a vol move to see the impact on the client:

https://kb.netapp.com/support/index?page=content&id=1013341&pmv=print&impressions...
Page 10 of 11
cluster1::*> statistics show -node * -object volume -instance *pod2vs9* -counter
read_data|write_data
cluster1::*> vol move start -volume pod2vs9_vol01 -destination-aggregate
aggr1_c01n02 -foreground true
(volume move start) [Job 348] Job is queued: Move
"pod2vs9_vol01" in Vserver "pod2vs9" to aggregate "aggr1_c01n02". Use the "job
show i [Job 349] Transferring data: 12.61GB sent. [Job 349] Transferring data:
14.35GB sent. [Job 349] Transferring data: 15.54GB sent. [Job 349] Transferring
data: 17.39GB sent. [Job 349] Transferring data: 18.22GB sent. [Job 349]
Transferring data: 19.03GB sent. [Job 348] Cutover Deferred(20.11GB Sent)::Reason:
The estimated time to complete cutover is greater than the cutover that can be
tolerated [Job 348] Job succeeded: Successful

8/20/2015

NetApp Knowledgebase -How to setup FCP in Data ONTAP 8.1 Cluster-Mode

Disclaimer
From Windows perfmon, we see no IO for about 15 seconds (from the right side and then wrapping
around on the left):

https://kb.netapp.com/support/index?page=content&