Mobistar eth-trunk Issue troubleshooting

Backup Plan
Summary
Packets captured on FTP Client/Server, routers, check device status, ethtrunk chip forwarding entries, sub-cards status, leave only one new link in
eth-trunk 23 and so on troubleshooting methods are needed. Please check
the detail procedure below;

BEO018 Topology

Troubleshooting Time Window

Because several operations are needed, and problem is complex, 12
hours is needed
(from 00::00 ->12:00)

Troubleshooting Plan
[Step1]: Before add new Link (L1PE-LEU-11 GE3/0/1 and
L1PE-LEU-12 GE3/0/1)
1. Get the IP1/IP2/IP3/IP4/MAC3/MAC4 ; make sure the GTP
tunnel(IP3/IP4) is used for the test FTP Client(IP1) and FTP
Server(IP2); -----as soon as possible;
2. Get answers in mails sent by Huawei(Tina) on Feb. 26 th; ------as soon
as possible;
3. Confirm the GTP tunnel(Source IP3 and Destination IP4) traffic speed,
to confirm if the packets captured are feasible on L1PE-LEU-11 and
L1PE-LEU-12; -----As soon as possible.
4. Huawei remote access to network to confirm the service path
including all Huawei devices; -------Once receiving the IP and MAC
information above;
5. Huawei configure traffic statistics policy on L1PE-LEU-11 and L1PELEU-12 for GTP tunnel, to make sure GTP tunnel source IP/destination
IP are correct; this operation will not impact any service. This step
will be confirmed after receiving the IPs information/mac address
information above. -------After getting information above and get
approval from customer.
6. Huawei prepare the script (commands) which are needed for
troubleshooting. ----After receiving information above.
7. Customer Connect FTP Client and FTP server, SGSN and GGSN side
confirm the GTP tunnel is correct;(FTP traffic will be encapsulated in
GTP tunnel with source IP=IP3, destination IP =IP4) ------Advise at
least 10 hours before reproduction.
8. Huawei send out 6 Etrans link which is used for packets feedback;
----- 10 hours before adding new link.
9. Configure traffic mirror commands on L1PE-LEU-11 and L1PE-LEU-12
if the packets capture is feasible (L1PE-LEU-11 Eth-trunk53.200,ethtrunk23 and L1PE-LEU-12 GE9/0/0, eth-trunk23), it means 4 PCs are
needed, and internet is available;-----1 hours before adding new link.
10. Capture packets on FTP Client and FTP Server; and also capture
packets on 4 PCs to make sure can work normally; At same time
record the FTP speed on FTP Client; --------------Before adding this new
link
11. From FTP Client, ping 100 packets to FTP server, to get the time
delay; ---Before adding this new link;
12. From SGSN, use GTP tunnel IP3 as source IP, ping destination IP4,
ping 100 packets, record the operation, get the time delay;
-------Before adding this new link;

[Step2]: Add the new link to eth-trunk 2

L1PE-LEU-11:
#
interface GigabitEthernet3/0/1
undo shutdown
L1PE-LEU-12:
#
interface GigabitEthernet3/0/1
undo shutdown

Then use following commands to check the status are normal:

display interface gigaX/X/X

display trunkmembership eth-trunk 23

[Step3]: After adding new link/Problem is reproduced

1. Ping 100 packets from FTP client to FTP server, record the result;
2. From SGSN, use GTP tunnel IP3 as source IP, ping destination IP4,
ping 100 packets, record the operation, get the time delay;
3. FTP same file as before, capture packets on FTP Client; 4 PCs, FTP
server, at same time record the download speed on FTP Client.
4. Need feedback the packets captured quickly by Huawei Etrans;
Especially the packets captured on FTP Client and FTP server need
to be feedback in higher priority.
5. At same time Huawei remote access all the Huawei devices on
service path to check the device status, packet dropped count,
route tables, MAC-address tables, chip entries used for forwarding,
chip packets count. And check the traffic statistics results on L1PELEU-11 and L1PE-LEU-12.

[Step4]: Remove the old link;

Command:
L1PE-LEU-11:
#
interface GigabitEthernet3/0/0
shutdown
L1PE-LEU-12:
#
interface GigabitEthernet3/0/0
shutdown

6. Ping 100 packets from FTP client to FTP server;

7. FTP the same file, record the FTP speed;
8. From SGSN, use GTP tunnel IP3 as source IP, ping destination IP4,
ping 100 packets, record the operation, get the time delay;
9. If everything is normal, then no need collect information;
If still exist the same problem, please collect same information as
step 3.

[Step5]: Restore Operation and confirm service resumed

Add the old link;

L1PE-LEU-11:
#
interface GigabitEthernet3/0/0
undo shutdown
L1PE-LEU-12:
#
interface GigabitEthernet3/0/0
undo shutdown

Remove the new link;

L1PE-LEU-11:
#
interface GigabitEthernet3/0/1
shutdown
L1PE-LEU-12:
#
interface GigabitEthernet3/0/1
shutdown

Then test FTP service and monitor the traffic Graph to confirm problem
is resolved.

Information Feedback
1. All the troubleshooting Operation records;
2. Packets captured (need show which scenario the packet is
captured clearly in the packet name).
3. FTP log and dblg including problem reproduction time(Later
after reproduction)