AR63

View AR | AR without Proprietary
New AR:
History | States | Assignment | Timetracking
Add Attachment
AR Text Search | More | CARES Home
Assistance Request 1-5667178
Customer Ticket N/A
Short Repeated File not arrived alarm increased on the network
Description
Current Aug 11: This Node B software issue will be fixed in 13.3.D
and
Summary plan is to deliver the fix part is end of Aug, awaiting

closure
of the AR.
State Resolved : Solution Provided - Awaiting Customer Approval

for Closure
Outage No
Severity 2
Priority 1
Service Request Remote Technical Support
Request Type Defect
Sub-Type Software
Category Software
Internal Yes
Assignment Events
Ask Alcatel-Lucent
Product
Product 9926 DBS-WCDMA
Version ANY
No Change Request is linked to this AR
Product Location
Site Abu Dhabi AE - Alcatel-Lucent MENA JLT-
Instance 9926DBS WCDMA-AUH : In Service
Site Company Emirates Telecommunications Corporation
City Abu Dhabi
Country United Arab Emirates
Contact
Name Karim IBRAHIM ABD EL NABY
Company Alcatel-Lucent : Open on behalf of Customer
Phone 971 56 354 4568 Email

Karim.Ibrahim@alcatel-lucent.com
Request Method Email-Eng
Dates
Occurred 07-Apr-2015 12:36 Time now 29-Aug-2015 11:33
(GMT+4)
Reported 07-Apr-2015 12:36 AR Created 07-Apr-2015 12:41
Service Start 07-Apr-2015 12:36
Next Customer Contact 25-Jun-2015 14:30
Responded 07-Apr-2015 13:11 Respond Target 07-Apr-2015 13:36

SA - Calculated
Restored 07-Apr-2015 13:11 Restore Target 04-May-2015 07:02

SA - Calculated
Resolved 24-Jun-2015 10:09 Resolve Target 29-Jun-2015 07:02

SA - Calculated
Targets for Restore & Resolve have been extended by 22 days

to account for Pending time
Closed -- --- ----
Last Modified 11-Aug-2015 10:20 Modified By mohmadi
Entitlement
Agreement 242895 (OXIA 627085)
Covered Service TS 24x7 (Gold, Wireless Mobile Access)
Script This request is entitled to service.
People
Owner TSCd-WLS-WCDMA-IN : mohmadi
Assignee NorP-WLS-WCDMA-vGlobal : mohmadi
Referred 1 TEC-WLS-WCDMA-BTS : vkuma073
Referred 2 NorP-WLS-WCDMA-vGlobal : mohmadi
Submitter mbednarz
Description
Attachments
From: "IBRAHIM ABD EL NABY, Karim (Karim)** CTR **"
<karim.ibrahim@alcatel-lucent.com>
Sent: 2015-04-07 10:36:17
To: ALU Support <support@alcatel-lucent.com>
Cc: "MERAD, ABDESSAMAD (ABDESSAMAD)"
<abdessamad.merad@alcatel-lucent.com>;"ABDEL-HALIM, SAYED (SAYED)"
<Sayed.Abdel-Halim@alcatel-lucent.com>;"EL-MIDANY, AHMED (AHMED)"
<Ahmed.El-Midany@alcatel-lucent.com>;3G_ALU_Integ_UAE
<3G_ALU_Integ_UAE@exchange.alcatel-lucent.com>
Subject: Etisalat UAE//Repeated File not arrived alarm increased on the

network
Hello,
Short Description : Repeated File not arrived alarm increased
on the network
Current Summary : Repeated File not arrived alarm
(OAM_0051_00005)increased on the network, TEC Support needed to check if
this alarm have any impact on the system and KPIs, and whats the RC of it,
also how to deal with it to be cleared,
Contact Surname : Karim
Contact Given Name : Ibrahim
Contact Phone :+971 56 354 4568
Contact Company : Alcatel-Lucent
Company : Emirates Telecommunications Corporation
Contract Number : OXIA 627085
Region : EMEA
Country : United Arab Emirates
City : Abu Dhabi
Site : ETISALAT ABU DHABI

Product Instance : 9926 DBS-WCDMA
Severity : 2
Priority : 2
Logs :HFB Attached,
Product Version : LR13.3W
Outage : No
Internal/External: :Internal
--
Best Regards,
Karim Ibrahim
LTE/WCDMA Integration Professional
META WLS Access Network (GNE EMEA)
M(UAE): +
<https://mail.eu.alcatel-
lucent.com/owa/redir.aspx?C=30449991f54743fd85063b63258fd6f2&URL=https%3a%2
f%2fmail.eu.alcatel-lucent.com%2fowa%2fUrlBlockedError.aspx>
971-56-354-4568
M(Egy): +
<https://mail.eu.alcatel-
lucent.com/owa/redir.aspx?C=30449991f54743fd85063b63258fd6f2&URL=https%3a%2
f%2fmail.eu.alcatel-lucent.com%2fowa%2fUrlBlockedError.aspx>
2010-668-44-810
ONNET: 2205 5534
Attachments
Showing Investigation and Proprietary logs together in time order Show

separately
Investigation Log and Proprietary Log

1. 07-Apr-2015 12:44 ALCATEL-LUCENT PROPRIETARY
mbednarz
Outgoing E-mail to Karim (Karim)** CTR ** IBRAHIM ABD EL NABY
Workflow Status: Queued
Subject: Re: Etisalat UAE//Repeated File not arrived alarm increased on the
network/1-5667178
Contact: Karim (Karim)** CTR ** IBRAHIM ABD EL NABY
Agent: mbednarz
From: support@alcatel-lucent.com
To: "IBRAHIM ABD EL NABY, Karim (Karim)** CTR **"
<karim.ibrahim@alcatel-lucent.com>
Cc: "MERAD, ABDESSAMAD (ABDESSAMAD)" <abdessamad.merad@alcatel-lucent.com>,
"ABDEL-HALIM, SAYED (SAYED)" <Sayed.Abdel-Halim@alcatel-lucent.com>,
"EL-MIDANY, AHMED (AHMED)" <Ahmed.El-Midany@alcatel-lucent.com>,
3G_ALU_Integ_UAE <3G_ALU_Integ_UAE@exchange.alcatel-lucent.com>
Bcc:
Sent on:
Dear Karim,
Thank you for contacting the Alcatel-Lucent Welcome Center.
Your request has been processed and the ticket number for your reference is
AR
1-5667178
Please reference that number when contacting Alcatel-Lucent for follow-up.
An Alcatel-Lucent representative will contact you regarding your request.
Kind Regards,
Malwina Bednarz
ALCATEL-LUCENT
GLOBAL WELCOME CENTER
Visit OnLine Customer Support for Contact details
2. 07-Apr-2015 13:11
mohmadi
Update to Current Summary: Apr 7: Under Investigation
3. 07-Apr-2015 13:12
mohmadi
Update to Current Summary: Apr 7: Awaiting Receive Log Files / Technical
Info

mohmadi
From: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **
Sent: Tuesday, April 07, 2015 2:39 PM
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **
Cc: INDIA-WCDMA-CdTSC-TEAM
Subject: AR 1-5667178/major/9926 DBS-WCDMA/Emirates Telecommunications
Corporation/Repeated File not arrived alarm increased on the network
Hello Karim,
Will check and update you on it.
Thanks,
Mohmadi Cutlerywala,
Mobile:+91 9870327804.
Email ID: mohmadi.cutlerywala@alcatel-lucent.com
Subject: RE: AR 1-5667178/major/9926 DBS-WCDMA/Emirates Telecommunications

Also Meanwhile please share more info on it.
Thanks,
Mobile:+91 9870327804.
5. 08-Apr-2015 12:37
mohmadi
Update to Current Summary: Apr 8: Awaiting Receive Log Files / Technical

Info

mohmadi
Sent: Wednesday, April 08, 2015 2:07 PM
Cc: INDIA-WCDMA-CdTSC-TEAM; 3G_ALU_Integ_UAE; MERAD, ABDESSAMAD

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); EL-MIDANY, AHMED (AHMED)
Hi Karim,
Can you please share following logs:
WOM_COMM_SEPE_RNC-20010.*
cp_utran-20000.*
wms_cm_mediationserver-20001.*
WOM_COMM_PP_FM-20007.*
WTK_FTS-20017.*
You can upload the logs on China FTP server (135.240.25.160 wftp/wftp)
under
path/directory / home/wcdma/traces/ETISALAT/1-5667178
Also share your observation as when did issue seen started? Was there any
activity
performed at WMS side?
Was WMS or its process been re-started earlier?
Thanks,
Mobile:+91 9870327804.
7. 09-Apr-2015 17:06
mohmadi
Update to Current Summary: Apr9:many errors observed for various

NodeBs,some
problem with NodeB PM file not able to communicate with WMS,info shared
awaiting
furthr update frm site team

mohmadi
From: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **
To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

(ABDESSAMAD);
Hello Mohamdi,
Please provide the path for the below required logs, All WMS process are Up
since
26 Mar,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

(ABDESSAMAD);

Hi Karim,
Check on following path:/opt/nortel/logs/utran
Thanks,
Mobile:+91 9870327804.

(ABDESSAMAD);
Hello Mohamdi,
All logs @ the china server with below configuration @

/home/wcdma/Etisalat_UAE/AR
1-5667178
Server details:- 135.240.25.160 (login/password= wftp/wftp)
Waiting your feedback,

Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
Sent: Thursday, April 09, 2015 3:50 PM

(ABDESSAMAD);
Hello Mohamdi,
Any update about this AR?.
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
From: AGRAWAL, Ritesh (Ritesh)** CTR **

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); EL-MIDANY, AHMED (AHMED); CUTLERYWALA, Mohmadi
(Mohmadi)** CTR **
Hi Karim,
Mohamdi is busy with several critical and major issues raised by your
network and
other networks.
This AR has been raised to us yesterday and we need time to chk this.
Thanks.
Regards
Ritesh Kumar Agrawal
Technical Product Support Leader
(GSM APAC, INDIA & WCDMA INDIA)
Work : +91-22-66798827
Mobile : +91-9820279489
Alcanet : 2758 8827 ( Preferred )
GTALK ID : riteshgsmtac@gmail.com

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); EL-MIDANY, AHMED (AHMED); AGRAWAL, Ritesh

(Ritesh)**
CTR **
Hello Karim,
From the logs provided following many errors are been observed for
various Node
Bs , it seems there is some problem with the Node B PM file not able to
communicate with WMS.
wom_pm_nePoller-20013.tra
For example:
2015/04/08-10:02:02,508+04:00 | FMK_PM_neProxyPmInterface.cc:338 | Thr:27 |

EXT |
component-name | class-name | CId:22815745
end output: succeeded to call the sendFileName method on the perf server
for event
type : GPO

EXT |

begin output: call the sendFileName method on perf server for eventType :
GPO to
send the message:
neType = NodeB
fileType = OBS_NODE_B
fileNameAndPath = /pmfs/84859620150408100000
neVersion = 091
neSWVersion = 09_01_00
neUniqueId = EB_AR_U_2298_BuhasaAccomodation2
neUserLabel = EB_AR_U_2298_BuhasaAccomodation2
timeStamp = 0

EXT |
GPO to
send the message:
neType = NodeB
neVersion = 091
neUniqueId = EP_AR_U_2502_BaayaWeddingHallU900
neUserLabel = EP_AR_U_2502_BaayaWeddingHallU900
timeStamp = 0
FMK_PM_server-20023.log.0 and 1
For example:
2015/04/08-10:02:04,217+04:00 | FMK_PM_itFtsCallBackImpl.cc:841 | Thr:12 |
CId:22815746 | (FMK_PM_server::FTSTransferFailure)
1-ERR-APP-221 | FTS transfer failed :
Main server cluster name : ;
Source file path and name : /pmfs/84859620150408100000;
Ne unique id : EB_AR_U_2298_BuhasaAccomodation2;
Software version : 09_01_00;
Event type : gpo;
Ne type : NodeB;
File type : OBS_NODE_B;
Ftp Protocol : FTP;
Ne unique id : EP_AR_U_2502_BaayaWeddingHallU900;
Event type : gpo;
Ne type : NodeB;
Ftp Protocol : FTP;
WTK_FTS-20017.log.0
For example:
2015/04/02-06:53:41,117+04:00 | GetFileRequest.cc:112 | Thr:46 |
CId:21238215 |
(FTS::GetFileRequestProcessingFailed)
1-ERR-APP-50106 | Failed to process the getFile request with parameters 1st

Ip
address = 10.235.157.77 ; 2nd Ip address = ; hostid =

ET_AR_U_0269_WRBuhasaNorth
; support SSH = no ; public key = ; private key = ; username = BTSXfer ;
clientContext = 35522 ; clientid = present ; retry = yes ; jobLabel =
/pmfs/85201120150401210000@@44415@2015/04/01-21:02:11 ; local file =
/opt/nortel/data/utran/gpo/IN/ET_AR_U_0269_WRBuhasaNorth/852011201504012100
00 ;
remote file = /pmfs/85201120150401210000 . The error "78:The remote file

does not
exist" has occured.

CId:21367235 |

Ip
ET_AR_U_2766_GhumaisiaEastU900 ; support SSH = no ; public key = ; private

key =
; username = BTSXfer ; clientContext = 38014 ; clientid = present ; retry =

no ;
jobLabel = /pmfs/65077720150401220000@@47221@2015/04/02-07:02:01 ; local

file =
/opt/nortel/data/utran/gpo/IN/ET_AR_U_2766_GhumaisiaEastU900/65077720150401
220000
; remote file = /pmfs/65077720150401220000 . The error "78:The remote file

does
not exist" has occured.

Please provide following command output:
1) df h
2) WMS Process status: /opt/nortel/shell/sysmgt <214> (oamops) %
./wam_checkall.sh
3) What is the IP of this Node bs a) EB_AR_U_2298_BuhasaAccomodation2
b) EP_AR_U_2502_BaayaWeddingHallU900
c) ET_AR_U_0269_WRBuhasaNorth
d) ET_AR_U_2766_GhumaisiaEastU900
4) Using wicl provide above Node bs details  a) BTSEquipment
EB_AR_U_2298_BuhasaAccomodation2 dis
b) BTSEquipment EP_AR_U_2502_BaayaWeddingHallU900 dis
c) BTSEquipment ET_AR_U_0269_WRBuhasaNorth dis
d)BTSEquipment ET_AR_U_2766_GhumaisiaEastU900 dis
Thanks,
Mobile:+91 9870327804.
9. 13-Apr-2015 10:39
mohmadi

NodeBs,some
awaiting

mohmadi
Sent: Friday, April 10, 2015 4:09 PM

(ABDESSAMAD);

(Ritesh)**
CTR **
Hello Mohamdi,
Thanks for your feedback, the required logs attached,
Please can your observe from the last logs when the issue started to
increase as
we already migrated the WMS to LR.14.2, may there are any relation,
The mentioned nodebs below are taken as example? Or what?
NodeBs IPs mentioned below,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
Sent: Monday, April 13, 2015 12:08 PM

(ABDESSAMAD);

(Ritesh)**
CTR **
Hi Karim
Kindly Let us know when was WMS migrated to LR14.2 .
Thanks,
Mobile:+91 9870327804.
11. 14-Apr-2015 09:53

mohmadi

NodeBs,some
awaiting

mohmadi
From: MERAD, ABDESSAMAD (ABDESSAMAD)
To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; IBRAHIM ABD EL NABY, Karim
(Karim)**
CTR **
Cc: INDIA-WCDMA-CdTSC-TEAM; 3G_ALU_Integ_UAE; ABDEL-HALIM, SAYED (SAYED);
EL-MIDANY, AHMED (AHMED); AGRAWAL, Ritesh (Ritesh)** CTR **
23/03/2015
Best Regards

mohmadi
To: CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Subject: FW: AR 1-5667178/major/9926 DBS-WCDMA/Emirates Telecommunications

Hi Nilanjan,
Need your help in this AR:
Here customer is observing Repeated File not arrived alarm (OAM_0051_00005)
increased on the network seen in HFB logs.
We tried to analysis from WMS side and found that there are many errors
been
observed for various Node Bs , it seems there is some problem with the
Node B PM
file not able to communicate with WMS.
We wanted to escalate it to known the solution and RC of it, but before

that can
you have a check from your side once.
All WMS Logs and HFB log are uploaded on China FTP server (135.240.25.160
wftp/wftp) under path/directory / home/wcdma/Etisalat_UAE/AR 1-5667178
Thanks,
Mobile:+91 9870327804.
From: CHATTERJEE, Nilanjan (Nilanjan)** CTR **
To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; ARORA, Gaurav (Gaurav)** CTR
**
Hello Mohmadi, Gaurav,
This is not same issue as 1-5050283 because IPs are correct as highlighted
below.

CId:21238215 |

Ip

/pmfs/85201120150401210000@@44415@2015/04/01-21:02:11 ; local file =
00 ;

does not
exist" has occured.

CId:21367235 |

Ip

key =
no ;

file =
220000

does
a) EB_AR_U_2298_BuhasaAccomodation2  10.235.157.71
b) EP_AR_U_2502_BaayaWeddingHallU900  10.235.170.167
c) ET_AR_U_0269_WRBuhasaNorth  10.235.157.77
d) ET_AR_U_2766_GhumaisiaEastU900  10.235.157.81
Looking at the error The error "78:The remote file does not exist" has
occured. It
seems it is either the PM file is missing in xCCM or some abrupt network
disturbances causing the failure of transfer else lest check with TEC..
BR Nilanjan.

mohmadi
Hello TEC, Escalating this AR for your support:
Product: 9926 DBS-WCDMA
SW Version: LR13.3.W
Customer: Emirates Telecommunications Corporation
Problem Short Description

Repeated File not arrived alarm increased on the network (1-5667178)
1. Detailed Description
Repeated File not arrived alarm
(OAM_0051_00005) increased on the network, TEC Support needed to check if
this alarm have any impact on the system and KPIs, and whats the RC of it,
also how to deal with it to be cleared.
WMS was migrated to LR14.2 on 23/03/2015, but this alarm is seen prior to
it too.
All Logs uploaded on China FTP server (135.240.25.160 wftp/wftp) under
path/directory / home/wcdma/Etisalat_UAE/AR 1-5667178
2. All the steps taken before AR escalated to ALU
As above.
3. All the steps taken before the issue observed by the engineer, who
reported the
AR
N/A
4. Activities After AR was escalated to L2 Technical Support
From L2 perspective, From the logs provided following many errors are been
observed for various Node Bs , it seems there is some problem with the
Node B PM
file not able to communicate with WMS.
For example:

EXT |
for event
type : GPO
EXT |
GPO to
send the message:
neType = NodeB
neVersion = 091
timeStamp = 0

EXT |
GPO to
send the message:
neType = NodeB
neVersion = 091
timeStamp = 0
For example:
Event type : gpo;
Ne type : NodeB;
Ftp Protocol : FTP;
Event type : gpo;
Ne type : NodeB;
Ftp Protocol : FTP;
WTK_FTS-20017.log.0
For example:

CId:21238215 |

Ip

/pmfs/85201120150401210000@@44415@2015/04/01-21:02:11 ; local file =
00 ;

does not
exist" has occured.

CId:21367235 |

Ip

key =

no ;

file =
220000

does
Also below details (Logs_Output.txt) are uploaded on china server.
1) df h
./wam_checkall.sh
3) What is the IP of this Node bs a) EB_AR_U_2298_BuhasaAccomodation2
b) EP_AR_U_2502_BaayaWeddingHallU900
c) ET_AR_U_0269_WRBuhasaNorth
d) ET_AR_U_2766_GhumaisiaEastU900
4) Using wicl provide above Node bs details  a) BTSEquipment
d)BTSEquipment ET_AR_U_2766_GhumaisiaEastU900 dis.
Please find below L2 WMS team analysis:

CId:21238215 |

Ip

/pmfs/85201120150401210000@@44415@2015/04/01-21:02:11 ; local file =
00 ;

does not
exist" has occured.

CId:21367235 |
Ip

key =

no ;

file =
220000

does
a) EB_AR_U_2298_BuhasaAccomodation2 10.235.157.71
b) EP_AR_U_2502_BaayaWeddingHallU900 10.235.170.167
c) ET_AR_U_0269_WRBuhasaNorth 10.235.157.77
d) ET_AR_U_2766_GhumaisiaEastU900 10.235.157.81
Looking at the error The error "78:The remote file does not exist" has
occurred.
It seems it is either the PM file is missing in xCCM or some abrupt network
disturbances causing the failure of transfer.
Required TEC help in getting solution and RC for it. And also wanted to
know will
this alarm have any impact on the system and KPIs?
5. Current Status
know will
6. Severity of this issue and its impact on the customer's organization
Major
7. Attachments
Escalation Note
8. Expectations from the TEC:
know will
Thanks,
Mohmadi
15. 14-Apr-2015 14:25

mohmadi
Update to Current Summary: Apr 14: Information/Action Requested

mohmadi
To: DAS, Sunil (Sunil)** CTR **
Cc: INDIA-WCDMA-UTRAN-BE; INDIA-WCDMA-WMS-NPO-BE; ARORA, Gaurav (Gaurav)**

CTR **;
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; VAIDYA, Deepak (Deepak)** CTR **
Hello Sunil,
This is for your information that we have escalated this AR 1-5667178 to

your
workgroup (TEC-WLS-WCDMA-BTS). Please assign someone to support on this.
Escalation note attached for your reference.
All WMS Logs and HFB uploaded on China FTP server (135.240.25.160
wftp/wftp) under
path/directory /home/wcdma/Etisalat_UAE/AR 1-5667178
Thanks,
Mobile:+91 9870327804.

mohmadi
Time Tracking Entry Added - IR01-TSA1

mohmadi

mohmadi
20. 15-Apr-2015 09:18

deepakva
Update to Current Summary: 15/04/2015-> Information/Action Requested
21. 16-Apr-2015 10:08

deepakva
Sent: Thursday, April 16, 2015 11:36 AM
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; CUTLERYWALA, Mohmadi
(Mohmadi)**
CTR **; VAIDYA, Deepak (Deepak)** CTR **
Cc: 3G_ALU_Integ_UAE; ABDEL-HALIM, SAYED (SAYED); EL-MIDANY, AHMED (AHMED);

MERAD,
ABDESSAMAD (ABDESSAMAD); INDIA-WCDMA-WMS-NPO-BE; AGRAWAL, Ritesh (Ritesh)**

CTR
**; INDIA-WCDMA-UTRAN-BE
Hello Karim,
Deepak Vaidya will work on this issue from L2 WMS team side.
TEC L3 WMS team is investigating this issue.
We will let you know any feedback we receive from them.
Meantime, We have observed the sudden appearance of "The error "78:The

remote file
does not exist" has occured." is appearing in the below 19 NodeBs among the
total
286 NodeBs those are sending the PM files.

Do you see any other NodeBs having this issue?
hostid = EB_AR_U_2321_MzdImmigrationDept
hostid = ER_AR_U_2032_Lateer
hostid = EU_AR_U_2358_PanArabianCamp
hostid = ET_AR_U_0269_WRBuhasaNorth
hostid = ET_AR_U_2766_GhumaisiaEastU900
hostid = ET_AR_U_2766_GhumaisiaEast
hostid = ET_AR_U_0266_SalabikWest
hostid = ET_AR_U_2119_MirfaMzd1
hostid = ET_AR_U_2139_UmAlAsthanSouth
hostid = EY_AO_U_5489_GhantootPoloClub
hostid = ET_AR_U_2200_BidiyaEast
hostid = EG_AR_U_0214_Hamyam
hostid = EB_AR_U_2298_BuhasaAccomodation2
hostid = DM_AR_U_2073_MzdCity27
hostid = EU_AR_U_2235_GhuwaifatPoliceStn
hostid = EU_AR_U_2833_TarfaBorderGuards
hostid = ET_AR_U_2141_DibsaEast
hostid = VF_AR_U_2388_RulersReprsDiwanSila
hostid = EP_AR_U_2502_BaayaWeddingHallU900
Can you please check any similarities between these 19 NodeBs? Are these
stable
NodeBs? Any similarity in the transmission path?
BR
NILANJAN CHATTERJEE
OAM L2 Support- 2G & 3G
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
Nilanjan.Chatterjee@alcatel-lucent.com
To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; AGRAWAL, Ritesh (Ritesh)** CTR
**;
INDIA-WCDMA-CdTSC-TEAM

MERAD,
ABDESSAMAD (ABDESSAMAD)
Importance: High
Hello Mohamdi,Ritesh,
Please push on TEC to get a feedback ASAP as we received a customer

escalation on
these alarms,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; MERAD, ABDESSAMAD
(ABDESSAMAD)
Hi Karim,
WMS TEC is looking into this AR, we will update you as and when we receive
any
info from them.
Thanks,
Mobile:+91 9870327804.
To: MERAD, ABDESSAMAD (ABDESSAMAD); CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

Hello Mohamdi,
Are there any update about your investigation,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
From: MERAD, ABDESSAMAD (ABDESSAMAD)
Sent: Monday, April 13, 2015 11:00 AM
(Karim)**
CTR **
23/03/2015
Best Regards
Sent: lundi 13 avril 2015 08:38

(ABDESSAMAD);

(Ritesh)**
CTR **
Hi Karim
Kindly Let us know when was WMS migrated to LR14.2 .
Thanks,
Mobile:+91 9870327804.
Sent: Friday, April 10, 2015 4:09 PM

(ABDESSAMAD);

(Ritesh)**
CTR **

Hello Mohamdi,
Thanks for your feedback, the required logs attached,
Please can your observe from the last logs when the issue started to
increase as
we already migrated the WMS to LR.14.2, may there are any relation,
The mentioned nodebs below are taken as example? Or what?
NodeBs IPs mentioned below,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

(ABDESSAMAD);

(Ritesh)**
CTR **
Hello Karim,
From the logs provided following many errors are been observed for
various Node
B's , it seems there is some problem with the Node B PM file not able to
communicate with WMS.
For example:

EXT |
for event
type : GPO

EXT |
GPO to
send the message:
neType = NodeB
neVersion = 091
timeStamp = 0

EXT |
GPO to
send the message:
neType = NodeB
neVersion = 091
timeStamp = 0
For example:

Event type : gpo;
Ne type : NodeB;
Ftp Protocol : FTP;
Event type : gpo;
Ne type : NodeB;
Ftp Protocol : FTP;
WTK_FTS-20017.log.0
For example:

CId:21238215 |

Ip

/pmfs/85201120150401210000@@44415@2015/04/01-21:02:11 ; local file =
00 ;

does not
exist" has occured.

CId:21367235 |

Ip

key =

no ;

file =
220000

does
Please provide following command output:
1) df -h
./wam_checkall.sh
3) What is the IP of this Node b's a) EB_AR_U_2298_BuhasaAccomodation2
'
10.235.157.71
b) EP_AR_U_2502_BaayaWeddingHallU900 ' 10.235.170.167
c) ET_AR_U_0269_WRBuhasaNorth ' 10.235.157.77
d) ET_AR_U_2766_GhumaisiaEastU900 ' 10.235.157.81
4) Using wicl provide above Node b's details a) BTSEquipment
d)BTSEquipment ET_AR_U_2766_GhumaisiaEastU900 dis
Thanks,
Mobile:+91 9870327804.

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); EL-MIDANY, AHMED (AHMED); CUTLERYWALA, Mohmadi
(Mohmadi)** CTR **
Hi Karim,
Mohamdi is busy with several critical and major issues raised by your
network and
other networks.
This AR has been raised to us yesterday and we need time to chk this.
Thanks.
Regards
Work : +91-22-66798827
Mobile : +91-9820279489

(ABDESSAMAD);
Hello Mohamdi,
Any update about this AR?.

Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

(ABDESSAMAD);
Hello Mohamdi,
All logs @ the china server with below configuration @

/home/wcdma/Etisalat_UAE/AR
1-5667178
Server details:- 135.240.25.160 (login/password= wftp/wftp)
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

(ABDESSAMAD);
Hi Karim,
Check on following path:/opt/nortel/logs/utran
Thanks,
Mobile:+91 9870327804.

(ABDESSAMAD);

Hello Mohamdi,
Please provide the path for the below required logs, All WMS process are Up
since
26 Mar,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

(ABDESSAMAD);
Hi Karim,
Can you please share following logs:

WOM_COMM_SEPE_RNC-20010.*
cp_utran-20000.*
wms_cm_mediationserver-20001.*
WOM_COMM_PP_FM-20007.*
WTK_FTS-20017.*
You can upload the logs on China FTP server (135.240.25.160 wftp/wftp)
under
path/directory / home/wcdma/traces/ETISALAT/1-5667178
Also share your observation as when did issue seen started? Was there any
activity
performed at WMS side?
Was WMS or its process been re-started earlier?
Thanks,
Mobile:+91 9870327804.

(ABDESSAMAD);
Importance: High
Hello Mohamdi,
Short Description : Repeated File not arrived alarm increased

on the
network
Current Summary : Repeated File not arrived alarm
(OAM_0051_00005)increased on the network, TEC Support needed to check if

this
alarm have any impact on the system and KPIs, and what's the RC of it, also
how to
deal with it to be cleared,
HFB Attached,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

Also Meanwhile please share more info on it.
Thanks,
Mobile:+91 9870327804.
Hello Karim,
Will check and update you on it.
Thanks,
Mobile:+91 9870327804.

deepakva

To: VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; VAIDYA, Deepak
(Deepak)**
CTR **

CTR **;
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; DAS, Sunil (Sunil)** CTR **
Hi Rammurthi,
On Behalf of Deepak:
We will check with customer & let you know the feedback.
Aside to that:
We have checked WTK_FTS log file & observed among the other failure errors
the
below error is appearing in below list of 19 NodeBs among the total 286
NodeBs
those are sending the PM files.
Error: The error "78:The remote file does not exist" has occurred
NodeB list:
Can there be any sudden transmission issues? However we have already asked
customer to check transmission as well.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
From: VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **
To: VAIDYA, Deepak (Deepak)** CTR **

CTR **;
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; CUTLERYWALA, Mohmadi (Mohmadi)**

CTR **;
DAS, Sunil (Sunil)** CTR **
Hi Deepak,
While i was doing log analysis I have observed the following detail.
There are FTP transfer success event noticed from below 2 Nodes where the
failure
is noticed,
10.235.157.77 ET_AR_U_0269_WRBuhasaNorth
10.235.157.81 ET_AR_U_2766_GhumaisiaEastU900
I am able to the FTP success message before and after the failure event
For 10.235.157.77 ET_AR_U_0269_WRBuhasaNorth
2015/04/02-07:02:02,801+04:00 Succeeded to process the

getFile
request
getFile
request

getFile
request

getFile
request

getFile
request
For 10.235.157.81 ET_AR_U_2766_GhumaisiaEastU900

getFile
request

getFile
request

getFile
request

getFile
request
1. Please can you check with customer environment whether the file
was
exist(created?) and available for the failed transfer
2. In other case, there might be a problem in establishing the

connection
with NODEs, can you send us the transport log
between these Nodes and server.
Regards,
Ramamurthi V
From: VAIDYA, Deepak (Deepak)** CTR **
Sent: 16 April 2015 11:43
To: VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **

CTR **;

CTR **;
Hello Ramamurthi,
As per cares update this AR is assigned to you.
Do we have any finding any issue? Please let us know if you need more
details?
---------------------------
Thanks & Regards,
Deepak Vaidya
GSM/WCDMA RTSC- India
Alcatel Lucent India Ltd.

Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
Gtalk ID: - deepakvaidya.gsm@gmail.com
------------------------------------------------------------

rvenkitt
Hi,
Pls see the reply in the below thread.
Regards
Ramamurthi v
Sent: 16 April 2015 12:26

CTR **;
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; DAS, Sunil (Sunil)** CTR **;
CHATTERJEE,
Nilanjan (Nilanjan)** CTR **
Hello Ramamurthi,
Please answers of our below queries: -

was
Deepak: - Do we need to check this file from NodeB, if yes, then /pmfs/ is
the
path to check this file?
Ramamurthi: yes, we need to check in /pmfs/<failed filename> in NodeB

connection
Deepak: - From where we have to check these logs either from WMS or NodeB?
Also
please share the path to get these logs.
Ramamurthi: Enable ALC log collection to include transport details. Pls
Zip/archive the logs in the FTP server.
I downloaded 700MB files from FTP server took more than an hour to
download, which
is around 30MB after zipping it, it could have taken less time.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522

------------------------------------------------------------

(Deepak)**
CTR **

CTR **;
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; DAS, Sunil (Sunil)** CTR **
Hi Rammurthi,
We will check with customer & let you know the feedback.
Aside to that:
We have checked WTK_FTS log file & observed among the other failure errors
the
below error is appearing in below list of 19 NodeBs among the total 286
NodeBs
those are sending the PM files.
Error: The error "78:The remote file does not exist" has occurred
NodeB list:
Can there be any sudden transmission issues? However we have already asked
customer to check transmission as well.
BR
NILANJAN CHATTERJEE

INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019

CTR **;

CTR **;
Hi Deepak,
While i was doing log analysis I have observed the following detail.
failure
is noticed,
I am able to the FTP success message before and after the failure event

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request
was

connection
Regards,
Ramamurthi V
24. 17-Apr-2015 10:06

deepakva

nchatter

nchatter

deepakva

28. 23-Apr-2015 13:01
deepakva
29. 23-Apr-2015 13:04

deepakva
From: owner-india-wcdma-wms-npo-be@LIST.ALCATEL-LUCENT.COM
[mailto:owner-india-wcdma-wms-npo-be@LIST.ALCATEL-LUCENT.COM] On Behalf Of
VAIDYA,
Deepak (Deepak)** CTR **

MERAD,

CTR
**; INDIA-WCDMA-UTRAN-BE; CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Hello Karim,
Issue is with backend, we will update you once receive any feedback on
this.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

MERAD,

CTR
Hello Deepack,
Please update,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

MERAD,

CTR
Hello Deepak,
Kindly find attached the required log, Please we need your confirmation
that this
issue not affect the KPIs?!. Also if you can provide a RC and recovery
action
ASAP,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

MERAD,

CTR
Hello Karim,
1. Please can you check the environment whether the file was
exist(created?)
and available for the failed transfer
Deepak: - We need to check in /pmfs/<failed filename> in NodeB

connection
Deepak: - Enable ALC log collection to include transport details. Pls

Zip/archive
the logs in the FTP server.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

MERAD,

CTR
Hello Deepack,
Thanks for your feedback, Please elaborate more for the your requirements,
as it's
not clear for me.
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568


MERAD,
ABDESSAMAD (ABDESSAMAD); CUTLERYWALA, Mohmadi (Mohmadi)** CTR **;
INDIA-WCDMA-WMS-NPO-BE; AGRAWAL, Ritesh (Ritesh)** CTR **; INDIA-WCDMA-

UTRAN-BE;
CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Hello Karim,
Below is more finding on this issue.
failure
is noticed,
We are able to the FTP success message before and after the failure event

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request

getFile
request
1. Please can you check the environment whether the file was
exist(created?)
and available for the failed transfer

connection

---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

deepakva

CTR **;
CHATTERJEE,
Hello Ramamurthi,
Do we have any update on this?
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
VAIDYA,

CTR **;
CHATTERJEE,
Hello Ramamurthi,
We have uploaded the required data @ /home/wcdma/Etisalat_UAE/AR 1-5667178

Server IP: - 135.240.25.160
Username/PW: - wftp/wftp
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

CTR **;
CHATTERJEE,
Hi,
Login to the nodeb which has the reported problem with root user
privilege
Instructions to collect the IMT trace from NodeB:
1. eCCMu -root-root> imt
(Note: for eCCMu _u -> login with the root id)
2. imt logs are stored in the /tmp directory
3. FTP and share the imt logs
Regards
Ramamurthi V
Sent: 20 April 2015 10:40

CTR **;
CHATTERJEE,
Hello Ramamurthi,
For point 2nd can you please let us know that how can we enable ALC log &
which files we need to collect? Also please share the path to collect
required
files.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

deepakva

rvenkitt
Hi Deepak,
I dont find any NODEB transport information logs from the log that you
have
shared via FTP,
We can find more transport related info from the NODEBs to others, from
the NODEB
transport log only.

So, please collect and share the Nodeb log as mentioned below. i already
mentioned
this in the previous mail(procedure)
Generally log files will have IMT substring in the filename
For example :
bouesse_imt_2015-03-05T17h01m11
privilege
Br
Ramamurthi V
33. 29-Apr-2015 08:39

deepakva
34. 30-Apr-2015 09:12

deepakva
VAIDYA,

MERAD,

CTR
Hello Karim,
I have cross checked the logs which you have provided but couldn't see the
IMT log
files containing bouesse_imt, can you please provide us the same logs to
further
investigation?
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522

------------------------------------------------------------

MERAD,

CTR
Dears,
Any update please,
Thanks,
--
BR,
Karim
LTE/3G Integration Professional
M: +971 (0)56-354-4568

MERAD,

CTR
Hello Karim,
Yes, we shared the same data with backend but required logs are not present
in
that.
For example :
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------


MERAD,

CTR
Importance: High
Hello Deepak,
Already we shared the IMT last time!!, Please check again on the FTP
server, the
file name is logs_pmfiles contains IMT for both sites,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

MERAD,
CTR
Hello Karim,
Below is latest feedback on this issue.
We don't find any NODEB transport information logs from the log that you
have
shared via FTP, We can find more transport related info from the NODEB
transport
log only.
So, please collect and share the Nodeb log as mentioned below.
For example :
privilege

---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

deepakva

CTR **;
CHATTERJEE,
Hello Ramamurthi,
Please check log_pmfiles.rar files to get the IMT logs.
As confirmed by customer, IMT logs are already present in this file.
Server IP: - 135.240.25.160
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
36. 30-Apr-2015 11:37

deepakva
Update to Current Summary: 30/04/2015-> Information/Action Provided

deepakva

deepakva
39. 06-May-2015 10:19

deepakva
Sent: Tuesday, May 05, 2015 11:41 PM

MERAD,
ABDESSAMAD (ABDESSAMAD); INDIA-WCDMA-WMS-NPO-BE; INDIA-WCDMA-UTRAN-BE;

CHATTERJEE,
Nilanjan (Nilanjan)** CTR **; KHEDR, MAHMOUD (MAHMOUD); AGRAWAL, Ritesh

(Ritesh)**
CTR **
Importance: High
Hello Deepack,
We will collect the logs again, but can you please let us know why the last
logs
are not valid?! And also no any output from all logs we collected till
now?!
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

MERAD,

CHATTERJEE,
Nilanjan (Nilanjan)** CTR **; KHEDR, MAHMOUD (MAHMOUD); AGRAWAL, Ritesh

(Ritesh)**
CTR **
Hello Karim,
Please collect below info.
1. We need latest IMT and HFB. Please collect IMT as soon as file not
arrived
alarm is seen.
2. Also please share NODE-B Zap logs for the date range 2015/04/06 to
2015/04/08.
-------------------------------
Thanks & Regards,
Deepak Vaidya

Mobile: +91 09926071114
--------------------------------------------
-----Original Message-----
From: VAIDYA, Deepak (Deepak)** CTR ** [deepak.vaidya@ALCATEL-LUCENT.COM]
Received: Tuesday, 05 May 2015, 18:19
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR ** [karim.ibrahim@alcatel-

lucent.com]
CC: 3G_ALU_Integ_UAE [3g_Alu_Integ_Uae@alcatel-lucent.com]; ABDEL-HALIM,

SAYED
(SAYED) [Sayed.Abdel-Halim@alcatel-lucent.com]; EL-MIDANY, AHMED (AHMED)
[Ahmed.El-Midany@alcatel-lucent.com]; MERAD, ABDESSAMAD (ABDESSAMAD)
[abdessamad.merad@alcatel-lucent.com]; INDIA-WCDMA-WMS-NPO-BE
[india-wcdma-wms-npo-be@alcatel-lucent.com]; INDIA-WCDMA-UTRAN-BE
[india-wcdma-utran-be@alcatel-lucent.com]; CHATTERJEE, Nilanjan

(Nilanjan)** CTR
** [nilanjan.chatterjee@alcatel-lucent.com]; KHEDR, MAHMOUD (MAHMOUD)
[Mahmoud.Khedr@alcatel-lucent.com]; AGRAWAL, Ritesh (Ritesh)** CTR **
[ritesh.agrawal@alcatel-lucent.com]
Hello Karim,
This is for your update that as confirmed by GPS team NODE-B Zap logs for
the date
range 2015/04/06 was missing from the last provided logs.
We are in touch with GPS team to get the info about required logs so that
we can
collect them in one shot.
Also we are checking ALC (Automatic Log Collection) process to collect some
logs
automatically to avoid more manual effort.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; VAIDYA, Deepak (Deepak)**
CTR **

MERAD,

CHATTERJEE,
Nilanjan (Nilanjan)** CTR **; KHEDR, MAHMOUD (MAHMOUD)
GPS is already involved.
Regards
Work : +91-22-66798827
Mobile : +91-9820279489
IBRAHIM
ABD EL NABY, Karim (Karim)** CTR **

MERAD,

CTR
**; INDIA-WCDMA-UTRAN-BE; CHATTERJEE, Nilanjan (Nilanjan)** CTR **; KHEDR,

MAHMOUD
(MAHMOUD)
Importance: High
Hello Deepack,
Any update here?!, can you involve the GPS here to try finish this issue?!,
Again
lot of alarms on the sites and the customer escalating everyday! And we are
not
sure if it's service affecting or not?! , Please try to help us to secure
the
project.
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
Sent: Sunday, May 03, 2015 7:15 AM

MERAD,

CTR

MAHMOUD
(MAHMOUD)
Hello Karim,
We have already shared your inputs with backend, their feedback awaited.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
Sent: Friday, May 01, 2015 6:49 PM

MERAD,

CTR

MAHMOUD
(MAHMOUD)
Importance: High
Hello Deepack,
It's the available logs as requested, Please at the GPS to the loop to
quick the
process, we received 2nd escalation from the customer regarding this

alarms.
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
Update to Current Summary: 06/05/2015-> Data aaited from customer.
40. 06-May-2015 10:19 ALCATEL-LUCENT PROPRIETARY

deepakva
From: DAS, Sunil (Sunil)** CTR **
To: Potdar, Vikas (Vikas)** CTR **; VAIDYA, Deepak (Deepak)** CTR **;
VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **

CTR **;
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)**

CTR **;
AGRAWAL, Ritesh (Ritesh)** CTR **
Okay, if it is not green lighted in 13.3, we will not activate.
Deepak,
We need timely IMT and HFB. Please ask customer team to collect IMT as soon
as
file not arrived alarm is seen.
Ramamurthy,
Mean time, Can you please think of writing a script which will
automatically
trigger IMT if alarm is triggered in HFB?
Regards,
Sunil
From: Potdar, Vikas (Vikas)** CTR **
To: DAS, Sunil (Sunil)** CTR **; VAIDYA, Deepak (Deepak)** CTR **;

CTR **;

CTR **;
Oh. I think you wanted to activated ELC, which is not recommended in LR13.3
For information the parameter name is "externalLogStorageActivation" in the
BTSEquipment.
Regards,
Vikas Potdar
Sent: 05 May 2015 18:40
To: Potdar, Vikas (Vikas)** CTR **; VAIDYA, Deepak (Deepak)** CTR **;

CTR **;

CTR **;
Ohh; It may not help to collect normal logs from ccm. There was a feature
which
will collect logs periodically from ndoeB. What is that feature name?
Regards,
Sunil

CTR **;

CTR **;

Hello Sunil,
ALC is for CEM resets [in LR13.3], it would automatically collect the CCM
logs
[imt, flr & lec current files] and CEM logs [EEC]. It will store these
files
in dedicated folder in BTS meant for ALC logging, "/store/alc"
Regards,
Vikas Potdar
Sent: 05 May 2015 18:14
To: VAIDYA, Deepak (Deepak)** CTR **; VENKITTARAMANUJAM, Ramamurthi

(Ramamurthi)**
CTR **; Potdar, Vikas (Vikas)** CTR **

CTR **;

CTR **;
Vikas,
I believe ALC will upload load as its buffer goes to threshold. It does not
wait
for any cem reset, right?
We need this ALC to collect XCCM logs to capture external socket status.
Regards,
Sunil
To: DAS, Sunil (Sunil)** CTR **; VENKITTARAMANUJAM, Ramamurthi

(Ramamurthi)** CTR
**; Potdar, Vikas (Vikas)** CTR **

CTR **;

CTR **;
Hello Vikas,
Will be any impact on server like trace size will be huge or any other
impact on
NEs if we activate ALC?
-------------------------------
Thanks & Regards,
Deepak Vaidya

Mobile: +91 09926071114
--------------------------------------------
From: Potdar, Vikas (Vikas)** CTR ** [Vikas.Potdar@alcatel-lucent.com]
To: VAIDYA, Deepak (Deepak)** CTR ** [deepak.vaidya@alcatel-lucent.com];

DAS,
Sunil (Sunil)** CTR ** [sunil.das@alcatel-lucent.com]; VENKITTARAMANUJAM,
Ramamurthi (Ramamurthi)** CTR ** [ramamurthi.venkittaramanujam@alcatel-

lucent.com]
CC: INDIA-WCDMA-UTRAN-BE [india-wcdma-utran-be@alcatel-lucent.com];
INDIA-WCDMA-WMS-NPO-BE [india-wcdma-wms-npo-be@alcatel-lucent.com]; ARORA,

Gaurav
(Gaurav)** CTR ** [g.arora@alcatel-lucent.com]; CUTLERYWALA, Mohmadi

(Mohmadi)**
CTR ** [mohmadi.cutlerywala@alcatel-lucent.com]; CHATTERJEE, Nilanjan

(Nilanjan)**
CTR ** [nilanjan.chatterjee@alcatel-lucent.com]; AGRAWAL, Ritesh (Ritesh)**

CTR **
Hello Deepak,
You can keep it activated, wait for the issue, let the ALC do its job
collecting
the logs automatically when there is any reset.
You can deactivate the same parameter once you're done with the logs.
But otherwise you can keep it activated, as it would collect the logs
automatically in case of any reset problems. But do you think a buy-in is

required
from customer? May be Sunil can comment.
Regards,
Vikas Potdar
Sent: 05 May 2015 17:48
VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; Potdar, Vikas

(Vikas)** CTR
**

CTR **;

CTR **;
Hello Vikas,
For how much time we should keep it active to get proper logs?
And how can we deactivate it once logs are collected?
-------------------------------
Thanks & Regards,

Deepak Vaidya
Mobile: +91 09926071114
--------------------------------------------
From: Potdar, Vikas (Vikas)** CTR ** [Vikas.Potdar@alcatel-lucent.com]
To: DAS, Sunil (Sunil)** CTR ** [sunil.das@alcatel-lucent.com]; VAIDYA,

Deepak
(Deepak)** CTR ** [deepak.vaidya@alcatel-lucent.com]; VENKITTARAMANUJAM,
Ramamurthi (Ramamurthi)** CTR ** [ramamurthi.venkittaramanujam@alcatel-

lucent.com]
CC: INDIA-WCDMA-UTRAN-BE [india-wcdma-utran-be@alcatel-lucent.com];
INDIA-WCDMA-WMS-NPO-BE [india-wcdma-wms-npo-be@alcatel-lucent.com]; ARORA,

Gaurav
(Gaurav)** CTR ** [g.arora@alcatel-lucent.com]; CUTLERYWALA, Mohmadi

(Mohmadi)**
CTR ** [mohmadi.cutlerywala@alcatel-lucent.com]; CHATTERJEE, Nilanjan

(Nilanjan)**
CTR ** [nilanjan.chatterjee@alcatel-lucent.com]; AGRAWAL, Ritesh (Ritesh)**

CTR **
Hello All,
The ALC can be activated by enabling the parameter

"autoLogCollectionActivation"
in BTSEquipment object - from WMS.

Regards,
Vikas Potdar
Sent: 05 May 2015 17:41

(Ramamurthi)**
CTR **

CTR **;

CTR **;
AGRAWAL, Ritesh (Ritesh)** CTR **; Potdar, Vikas (Vikas)** CTR **
Yes HFB and IMT is needed. IMT collects some extra information which is not
there
in ALC.
Let me add Vikas from R&D.
Vikas,
Please send procedure to activate ALC in 13.3.
Regards,
Sunil

(Ramamurthi)** CTR **

CTR **;

CTR **;
Hello Sunil,
Please share the process to activate/deactivate ALC, so we will ask local

team for
the same.
Also if we collect ALC then still will we require remaining logs like HFB,
IMT?
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

(Ramamurthi)**
CTR **

CTR **;

CTR **;
Nodeb Zap is a part of IMT. So, IMT will cover Zap file.
Can you please ask to activate ALC( automatic log collection). It will help
to
collect all warning/errors in the nodeB even no one collects when issue is
seen.
ALC will automatically upload the logs from nodeB to WMS.
Regards,
Sunil


CTR **;
CTR **;
Hello Sunil,
Ok, we are going to ask for the below data from customer.
1. NODE-B Zap logs for the date range 2015/04/06 -> 2015/04/08
2. IMT, WMS and HFB for latest time stamp.
Please let us know if you want some additional info so we will ask customer
in one
shot to share.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

To: VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; AGRAWAL, Ritesh
(Ritesh)** CTR **
Cc: VAIDYA, Deepak (Deepak)** CTR **; INDIA-WCDMA-UTRAN-BE;
INDIA-WCDMA-WMS-NPO-BE; ARORA, Gaurav (Gaurav)** CTR **; CUTLERYWALA,

Mohmadi
(Mohmadi)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Deepka,
It may not be possible to have back dated IMT. If this issue is still in
network,
please collect IMT, WMS and HFB for latest time stamp.
BTW, we need to always match the logs and issue reported date. Otherwise,
email
forth and back would be exchanged.
Regards,
Sunil
To: AGRAWAL, Ritesh (Ritesh)** CTR **
Cc: VAIDYA, Deepak (Deepak)** CTR **; INDIA-WCDMA-UTRAN-BE;
INDIA-WCDMA-WMS-NPO-BE; ARORA, Gaurav (Gaurav)** CTR **; CUTLERYWALA,

Mohmadi
(Mohmadi)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **; DAS, Sunil
(Sunil)**
CTR **
Ritesh,
We don't have proper logs, see below the details
Alarm related logs collected for the duration 2015/04/06 -> 2015/04/08
NodeB zap logs from imt_zap.txt.gz file available for duration 2015/04/10
->
2015/04/20
Zap/Transport logs collected are not dates are not matching with Alarm
related
logs.
As the FTP file transfer failure problem found on the logs for the date
range
2015/04/06 -> 2015/04/08,
I need NODE-B Zap logs also for the date range 2015/04/06 -> 2015/04/08
to
check the NODE-B transport issue.
Regards,
Ramamurthi V
Sent: 05 May 2015 3:57

Cc: VAIDYA, Deepak (Deepak)** CTR **; VENKITTARAMANUJAM, Ramamurthi
(Ramamurthi)**
CTR **; INDIA-WCDMA-UTRAN-BE; INDIA-WCDMA-WMS-NPO-BE; ARORA, Gaurav

(Gaurav)** CTR
**; CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; CHATTERJEE, Nilanjan

(Nilanjan)** CTR
**
Adding the latest communications.
Sunil,
Can we get the confirmation whether the required information is available

or not ?
If yes then can we get the path fwd ? Customer is sending reminders on
daily basis.
Thanks.
Regards
Ritesh
Sent: Monday, May 04, 2015 11:27 AM
Cc: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; AGRAWAL, Ritesh (Ritesh)**

CTR **;
Hello Sunil,
Yes, I can see IMT logs are present in that file.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

CTR **;
Deepak,
Can you please confirm, is IMT available or not. Some email says it is not
available.
I will discuss with Ramamurthy once he is in office.
Regards,
Sunil

CTR **;
Hello Sunil,
Good Morning.
I requested customer for IMT logs but as per customer they have already
shared the
same logs and asking us to verify it again.
As informed to Ramamurthi, logs are already uploaded in the below server

with file
name log_pmfiles.rar
Server IP: - 135.240.25.160
Please let me know if logs are not useful and need a new set of logs.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: AGRAWAL, Ritesh (Ritesh)** CTR **; VENKITTARAMANUJAM, Ramamurthi
Cc: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; VAIDYA, Deepak (Deepak)** CTR
**
Deepak,
I understood that IMT was pending when issue was reported. We need IMT at
the
time when issue is seen.

We have seen similar issue few months back in some customer. I don't
remember name
of customer. The issue was transport. Let me sync with Ramamurthy.
Regards,
Sunil
Sent: Sunday, May 03, 2015 9:52 AM
Cc: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; VAIDYA, Deepak (Deepak)** CTR
**
Subject: FW: AR 1-5667178/major/9926 DBS-WCDMA/Emirates Telecommunications
Sunil, we need ur help in expediting the solution.
Regards
Work : +91-22-66798827
Mobile : +91-9820279489
41. 07-May-2015 09:58

deepakva
Update to Current Summary: 06/05/2015-> Need some clarity on customer
concern.

deepakva
Sent: Thursday, May 07, 2015 11:21 AM

(Deepak)**
CTR **

CTR **;

CTR **;
AGRAWAL, Ritesh (Ritesh)** CTR **; DAS, Sunil (Sunil)** CTR **
Hello Ramamurthi,
For your query, you need to contact WMS team.
for Zap , from my experience it's not run by NodeB it's done for all the
OAM, do
you need me to run it as below
- on main (as root user): type /opt/nortel/shell/zap/wam_zap.sh -a -f
trace file in /opt/nortel/data/zap/
Regards,
Vikas Potdar
Sent: 06 May 2015 20:13

CTR **;

CTR **;
AGRAWAL, Ritesh (Ritesh)** CTR **; DAS, Sunil (Sunil)** CTR **; Potdar,
Vikas
(Vikas)** CTR **
Deepak,
Below are the available zap log duration from file
<imt_2015-05-06T15h19m20.tar> that you shared.
Which are not matching to date range 2015/04/06 to

2015/04/08.
2015-04-09 19:44:53:458 - 2015-04-09 20:40:24:272

flr_6.txt
2015-04-10 16:06:46:302 - 2015-04-10 17:05:45:419 flr_5.txt
2015-04-10 19:08:45:129 - 2015-04-10 19:34:16:856: flr_4.txt
2015-04-13 10:30:50:437 - 2015-04-13 11:34:07:904 flr_3.txt
2015-04-22 13:51:39:458 - 2015-04-22 13:51:37:672 flr_2.txt
2015-04-26 07:37:44:269 - 2015-04-26 10:40:36:394: flr_1.txt
2015-05-06 14:19:41:993 - 2015-05-06 15:19:19:334: flr_current.txt

@Vikas,
Pls add your input for the below query
OAM, do
-BR
Ramamurthi V
Sent: 06 May 2015 6:08
To: DAS, Sunil (Sunil)** CTR **; Potdar, Vikas (Vikas)** CTR **;

CTR **;

CTR **;
Hello Sunil,
Please find attached the current IMT & HFB.

We also requested for NODE-B Zap logs for the date range 2015/04/06 to
2015/04/08
from customer for that they have below concern, so please answer below
query if
you still need ZAP logs for date range 2015/04/06 to 2015/04/08.
OAM, do
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
43. 07-May-2015 10:19

deepakva
VAIDYA,
To: ABDEL-HALIM, SAYED (SAYED)
Cc: 3G_ALU_Integ_UAE; EL-MIDANY, AHMED (AHMED); MERAD, ABDESSAMAD

(ABDESSAMAD);
INDIA-WCDMA-WMS-NPO-BE; INDIA-WCDMA-UTRAN-BE; KHEDR, MAHMOUD (MAHMOUD);

IBRAHIM
ABD EL NABY, Karim (Karim)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR
**;
Hello Sayed,
GPS is already involved in this issue & we are working on this on priority.
We need timely logs for further investigation but somehow logs were missing
from
the provided data. In our last query we requested for latest HFB/IMT logs
but
while analysing HFB we found that alarm was occurred at 01/05/2015 but IMT
logs is
of 06/05/2015 (Time mismatch). Earlier Zap log was missing for 06/04/2015
to
08/04/2015. So it was not possible to find out any cause from the provided
logs
due to time mismatch in the provided data.
We need below data for further investigation, which we also requested

earlier: -
Need to collect the IMT_ZAP logs from the NODE-Bs for the date range
2015/04/06 to
2015/04/08.
For following problematic NODE-Bs
Procedure to collect IMT
privilege
We also request you to provide remote connection of this server to collect
required data in one shot for faster investigation.
---------------------------
Thanks & Regards,

Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
From: ABDEL-HALIM, SAYED (SAYED)
To: VAIDYA, Deepak (Deepak)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR
**;

(ABDESSAMAD);

IBRAHIM
Importance: High
Hello All,
This AR is ongoing since 1 month, issue is highly escalated by etisalat

regarding
number of alarms in our system
When can we expect the feedback and solution for this problem?
Thanks,
Sayed
Sent: Wednesday, May 06, 2015 4:23 PM
To: VAIDYA, Deepak (Deepak)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR
**

MERAD,

KHEDR,
MAHMOUD (MAHMOUD); AGRAWAL, Ritesh (Ritesh)** CTR **
Hello Deepak,
Attached,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; CHATTERJEE, Nilanjan
(Nilanjan)**
CTR **

MERAD,

KHEDR,
Hello Karim,
Also please share HFB, for ZAP log queries we will come back to you
shortly.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; VAIDYA, Deepak (Deepak)** CTR
**
MERAD,

KHEDR,
Hello Nilanjan
Attached IMT log, for Zap , from my experience it's not run by NodeB it's
done for
all the OAM, do you need me to run it as below
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
CTR **
MERAD,

KHEDR,
Hello Karim,
As Deepak mentioned in the trailing mail the last provided logs could not
help
because NODE-B Zap logs for the date range 2015/04/06 was missing from the
last
provided logs.
Please let us know when are you going to send us the log?
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
deepakva

CTR **;

CTR **;
Hi,
Need to collect the IMT_ZAP logs from the NODE-Bs for the date range
2015/04/06 to
2015/04/08.
Following problematic NODE-Bs
IMT ZAP collection procedure included in one of the below mail thread.
Regards
Ramamurthi V.
45. 07-May-2015 10:20

deepakva
Update to Current Summary: 06/05/2015-> Requested some more info from

customer.
46. 07-May-2015 11:58

deepakva
Sent: Thursday, May 07, 2015 1:28 PM

(ABDESSAMAD);
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; AGRAWAL, Ritesh (Ritesh)** CTR

**;
ABDEL-HALIM, SAYED (SAYED)
Hello Karim,
We have remotely collected the requested IMT logs.
Please keep open RAMSES connection in case if we require more logs to

collect. We
will intimate you before collecting more data.

---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: VAIDYA, Deepak (Deepak)** CTR **; ABDEL-HALIM, SAYED (SAYED)

(ABDESSAMAD);
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; AGRAWAL, Ritesh (Ritesh)** CTR **
Hello Deepack,
Ramses' United Arab Emirates' WMS 3G, use the default user/pass,
oamops/oam_oamops
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; ABDEL-HALIM, SAYED (SAYED)

(ABDESSAMAD);
Hello Karim,
To investigate any issue we always need a time matching logs & data. For
example last provide IMT logs is of 06/0/2015 & HFB is covering 01/05/2015
alarms.
So if alarms is reflecting for date 01/05/2015 then how can we found any
cause
from IMT log of 06/05/2015. This is the reason we requested repeated logs.
Also please share the IP of the server along with login credentials. Surely
we
will let you know logs details which we will collect remotely.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: VAIDYA, Deepak (Deepak)** CTR **; ABDEL-HALIM, SAYED (SAYED)

(ABDESSAMAD);
Importance: High
Hello Deepack,
We provided all requested data lot of times, I don't know what' the
difference
between the IMT which we took usually for all ARs and the one you need?!,
you
mention the same procedure we used,
Anyway, you can access our WMS through Ramses under united arab emirates
and
collect all your required logs, but please u should send us the log after
you
finish and notify us before access the WMS.
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568

deepakva
VAIDYA,

CTR **;

CTR **;
Hello Ramamurthi,
We have uploaded IMT logs for all 4 impacted NodeB in the server, details
is as
below.
@/home/wcdma/Etisalat_UAE/AR 1-5667178/IMT
Server IP: - 135.240.25.160
I remotely collected these logs and sharing the available IMT logs present
in the
/tmp from all 4 NodeB. Also attaching ls -ltr output from all 4 NodeB to
cross
check the IMT log file available in NodeB.
If you still find something wrong with the provided data then you can also
remotely login in the server to check IMT logs. If requires I can also
provide TV
of my laptop by login in the server.
oamops/oam_oamops
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114

Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
48. 07-May-2015 11:58

deepakva
Update to Current Summary: 07/05/2015-> Data has been shared with GPS.

audreys
Incoming E-mail from Nilanjan (Nilanjan) CHATTERJEE
Workflow Status: Handled by an agent
Subject: 1-5667178
Contact: Nilanjan (Nilanjan) CHATTERJEE
From: "CHATTERJEE, Nilanjan (Nilanjan)** CTR **"
<nilanjan.chatterjee@alcatel-lucent.com>
To: ALU Support <support@alcatel-lucent.com>
Cc:
Sent on: May 11, 2015 5:39:08 AM EDT
Hello WC,
Please change the product to 9353 WMS.
BR Nilanjan.
audreys
Outgoing E-mail to Nilanjan (Nilanjan) CHATTERJEE
Workflow Status: Queued
Subject: Re: 1-5667178
Contact: Nilanjan (Nilanjan) CHATTERJEE
Agent: audreys
From: support@alcatel-lucent.com
To: "CHATTERJEE, Nilanjan (Nilanjan)** CTR **"
<nilanjan.chatterjee@alcatel-lucent.com>
Cc:
Bcc:
Sent on:
Hello,
The product has been changed as requested
Thanks,
Audrey
ALCATEL-LUCENT
GLOBAL WELCOME CENTER
Visit OnLine Customer Support for Contact details

deepakva

deepakva

deepakva
54. 12-May-2015 12:43

nchatter
Update to Current Summary: 12/05/2015-> Data has been shared with TEC. TEC
to
share he WMS template & script to colllect IMT logs

nchatter
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; VENKITTARAMANUJAM,

Ramamurthi
Cc: PASHA, D Hussain (D Hussain)** CTR **; CHATTERJEE, Nilanjan

(Nilanjan)** CTR
**; 3G_ALU_Integ_UAE; EL-MIDANY, AHMED (AHMED); MERAD, ABDESSAMAD

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); VAIDYA, Deepak (Deepak)** CTR **; AGRAWAL,

Ritesh
(Ritesh)** CTR **
Karim,
I have found some strange. I took a nodeB where I could see problem and it
is
trying to extract 7 files one short. However one PM file is generated at

every hr.
I expect this file should also be upload every hr.
Any case, if files are missing, I would not see any NPO counter for these
hrs.
can you please get me counter 10733 and 10734 for below nodeBs for
2015-03-09T12:00:00 to 2015-03-09T20:00:00?
OAM_0051_00005 EM BTSEquipmentAR_U_2354_GayathiAgrComplex
AR_U_2354_GayathiAgrComplex equipment 2225534 NW:UTRAN
BTSEquipment:AR_U_2354_GayathiAgrComplex NW/UTRAN
BTSEquipment/AR_U_2354_GayathiAgrComplex 2015-03-09T17:47:01 +0400

Regards,
Sunil
56. 12-May-2015 13:04

nchatter
Update to Current Summary: 12/05/2015-> Local team to share the counter

details.
TEC to share WMS template & script.

57. 13-May-2015 10:09
nchatter

Ramamurthi

(Nilanjan)** CTR

(ABDESSAMAD);

Ritesh
(Ritesh)** CTR **
Karim.
Please target EM BTSEquipmentEA_AO_U_4074_FalahCommunityV12 nodeB. it has

many
alarms.
please check followings for 2015-04-28 from 00 hrs to 24 hrs
1. PM files in /opt/nortel/data/utran/observation. Please list of files

with
ls-lrt option.
2. NPO counter for 10733 and 10734.

Regards,
Sunil


(Nilanjan)** CTR

(ABDESSAMAD);

Ritesh
(Ritesh)** CTR **
Sunil,
Attached another HFB,
Thanks,
--
BR,
Karim
M: +971 (0)56-354-4568
ONNET:2205 5534
58. 01-Jan-1970 04:00

deepakva
From: PASHA, D Hussain (D Hussain)** CTR **
Cc: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; 3G_ALU_Integ_UAE; EL-MIDANY,

AHMED
(AHMED); MERAD, ABDESSAMAD (ABDESSAMAD); INDIA-WCDMA-WMS-NPO-BE;
INDIA-WCDMA-UTRAN-BE; KHEDR, MAHMOUD (MAHMOUD); ABDEL-HALIM, SAYED (SAYED);
AGRAWAL, Ritesh (Ritesh)** CTR **; SHAKAR, Pravin Kumar (Pravin Kumar)**
CTR **;
VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; VAIDYA, Deepak

(Deepak)** CTR
**; DAS, Sunil (Sunil)** CTR **
Hi All,
Please find the attached script. Steps to be followed before running the
script
Steps:
=========
1. copy this script to WMS server.
This should be copied only to /home/oamops/ directory.
2. untar the tar file

command: tar -xvf pmFileCollection.tar
3. once 2nd step is successful then go inside pmFileCollection directory
command: cd pmFileCollection
4. Please run get_iplist.sh script 1st.
command: ./scripts/get_iplist.sh
5. Once 4th step is completed successful, then please run start.sh script.
command: ./scripts/start.sh
it will add entry in the crontab entry and every 15 minutes it will run and
generate pmFileCollection in " logs" directory.
Note: if you want to stop the script then run below command.
command: ./scripts/stop.sh
Logs will be collected under logs directory.
If you are sending any logs related to this script then please send logs
which are
under logs directory.
BR,
Pasha
Sent: 13 May 2015 19:23
CTR **

(Nilanjan)** CTR

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); AGRAWAL, Ritesh (Ritesh)** CTR **; SHAKAR,

Pravin
Kumar (Pravin Kumar)** CTR **; VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)**

CTR **
Karim,
Summary:
1. The alarms were generated because files was missing from nodeB itself.
We could
see all PM files were deleted in nodeB /pmfs directory.
2. We waited for one and half hrs. we could see nodeB generates PM file
exactly
every hr. So, no issue in nodeB.
3. I could see PM files in wms stats/observation/nodeB_name directory.
4. If wms tries to get PM file from nodeB using ftp, it will fail because
of
missing file.
5. I suspect some script might be running in back ground, which is

cleaning /tmp
and /pmfs.
My recommendation.
1. Please change password of a nodeB so that no one can login. WMS does
not use
login and password for normal operation. So, no problem would be there from
operation point of view. Yes, PM file would be transferred to WMS for this
nodeB
if you change password.
2. Pasha will send a script which will monitor PM files at every 15

minutes in
nodeB. it will give us history of file and when it gets deleted.
Regards,
Sunil
To: VAIDYA, Deepak (Deepak)** CTR **; DAS, Sunil (Sunil)** CTR **

(Nilanjan)** CTR

(ABDESSAMAD);

Pravin

CTR **
Thanks Deepack,
Hi Sunil,
Thanks to summarize our findings and our next steps,

Thanks,
--
BR,
Karim Ibrahim
Alcatel-Lucent, Dubai, Etisalat Program
M: +971 (0)56-354-456 || ONNET:2205 5534
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; DAS, Sunil (Sunil)** CTR
**

(Nilanjan)** CTR

(ABDESSAMAD);

Pravin

CTR **
Hello All,
As discussed, remote connection is now closed.
Hello Karim,
As requested please find the session log.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
From: SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **
CTR **;
DAS, Sunil (Sunil)** CTR **; VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)**

CTR **

(Nilanjan)** CTR

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); AGRAWAL, Ritesh (Ritesh)** CTR **
Hi Karim,
Session will start from 3 PM (IST).
---------------------------
Thanks & Regards,
PRAVIN SHAKAR
Mobile: +91-7045361609
Landline: +91-22-66798739
Alcanet: 27588739
Gtalk ID: - Pravin.shakar@gmail.com
------------------------------------------------------------
IBRAHIM
Sent: 13 May 2015 14:55
To: SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **; VAIDYA, Deepak (Deepak)**
CTR
**; DAS, Sunil (Sunil)** CTR **; VENKITTARAMANUJAM, Ramamurthi

(Ramamurthi)** CTR
**

(Nilanjan)** CTR

(ABDESSAMAD);

Hello Pravin
When you will start?!
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
CTR **;

CTR **

(Nilanjan)** CTR

(ABDESSAMAD);

Hi Sunil,
TV details:-
---------------------------
Thanks & Regards,
PRAVIN SHAKAR
Mobile: +91-7045361609
Landline: +91-22-66798739
Alcanet: 27588739
------------------------------------------------------------
IBRAHIM
Sent: 13 May 2015 14:33
To: VAIDYA, Deepak (Deepak)** CTR **; DAS, Sunil (Sunil)** CTR **;

(Nilanjan)** CTR

(ABDESSAMAD);

Hello all
Please send me the session details as I'll join it.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
To: DAS, Sunil (Sunil)** CTR **; IBRAHIM ABD EL NABY, Karim (Karim)** CTR
**;

(Nilanjan)** CTR

(ABDESSAMAD);

Hello Sunil,
Ok, we will share TV (Team Viewer 9) ID details before 15mins.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: VAIDYA, Deepak (Deepak)** CTR **; IBRAHIM ABD EL NABY, Karim (Karim)**
CTR **;

(Nilanjan)** CTR

(ABDESSAMAD);
Deepak,
Let us have joint session. Please you start ramses and share the desktop on
linc.
Let us start at 3PM today.
Regards,
Sunil
**;

(Nilanjan)** CTR

(ABDESSAMAD);
Hello Sunil,
Yes RAMSES is available (SSH session). Details is as below.
oamops/oam_oamops
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------

Ramamurthi

(Nilanjan)** CTR

(ABDESSAMAD);

Ritesh
(Ritesh)** CTR **
it is strange that no counter is available in 24 hrs. I could see only few

files
are not there.
Nilanjan,
Do you have ramses? Let us have a live login today.
Regards,
Sunil


(Nilanjan)** CTR

(ABDESSAMAD);

Ritesh
(Ritesh)** CTR **
Hello Sunil,
Attached the required logs,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
Update to Current Summary: 14/05/2015-> As per analysis it is concluded

that PM
files are getting deleted automatically from NodeB. Shared one script with
customer to get the info about PM files deletion from NodeB.

rvenkitt
it is strange that no counter is available in 24 hrs. I could see only few

files
are not there.
Nilanjan,
Do you have ramses? Let us have a live login today.
Regards,
Sunil
Sent: 13 May 2015 19:23
Karim,
Summary:
1. The alarms were generated because files was missing from nodeB itself.
We could
see all PM files were deleted in nodeB /pmfs directory.
2. We waited for one and half hrs. we could see nodeB generates PM file
exactly
every hr. So, no issue in nodeB.
3. I could see PM files in wms stats/observation/nodeB_name directory.
4. If wms tries to get PM file from nodeB using ftp, it will fail because
of
missing file.

cleaning /tmp
and /pmfs.
My recommendation.
1. Please change password of a nodeB so that no one can login. WMS does
not use
login and password for normal operation. So, no problem would be there from
nodeB

minutes in
nodeB. it will give us history of file and when it gets deleted.
Regards,
Sunil
Hi All,
script
Steps:
=========
generate pmFileCollection in logs directory.
which are
BR,
Pasha
60. 14-May-2015 12:07
nchatter
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; PASHA, D Hussain (D
Hussain)**
CTR **

AHMED
CTR **;

(Deepak)** CTR
**
we are expecting some alarm to be generated and script will collect files
status.
End of today is okay.
Regards,
Sunil
To: PASHA, D Hussain (D Hussain)** CTR **; DAS, Sunil (Sunil)** CTR **
AHMED
CTR **;

(Deepak)** CTR
**
Hello Sunil,Paha,
The script applied now, when should we stop it?.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
From: PASHA, D Hussain (D Hussain)** CTR **

AHMED
CTR **;

(Deepak)** CTR
Hi All,
script
Steps:
=========

which are
BR,
Pasha
Sent: 13 May 2015 19:23
CTR **

(Nilanjan)** CTR

(ABDESSAMAD);

Pravin

CTR **
Karim,
Summary:
1. The alarms were generated because files was missing from nodeB
itself. We
could see all PM files were deleted in nodeB /pmfs directory.
2. We waited for one and half hrs. we could see nodeB generates PM
file
exactly every hr. So, no issue in nodeB.
3. I could see PM files in wms stats/observation/nodeB_name

directory.
4. If wms tries to get PM file from nodeB using ftp, it will fail
because of
missing file.

cleaning
/tmp and /pmfs.
My recommendation.
1. Please change password of a nodeB so that no one can login. WMS

does not
use login and password for normal operation. So, no problem would be there
from
nodeB

minutes
in nodeB. it will give us history of file and when it gets deleted.
Regards,
Sunil
To: VAIDYA, Deepak (Deepak)** CTR **; DAS, Sunil (Sunil)** CTR **

(Nilanjan)** CTR

(ABDESSAMAD);

Pravin

CTR **
Thanks Deepack,
Hi Sunil,
Thanks to summarize our findings and our next steps,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534

**

(Nilanjan)** CTR

(ABDESSAMAD);

Pravin

CTR **
Hello All,
As discussed, remote connection is now closed.
Hello Karim,
As requested please find the session log.
---------------------------
Thanks & Regards,
Deepak Vaidya

Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
CTR **;

CTR **

(Nilanjan)** CTR

(ABDESSAMAD);
Hi Karim,
Session will start from 3 PM (IST).
---------------------------
Thanks & Regards,
PRAVIN SHAKAR
Mobile: +91-7045361609
Landline: +91-22-66798739
Alcanet: 27588739
------------------------------------------------------------
IBRAHIM
Sent: 13 May 2015 14:55
To: SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **; VAIDYA, Deepak (Deepak)**
CTR

(Ramamurthi)** CTR
**

(Nilanjan)** CTR

(ABDESSAMAD);
Hello Pravin
When you will start?!
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
CTR **;

CTR **

(Nilanjan)** CTR

(ABDESSAMAD);
Hi Sunil,
TV details:-
---------------------------
Thanks & Regards,
PRAVIN SHAKAR

Mobile: +91-7045361609
Landline: +91-22-66798739
Alcanet: 27588739
------------------------------------------------------------
IBRAHIM
Sent: 13 May 2015 14:33
To: VAIDYA, Deepak (Deepak)** CTR **; DAS, Sunil (Sunil)** CTR **;

(Nilanjan)** CTR

(ABDESSAMAD);
Hello all
Please send me the session details as I'll join it.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
**;

(Nilanjan)** CTR

(ABDESSAMAD);
Hello Sunil,
Ok, we will share TV (Team Viewer 9) ID details before 15mins.
---------------------------
Thanks & Regards,
Deepak Vaidya

Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: VAIDYA, Deepak (Deepak)** CTR **; IBRAHIM ABD EL NABY, Karim (Karim)**
CTR **;

(Nilanjan)** CTR

(ABDESSAMAD);
Deepak,
Let us have joint session. Please you start ramses and share the desktop on
linc.
Let us start at 3PM today.
Regards,
Sunil

**;

(Nilanjan)** CTR

(ABDESSAMAD);
Hello Sunil,
Yes RAMSES is available (SSH session). Details is as below.
oamops/oam_oamops
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
61. 15-May-2015 19:04
deepakva
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; DAS, Sunil (Sunil)** CTR **

(ABDESSAMAD);

Pravin

CTR
**; VAIDYA, Deepak (Deepak)** CTR **; PASHA, D Hussain (D Hussain)** CTR
**;
Hello Suni,
I performed audit on the pmObservationPeriod it's only 15min for 3 sites as

below
and other are 60min
Are these the same sites reporting 15min from the logs !?.
NAME IP SW pmObservationPeriod
DM_AR_U_2073_MzdCity27 10.235.158.90 NODE-B V13D3.0 EBC.01 15
DA_AR_U_2505_UpperYasatIsland 10.235.170.180 NODE-B V13D3.0 EC2.03

15
ET_AR_U_2766_GhumaisiaEast 10.235.157.79 NODE-B V13D3.0 EC2.03 15
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534

(ABDESSAMAD);

Pravin

CTR
**;
Ok Sunil, but what's the recommended is it 15mi or 1hr? Also when the
script will
be deivered.
Any outage will be caused when we apply this activity?
--
BR,
Karim
+971 (0) 56 345 4568
From: DAS, Sunil (Sunil)** CTR ** [sunil.das@alcatel-lucent.com]
Received: Friday, 15 May 2015, 12:58pm
[karim.ibrahim@alcatel-lucent.com]; Kumar, Kanipakam Vijaya K (Vijay)** CTR

**
[vijay.k.kumar@alcatel-lucent.com]
CC: 3G_ALU_Integ_UAE [3g_Alu_Integ_Uae@alcatel-lucent.com]; EL-MIDANY,

AHMED
(AHMED) [Ahmed.El-Midany@alcatel-lucent.com]; MERAD, ABDESSAMAD

(ABDESSAMAD)
[india-wcdma-utran-be@alcatel-lucent.com]; KHEDR, MAHMOUD (MAHMOUD)
[Mahmoud.Khedr@alcatel-lucent.com]; ABDEL-HALIM, SAYED (SAYED)
[Sayed.Abdel-Halim@alcatel-lucent.com]; AGRAWAL, Ritesh (Ritesh)** CTR **
[ritesh.agrawal@alcatel-lucent.com]; SHAKAR, Pravin Kumar (Pravin Kumar)**

CTR **
[pravin.shakar@alcatel-lucent.com]; VENKITTARAMANUJAM, Ramamurthi

(Ramamurthi)**
CTR ** [ramamurthi.venkittaramanujam@alcatel-lucent.com]; VAIDYA, Deepak
(Deepak)** CTR ** [deepak.vaidya@alcatel-lucent.com]; PASHA, D Hussain (D

Hussain)** CTR ** [d_hussain.pasha@alcatel-lucent.com]; CHATTERJEE,
Nilanjan
(Nilanjan)** CTR ** [nilanjan.chatterjee@alcatel-lucent.com]
Karim,
I could see some nodeBa are running on 1 hr and some are 15 minutes. So,
last
observation, wms was trying to extract files in odd time. it was some
3.47PM. I
suggested Pasha/Vijay to make a script to check, how many nodeBs are

running on 15
minutes interval and how many are in 1 hr.
Based on findings, let us move all nodeB to uniform period. Either 15

minutes or 1
hr. I would suggest 1 hr.
Regards,
Sunil
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; DAS, Sunil (Sunil)** CTR
**;
IBRAHIM ABD EL NABY, Karim (Karim)** CTR **

(ABDESSAMAD);

Pravin
CTR
**; VAIDYA, Deepak (Deepak)** CTR **; DAS, Sunil (Sunil)** CTR **; PASHA, D
Hussain (D Hussain)** CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Importance: High
Hello
Any progress here please.
--
BR,
Karim
+971 (0) 56 345 4568
From: IBRAHIM ABD EL NABY, Karim (Karim)** CTR ** [karim.ibrahim@alcatel-

lucent.com]
Received: Thursday, 14 May 2015, 6:04pm
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR ** [vijay.k.kumar@alcatel-

lucent.com];
DAS, Sunil (Sunil)** CTR ** [sunil.das@alcatel-lucent.com]

AHMED
(AHMED) [ahmed.el-midany@alcatel-lucent.com]; MERAD, ABDESSAMAD

(ABDESSAMAD)
[mahmoud.khedr@alcatel-lucent.com]; ABDEL-HALIM, SAYED (SAYED)

CTR **

(Ramamurthi)**
(Deepak)** CTR ** [deepak.vaidya@alcatel-lucent.com]; DAS, Sunil (Sunil)**

CTR **
[sunil.das@alcatel-lucent.com]; PASHA, D Hussain (D Hussain)** CTR **
[d_hussain.pasha@alcatel-lucent.com]; CHATTERJEE, Nilanjan (Nilanjan)** CTR

**
[nilanjan.chatterjee@alcatel-lucent.com]
Hello,
I can see that the script reporting the correct number of created sites and
also
the correct number of integrated site:
Created site ' 486
Integrated ' 287 , which is the same number of IP,
Check also the attached Audit.
Let me know your comments, and please Sunil advise for the parameters to be
checked for the PM duration time on WMS

Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
From: Kumar, Kanipakam Vijaya K (Vijay)** CTR **

(ABDESSAMAD);

Pravin

CTR
**; VAIDYA, Deepak (Deepak)** CTR **; DAS, Sunil (Sunil)** CTR **; PASHA, D
Hi Karim,
Attached document is IPLIST file. In that lot of ip's are

missing.
Ex:
ET_AR_U_2158_NashashWest:
EI_AR_U_2887_FertilMcb:
Please add appropriate ip addresses and follow steps to run the script.
Note: Please don't run get_iplist.sh
Steps:
=====
1. Please go inside "logs" directory.
command: cd pmFileCollection/logs/
2. delete all files inside "logs" directory
command: rm -f *
3. Please copy updated IPLIST file in "logs" directory.
4. come back to "pmFileCollection" directory.
command: cd ../
5. Once 4th step is done, then please run start.sh script.
which are
Thanks & Regards
-Vijay
Sent: 14 May 2015 18:32
(Nilanjan)**
CTR **; PASHA, D Hussain (D Hussain)** CTR **; Kumar, Kanipakam Vijaya K
(Vijay)**
CTR **

(ABDESSAMAD);

Pravin

CTR
**; VAIDYA, Deepak (Deepak)** CTR **
Adding Vijay.
Karim,
We could observed followings.
1. Many nodeBs were not captured. There a problem with snapshot file
in
wms. Vijay will send you IPlist file. please update and start the script
again.
2. Many nodeB files are deleted. When wms ask for file, naturally, it
will
fail.
3. All nodeBs are not generating file in uniform rate. Some nodeB
generates
PM files at 15 minutes and some nodeB generates at 1 hr. I would suggest

to make
it uniform.
4. Wms is also not extracting PM files every hr. it extracts sometime

after
7 hrs or 10 hrs or sometime very late. It could be configuration issue. Can

you
please look at WMS user guide and configure PM file that should be
extracted at
every 1 hr?
Regards,
Sunil
To: CHATTERJEE, Nilanjan (Nilanjan)** CTR **; DAS, Sunil (Sunil)** CTR **;
PASHA,
D Hussain (D Hussain)** CTR **

(ABDESSAMAD);

Pravin

CTR
Hello all,
Attached another file,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
**;
PASHA, D Hussain (D Hussain)** CTR **

(ABDESSAMAD);

Pravin

CTR

Hello Karim,
Seems the file is damaged.
The rar file is not unzipping can you please check & remake the zip & send
it.
This is happening to 2-3 more colleagues.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
To: DAS, Sunil (Sunil)** CTR **; PASHA, D Hussain (D Hussain)** CTR **

AHMED

CTR **;

(Deepak)** CTR
**
Hello Pasha,Sunil
I stopped the script, attached the log, Please waiting your feedback,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
62. 18-May-2015 16:20

deepakva
Sent: Monday, May 18, 2015 5:37 PM

(ABDESSAMAD);

Pravin

CTR
**;
Hello Sunil
I modified the 3 sites, Please update about next AP and recovery action,.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
Sent: Saturday, May 16, 2015 6:14 PM

(ABDESSAMAD);

Pravin

CTR
**;
Ok Sunil, I'll align it tomorrow morning, pleaae update about the script
and our
next step.
--
BR,
Karim
+971 (0) 56 345 4568
Received: Saturday, 16 May 2015, 8:24am

**

AHMED

(ABDESSAMAD)

CTR **

(Ramamurthi)**

Nilanjan
I could see below one extra one nodeB as well. Anyway, please make all
1hr.
Regards,
Sunil

(ABDESSAMAD);

Pravin
CTR
**;
Hello Suni,
I performed audit on the pmObservationPeriod it's only 15min for 3 sites as

below
and other are 60min
Are these the same sites reporting 15min from the logs !?.
NAME IP SW pmObservationPeriod
DM_AR_U_2073_MzdCity27 10.235.158.90 NODE-B V13D3.0 EBC.01 15
DA_AR_U_2505_UpperYasatIsland 10.235.170.180 NODE-B V13D3.0 EC2.03

15
ET_AR_U_2766_GhumaisiaEast 10.235.157.79 NODE-B V13D3.0 EC2.03 15
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534


(ABDESSAMAD);

Pravin

CTR
**;
Ok Sunil, but what's the recommended is it 15mi or 1hr? Also when the
script will
be deivered.
Any outage will be caused when we apply this activity?
--
BR,
Karim
+971 (0) 56 345 4568
63. 18-May-2015 16:27

deepakva
Update to Current Summary: 18/05/2015-> While checking found that PM
OBSERVATION
PERIOD for NodeB are different, so suggested customer to make it uniform

for
1Hour.
64. 20-May-2015 07:14

deepakva
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **

(ABDESSAMAD);
ABDEL-HALIM, SAYED (SAYED); AGRAWAL, Ritesh (Ritesh)** CTR **; DAS, Sunil
(Sunil)** CTR **; SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **;
VENKITTARAMANUJAM,
Ramamurthi (Ramamurthi)** CTR **; VAIDYA, Deepak (Deepak)** CTR **; PASHA,
D
Dears,
I stopped the trace and all logs available @/home/wcdma/Etisalat_UAE/1-

5667178 on
the china ftp server,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
Sent: Tuesday, May 19, 2015 9:58 AM

(ABDESSAMAD);
VENKITTARAMANUJAM,
D
Hello Suni,Vijay,
Script applied now and will send you the log shortly, attached HFB as
requested,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534

(ABDESSAMAD);
VENKITTARAMANUJAM,
D
Hi Karim,
Here is the updated script. Please follow below steps
Note: Please remove existing pmFileCollection directory and

pmFileCollection.tar
file from WMS server.
command: rm -rf pmFileCollection*

Steps:
=========
which are
Thanks & Regards
-Vijay
Sent: 18 May 2015 19:40

To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; Kumar, Kanipakam Vijaya K
(Vijay)** CTR **

(ABDESSAMAD);

Pravin

CTR
**;
Please share HFB for today.
One more observation from last script log. Few nodeB did not have ip
address. It
may be possible that few nodebs might have missed. Vijay will send a
script.
Please run and get us script log as Vijay suggests.
Regards,
Sunil

(ABDESSAMAD);

Pravin

CTR
**;
Hello Sunil
I modified the 3 sites, Please update about next AP and recovery action,.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534
Sent: Saturday, May 16, 2015 6:14 PM

(ABDESSAMAD);

Pravin

CTR
**;
Ok Sunil, I'll align it tomorrow morning, pleaae update about the script
and our
next step.
--
BR,
Karim
+971 (0) 56 345 4568
Received: Saturday, 16 May 2015, 8:24am

**

AHMED

(ABDESSAMAD)

CTR **

(Ramamurthi)**

Nilanjan
I could see below one extra one nodeB as well. Anyway, please make all
1hr.
Regards,
Sunil
Update to Current Summary: 20/05/2015-> While checking found that PM

OBSERVATION
PERIOD for NodeB are different, so suggested customer to make it uniform

for
1Hour.
65. 20-May-2015 09:48

nchatter
Update to Current Summary: 20/05/2015-> Script output shared to TEC by

local team.
Awaiting TEC feedback
66. 21-May-2015 09:18

nchatter
Update to Current Summary: 21/05/2015-> TEC sent mail to local team to

collect few
more occurence sample suing the script
67. 21-May-2015 09:23

nchatter

collect few
more occurence sample using the script
68. 21-May-2015 09:25

deepakva

(ABDESSAMAD);
VENKITTARAMANUJAM,
D

Hello,
Please send me these 9 nodebs I'll check if any issue from my side.
Also are there any findings why we have this behaviour?.
I'll apply the script again morning ad share with you the logs.
--
BR,
Karim
+971 (0) 56 345 4568

nchatter

(ABDESSAMAD);
VENKITTARAMANUJAM,
D

Hello,
Please send me these 9 nodebs I'll check if any issue from my side.
Also are there any findings why we have this behaviour?.
I'll apply the script again morning ad share with you the logs.
--
BR,
Karim
+971 (0) 56 345 4568
From: Kumar, Kanipakam Vijaya K (Vijay)** CTR ** [vijay.k.kumar@alcatel-

lucent.com]
Received: Wednesday, 20 May 2015, 5:40pm
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR ** [karim.ibrahim@alcatel-

lucent.com]

AHMED

(ABDESSAMAD)

[ritesh.agrawal@alcatel-lucent.com]; DAS, Sunil (Sunil)** CTR **
[sunil.das@alcatel-lucent.com]; SHAKAR, Pravin Kumar (Pravin Kumar)** CTR

**

(Ramamurthi)**

Nilanjan
Hi Karim,
Here are my Observations from script logs.
1. All nodeb's are aligned to 60 min time duration.
2. There are 9 nodeb's which are majorly reporting alarms.
3. When I checked pm file collection in those 9 nodeb's, are very less

compared to
other nodebs (There are nodeb's having max collection of 100 pm files). We
dont
know why very less pm collection in these 9 nodeb's.
I wanted to run the script one more day and please send me the logs to
analyse
further.
Thanks & Regards
-Vijay
Sent: 20 May 2015 14:13

(ABDESSAMAD);
VENKITTARAMANUJAM,
D
Dears,
Any progress please.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-456 || ONNET:2205 5534

nchatter

nchatter

nchatter
73. 22-May-2015 04:06

deepakva

collect few
more occurence sample using the script
74. 26-May-2015 09:53

deepakva

(ABDESSAMAD);

Pravin
CTR
**;
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; DAS, Sunil (Sunil)** CTR **
Hello Kumar,
The value is " <CONFIG_ITEM name="pm_file_to_be_deleted" value="no" />"
Attached the config file for more info, Please answer the below question
for more
details
1-what's our next action?,
2- Are there any RC for this issue?,
3- Do we have idea why the alarm is not cleared and still active?,
4- Is this a SW issue?!
5- Are there a parameter modification needed?
6- Can we involve the TEC?.
Thanks,
--
BR,
Karim Ibrahim

M: +971 (0)56-354-4568 || ONNET:2205 5534

(ABDESSAMAD);

Pravin

CTR
**;
Hi Karim,
Still we are analyzing logs to find RC for this issue. But attached .xls
document
contains my updates on alarms which are generated on 25th May.
Here are some of my finding from 25th log file:
-----------------------------------------------------------
-> At the same time 10 to 14 same alarms are generating for same nodeb.
This I'm
checking with R&D team?
-> On one nodeb (nodeb name: ET_AR_U_243_Shams) up to 9 am files are

generated and
it showing in script log file collect at 9:45, But in 10 am log file its
showing
files are deleted.
-> On another nodeb (nodeb name: ET_AR_U_2125_GhayathiWestU900) alarm

generated @
11:02:03 and 11:02:02 But 11 am file is present on nodeb side. Don't know
whether
it is checking for 10am file or some thing else?
---------------------------------------------------------------------------
-------
------
Mean time Can you check and update us, What is the parameter value of
(<CONFIG_ITEM name="pm_file_to_be_deleted" value="xyz" />) under
/opt/nortel/config/utran/gpo/nodeb/pluginConfig.xml file in WMS Server?
Thanks & Regards
-Vijay (+919886588573)
"Don't take what people say about you, Take what you say about yourself."
________________________________________

(ABDESSAMAD);

Pravin

CTR
**;
Hello Kumar,
The logs available @ china server @ /home/wcdma/Etisalat_UAE/1-5667178
Please it's became very urgent to close this issue and find rhe RC and
clear the
existing active alarms on the NW, we have about 3K of alarm
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

(ABDESSAMAD);

Pravin

CTR
**;
Hello Kumar,
The issue not closed and the alarms still exist and we still don't receive
a RC or
recovery action, the script is running from 9am today and will update you
shortly
with the HFB and script output?
Are there any new update about the RC of this issue from last logs we
shared?!.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

(ABDESSAMAD);

Pravin

CTR
**;
Hi Karim,
Can you send us the latest HFB and script output to analyze...
OR
Is this Issue is closed???
Please update us...
Thanks & Regards
-Vijay (+919886588573)
________________________________________
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; IBRAHIM ABD EL NABY, Karim
(Karim)** CTR **

(ABDESSAMAD);

Pravin

CTR
**;
Karim,
Can you please send us latest HFB and script output. We are monitoring 9
nodeBs on
their PM file existence.
Regards,
Sunil

(ABDESSAMAD);
VENKITTARAMANUJAM,
D

Hi Karim,
Here is the list.
EI_AR_U_2637_HabshanGascoAdmin 10.235.154.164
ET_AR_U_0266_SalabikWest 10.235.154.182
ET_AR_U_0269_WRBuhasaNorth 10.235.157.77
ET_AR_U_2119_MirfaMzd1 10.235.158.36
ET_AR_U_2139_UmAlAsthanSouth 10.235.171.168
ET_AR_U_2532_WadiAlGhazalan 10.235.170.4
ET_AR_U_2532_WadiAlGhazalanU900 10.235.222.170
ET_AR_U_2766_GhumaisiaEast 10.235.157.79
ET_AR_U_2766_GhumaisiaEastU900 10.235.157.81
Red marked one is not reachable. Please check it.
Thanks & Regards
-Vijay
Update to Current Summary: 26/05/2015-> TEC team is checking RCA of this

issue.
75. 28-May-2015 15:32

deepakva

(Vijay)** CTR **

(ABDESSAMAD);

Pravin

CTR
**;
Karim,
We have seen similar issue in our Lab network. We have escalated to R&D for
further investigation. CRs are raised.
Regards,
Sunil

(ABDESSAMAD);

Pravin
CTR
**;
Importance: High
Dears,
Are there any feedback from TEC regarding this issue?!.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

(ABDESSAMAD);

Pravin
CTR
**;
Hello Kumar,
What's the number of CRs?, no any proposed action can be taken to stop
these alarm
of clear from the WMS?
Are there estimated time to receive the feedback from R&D.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

(ABDESSAMAD);

Pravin

CTR
**;
Hi Karim,
We are going to raise 2 CR's.
1. on NodeB: Why pm files are deleting from nodeb.
2. on WMS: Why repeated alarms are raising @ same time.
Thanks & Regards
-Vijay (+919886588573)
________________________________________
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; IBRAHIM ABD EL NABY, Karim
(Karim)** CTR **

(ABDESSAMAD);

Pravin
CTR
**;
Hello Kumar,
Any progress and answers for my questions please.
--
BR,
Karim
+971 (0) 56 345 4568
Update to Current Summary: 28/05/2015-> CR is rasied for this issue.
76. 29-May-2015 13:49

deepakva
77. 01-Jun-2015 12:43 ALCATEL-LUCENT PROPRIETARY

sunilkd
it looks like nodeB issue. moving to nodeB WG.

vkuma073
1. Because of network not in stable state OR its under integration stage,
nodebs
are rebooting or network configuration is changing in between we can

expect pm
file missing alarms on the WMS server.
2. As per current design, pm file in nodeB will be deleted if nodeB is
reset/reboot. if WMS could not extract PM file some time, WMS will raise
alarm as
file missing/not reached. so, it is expected behavior.
3. This alarm would be there in WMS server till your network is stable.
Time Tracking Entry Added - TSA4 diagnosis + TEC support

deepakva
80. 05-Jun-2015 11:47

deepakva
Sent: Friday, June 05, 2015 9:13 AM
(Vijay)** CTR **; VAIDYA, Deepak (Deepak)** CTR **

(ABDESSAMAD);

Pravin

CTR
**; PASHA, D Hussain (D Hussain)** CTR **; CHATTERJEE, Nilanjan
(Nilanjan)** CTR
**
Karim,
We are working a solution in code either in WMS or in nodeB. however, I

would like
to delete all old alarms from wms. Those are not value added any more.
2nd, till we get alternate solution in code, I would like to suppress

alarms.
Ramamurthy and Vijay,
Can you please work on followings.
1. How to delete all old alarms from wms?
2. How to suppress this alarm from reporting?
Regards,
Sunil
Sent: Friday, June 05, 2015 12:41 AM
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; VAIDYA, Deepak (Deepak)**
CTR **
(ABDESSAMAD);

Pravin

CTR

(Nilanjan)** CTR
Dears,
Again, the provided RC is not completed clear for us, how can we secure the
NW
from these alarms and how to stop it and what's the soln for it?
Any update about hard limit of alarms.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798

Sent: Wednesday, June 3, 2015 6:40 PM
CTR **

(ABDESSAMAD);

Pravin

CTR

(Nilanjan)** CTR
Hello Kumar
Thanks for your reply, but you mean by IPs changing every day?!, the
assigned IP
per site not changed anytime..
Also we are not having this alarms on 10 or 9 sites , you may mean the high
runners but we can say most of the sites are impacted..
Waiting your feedback and R&D feedback about the hard limit.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534
CTR **

(ABDESSAMAD);

Pravin

CTR

(Nilanjan)** CTR
Hi Karim,
There are 2 CR's raised from this AR.
1. On NodeB: PM files are deleted when nodeB reset/reboot.
2. On WMS: repeated alarms are raising.
About 1st CR which is raised on nodeb is expected behaviour and same thing
we
updated in AR.
As per my understanding nodeb ip's are changing on daily basis on this
network,
nodeb will reset to take effect of changes. So pm files will be deleted

when nodeb
reboot/reset.
From hfb file which you shared earlier, we observed that, on daily basis
there
are 8 to 10 nodeb's rebooted and respective alarms are raised on WMS

server.
As you said, If nodeb's are not rebooting then can you send me the full hfb
and
cfm (command file manager) files to analyse.
About 2nd CR: Still it's an issue and WMS team going to work on this.
But from customer end once network becomes stable, pm files will not be
deleted
and respective repeated alarms will stop raising.
About your question regarding (hard fault change value):
Still we are waiting for updates from R&D team.
Thanks & Regards
-Vijay
Sent: 03 June 2015 15:14
To: VAIDYA, Deepak (Deepak)** CTR **; Kumar, Kanipakam Vijaya K (Vijay)**
CTR **

(ABDESSAMAD);

Pravin

CTR

(Nilanjan)** CTR
Importance: High
Dear Kumar,
We are not doing daily resets on the nodebs to have all these alarms on
daily
based!!, so how we will work with alarms till ending of the swap!?
I my last mail I asked you that we cannot make monitor for the network on
due
these alarms,
What's the soln to delete them?!, what's the technical reason and RC to be
delivered to the customer?!. How we can stop these alarms?!
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

(ABDESSAMAD);

Pravin

CTR

(Nilanjan)** CTR
**; DAS, Sunil (Sunil)** CTR **; Kumar, Kanipakam Vijaya K (Vijay)** CTR **
Hello Karim,
Below is latest update on this issue: -
1. Because of network not in stable state OR its under integration stage,

nodebs
are rebooting or network configuration is changing in between we can expect

pm
file missing alarms on the WMS server.
2. As per current design, pm file in nodeB will be deleted if nodeB is

reset/reboot. if WMS could not extract PM file some time, WMS will raise
alarm as
file missing/not reached. so, it is expected behaviour.
3. This alarm would be there in WMS server till your network is stable.
---------------------------
Thanks & Regards,
Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
To: DAS, Sunil (Sunil)** CTR **; Kumar, Kanipakam Vijaya K (Vijay)** CTR **

(ABDESSAMAD);

Pravin

CTR
**;

Importance: High
Deara,
Any progress from R&D on this issue?, the alarms are repeated and we cannot
monitor on the WMS due to this large number of alarms
Any idea how to change the hard fault alarm value on the WMS a we are
getting the
below error, Appreciate your fast response,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534
Sent: Monday, June 1, 2015 1:23 PM
(Vijay)** CTR **

(ABDESSAMAD);

Pravin
CTR
**;
This issue is regularly is seen in Lab, one or other nodeB. R&D is
investigating. We are also running our script.
No break through yet.
Regards,
Sunil
To: DAS, Sunil (Sunil)** CTR **; Kumar, Kanipakam Vijaya K (Vijay)** CTR **

(ABDESSAMAD);

Pravin

CTR
**;

Hello Sunil,all
Any progress from the R&D regarding this issue,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET:2205 5534

vkuma073
Sent: Friday, June 5, 2015 4:23 PM
To: KHEDR, MAHMOUD (MAHMOUD); DAS, Sunil (Sunil)** CTR **
Cc: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; Kumar, Kanipakam Vijaya K
(Vijay)** CTR **; VAIDYA, Deepak (Deepak)** CTR **; 3G_ALU_Integ_UAE; EL-
MIDANY,
AHMED (AHMED); MERAD, ABDESSAMAD (ABDESSAMAD); INDIA-WCDMA-WMS-NPO-BE;
INDIA-WCDMA-UTRAN-BE; ABDEL-HALIM, SAYED (SAYED); AGRAWAL, Ritesh

(Ritesh)** CTR
**; SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **; PASHA, D Hussain (D
Hussain)**
CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **

Hi,
1. How to delete all old alarms from WMS?
Login WMS GUI with administrator username and password
a) From the Alarm manager window, follow the below procedure
b) Click and then drag on alarm rows from <alarm list> table view or
click
on <alarm list> table view then press Ctrl+A to select all alarm
c) Right click then select manual alarm clear option from shortcut
menu.
d) Check the attached below screenshot,
The below procedure to inhibit a specific alarm from WMS,
Select the menu item Fault -> Alarm Stream Rule Set
To create a new alarm rule set, click on the <new> button,
a) Type the rule name
b) Navigate to the <problem specific tab> then select the contains

in
alarm code drop down
c) Enter the alarm code OAM_0051_00005, which is file not found alarm
code (
OAM_0051_00005 )
d) Finally click on <save> button to save the rule definition
e) The rule will be activate If the rule is moved to <active rule set>
Service impact of inhibiting the specific alarm from WMS

GUI,
There is no specific impact by following the above
procedure,
1. Simply the specific alarm is not picked up by the WMS for showing
it
anywhere in the GUI
2. Still these alarm are generated from the NE so available in other
locations except wms GUI
3. Since this is a simple GUI rule , you can deactivate the rule
anytime to
restore the specific alarm for the WMS GUI
-BR
Ramamurthi V
Sent: Saturday, June 06, 2015 1:30 AM
To: VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; DAS, Sunil

(Sunil)** CTR **
Cc: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; VAIDYA, Deepak (Deepak)**
CTR **;
3G_ALU_Integ_UAE; EL-MIDANY, AHMED (AHMED); MERAD, ABDESSAMAD (ABDESSAMAD);
INDIA-WCDMA-WMS-NPO-BE; INDIA-WCDMA-UTRAN-BE; ABDEL-HALIM, SAYED (SAYED);

AGRAWAL,
Ritesh (Ritesh)** CTR **; KHEDR, MAHMOUD (MAHMOUD); SHAKAR, Pravin Kumar
(Pravin
Kumar)** CTR **; PASHA, D Hussain (D Hussain)** CTR **; CHATTERJEE,

Nilanjan
(Nilanjan)** CTR **

Dears.
Thanks to below steps, but its not a soln for our problem , we still
waiting a
clear RC and recovery soln for this issue and answer for all raised
questions
below.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
Sent: 08 June 2015 10:10

Ramamurthi
CTR **;

AGRAWAL,
(Pravin

Nilanjan
(Nilanjan)** CTR **
Karim,
Steps that are shared for cleaning alarms. It is work-around to come clean
on WMS.
We cant keep 10K alarms. As I communicated, we see some issue with WMS
which is
not retrieving files on time. when it retrieves, it tries to retrieve some

back
hrs files which are already deleted by nodeB reboot.
Solution we are trying to have as below:
1. WMS should retrieve only for current date and time. let it forgets old
files
which had not reached to WMS.
Problem with this solution:
1. Few files would be missing and NPO counter would be missing.
2. If the customer charges their customer based on NPO counter, there

would be
some missing revenue for the customer.
Or
1. Move PM file to persistence memory in nodeB. so that files exist

across reboot.
Problem with this solution
1. Alarm will not be completely removed because as below.
a. If nodeB restart at boundary of PM file generation, file will be

missing from
persistence memory. When WMS tries to retrieve missing files, it would not
be
there in nodeB and alarms would be generated.
b. If xccm/eccm removed physically, all files will be removed from

persistence
memory. It would generate alarms in wms.
Regards,
Sunil
Time Tracking Entry Added - TSA4 diagnosis + TEC support
82. 08-Jun-2015 15:43

deepakva

CTR **;

AGRAWAL,
(Pravin

Nilanjan
(Nilanjan)** CTR **
Hello Sunil
Thanks and I'm waiting you.
Yes applied,
No need to do any health checks on WMS,patchs,SW , no relation?! Can you

confirm?
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798

Ramamurthi
CTR **;

AGRAWAL,
(Pravin

Nilanjan
(Nilanjan)** CTR **
Karim,
Very few alarms would be there in any network.
As you are seeing high number of alarms, we need to find out some solution.
We are
working on. We will provide you some solution for you.
Mean time, can you please apply work-around as suggested by Ramamurthi?
Regards,
Sunil

CTR **;

AGRAWAL,
(Pravin

Nilanjan
(Nilanjan)** CTR **
Hello Sunil,
Do you mean that no RC/Soln for these alarms?!, I don't face this issue
with
anyother before NWs, Please are there any other NW have the same issue, is
it
related to SW version?!, we raised lot of question for this issue and tell
now we
don't have a clear answer..
Appreciate your usual support ,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
Sent: Monday, June 8, 2015 8:40 AM

Ramamurthi
CTR **;

AGRAWAL,
(Pravin

Nilanjan
(Nilanjan)** CTR **
Karim,
Steps that are shared for cleaning alarms. It is work-around to come clean
on WMS.
We can't keep 10K alarms. As I communicated, we see some issue with WMS
which is
not retrieving files on time. when it retrieves, it tries to retrieve some

back
hrs files which are already deleted by nodeB reboot.
Solution we are trying to have as below:
1. WMS should retrieve only for current date and time. let it forgets
old
files which had not reached to WMS.
Problem with this solution:
1. Few files would be missing and NPO counter would be missing.
2. If the customer charges their customer based on NPO counter, there

would
be some missing revenue for the customer.
Or
1. Move PM file to persistence memory in nodeB. so that files exist

across
reboot.
Problem with this solution
1. Alarm will not be completely removed because as below.
a. If nodeB restart at boundary of PM file generation, file will be

missing
from persistence memory. When WMS tries to retrieve missing files, it would
not be
there in nodeB and alarms would be generated.
b. If xccm/eccm removed physically, all files will be removed from
persistence memory. It would generate alarms in wms.
Regards,
Sunil
Sent: Saturday, June 06, 2015 1:30 AM
To: VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; DAS, Sunil

(Sunil)** CTR **
CTR **;

AGRAWAL,
(Pravin

Nilanjan
(Nilanjan)** CTR **

Dears.
Thanks to below steps, but it's not a soln for our problem , we still
waiting a
clear RC and recovery soln for this issue and answer for all raised
questions
below.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
To: KHEDR, MAHMOUD (MAHMOUD); DAS, Sunil (Sunil)** CTR **
MIDANY,

(Ritesh)** CTR
**; SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **; PASHA, D Hussain (D
Hussain)**
CTR **; CHATTERJEE, Nilanjan (Nilanjan)** CTR **
Hi,
1. How to delete all old alarms from WMS?
Login WMS GUI with administrator username and password
a) From the Alarm manager window, follow the below procedure
b) Click and then drag on alarm rows from <alarm list> table view or
click
on <alarm list> table view then press "Ctrl+A" to select all alarm
c) Right click then select "manual alarm clear" option from shortcut
menu.
d) Check the attached below screenshot,
The below procedure to inhibit a specific alarm from WMS,
Select the menu item "Fault" -> "Alarm Stream Rule Set"
To create a new alarm rule set, click on the <new> button,
a) Type the rule name
b) Navigate to the <problem specific tab> then select the "contains"

in
alarm code drop down
c) Enter the alarm code OAM_0051_00005, which is "file not found alarm
code" (
OAM_0051_00005 )
d) Finally click on <save> button to save the rule definition
e) The rule will be activate If the rule is moved to <active rule set>
Service impact of inhibiting the specific alarm from WMS
GUI,
There is no specific impact by following the above

procedure,
1. Simply the specific alarm is not picked up by the WMS for showing
it
anywhere in the GUI
2. Still these alarm are generated from the NE so available in other
locations except wms GUI
3. Since this is a simple GUI rule , you can deactivate the rule
anytime to
restore the specific alarm for the WMS GUI
-BR
Ramamurthi V
From: KHEDR, MAHMOUD (MAHMOUD)
Sent: 05 June 2015 3:09
MIDANY,

(Ritesh)** CTR
**; SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **; VENKITTARAMANUJAM,

Ramamurthi
(Ramamurthi)** CTR **; PASHA, D Hussain (D Hussain)** CTR **; CHATTERJEE,

Nilanjan
(Nilanjan)** CTR **
Subject: Re: AR 1-5667178/major/9926 DBS-WCDMA/Emirates Telecommunications
Hello Sunil,
This means partial NPO outageS in other way!
Best regards,
Mahmoud Khedr
Sent from my iPhone
On Jun 5, 2015, at 1:24 PM, DAS, Sunil (Sunil)** CTR **
<sunil.das@alcatel-lucent.com> wrote:
This alarm does not impact user data service; however, counter or NPO data
would
not be available for the duration for which file is missing.
Regards,
Sunil
CTR **;
DAS, Sunil (Sunil)** CTR **; IBRAHIM ABD EL NABY, Karim (Karim)** CTR **

(ABDESSAMAD);

Pravin
CTR

(Nilanjan)** CTR
**
Hi Sunil
Another point please, can you confirm that no service impcat of this
alarms.
--
BR,
Karim
+971 (0) 56 345 4568
From: IBRAHIM ABD EL NABY, Karim (Karim)** CTR ** [karim.ibrahim@alcatel-

lucent.com]
Received: Friday, 05 Jun 2015, 11:47am
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR ** [vijay.k.kumar@alcatel-

lucent.com];
VAIDYA, Deepak (Deepak)** CTR ** [deepak.vaidya@alcatel-lucent.com]; DAS,

Sunil
(Sunil)** CTR ** [sunil.das@alcatel-lucent.com]

AHMED

(ABDESSAMAD)

CTR **

(Ramamurthi)**
CTR ** [ramamurthi.venkittaramanujam@alcatel-lucent.com]; PASHA, D Hussain

(D

Nilanjan
Sunil,
Thanks, and hope we can recieve a feedback before Sunday morning for the 2
points
you mentioned.
--
BR,
Karim
+971 (0) 56 345 4568
83. 09-Jun-2015 09:16

deepakva
Update to Current Summary: 09/06/2015-> CRs have been rasied for this
issue.
84. 12-Jun-2015 10:24
deepakva
Sent: Thursday, June 11, 2015 4:32 PM
**;
CTR **;

AGRAWAL,
(Pravin
Kumar)** CTR **; PASHA, D Hussain (D Hussain)** CTR **
Hello Sunil,
Can you please let us know by when the fix can be delivered.
BR
NILANJAN CHATTERJEE
INDIA
On-NET:2758-8716
T:+91-22-66798716
M:+91-9820820019
85. 12-Jun-2015 14:49

deepakva
Update to Current Summary: 12/06/2015-> CRs have been rasied for this
issue.

nchatter

nchatter

sunitap
Hello WC,
Please change this AR product to /9926 DBS-WCDMA.
---------------------------
Thanks & Regards,

Deepak Vaidya
Mobile: +91 09926071114
Alcanet: 27532522
Landline: +91 755 4028300 ext. 27532522
------------------------------------------------------------
89. 16-Jun-2015 14:44

mohmadi
Update to Current Summary: June 16: Fix is awaited for Nodeb, awaiting TEC
update.

mohmadi
Sent: Monday, June 15, 2015 9:39 AM
(Nilanjan)**
CTR **; DAS, Sunil (Sunil)** CTR **; VENKITTARAMANUJAM, Ramamurthi

(Ramamurthi)**
CTR **
Cc: VAIDYA, Deepak (Deepak)** CTR **; 3G_ALU_Integ_UAE; EL-MIDANY, AHMED
(AHMED);
MERAD, ABDESSAMAD (ABDESSAMAD); INDIA-WCDMA-WMS-NPO-BE; INDIA-WCDMA-UTRAN-

BE;
ABDEL-HALIM, SAYED (SAYED); AGRAWAL, Ritesh (Ritesh)** CTR **; KHEDR,

MAHMOUD
(MAHMOUD); SHAKAR, Pravin Kumar (Pravin Kumar)** CTR **; PASHA, D Hussain
(D
Hussain)** CTR **
Hi Karim,
Here is the WMS server behaviour/Design:
-----------------------------------------------------
As per WMS server design, If nodeB is not reachable for some time (Example:
1hr)
and pm granularity period (Example: 15m) then it will try to poll every 15m
time
interval. Suppose nodeB connectivity down for 1hr and came to network after
1hr
and connectivity established between WMS and nodeB, then it will try to
fetch all
missed 4 files in that 1hr duration time and if anyone is missing OR all
are
missed then it will raise missing file alarm for all missed files in one
shot.
Resolution:
This is expected behaviour and there are no changes from

WMS team.
NodeB behaviour:
----------------------
Till now we are not persisting pm files, So whenever nodeB reboots/resets

pm files
getting deleted. But as per design nodeB as to persist pm files. As I

understand
xCCM/eCCM should keep pm files in persistent memory. So nodeB team is fixed

this
defect.
Thanks & Regards
-Vijay
Sent: Tuesday, June 16, 2015 4:57 AM
To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; CHATTERJEE, Nilanjan

(Nilanjan)**

(Ramamurthi)**
CTR **

(AHMED);

BE;

MAHMOUD
(D
Hussain)** CTR **

Hello Kumar,
Thanks, can you please answer my below questions,
1- Can you confirm its SW issue?!, if yes its on the node level or
WMS?
2- PM file depend on the OAM IP or traffic IP , as we have here 2

channel for
IUB, IP/VLAn for OAM, and IP/VLAN for traffic and if depend on OAM, and
relation
with the traffic?
3- I see you said the fix will be deleiverd to 15.3, and will be
disucsse?,
whats the status?.
4- Whats this fix do in details ?!,
5- Any other NW on L4.2 for the WMS having the same issue?!
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
Sent: Tuesday, June 16, 2015 4:03 PM

(Nilanjan)**
(Ramamurthi)**
CTR **
Cc: VAIDYA, Deepak (Deepak)** CTR **; INDIA-WCDMA-WMS-NPO-BE; INDIA-WCDMA-

UTRAN-BE
Hi Vijay,
As now I am the ticket owner, so do share me if any update on when will we

get fix
for this node B defect.
Thanks,
Mobile:+91 9870327804.
91. 18-Jun-2015 12:34

mohmadi
Update to Current Summary: June 18: This Node B software issue will be
fixed in
13.3, awaiting closure of the AR.

mohmadi
From: owner-india-wcdma-utran-be@LIST.ALCATEL-LUCENT.COM
[mailto:owner-india-wcdma-utran-be@LIST.ALCATEL-LUCENT.COM] On Behalf Of
Kumar,
Kanipakam Vijaya K (Vijay)** CTR **
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; KHEDR, MAHMOUD (MAHMOUD);
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; DAS, Sunil (Sunil)** CTR **;

(AHMED);

BE;

Pravin
Kumar (Pravin Kumar)** CTR **; PASHA, D Hussain (D Hussain)** CTR **
Please see my inline comments.
-Vijay
Sent: 17 June 2015 15:06
To: KHEDR, MAHMOUD (MAHMOUD); Kumar, Kanipakam Vijaya K (Vijay)** CTR **;

(AHMED);

BE;
Pravin
Dear Kumar,
Please update.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
Sent: Tuesday, June 16, 2015 3:27 AM

(Nilanjan)**

(Ramamurthi)**
CTR **

(AHMED);

BE;
MAHMOUD
(D
Hussain)** CTR **
Hello Kumar,
Thanks, can you please answer my below questions,
1- Can you confirm its SW issue?!, if yes its on the node level or
WMS?
[Vijay]: Yes, its a nodeb software issue.
2- PM file depend on the OAM IP or traffic IP , as we have here 2

channel for
IUB, IP/VLAn for OAM, and IP/VLAN for traffic and if depend on OAM, and
relation
with the traffic?
[Vijay]: PM files go to WMS. WMS is connect to NodeB via OAM IP.
3- I see you said the fix will be deleiverd to 15.3, and will be
disucsse?,
whats the status?.
[Vijay]: Going to be deliver to 15.3. Fix propagation to 13.3 (i.e. same

fix
giving in 13.3) is planned.
4- Whats this fix do in details ?!,
[Vijay]: PM files will be kept in persistent memory in NodeB. pm files will

not be
lost even if nodeb reboot/reset case. Due to this respective alarm will not
be
raised on WMS server.
5- Any other NW on L4.2 for the WMS having the same issue?!
[Vijay]: No issue with WMS server. Its working as per design (Design I
explained
below mail chain. Please ref).
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
93. 23-Jun-2015 09:12

mohmadi
Update to Current Summary: June23: This Node B software issue will be fixed
in

mohmadi
IBRAHIM

To: Kumar, Kanipakam Vijaya K (Vijay)** CTR **; KHEDR, MAHMOUD (MAHMOUD);

(AHMED);

BE;

Pravin
Hello Kumar,
Thanks for your feedback, when the fix will be ready and whats the NodeB
SW
name?!, is it included L13.3.C?
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
IBRAHIM

(AHMED);

BE;

Pravin
Hello Kumar,
Can you please answer my question?!.
Thanks,
[cid:image002.gif@01D09A22.DCE14220]
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798

95. 24-Jun-2015 09:41
mohmadi
in

mohmadi
Sent: Wednesday, June 24, 2015 10:51 AM
(Vijay)** CTR **; KHEDR, MAHMOUD (MAHMOUD); CHATTERJEE, Nilanjan

(Nilanjan)** CTR

(Ramamurthi)** CTR
**

(AHMED);

BE;

Pravin
Hello Kumar,
Any update on the Karim's query?

"when the fix will be ready and what's the NodeB SW name?!, is it included
L13.3.C?"
Thanks,
Mobile:+91 9870327804.
97. 24-Jun-2015 10:06

mohmadi
in
13.3.D, awaiting closure of the AR.

mohmadi
Sent: Wednesday, June 24, 2015 11:26 AM
(Karim)**
CTR **; Kumar, Kanipakam Vijaya K (Vijay)** CTR **; KHEDR, MAHMOUD
(MAHMOUD);
CHATTERJEE, Nilanjan (Nilanjan)** CTR **; VENKITTARAMANUJAM, Ramamurthi

(AHMED);
BE;

Pravin
Mohmadi,
Fix was delivered in 15.2. it is being regressed.
The fix will be delivered in 13.3.D.
Regards,
Sunil

mohmadi
100. 25-Jun-2015 11:11

mohmadi
in
13.3.D, awaiting closure of the AR.

mohmadi

(Nilanjan)** CTR
**; VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; DAS, Sunil

(Sunil)** CTR
**

(AHMED);

BE;

Pravin
Hello Karim,
Let us know if any other query on it or else can we close this AR.
Thanks,
Mobile:+91 9870327804.

mohmadi
To: CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; Kumar, Kanipakam Vijaya K

(Vijay)**
CTR **; KHEDR, MAHMOUD (MAHMOUD); CHATTERJEE, Nilanjan (Nilanjan)** CTR **;
VENKITTARAMANUJAM, Ramamurthi (Ramamurthi)** CTR **; DAS, Sunil (Sunil)**

CTR **

(AHMED);

BE;

Pravin
Dear Mohamdi
Keep the AR open till we deploy the SW and the issue solve
Hi Sunil,
The mentioned SW is GA?, is it deployed on other NW?!
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
103. 02-Jul-2015 10:00

mohmadi
Update to Current Summary: July 2: This Node B software issue will be fixed
in
13.3.D and plan is to deliver the fix part is end of July, awaiting closure
of the
AR.
104. 02-Jul-2015 10:00 ALCATEL-LUCENT PROPRIETARY

mohmadi

(Vijay)**

CTR **

(AHMED);

BE;

Pravin
Hello Sunil
I'm waiting your update,
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
To: IBRAHIM ABD EL NABY, Karim (Karim)** CTR **; CUTLERYWALA, Mohmadi
(Mohmadi)**
(MAHMOUD);

(AHMED);

BE;
Pravin
Kumar (Pravin Kumar)** CTR **; PASHA, D Hussain (D Hussain)** CTR **;
GOURAUD,
ALAIN (ALAIN)
Current working view is to deliver to 13.3.D. it is not yet build.
I am copying Alain, who is PJM for post DR5. If is critical and urgently,
Alain
can take decision to deliver to 13.3.C patch.
Regards,
Sunil
From: GOURAUD, ALAIN (ALAIN)
**;
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **; Kumar, Kanipakam Vijaya K

(Vijay)** CTR
**; KHEDR, MAHMOUD (MAHMOUD); CHATTERJEE, Nilanjan (Nilanjan)** CTR **;

(AHMED);

BE;

Pravin
Hello
So the plan is to deliver the fix part of LR13.3.D for end of July.
BR
Alain
105. 06-Jul-2015 10:40

mohmadi
Update to Current Summary: July 7: This Node B software issue will be fixed
in
of the
AR.

mohmadi
Sent: Monday, July 06, 2015 12:10 PM

(Nilanjan)** CTR

(Sunil)** CTR
**; GOURAUD, ALAIN (ALAIN)

(AHMED);

BE;

Pravin
Hi Karim,
If no more queries, can we proceed for the closure.
Thanks,
Mobile:+91 9870327804.

mohmadi
Sent: Monday, July 06, 2015 3:09 PM

(Vijay)**

CTR **;
GOURAUD, ALAIN (ALAIN)

(AHMED);

BE;

Pravin
Dear Mohamdi,
We should wait till the SW required is ready and GA,.
Thanks,
--
BR,
Karim Ibrahim
M: +971 (0)56-354-4568 || ONNET: 22341798
108. 03-Aug-2015 09:44

mohmadi
Update to Current Summary: Aug 3: This Node B software issue will be fixed
in
of the
AR.
109. 03-Aug-2015 09:44 ALCATEL-LUCENT PROPRIETARY

mohmadi
Sent: Monday, August 03, 2015 11:14 AM

(Nilanjan)** CTR

(Sunil)** CTR
**; GOURAUD, ALAIN (ALAIN)

(AHMED);

BE;

Pravin
Hello Karim,
Please share if any update on it.
Thanks,
Mobile:+91 9870327804.

mohmadi
From: GOURAUD, ALAIN (ALAIN)
Sent: Monday, August 03, 2015 12:18 PM
(Karim)**
(MAHMOUD);
(Ramamurthi)** CTR **; DAS, Sunil (Sunil)** CTR **

(AHMED);

BE;

Pravin
Hello,
LR13.3.D DR4 external delivery is planned wk35.5.
Then, to get it GA, I need to have a customer soak report.
For the moment, I do not have real commitment about customer soak, so the
GA is
not yet planned.
BR
Alain

mohmadi
Sent: Monday, August 03, 2015 3:57 PM
(Ramamurthi)** CTR **; DAS, Sunil (Sunil)** CTR **; GOURAUD, ALAIN (ALAIN);
CUTLERYWALA, Mohmadi (Mohmadi)** CTR **

(AHMED);

BE;

Pravin
Hello Mohamdi
As I mentioned before the closure can be done when the delivery be GA
BR
Karim
+971 56 354 4568
112. 11-Aug-2015 10:20

mohmadi
Update to Current Summary: Aug 11: This Node B software issue will be fixed
in
13.3.D and plan is to deliver the fix part is end of Aug, awaiting closure
of the
AR.
Add to log
Resolution
This Node B software issue will be fixed in 13.3.D
End of Assistance Request 1-5667178

View AR | AR without Proprietary | OLCS
New AR:
History | States | Assignment | Timetracking
View Attachments | Add Attachment
AR Text Search | More | CARES Home

AR63

Enviado por

Dados do documento

Descrição original:

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

AR63

Enviado por

Direitos autorais:

Formatos disponíveis

View AR | AR without Proprietary

Short Repeated File not arrived alarm increased on the network

Summary plan is to deliver the fix part is end of Aug, awaiting

State Resolved : Solution Provided - Awaiting Customer Approval

Service Request Remote Technical Support

Request Type Defect

No Change Request is linked to this AR

Instance 9926DBS WCDMA-AUH : In Service

Site Company Emirates Telecommunications Corporation

City Abu Dhabi

Country United Arab Emirates

Company Alcatel-Lucent : Open on behalf of Customer

Phone 971 56 354 4568 Email

Request Method Email-Eng

Reported 07-Apr-2015 12:36 AR Created 07-Apr-2015 12:41

Service Start 07-Apr-2015 12:36

Next Customer Contact 25-Jun-2015 14:30

Responded 07-Apr-2015 13:11 Respond Target 07-Apr-2015 13:36

Restored 07-Apr-2015 13:11 Restore Target 04-May-2015 07:02

Resolved 24-Jun-2015 10:09 Resolve Target 29-Jun-2015 07:02

Targets for Restore & Resolve have been extended by 22 days

Closed -- --- ----

Last Modified 11-Aug-2015 10:20 Modified By mohmadi

Covered Service TS 24x7 (Gold, Wireless Mobile Access)

Script This request is entitled to service.

Assignee NorP-WLS-WCDMA-vGlobal : mohmadi

Referred 1 TEC-WLS-WCDMA-BTS : vkuma073

Referred 2 NorP-WLS-WCDMA-vGlobal : mohmadi

From: "IBRAHIM ABD EL NABY, Karim (Karim)** CTR **"

Sent: 2015-04-07 10:36:17

To: ALU Support <support@alcatel-lucent.com>

Cc: "MERAD, ABDESSAMAD (ABDESSAMAD)"

<abdessamad.merad@alcatel-lucent.com>;"ABDEL-HALIM, SAYED (SAYED)"

<Sayed.Abdel-Halim@alcatel-lucent.com>;"EL-MIDANY, AHMED (AHMED)"

Subject: Etisalat UAE//Repeated File not arrived alarm increased on the

Current Summary : Repeated File not arrived alarm

(OAM_0051_00005)increased on the network, TEC Support needed to check if

also how to deal with it to be cleared,

Contact Surname : Karim

Contact Given Name : Ibrahim

Contact Phone :+971 56 354 4568

Contact Company : Alcatel-Lucent

Company : Emirates Telecommunications Corporation

Contract Number : OXIA 627085

Country : United Arab Emirates

City : Abu Dhabi

Site : ETISALAT ABU DHABI

Logs :HFB Attached,

Product Version : LR13.3W

LTE/WCDMA Integration Professional

META WLS Access Network (GNE EMEA)

ONNET: 2205 5534

Showing Investigation and Proprietary logs together in time order Show

Investigation Log and Proprietary Log

Outgoing E-mail to Karim (Karim)** CTR ** IBRAHIM ABD EL NABY

Workflow Status: Queued

Contact: Karim (Karim)** CTR ** IBRAHIM ABD EL NABY

To: "IBRAHIM ABD EL NABY, Karim (Karim)** CTR **"

Cc: "MERAD, ABDESSAMAD (ABDESSAMAD)" <abdessamad.merad@alcatel-lucent.com>,

"ABDEL-HALIM, SAYED (SAYED)" <Sayed.Abdel-Halim@alcatel-lucent.com>,

"EL-MIDANY, AHMED (AHMED)" <Ahmed.El-Midany@alcatel-lucent.com>,

Thank you for contacting the Alcatel-Lucent Welcome Center.

Please reference that number when contacting Alcatel-Lucent for follow-up.

From: "IBRAHIM ABD EL NABY, Karim (Karim) CTR "

Outgoing E-mail to Karim (Karim) CTR IBRAHIM ABD EL NABY

Contact: Karim (Karim) CTR IBRAHIM ABD EL NABY

To: "IBRAHIM ABD EL NABY, Karim (Karim) CTR "

From: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR

From: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR

From: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR

To: CUTLERYWALA, Mohmadi (Mohmadi) CTR

From: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR

From: IBRAHIM ABD EL NABY, Karim (Karim) CTR

To: CUTLERYWALA, Mohmadi (Mohmadi) CTR

From: IBRAHIM ABD EL NABY, Karim (Karim) CTR

To: CUTLERYWALA, Mohmadi (Mohmadi) CTR

To: IBRAHIM ABD EL NABY, Karim (Karim) CTR