Escolar Documentos
Profissional Documentos
Cultura Documentos
Troubleshooting Common
Ericsson GSM Alarms
NOTE:
Prior to troubleshooting this or any other Ericsson alarm, always perform a right
click on the alarm in Netcool and chose the ―View alarms at this Location‖
option to view all alarms at this site to see if this could be a secondary affect
caused by power, maintenance, ECT and always search CTS to see if there is an
existing Ticket on the site for this or any related issue.
Slide 6
Recommended Troubleshooting
Steps
SKCAB07 SCRMCAT021 MO=RXOCF-55 SLOGAN=OML FAULT
RXASP:MO=RXOTG-55;
Connecting to SKCAB07... (Use 'quit' to logoff)
<rxasp:mo=rxotg-55;
RADIO X-CEIVER ADMINISTRATION
MANAGED OBJECT ALARM SITUATIONS
END
As we can see the MO’s in this TG show multiple OML faults indicating a down or
dirty T1. The next step is to status the primary DIP for the site to determine if it is
blocked.
Slide 8
<dtstp:dip=55rb3;
DIGITAL PATH STATE
Use the DTSTP:DIP=55rb3; command to status the DIP. This printout shows the
state of the DIP is ABL or Automatically Blocked and has an AIS (Alarm
Indication Signal).
This indicates that this site has a dead T1 and a Ticket should be created and
escalated to Telco to test the circuit.
Slide 9
END
<dtstp:dip=55rb3;
DIGITAL PATH ST ATE
Open a CTS ticket on this site from the OML fault alarm. Paste this information
along with the RXASP printout and the Granite (ED) path into the Ticket and
send it to Telco to have the circuit tested. No further actions will be needed at this
point.
If the DTSTP printout shows the DIP as WO or Working, the DIP may be working
but taking errors. In this case proceed on to step 4, checking the quality of the
DIP.
NOTE: The primary DIP is usually numbered the same as the RXOTG.
However, sometimes the OML links are placed onto the secondary DIP at
the site. If this is the case, the primary DIP may show WO when a portion
of the site is down (when in reality it is the second DIP that has faulted out).
You may need to determine what the secondary DIP is (if it exists) and
status it. It is important to get the correct DIP information to the field / telco
group so the correct circuit will be tested.
Slide 10
INCOMING DIRECTION
OUTGOING DIRECTION
INCOMING DIRECTION
OUTGOING DIRECTION
FRAME SLIPS
The next step would be to check the quality of the DIP by running the
DTQUP:DIP=___; command to see if it is taking errors
The quality printout shows this DIP is taking errors in the N-UAS section which is
the Unavailable seconds for unacceptable and degraded performance level for
the near end (incoming direction). In this case a ticket will need to be generated
and sent to telco as well with this printout, the RXSP printout and the ED path.
Any errors in these fields indicates a faulty T1 that will need to be ticketed and
tested by telco.
If the DIP counters read all zeros with no errors, the DIP appears clean and you
have verified the secondary DIP’s, then create a CTS ticket to send to telco with
your notes and troubleshooting steps and have them test the circuit to verify. If
the circuit tests clean and the OML faults are still present then forward the ticket
to the field to have them check the TRX’s. If the circuit test clean and the OML
faults clear, wait about 20 minutes and status the site again. If the OML faults
clear then the site has restored and you can close the TT. If the faults return then
send the ticket to the field tech with your troubleshooting notes to have him
investigate the issue.
It is important to note at this point that the CF/TG number are not always the
same as the DIP number. Secondary T1’s will have a number different than that
of the TG. There can be 2 or more DIP’s assigned to a CF/TG. In these cases
you will need to run a few extra commands to find the correct DIP number to
status and include in your ticket. Consider the following example using the same
commands used on the previous example.
Slide 11
<rxasp:mo=rxotg-90;
RADIO X-CEIVER ADMINISTRATION
MANAGED OBJECT ALARM SITUATIONS
END
Status the TG using the RXASP command. As we can see there are OML faults
on this CF so the next step is to status the DIP as we did in the last example.
Slide 12
As we see here the DTSTP printout indicates the DIP is in the WO or working
state so we will check the DIP quality printout for errors using the DTQUP
command.
Slide 13
INCOMING DIRECTION
OUTGOING DIRECTION
INCOMING DIRECTION
OUTGOING DIRECTION
FRAME SLIPS
As shown in the DIP quality printout there are no reported errors on this DIP. The
next step would be to look for a secondary DIP on this TG and then status it to
see if it is down or taking errors.
Slide 14
RXAPP Command
<rxapp:mo=rxotg-90;
RADIO X-CEIVER ADMINISTRATION
ABIS PATH STATUS
MO
RXOTG-90
The first command to run when looking for a secondary DIP is the
RXAPP:MO=RXOTG-__; This will show you the range of RBLT3 device numbers
attached to each DIP listed in sequential order.
Look at the result printout and find the range of RBLT or RBLT3 devices listed.
Usually it is easy to tell if there is more than one DIP assigned because the RBLT
range will have a noticeable skip in the numbering. In this case, the devices start
with RBLT3-1560 through 1583 (first DIP). Then jumps to RBLT3-2160 through
2183 (second DIP). Then Jumps again to RBLT3-5496 through 5513 (third DIP).
To find the DIP number form these devise ranges simply divide any number in
the device range by 24 and that will give you your DIP number. 1560/24=65 so
60RB3 is your first DIP. Then
2160/24=90, so 90RB3 is your second DIP.
5496/24=229 so 229RB# will be your third DIP. Now we can status all three DIP’s
to see which one is faulty.
Slide 15
Look at the result printout and find the range of RBLT or RBLT3 devices listed.
Usually it is easy to tell if there is more than one DIP assigned because the RBLT
range will have a noticeable skip in the numbering. In this case, the devices start
with RBLT3-1560 through 1583 (first DIP). Then jumps to RBLT3-2160 through
2183 (second DIP). Then Jumps again to RBLT3-5496 through 5513 (third DIP).
To find the DIP number form these devise ranges simply divide any number in
the device range by 24 and that will give you your DIP number. 1560/24=65 so
60RB3 is your first DIP. Then
2160/24=90, so 90RB3 is your second DIP.
5496/24=229 so 229RB3 will be your third DIP. Now we can status all three DIP’s
to see which one is faulty
Slide 16
<dtqup:dip=65r b3;
DIGITAL PATH QUALITY
INCOMING DIRECTION
OUTGOING DIRECTION
INCOMING DIRECTION
OUTGOING DIRECTION
FRAME SLIPS
Looking at both the status and the quality printouts for 65RB3 we can tell that this
DIP is up and clean with the state as WO and the error counters at all zeros.
Since we already know that 90RB3 is clean from the previous troubleshooting
steps, we will now status 229RB3.
Slide 17
<dtqup:dip=229rb3;
DIGITAL PATH QUALITY
INCOMING DIRECTION
OUTGOING DIRECTION
INCOMING DIRECTION
OUTGOING DIRECTION
FRAME SLIPS
As we can see this DIP is ABL (auto blocked) and the counters are registering
several errors. This will be the DIP that you will put in the ticket and retrieve the
ED path for. From here Create a Ticket in CTS and put the RXASP printout with
this DIP information and the ED path for this DIP and send it to telco.
Slide 18
END
During a possible outage situation where you have multiple sites showing OML
fault off the same BSC you can run the RXASP:MOTY=RXOCF; (you can
replace CF with TG, TRX, TS, ect..). This command will give you a printout of all
the CF’s that are in alarm with the site and condition for a quick count of how
many sites are affected.
Slide 19
DTSTP:DIP=ALL,STATE=ABL;
<dtstp:dip=all,state=abl;
DIGITAL PATH ST ATE
Recommended Troubleshooting
Steps
1. Log into the appropriate Complex/BSC
and status the DIP using the
DTSTP:DIP=____; (81RB3 in this case)
Command to check and see if the DIP is
down or taking errors.
Slide 22
Status DIP
Connecting to RVCAB08... (Use 'quit' to logoff)
<rxasp:mo=rxotg-81;
NOT ACCEPTED
UNREASONABLE VALUE
(0)MO=RXOTG-81
<dtstp:dip=81rb3;
DIGITAL PATH STATE
As we can see here the DIP is ABL and the State is AIS (alarm indication signal).
When troubleshooting this alarm you can also begin, as I have done here, be
running the RXASP command and use the DIP number as the TG number since
often times the DIP number and the TG number are the same. This may be a
shortcut to correlating a site and TG to your DIP. You can cross reference the
info in the switch (which we will cover next) or in ED to check accuracy. In this
case The DIP is not the TG number so we will have to find the site/devices the
DIP is connected to the long way by checking the devices and SNT (switching
Network Terminal) it is connected to.
Slide 23
The first step to researching the DIP is to find and status the SNT. The fist
command you need to run is the DTSTP:DIP=____; command to find the SNT.
With this we can see that the SNT is ETM3-2. with that in mind we can now
query the SNT to see all the DIP’s connected to it and the devises connected to
them.
Slide 24
3. Status the SNT for the DIP's and their Device ranges
NTCOP:SNT=EMT3-2;
<ntcop:snt=etm3-2;
SWITCHING NETWORK TERMINAL CONNECTION DATA
To find all the DIP’s connected to this SNT and their range of devises connected
to them, you will need to run the NTCOP:SNT=EMT3-2; command. Scroll
through the DIP's connected until you find the one you are looking for. In this
case 81RB3.
Note: Some data (DIPS) were removed from this printout for spacing reasons.
Slide 25
3. Status the SNT for the DIP's and their Device ranges
NTCOP:SNT=EMT3-2; Cont.
109RA3 RALT3-2616&&-2639 43
78RB3 RBLT3-1872&&-1895 51
79RB3 RBLT3-1896&&-1919 52
80RB3 RBLT3-1920&&-1943 53
81RB3 RBLT3-1944&&-1967 54
82RB3 RBLT3-1968&&-1991 55
83RB3 RBLT3-1992&&-2015 56
84RB3 RBLT3-2016&&-2039 57
85RB3 RBLT3-2040&&-2063 58
86RB3 RBLT3-2064&&-2087 59
87RB3 RBLT3-2088&&-2111 60
88RB3 RBLT3-2112&&-2135 61
89RB3 RBLT3-2136&&-2159 62
90RB3 RBLT3-2160&&-2183 63
91RB3 RBLT3-2184&&-2207 64
92RB3 RBLT3-2208&&-2231 65
93RB3 RBLT3-2232&&-2255 66
94RB3 RBLT3-2256&&-2279 67
95RB3 RBLT3-2280&&-2303 68
96RB3 RBLT3-2304&&-2327 69
97RB3 RBLT3-2328&&-2351 70
98RB3 RBLT3-2352&&-2375 71
99RB3 RBLT3-2376&&-2399 72
6RTG3 RTGLT3-144&&-167 81
7RTG3 RTGLT3-168&&-191 82
8RTG3 RTGLT3-192&&-215 83
SNT EQLEV PROT SDIP SUBSNT DEFPST SNTP MODE
ETM3-2 1 2ETM3 0 XM-0-0-6 2176
1 XM-0-0-17 0
END
Now that we have found our DIP and its device range (located to the right of the
DIP number in the printout) we can status this device range. The devise range
numbers are the numeric value configured in the switch and the site for all 24
devises connected to that DIP.
Note: Some data (DIPS) were removed from this printout for spacing reasons.
Slide 26
This shows the status of the devise range which we can see is ABL. Also it
shows us that the devises are provisioned for those time slots under the config
column with the PC or P (provisioned Configured and Provisioned) next to them.
If they were not configured it would show NP (Not Provisioned). It is important to
note the Config status as if they were listed as NP then this DIP has not yet been
provisioned in the Switch and the only further action would be to send a Minor TT
to the switch to have them turn this DIP down until provisioned so we don’t keep
getting alarms on it.
From here we can now find the TG and site connected to the DIP.
Slide 27
END
To find the TG and the site from the previous info, run the
RXMDP:MOTY=RXOTS,DEV=RBLT3-1952; command. This can be ran on any
provisioned device in the range. Also, you can replace the TS (time slot) for TRX.
What this output shows us is that the there is a timeslot allocated to this rblt3
deice and it is RXOTS-79-9-4. 79 is your TG number, 9 is your TRX number and
4 is the timeslot number. With this in mind we can now run the
RXASP:MO=RXOTG-79; command since we know this is on TG 79 from the
printout. This will of course give us the site ID and the alarm situation for that TG.
Slide 28
END
Our status here shows that this TG appears to be alarm free. However we know
this is not the case. With Ericsson, when you have a secondary DIP that goes
down, it may not always show up in the alarm printout for the RXASP command
but that doesn’t mean it’s not in alarm. We can view all the radios and the
timeslots and their status by running the RXMSP:MO=RXOTG-79,SUBORD;
command to verify that this TG does in fact have a bad T1.
Slide 29
From this Printout we can see the TRX’s, subordinate timeslots, and their status.
As we look we can see that in the BTS column there are several timeslots that
are DIS or disabled as well as the CONF column where you can see the same
timeslots listed as UNCONF or unconfigured along with the LMO column with the
HEX code stating an issue. At this point with all the information we have we
would create a CTS ticket to send to Telco with the DTSTP, RXASP, and the
RXMSP along with the correct ED path for the circuit to be tested.
Looking at this we see that not all the timeslots are in order or on the same
radio. This is done to split the rescores from the different T1’s to each sector for
redundancy purposes.
Slide 30
7. RXMSP:MO=RXOTG-79,SUBORD; Cont.
RXOTS-79-6-6 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-6-7 OPER 0000 0000 0840 DIS UNCONF
RXOTX-79-6 OPER 0000 0000 0000 ENA ENA
RXOTRX-79-7 OPER 0000 0000 STA
RXORX-79-7 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-0 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-1 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-2 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-3 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-4 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-5 OPER 0000 0000 0000 ENA ENA
RXOTS-79-7-6 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-7-7 OPER 0000 0000 0840 DIS UNCONF
RXOTX-79-7 OPER 0000 0000 0000 ENA ENA
RXOTS-79-9-0 OPER 0000 0000 0000 ENA ENA
RXOTS-79-9-1 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-9-2 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-9-3 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-9-4 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-9-5 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-9-6 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-9-7 OPER 0000 0000 0840 DIS UNCONF
RXOTX-79-9 OPER 0000 0000 0000 ENA ENA
RXOTRX-79-10 OPER 0000 0000 STA
RXORX-79-10 OPER 0000 0000 0000 ENA ENA
RXOTS-79-10-0 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-1 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-2 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-3 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-4 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-5 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-6 OPER 0000 0000 0840 DIS UNCONF
RXOTS-79-10-7 OPER 0000 0000 0840 DIS UNCONF
RXOTX-79-10 OPER 0000 0000 0000 ENA ENA
END
Slide 31
Recommended Troubleshooting
Steps
1. Retrieve alarm printout from parent RXOTG
END
MO BTSSWVER
RXOCF-195 ERA-G04-R08-V01
RU RUREVISION RUSERIALNO
5 BGM1361001/3 R3A B991781311
RUPOSITION RULOGICALID
C:0 R:C SH: 1 SL: 37 FC FCU_01 0
RU RUREVISION RUSERIALNO
7 SEB1121095/1 R5B TU85160324
RUPOSITION RULOGICALID
C:0 R:C SH: 8 SL:--- CABI 2206 0
REPLACEMENT UNITS
MO BTSSWVER
RXOTX-195-0 ER A-G04-R08-V01
RU RUREVISION RUSERIALNO
0
RU RUREVISION RUSERIALNO
0
Reference the fault code given from our documentation to view the fault and see
what are the next steps to take. From our documentation we can see that this is
a VSWR alarm
Recommended Troubleshooting
Steps
1. Right click on the alarm in Netcool and
chose the ―View Alarms At This Location‖
option to see if there are secondary or
correlated faults that may be causing the
Alarm.
1A. If there are no secondary or correlated
alarms, search CTS on the site for
previously opened tickets.
MO CELL CHGR
RXOTG-91 SD0379Y 0
SD0379Y 1
END
From looking at the alarm we do not have the TG number to status the alarm
situation. However, we can see the Cell ID in the alarm. From that we can get the
TG number. By looking at the alarm we see in the text that the alarm is on
sd0379 on sector ―Y‖. We can query the cell with the site and sector information.
To find the correct TG to a cell in these alarms you must first run the
RXTCP:CELL=SD0379Y,MOTY=RXOTG; command. This will give you the TG
ID from the cell ID and the sector. We can now see from the printout that the
correct TG to status is 91 and status the TG with the RXASP command.
Slide 39
END
We can now see from the RXASP printout that there are internal faults on this TG
in 2 of the radios. They are on RXOTX 91-5 and 91-4. From here we can check
the status of the sectors and get our fault codes for the problem. Basically
working this issue like any other internal fault problem. You will need to run the
RXMFP:MO=RXOTG-91,SUBORD,FAULTY; command to get your fault codes
for these devises. We will run this command next.
Slide 40
MO BTSSWVER
RXOCF-91 ERA-G04-R08-V01
RU RUREVISION RUSERIALNO
0 BOE 602 17/1 R1B/A TU86267283
RUPOSITION RULOGICALID
C:0 R:C SH: 6 SL: 10 DX DXU_22 0
RU RUREVISION RUSERIALNO
1 BFL 119 437/1 R1E TR42305300
RUPOSITION RULOGICALID
C:1 R:C SH: 7 SL: 0 CD CDU_L8 0
RU RUREVISION RUSERIALNO
2 SEB 112 1147/1 R2A BK41017805
RUPOSITION RULOGICALID
C:0 R:C SH: 9 SL:--- CABI 2250 TRX 0
REPLACEMENT UNITS
59
Slide 41
RU RUREVISION RUSERIALNO
0
RUPOSITION RULOGICALID
MO BTSSWVER
RXOTX-91-5 ERA-G04-R08-V01
RU RUREVISION RUSERIALNO
0
RUPOSITION RULOGICALID
END
<
We already know from the RXASP printout that the faults are internal on
RXOTX91-4 and 91-5. From here we can see that the faults codes on RXOTX-
91-4 and 91-5 are fault code class 1B2. We can now refer to our documentation
to see what this fault is and if it can be cleared remotely or if it will need a ticket
to be dispatched to the field.
Slide 42
From our documentation we can see that this is a CDU power limits exceeded
fault. As the procedure indicates, there is no remote action that can fix this issue.
At this point you would create a ticket in CTS and send it to the field with the
RXASP, and the RXMFP printouts and a statement stating the problem.
It is important to note that the RXASP printout will not always display active
alarms but their could still be resources down in the sector. To check this we
would run the RXMSP command for this TG.
Slide 43
END
Again if there are no alarms displayed on the RXASP command then we check
the sectors to see if the resources are available. In this case we can see the
sector is OOS and needs attention. Often times if a secondary DIP goes down,
the Cell Logic Availability alarm will present itself with no OML fault or other
alarms in Netcool or in the RXASP printout.
Slide 44
Recommended Troubleshooting
Steps
1. Log into the appropriate BSC to verify the alarm with the
RXOTG command.
<rxasp:mo=rxotg-32;
RADIO X-CEIVER ADMINISTRATION
MANAGED OBJECT ALARM SITUATIONS
END
From the RXASP printout we can see that the permanent fault is on RXOTRX-
32-8 and 32-9. We can status the sector to confirm the ratios status if desired
with the RXMSP command. You can always attempt to restore the radio (or radio
function depending on the MO, TX, RX) by blocking the TRX, testing it, and then
unblocking it. This will give the radio another chance to load and restore. It may
restore for 10 or 15 minutes and then go back into fault. If this happens send
ticket to the field explaining that you have attempted unsuccessfully to restore it.
This is the case more often then not, and this will require either hardware
replacement or a hard reset at the site. We will now go over the procedure to
restore the TRX.
NOTE: If the permanent faults are accompanied by OML faults in this printout,
investigate the issue as a bad T1.
Slide 46
MO STATE RESULT
RXOTX-32-8 COM EXECUTED
RXOTS-32-8-0 COM EXECUTED
RXOTS-32-8-1 COM EXECUTED
RXOTS-32-8-2 COM EXECUTED
RXOTS-32-8-3 COM EXECUTED
RXOTS-32-8-4 COM EXECUTED
RXOTS-32-8-5 COM EXECUTED
RXOTS-32-8-6 COM EXECUTED
RXOTS-32-8-7 COM EXECUTED
RXORX-32-8 COM EXECUTED
RXOTRX-32-8 COM EXECUTED
END
To try and attempt to restore the TRX you must first block it down along with all
its subordinate devices. Use the RXBLI:MO=RXOTRX-32-8,SUBORD: command
to accomplish this. The Subord on the end of the command is to make sure that
all devices within the TRX are down. When you run this command you will notice
that the switch capitalize the command before any other output is given. It is
asking you to confirm your request to block. You will need to enter a ; and then
return to confirm. Then it will give you the printout you see here confirming that
the TRX is blocked. The next step is to test the TRX with the RXTEI command.
Slide 47
MO RESULT
RXOTRX-32-8 ORDERED
END
Run the RXTEI command to test the TRX. This will usually take a minute or 2 to
run and then it will give you the results. Either a pass or fail.
Slide 48
MO RESULT BTSSWVER
RXOTRX-32-8 LOADING FAILED ERA-G04-R08-V01
END
MO RESULT BTSSWVER
RXOTRX-32-8 TEST WAS PERFORMED ERA-G04-R08-V01
NO FAULT INDICATIONS
END
When the test is complete it will printout one of these 2 responses. From these
we can see the pass or fail indications. If it returns as failed the next step would
be to create a CTS ticket with the RXASP, and test result printouts and send it to
the field. If it comes back passed then wait a couple of minutes and status the
sector with the RXMSP command and status the TG with the RXASP command
to insure that the sector has restored.
It is important to note at this point that the alarm in Netcool may clear after
blocking and unblocking even though the problem has not gone away. Also, If the
test passes and the sector clears there is a good chance that the alarm and the
alarm condition will return in 15 or 20 minutes. In that case create a ticket and
send it to the field with the printouts and all troubleshooting steps taken.
Slide 49
Typically, these are just ―Rip and Ship‖ alarms. They are usually on equipment
either outside of the cabinet (I.E. Generators, Tower lights and amps, antenna,
ect…) or separate from the BTS equipment (rectifiers, fuse panels, door alarms,
ect..) They can be viewed in a printout with the ALLIP:ACL=EXT; command.
NOTE: Although not considered External faults. Any temperature alarm, High
Temp or Low Temp alarms can be treated much the same way. Since there is
nothing we can do remotely for them, they will just need to be ticketed and sent
straight out to the field. They can also be viewed in the ALLIP printouts.
Slide 50
Recommended Troubleshooting
Steps
Connec ting to SDCAB08... (Use 'quit' to logoff)
<allip:alcat=ext;
ALARM LIST
MO RSIT E CLASS
RXOCF-78 SD 0366 2
EXTERNAL ALARM
RECTIFIER 24V+ MINOR
RECT -48V MINOR
MO RSIT E CLASS
RXOCF-68 SD 0339 2
EXTERNAL ALARM
RECTIFIER 24V+ MINOR
END
Run the ALLIP:ALCAT=EXT; command to view the all external alarms in the
BSC. You will have to scroll through and find the site for which the Netcool alarm
has been generated for. Since we already know the fault from the additional
information in Netcool we can match it in the alarm printout. Since the these
alarms can not be fixed or restored remotely, you would now need to create a
CTS ticket, paste the allip information in the ticket and send it to the field tech. If
the alarm is not present in the external alarm list, these alarms can also be view
in the A2 or major alarm list by running the ALLIP:ACL=A2; as well. This will just
give you all the major alarms on the BSC and will probably be a much longer list.
Slide 51
Recommended Troubleshooting
Steps
1. Run the RXASP:MO=RXOTG-181&-180;
<rxasp:mo=rxotg-181&-180;
RADIO X-CEIVER ADMINISTRATION
MANAGED OBJECT ALARM SITUATIONS
END
With Mains Fail or commercial power alarms there is no remote action to recover
from this. These will require a CTS ticket to be dispatched to the field. Typically,
this is done after waiting about 20 minutes from the alarm presentation time. The
waiting period is to insure that the power does not come back shortly after the
alarm presents itself. This is common in regions that are experiencing extreme
weather events. The alarm printout can be viewed by running the RXASP
command on the affected CF as shown in this slide. Paste this printout in the
CTS ticket to send to the field tech.
Slide 53
MO RSITE AL AR M SLOGAN
RXOCF-181 LA3109 MAINS FAILURE
MO RSITE AL AR M SLOGAN
RXOCF-180 LA3109 MAINS FAILURE
END
It is possible that the alarm condition may not present itself in the RXASP
command. This is especially true with alarms that have ― Commercial Power
Failure‖ in the text. In this case you may need to view the ALLIP printout. They
can be in the ALLIP:ALCAT=POWER; or =EXT; or ACL=A1; or A2 depending on
the configuration.
Slide 54
Recommended Troubleshooting
Steps
1. Retrieve alarm printout from parent RXOTG to determine
which RXOTS MO(s) are affected
<rxasp:mo=rxotg-25;
RADIO X-CEIVER ADMINISTRATION
MANAGED OBJECT ALARM SITUATIONS
END
RXOTS (Timeslots) can generate TS SYNC FAULT alarms when the span takes
slips, or the path between the transcoder and the TRX is disturbed (ie congestion
in subrate switch). Generally, the RXOTS MO’s will show OPER, but the
corresponding TCH’s will show BLOC. To clear the TS faults, you must block,
loop test, and deblock the affected RXOTS MO(s). It is also helpful to check the
DIP for errors to resolve the origin of the problem.
Here we see that RXOTS-25-3-2 has faulted
If the RXOIS is in alarm PERMANENT FAULT, proceed directly to document
―RXOIS: PERMANENT FAULT‖. A faulty RXOIS can cause RXOTS problems.
In general, if a site only has 2 or 3 TS in fault, you should be able to clear them.
If all the TS under a TRX are down or multiple (more than 7) are down on the
site, additional troubleshooting will be required.
Slide 56
MO STA TE RESULT
RXOTS-25-3-2 COM EXECUTE D
MO RESULT
RXOTS-25-3-2 ORDERED
END
<
COMMAND SESSION SUSPENDED
MO RESULT BTSSWVER
RXOTS-25-3-2 TEST WAS PERFORMED ERA-G04-R08-V01
NO FAULT INDICATIONS
END
Test the affected RXOTS MO with the RXTEI command. After a few seconds, a
result printout should appear with ―NO FAULT INDICATIONS‖ as seen here
Slide 58
MO RESULT
RXOTS-25-3-2 TEST SUCCESSFUL
END
Run a Loop-Test on the affected RXOTS MO ). This tests continuity between the
transcoder and the TRX/TS. The Result should be ―TEST SUCCESSFUL‖. Then
unblock the TS and check it for a status. If the result comes back loop test failed,
try the test one more time. Sometimes it will still come back. If it fails out again.
Unblock the TS and then cut a ticket to the field for a possible hardware hard
reset or replacement.
Slide 59
MO STA TE RESULT
RXOTS-25-3-2 PREOP ORDERE D
<rxble:mo=rxots-25-3-2;
MO STA TE RESULT
RXOTS-25-3-2 PREOP EXECUITE D
Unblock the affect TS. It will show ORDERED, then after a few seconds,
EXECUTED
Slide 60
Wait a few seconds after unblocking so the TS can reset and then status the TS.
It should read operational. If the TS does not come back after a few attemps to
status it and all the DIPs on the CF are clean. Create a TT and send it to the field
with all of your troubleshooting steps and printouts and send it to the field.
Slide 61
A threshold alarm from the BSC triggered when a certain number of traffic
channels are continuously busy or unavailable. These are usually due to
secondary faults or conditions at the equipment or site they are originating from.
T1 failure, radio issues, ect… These are not alarm conditions within the BSC,
rather they are just informational alarms telling a certain number of traffic
channels are down. There is no remote troubleshooting remedy for this condition.
The condition can be cleared manually by clearing the traffic channel alarm data
in the BSC.
Slide 62
Recommended Troubleshooting
Steps
1. Retrieve the traffic channel seizure
information.
<rlvap;
CELL SEIZURE SUPERVISION OF LOGICAL CHANNELS
ALARMED OBJECTS DATA
CONTINUOUSLY BUSY CHANNELS
CHANNEL CELL STATE
TCH-58855 SF0323Z BLOC
TCH-58856 SF0323Z BLOC
END
Use the RLVAP; command to view the counter for the traffic channels in alarm.
From the printout we can see which site and sector they belong to. In this case
SF0323Z. Again these are usually from a secondary condition which has most
likely alarmed at the cell site and equipment level. The next step is to clear the
channel data from the counter.
Slide 63
<rlvap;
CELL SE IZURE SUPE RVIS ION OF LOGICA L CHANNELS ALA RMED
OBJE CTS DA TA
CONTINUOUSLY BUSY CHA NNE LS
CHA NNEL CELL STATE
NONE
END
<
To clear the alarm you must clear the counters for the channels. Use the
RLVAP:CHTYPE=TCH; command. You can check you work if you like by running
the RLVAP command again to see if the counters have cleared as shown here.
The alarm should clear from Netcool after a few minutes.
Slide 64
CP AP COMMUNICATION FAULT
CP AP COMMUNIC ATION FAULT
AP/CP faults can come in for a wide range of issues as both critical and major.
The can be verified by running the ALLIP for both A1 and A2. The severity of
these alarms is not always represented well by netcool meaning just because it
presents as a major in netcool it still may be a critical issue. CP issue tend to be
more critical and less common then AP faults.
Slide 65
Recommended Troubleshooting
Steps
1. Verify the alarm using ALLIP on A1 and A2
<allip:ac l=a1;
ALARM LIST
END
From the ALLIP A1 we can see that the AP process has stopped. This will
require an immediate ticket to the Switch and a call as well. Also, report to the
Outage management team. If the AP or CP have gone single sided, as in this
case, they will need to send a SIR notification for lack of redundancy. Also, check
the ALLIP A2 printout as some of the alarms will only present as majors even
though they are critical.
Slide 66
2. Check ALLIP A2
A2/APZ "DNCOB08_L000403" 859 071213 1105
CP AP COMMUNICATION FAULT
FAULT
NETWORK FAULT
RP EM RPTYPE TYPE
0 0
FAULT
NETWORK FAULT
RP EM RPTYPE TYPE
0 0
END
From here we can see that CP AP communications are down, the AP is not
redundant and is down. Paste these in the ticket along with the A1 printout to
send to the switch.
It is important to note that not all AP alarms are not this serious. Most are majors
with process errors or faults that can just be sent to the switch without callout.
However, anytime you lose redundancy with either the AP or CP, a callout will
need to be made and the Outage Management team advised.
Slide 67
Recommended Troubleshooting
Steps
1. Retrieve alarm printout from parent RXOTG
<RXASP:MO= RXOTG-63;
END
MO ST AT E RESULT
RXOTS-63-0-0 COM EXECUTED
END
<RXTEI:MO=RXOTS-63-0-0;
MO RESULT
RXOTS-63-0-0 ORDER ED
END
<
RADIO X-CEIVER ADM INISTRAT ION
TEST O F MAN AGED OBJ ECT R ESULT
MO RESULT BTSSWVER
RXOTS-63-0-0 T EST WAS PERFORM ED ER A-G03-R01-V01
END
<RXLTI:MO=R XOT S-63-0-0;
MO RESULT
RXOTS-63-0-0 T EST SUCC ESSFUL
END
Block the affected RXOTS MO(s). Test the affected RXOTS MO(s) (NOT
REQUIRED, BUT RECOMMENDED) After a few seconds, a result printout
should appear with ―NO FAULT INDICATIONS. Run a Loop-Test on the affected
RXOTS MO(s). This tests continuity between the transcoder and the TRX/TS.
The result should be ―TEST SUCCESSFUL‖. If RESULT = ―ABIS PATH
UNAVAILABLE‖, you may have a faulty DIP or the DIP resources have not been
assigned correctly. If RESULT = ―TEST PASSED‖, the fault may have just been
transient. Proceed with unblocking
Slide 70
3. Unblock the TS
RXBLE:MO=R XOTS-63-0-0;
MO STATE RESULT
RXOTS-63-0-0 PREOP ORDERED
END
MO STATE RESULT
RXOTS-63-0-0 OPER EXECUTED
END
Unblock the affected RXOTS MO(s). It will show ORDERED, then after a few
seconds, EXECUTED if you are successful. Otherwise it will just return a NOOP
result. At that point you would have to create a ticket and send it to the field.
Slide 71