Punjab IFMS

Tata Consultancy Services confidential 1
PUNJAB IFMS/IWDMS
PRODUCTION ENVIRONMWENT
ADMINISTRATION GUIDE
FOR
APPLICATION SERVERS
Tata Consultancy Services confidential

Table of Contents
1. Introduction..........................................................................................................................................................................3
2. Architectural Layout.............................................................................................................................................................4
3. Layer wise Summary.............................................................................................................................................................5
4. Web Servers..........................................................................................................................................................................6
a. Installations
b. Configurations
c. Load Balancing with Sticky Sessions
d. Test cases
5. Portal Servers.......................................................................................................................................................................... 7
6. Application Servers............................................................................................................................................................... .9
a. Installations
b. Configurations
c. WebLogic Clustering
d. Profiling
e. Test cases
7. Veritas Cluster Servers............................................................................................................................................................13

a. Installations
b. Configurations
c. Administration
d. User Configurations
e. Test cases
8. Logs...........................................................................................................................................................................................15
a. Application Logs (ifms.log)
b. Application Server Logs
c. Web Server access & error logs
d. Archival of logs (Pending)
9. IP wise details guide...................................................................................................................................................................16
10. Fail Over Situations and Remedies.............................................................................................................................................17

1. Introduction
Punjab IFMS/IWDMS/PORTAL production site has below listed configured architecture in brief.
Machine HP Proliant
Operating System Red Hat Linux 5
Application Servers 4 [2 Active , 2 Passive]
Portal Servers 2 [1 Active , 1 Passive]
Alfresco Server & ESB 2 [1 Active , 1 Passive]

2. Architectural Layout
 Diagram
Internet Access
IWDMS Access
Point
H/W LB
H/W LB
IFMS Access Point

192.168.20.51 192.168.20.52
IFMSPortal1Domain IFMSPortal1Domain
MS1 MS2 MS1 MS2

H/W LB MS3 MS4 MS3 MS4
Portal1Domain Portal1Domain
MS5 MS6 MS5 MS6
MS7 MS8 MS7 MS8

Portal1 (VCS Group 3 - Portal1 (VCS Group 3 -
Active) Passive)
Apache
Web Server(IWDMS)
192.168.20.53 192.168.20.55 192.168.20.54 192.168.20.56
IFMS Domain IFMS Domain Digigov Domain Digigov Domain
MS1 MS2 MS5 MS6 MS1 MS2 MS5 MS6
IFMS Domain IFMS Domain Digigov Domain Digigov Domain

App1 (VCS Group 1 - App3 (VCS Group 1 - App2 (VCS Group 1 - App4 (VCS Group 2 -
Active) Passive) Active) Passive)
ContentManageme ContentManagemen
nt1 t2 SAN
192.168.20.83 192.168.20.84
Alfresco Domain Alfresco Domain Mounting
MS1 MS1 Points
Administrator Administrator
ESB Domain ESB Domain
MS1 MS1
Administrator Administrator

3. Layer wise Summary
1. Hardware Load Balancer

a. A physical device that shares load between Web Servers , Application Servers.
b. In this case , HLB will share load between two active servers (Acc. To Veritas cluster) of IFMS , which in turn shares load
between eight instance of Weblogic Application Servers.
2. Web Servers
a. A Software that works for , load balancing between Application Servers , static content serving with sticky sessions.
b. Two web servers will be serving all the requests for IFMS application from one Hardware load balancer.
c. Both web servers will share the load of all the requests between 8 Weblogic Application Servers instances.
d. Currently IFMS is not using any webserver. While IWDMS is still using Webserver.
3. Application Servers
a. An actual JVM run Weblogic Application Server , on which J2EE Web Application is deployed.
b. Punjab Production site has total 32 WebLogic Application Server’s instance , of which 16 instances are allocated to IFMS
and 16 are to IWDMS Divigov.
c. Out of 16 Application Server’s instance , 8 Instance are in Active position and another 8 are in Passive Position for IFMS and
in same manner out of other 16 Application server’s instance, 8 Instance are in Active position and another 8 are in Passive
Position for Divigov.
d. Thus , exactly 8 Weblogic server’s instance will be active and running for IFMS in this site and similarly 8 Weblogic server’s
instance will be active and running for Digigov.
e. Active and Passive modes are controlled and maintained by Veritas Clustering of Symentec.

4. Web Servers
Web Server Installation

Web Server Machine Physical IP Installation Dir Configfile Shared Module
WS1 App1 192.168.20.53 /etc/httpd /etc/httpd/conf/httpd.conf wl_mod_22.so
Web Server Configuration

Web Server Netting IP Physical IP Load Balancing Ips
WS1 192.168.20.53 192.168.20.206 , 192.168.20.208 : 7002,7003,7004,7005
WS2 10.10.20.34 192.168.20.54 192.168.20.206 , 192.168.20.208 : 7002,7003,7004,7005
WS3 10.10.20.36 192.168.20.55 192.168.20.206 , 192.168.20.208 : 8002,8003,8004,8005
WS4 192.168.20.56 192.168.20.206 , 192.168.20.208 : 8002,8003,8004,8005
5. Application Servers
WebLogic Installation for IFMS

Machine Bea_home Node manager Home Managed Server Log Path
pbifmsapp /opt/Oracle/Middlewa /opt/Oracle/Middleware/wlserver_10.3/com /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/IfmsMS1/l
1 re mon ogs
/app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/IfmsMS2/l
ogs
ogs
ogs
pbifmsapp /opt/Oracle/Middlewa /opt/Oracle/Middleware/wlserver_10.3/com /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/IfmsMS5/l
2 re mon ogs
ogs
ogs
ogs
pbifmsapp /opt/Oracle/Middlewa /opt/Oracle/Middleware/wlserver_10.3/com /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS9/
3 re mon logs
/app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS1
0/logs
/logs
2/logs
/opt/Oracle/Middlewar /opt/Oracle/Middleware/wlserver_10.3/comm /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS1
pbifmsapp e on 3/logs
4
4/logs
5/logs
6/logs

WebLogic Installation for Digigov

Machine Bea_home Node manager Home Managed Server Log Path
pbifmsapp /opt/Oracle/Middlew /opt/Oracle/Middleware/wlserver_10.3/com /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovM
1 are mon S1/logs
/app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovMS
2/logs
3/logs
4/logs
pbifmsapp /opt/Oracle/Middlew /opt/Oracle/Middleware/wlserver_10.3/com /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovM
2 are mon S5/logs
/app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovM
S6/logs
7/logs
/app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovM
S8/logs
pbifmsapp /opt/Oracle/Middlew /opt/Oracle/Middleware/wlserver_10.3/co /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovMS
3 are mmon 9/logs
/app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/Digigov
MS10/logs
11/logs
12/logs
pbifmsapp /opt/Oracle/Middlewa /opt/Oracle/Middleware/wlserver_10.3/com /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/DigigovMS
4 re mon 13/logs
14/logs
15/logs
16/logs
WebLogic Configuration(IFMS)
Machine WebLogic URL Admin URL Configuration Dir
Instance
App1 AdminServer 192.168.20.206:7001 N.A. /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/ AdminServer
App1 IfmsMS1 192.168.20.206:7002 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/IfmsMS1
App2 AdminServer 192.168.20.208:7001 N.A. /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/AdminServer
App3 AdminServer 192.168.20.206:7001 N.A. app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/AdminServer
App4 AdminServer 192.168.20.208:7001 N.A. app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp4/servers/AdminServer

WebLogic Configuration (Digigov)

Machine WebLogic URL Admin URL Configuration Dir
Instance
App1 AdminServer 192.168.20.206:8001 N.A. /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp1/servers/
AdminServer
App1 DigigovMS1 192.168.20.206:8002 192.168.20.206:8001 /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp1/servers/
DigigovMS1
DigigovMS2
DigigovMS3
App1 DigigovMS4 192.168.20.206:8005 192.168.20.206:8001 /app2/Oracle/Middleware/user_ projects/domains/ DigigovDomainApp1/servers/
DigigovMS4
App2 AdminServer 192.168.20.208:8001 N.A /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp2/servers/AdminServ
er
DigigovMS5
App2 DigigovMS6 192.168.20.208:8003 192.168.20.208: 8001 /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp2/servers/
DigigovMS6
DigigovMS7
DigigovMS8
App3 AdminServer 192.168.20.206: 8001 N.A. /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp3/servers/AdminServ
er
DigigovMS9
DigigovMS10
DigigovMS11
DigigovMS12
App4 AdminServer 192.168.20.208: 8001 N.A. /app2/Oracle/Middleware/user_projects/domains/DigigovDomainApp4/servers/AdminServ
er
DigigovMS13
DigigovMS14
DigigovMS15
DigigovMS16
Memory Configuration (IFMS)

Machine WebLogic Instance Xms Xmx Permgen MaxPerm
App1 AdminServer 4096m 4096m 1024m 1024m

App1 IfmsMS1 4096m 4096m 1024m 1024m
App1 IfmsMS2 4096m 4096m 1024m 1024m

App1 IfmsMS3 4096m 4096m 1024m 1024m
App1 IfmsMS4 4096m 4096m 1024m 1024m

App2 IfmsMS5 4096m 4096m 1024m 1024m
App2 IfmsMS6 4096m 4096m 1024m 1024m
App2 IfmsMS7 4096m 4096m 1024m 1024m

App2 IfmsMS8 4096m 4096m 1024m 1024m
App3 IfmsMS9 4096m 4096m 1024m 1024m
App3 IfmsMS10 4096m 4096m 1024m 1024m
App3 IfmsMS11 4096m 4096m 1024m 1024m
App3 IfmsMS12 4096m 4096m 1024m 1024m


App4 IfmsMS13 4096m 4096m 1024m 1024m
App4 IfmsMS14 4096m 4096m 1024m 1024m

App4 IfmsMS15 4096m 4096m 1024m 1024m
App4 IfmsMS16 4096m 4096m 1024m 1024m
Memory Configuration (Digigov)

Machine WebLogic Instance Xms Xmx Permgen MaxPerm

App1 DigigovMS1 4096m 4096m 1024m 1024m



6. Veritas Clusters
Veritas Cluster Group 1 Management IP :- 192.168.20.205

App1 (Active) App3 (Passive)
Container Ips Ports MS App Container Ips Ports MS App
IfmsDomainApp1 192.168.20.53 IfmsDomainApp3 192.168.20.55
192.168.20.206 7001 AdminServer 192.168.20.206 7001 AdminServer
192.168.20.206 7002 IfmsMS1 PIFMS 192.168.20.206 7002 IfmsMS9 PIFMS


DigigovDomainApp1 DigigovDomainApp3
192.168.20.206 8002 DigigovMS1 192.168.20.206 8002 DigigovMS9

App2 (Active) App4 (Passive)
IfmsDomainApp2 192.168.20.54 IfmsDomainApp4 192.168.20.56

DigigovDomainApp2 DigigovDomainApp4


Portal1 (Active) Portal2 (Passive)
192.168.20.83 192.168.20.84
AlfrescoDomainIcm1 192.168.20.210 7001 AdminServer AlfrescoDomainIcm2 192.168.20.210 7001 AdminServer
EsbDomainIcm1 192.168.20.210 8001 AdminServer EsbDomainIcm2 192.168.20.210 8001 AdminServer

Veritas Testcases
Running Active
Running Passive
Fault
OS Shutdown
Pre Action Status POST Action Status
App1 App3 App1 App3
Testcase
I I I I D D D D I I I I D D D D I I I I D D D D I I I I D D D D
1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4 1 2 3 4
[1] Switch over to
passive machine
manually
[2] Offline passive
Not Applicable machine manually Not Applicable
[3] Offline active
Not Applicable machine manually Not Applicable
[4]Manually killed
process of wls
instance
[5]Manually
shutdown of a wls
instance
[6]Manually
shutdown of passive
machine
7. Application Log
URL Executed from Server Managed Servers Machine Name and IP IFMS Log Path
IFMS App. pbifmsapp1 IfmsMS1 pbifmsapp1 and 192.168.20.53 /extra/logs/IFMSLogs/AppServer1/ifmslog
IFMS App. IfmsMS2 pbifmsapp1 and 192.168.20.53 /extra/logs/IFMSLogs/AppServer1/ifmslog

IWDMS pbifmsapp1 DigigovMS1 pbifmsapp1 and 192.168.20.53 /extra/logs/DigiGOVLogs/AppServer1/

App.
IWDMS DigigovMS2 pbifmsapp1 and 192.168.20.53 /extra/logs/DigiGOVLogs/AppServer1/
App.

App.

App.

App.

App.

App.

App.

App.

App.

App.
App.

App.

App.

App.

App.
8. IP wise Details
IP wise Details
Content IP Apache Server Virtual IP Managed IP
pbifmsportal1 Liferay Portal Server A 192.168.20.51
pbifmsportal2 Liferay Portal Server B 192.168.20.52
App1 Application Server A 192.168.20.53 192.168.20.53 192.168.20.206 192.168.20.205
App2 Application Server B 192.168.20.54 192.168.20.54 192.168.20.208
App3 Application Server C 192.168.20.55 192.168.20.55 192.168.20.206 192.168.20.207
App4 Application Server D 192.168.20.56 192.168.20.56 192.168.20.208
ICM1 Integrtion Content Mgmt A 192.168.20.83 192.168.20.210

ICM2 Integrtion Content Mgmt B 192.168.20.84 192.168.20.210
DB1 Database A 192.168.20.59 192.168.20.203
DB2 Database B 192.168.20.60 192.168.20.203
DB3 Database C 192.168.20.61 192.168.20.204
DB4 Database D 192.168.20.62 192.168.20.204
9. Fail Over Scenarios and remedies
Sr. No. Scenario Automatic Process Manuall Process

1 Any of the Web Start Backup Process
Server goes fail
2 Any Machine goes [1] Start Backup Web Server.
fail. [2] Restart and Repair the machine and check the Veritas Configurations
3 Any WebLogic Veritas will switch over [1] Figure out and resolve the issue which failed the WL.
Instance goes fail. the machine

Punjab IFMS

Enviado por

Dados do documento

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

Punjab IFMS

Enviado por

Direitos autorais:

Formatos disponíveis

Tata Consultancy Services confidential 1

Tata Consultancy Services confidential

7. Veritas Cluster Servers............................................................................................................................................................13

Tata Consultancy Services confidential

Tata Consultancy Services confidential

IFMS Access Point

MS1 MS2 MS1 MS2

MS5 MS6 MS5 MS6

MS7 MS8 MS7 MS8

IFMS Domain IFMS Domain Digigov Domain Digigov Domain

MS1 MS2 MS5 MS6 MS1 MS2 MS5 MS6

MS3 MS4 MS7 MS8 MS3 MS4 MS7 MS8

IFMS Domain IFMS Domain Digigov Domain Digigov Domain

MS1 MS2 MS5 MS6 MS1 MS2 MS5 MS6

MS3 MS4 MS7 MS8 MS3 MS4 MS7 MS8

ESB Domain ESB Domain

Tata Consultancy Services confidential

3. Layer wise Summary

1. Hardware Load Balancer

Tata Consultancy Services confidential

Web Server Installation

WS2 App2 192.168.20.54 /etc/httpd /etc/httpd/conf/httpd.conf wl_mod_22.so

WS3 App3 192.168.20.55 /etc/httpd /etc/httpd/conf/httpd.conf wl_mod_22.so

WS4 App4 192.168.20.56 /etc/httpd /etc/httpd/conf/httpd.conf wl_mod_22.so

Web Server Configuration

WebLogic Installation for IFMS

Tata Consultancy Services confidential

WebLogic Installation for Digigov

App1 IfmsMS2 192.168.20.206:7003 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/IfmsMS2

App1 IfmsMS3 192.168.20.206:7004 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/IfmsMS3

App1 IfmsMS4 192.168.20.206:7005 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp1/servers/IfmsMS4

App2 AdminServer 192.168.20.208:7001 N.A. /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/AdminServer

App2 IfmsMS5 192.168.20.208:7002 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/IfmsMS5

App2 IfmsMS6 192.168.20.208:7003 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/IfmsMS6

App2 IfmsMS7 192.168.20.208:7004 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/IfmsMS7

App2 IfmsMS8 192.168.20.208:7005 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp2/servers/IfmsMS8

App3 AdminServer 192.168.20.206:7001 N.A. app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/AdminServer

App3 IfmsMS9 192.168.20.206:7002 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS9

App3 IfmsMS10 192.168.20.206:7003 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS10

App3 IfmsMS11 192.168.20.206:7004 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS11

App3 IfmsMS12 192.168.20.206:7005 192.168.20.206:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp3/servers/IfmsMS12

App4 AdminServer 192.168.20.208:7001 N.A. app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp4/servers/AdminServer

App4 IfmsMS13 192.168.20.208:7002 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp4/servers/IfmsMS13

App4 IfmsMS14 192.168.20.208:7003 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp4/servers/IfmsMS14

App4 IfmsMS15 192.168.20.208:7004 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp4/servers/IfmsMS15

App4 IfmsMS16 192.168.20.208:7005 192.168.20.208:7001 /app1/Oracle/Middleware/user_projects/domains/IfmsDomainApp4/servers/IfmsMS16

Tata Consultancy Services confidential

WebLogic Configuration (Digigov)

Memory Configuration (IFMS)

App1 AdminServer 4096m 4096m 1024m 1024m

App1 IfmsMS2 4096m 4096m 1024m 1024m

App2 AdminServer 4096m 4096m 1024m 1024m

App2 IfmsMS7 4096m 4096m 1024m 1024m

Tata Consultancy Services confidential

App4 AdminServer 4096m 4096m 1024m 1024m

App4 IfmsMS14 4096m 4096m 1024m 1024m

Memory Configuration (Digigov)

App1 AdminServer 4096m 4096m 1024m 1024m

App1 DigigovMS3 4096m 4096m 1024m 1024m

App4 AdminServer 4096m 4096m 1024m 1024m

App4 DigigovMS15 4096m 4096m 1024m 1024m

Veritas Cluster Group 1 Management IP :- 192.168.20.205

IfmsDomainApp1 192.168.20.53 IfmsDomainApp3 192.168.20.55

192.168.20.206 7001 AdminServer 192.168.20.206 7001 AdminServer