Você está na página 1de 31

MALAYSIAN PUBLIC SECTOR

OPEN SOURCE SOFTWARE (OSS)


PROGRAMME

BENCHMARK/EVALUATION REPORT
on WEB SERVERS for BUDGET 2008 DAY

AUGUST 2008
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Copyright

The government of Malaysia retains the copyright of this document.


MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Table of Contents

1.0 EXECUTIVE SUMMARY.....................................................................................................1


2.0 INTRODUCTION..................................................................................................................1
2.1 Background ......................................................................................................................1
2.2 Purpose ............................................................................................................................2
2.3 Scope .............................................................................................................................3
2.3.1 Benchmarking activities ............................................................................................3
2.3.2 Visitor access statistic ..............................................................................................3
2.3.3 Personnel involved ...................................................................................................4
3.0 METHODOLOGY ................................................................................................................5
3.1 Benchmarking methodology ............................................................................................5
3.2 Visitor access recording and statistic generation ............................................................5
4.0 BENCHMARKING REPORT ...............................................................................................6
4.1 Benchmarking Activities..................................................................................................6
4.1.1 Experimental Setup ..................................................................................................6
4.1.2 Test System Specification And Configuration ...........................................................7
4.1.3 Commands Used ......................................................................................................7
4.2 Result of Benchmarking Exercise ..................................................................................9
4.2.1 Apache Web Server 2.2.3 .........................................................................................9
4.2.2 Lighttpd Web Server 1.4.15-1 ................................................................................10
4.3 Proposed Infrastructure Solution ...................................................................................11
5.0 BUDGET DAY SERVER OPERATION REPORT .............................................................13
5.1 Server Preparation Activities .......................................................................................13
5.2 Production Server Setup & Configuration ...................................................................13
5.2.1 Sysctl.conf ..............................................................................................................13
5.2.2 Synchronization scripts ..........................................................................................14
5.3 Budget Day Operation Report .....................................................................................17
5.4 Visitors Statistic For The Budget Day ..........................................................................17
5.4.1 General statistic ......................................................................................................17
5.4.2 Visitors per hour......................................................................................................18
5.4.3 Visitors by countries (Top 20) .................................................................................19
5.4.4 Visitors by operating system types..........................................................................20
5.4.5 Visitors by browser types.........................................................................................20
6.0 BENEFITS OF OSCC'S PARTICIPATION ........................................................................21
7.0 CONCLUSION ..................................................................................................................22
8.0 APPENDICES ..................................................................................................................24
8.1 Snapshot Treasury Portal during the Budget Day .........................................................24
8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo embedded ...........25
8.3 Snapshot of Awstats reports...........................................................................................26
8.4 Snapshot of appreciation letter from MOF.....................................................................27
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

1.0 EXECUTIVE SUMMARY

This document is designed to provide detailed report of all exercises done by OSCC during
their participation in preparing a dedicated web server for the Budget 2008 presentation day
conducted by the Ministry Of Finance (MOF). Due to a massive visitor access spike projected
during the budget day, OSCC team has been assigned to propose, set up and maintain a web
server infrastructure solution based on Open Source technology that is reliable to handle the
visitor surge, secure and cost saving. This solution is meant to replace the solution adopted
by MOF for the past years that are too expensive and complex. The solution provided by
OSCC has successfully performs reliably and receives more than 130,000 page views
without any problem. The solution also saves MOF a huge amount of money as it eliminates
the need of expensive hardwares and it only uses a single unit of server equipped with free
Open Source softwares. All activities, findings and information will be presented in detail
within this report which will be used as source of reference for similar implementation in the
future.

2.0 INTRODUCTION

2.1 Background

Over the years Ministry Of Finance's (MOF) website (http://www.treasury.gov.my) receives a


huge number of web accesses particularly during the national budget day presentation. These
spikes of requests were caused by a large number of visitors trying to get information
concerning the upcoming year's budget and also downloading the Malaysia Economic
Reports in digital format documents. Visitors also access the website to get information about
the live video broadcast of the presentation, and for this purpose the treasury website only
provide a web URL to a third party portal that handles the web broadcast. For the past years
OSCC had involved whether directly or indirectly in providing consultancy and human
expertise in preparing a suitable server solution for the budget presentation day. It was

Page 1
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

reported that in 2005, during the Malaysian Budget 2006 presentation day, such huge visitor
accesses had caused the web server to stall due to the excessive load congesting the server
resources. This event had caused denial of service state to the server thus causing failure of
web access requests to the visitors. To prevent the situation from happening again, for the
Malaysian Budget 2007 presentation day in 2006, drastic approaches have been taken. An
alternative server infrastructure consists of several unit of servers with load balancing
approach was implemented to substitute the actual web server only for the budget days
period. This solution was installed a few days prior to the budget date and being
decommissioned several days after once visitor access numbers back to normal day to day
routine. The solution had proven to be reliable as there are no denial of access reported but
for MOF's view, it was somewhat too expensive and too complicated and they are seeking for
a more practical and economical approach for the next national budget day. In August 2007,
OSCC once again been invited to provide consultancy and to facilitate the preparation
process for the Malaysian Budget 2008 presentation day. Both R&D and Technical Unit of
OSCC involved cooperatively to propose, design, install and operates a suitable server
solution for the budget day.

2.2 Purpose

The purpose of this document is to:-

1. Identify suitable web server infrastructure solution to be applied by Ministry Of Finance


for the Budget 2008 presentation day

2. To identify whether or not a server load balancing formation is needed to handle high
web access request on the particular day

3. To determine which type of web server package to be used

4. To provide reports of operations initiated during the actual budget presentation day

5. To present web access statistic captured for the whole budget day

6. To table any related findings gathered during and after the operation day

Page 2
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

The testing is not in any way done to declare which web server application is better compared
to others, but merely to find which solution is the most suitable within the scope of our specific
requirement. Therefore, any results, findings and recommendation provided in this report
should not be considered as a generalized head to head comparison.

2.3 Scope

2.3.1 Benchmarking activities

Only two web servers software were selected to be the testing subjects which were Apache
(http://www.apache.org) and Lighttpd (http://www.lighttpd.net). All testing activities were done
on machines with the same hardware specifications, identical operating systems and similar
configurations and performance tuning settings. All testing were done in a lab located in
OSCC. All network connections were Local Area Network in nature which means that
maximum network bandwidth should be approximately 100Mbps.

2.3.2 Visitor access statistic

This report examines visitor activity log data for the website www.treasury.gov.my only for the
budget presentation day which is on the 7th September 2007. Only genuine human visitor will
be counted in the analysis and no visits or page hits by automated robots such as crawler,
bots and external data mining agents will be used within this report.

Due to the internet nature of 'the world without boundaries', visitor origins in the analysis will
be from all over the world which is not limited to specific geographical location. Data that will
be taken into consideration are hourly unique visitors and visitors which are divided by
countries. The analysis will also provide comparison between operating system types and
internet browser types to estimate the percentage in term of users who are using open source
technologies.

Page 3
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

2.3.3 Personnel involved

Both RND and technical teams were involved directly with this project. There were also a
number of personnel from MOF participate in various activities throughout the server
benchmarking, server preparation and during operation day.

OSCC personnel involved in the benchmarking activities:

1. Haris (R&D Unit)

2. Jamal (R&D Unit)

3. Hisham (Technical Unit)

4. Azizul (Technical Unit)

5. Maisarah (R&D Unit)

6. Indhran (R&D Unit)

OSCC personnel involved for the server preparation and operation day:

1. Haris (R&D Unit)

2. Jamal (R&D Unit)

3. Hisham (Technical Unit)

4. Azizul (Technical Unit)

Page 4
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

3.0 METHODOLOGY

3.1 Benchmarking methodology

The benchmarking activities were done using an open source web server stress test tool
called ApacheBench (AB). ApacheBench is a command line computer program for measuring
the performance of HTTP web servers, in particular the Apache HTTP Server. It was designed
to give an idea of the performance that a given Apache installation can provide. In particular, it
shows how many requests per second the server is capable of serving. A series of testing
were done on each test subject and the results were recorded. On each occasion, a number
of connections and quantity of concurrency were pre-determined. If the test finished
successfully, meaning all request been served effectively by the test subject without any failed
or denied request, the number of concurrency will be increased and another round of test will
be done. The procedures were repeated until the subject matters fail to serve. This would
mean that the limit of connection that the particular web server can handle has been found.
By using this method, a comparison can be made on which web server has the capability to
serve the highest number of connections and maintain availability through sudden spike of
visitor access.

3.2 Visitor access recording and statistic generation

Throughout the operation process including the budget presentation day, no additional
monitoring tools were used on the web server rather than the conventional web server log
capability provided by both Apache and Lighttpd. This is to minimize resource usage of the
particular server to keep the free of unnecessary overhead. The web server logs are kept in
the access_log. Analyses were done to the log after the budget day to generate meaningful
statistic using an open source log analyzer tool called Awstat (http://awstats.sourceforge.net).
AWStats is a free powerful and featureful tool that generates advanced web, streaming, ftp or
mail server statistics, graphically. This log analyzer works as a CGI or from command line and
shows you all possible information your log contains, in few graphical web pages. It uses a
partial information file to be able to process large log files, often and quickly. It can analyze

Page 5
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

log files from all major server tools like Apache log files (NCSA combined/XLF/ELF log format
or common/CLF log format), WebStar, IIS (W3C log format) and a lot of other web, proxy,
wap, streaming servers, mail servers and some ftp servers.

4.0 BENCHMARKING REPORT

4.1 Benchmarking Activities

4.1.1 Experimental Setup

A series of benchmarking activities were done using the Apache Bench tool. 2 servers with
identical hardware specification, Operating System and configurations were installed
with Apache and Lighttpd respectively.

Machine A : Machine B :

IP address : 10.20.20.51 IP address : 10.20.20.52

Apache 2.2.3 Lighttpd 1.4.15-1

Another machine was being set up as the testing terminal where the benchmarking and stress
test tool will be executed. This machine was equipped with the Apache Bench Tool.

Page 6
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.1.2 Test System Specification And Configuration

All machines specification are identical. Using the same hardware model, operating system
and configurations.

Maker Model HP DC770


Processor Intel(R) Pentium(R) D CPU 3.20GHz
RAM 512 MB
Hard Disk 40 GB
Operating System Linux CentOS 5

4.1.3 Commands Used

Command used to launch the benchmarking process

ab –n 10000 –c xxx http://ipaddress/

Where :-

–n is the number of connections to be generated during the test emulating the number of web
access estimated to be received by the server within a specific timeframe (approximately
below 20 seconds) during the budget day. The value 10000 was pre-determined by the
team as the appropriate number of estimated connection judging by the projected number of
web access for the upcoming budget day based on the past years pattern.

–c is the number of concurrent connection that will take place during the series of tests. This
is the most crucial element within the benchmarking activities, understanding that the aspect
of availability should be the highest priority in the choosing the most suitable solution. For
each round of testing, the number of concurrent connection will be increased until error
encountered which signals the actual limit where the web server capable of serving.

Example : ab –n 10000 –c 500 http://10.20.20.52/

*Testing the Machine B with 10000 number of connection with 500 number of concurrency.
During the test, system resource utilization was monitored and logged using vmstat

Page 7
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

command. This was to find any spike of resource usage or any occurrence of I/O bottleneck.
Several data that were closely monitored were:

CPU Idle To determine whether any excessive CPU usage


occurred during the stress test process. High CPU
Idle status means that the system is healthy
Free Memory To determine whether any excessive RAM usage
occurred during the stress test process. High Free
Memory status means that the system is
healthy

Page 8
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.2 Result of Benchmarking Exercise

4.2.1 Apache Web Server 2.2.3

Number of request (n) = 10,000

On each test round, Apache failed to surpass 400 concurrency connection level.

Page 9
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

4.2.2 Lighttpd Web Server 1.4.15-1

Number of request (n) = 10,000

Page 10
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Based on the above results, it is clear that Lighttpd capable of handling larger number of
concurrent web requests compared to Apache when it comes to serving static web contents.
The above rounds of tests were repeated a few times but the outcome persists. In addition,
the team also tried a larger number of requests to the Lighttpd server which was supposedly
beyond the scope of testing by increasing the –n number and the –c number and lighttpd
proves to have the ability to withstand them.

4.3 Proposed Infrastructure Solution

Based on the results of the testing, the team has decided to opt for Lighttpd as the web server
to use. We are confident that a single server with adequate hardware specification, equipped
with Lighttpd could withhold the high number of web access requests during the budget day
provided that the server only servers static contents without any server side scripting nor any
king of database connectivity involved. To make sure that the server uses resources efficiently
and to increase stability, several modifications and fine tuning configurations will be done to
the production server. These include CPU & RAM allocation and kernel optimization tuning.
Unneeded services were also turned off minimize resource overhead. All software installation,
modification and tuning processes will be done by OSCC with assistance of MOF personnel.

In addition, one unit of standby server will be also placed alongside the production server for

Page 11
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

contingency measure such as in the event of hardware failure to the primary server. The
standby server also has the same configuration and contents as the production server with
almost identical hardware specification. The team had also suggested the use of multiple
servers located in different data centers if in case large binary files such as 'self extracting
compilation of economic reports' were going to be served and made available to the public as
what have been done in the previous years. Those servers will act as the alternatives
download locations listed as download links within the download page in the main portal,
where visitors can choose from. This method will reduce the burdens of the primary portal.
Those server were also equipped with Lighttpd where minimal hardware specification as low
as a Personal Computer (PC) specification could be used.

Based on mutual agreement with MOF, three alternative download locations were identified.
Those three servers are:

• The standby server which are located in NetMyne Datacenter alongside primary server

• One unit of server located at Ministry of Finance

• One unit of server located at OSCC

A simple bash script was created to handle synchronization among servers to make sure that
all servers have the same up-to-date web contents. The scripts will be provided in the later
part of this document.

*** However during the budget day, none of the alternative download servers were utilized, as
there are no large binary files were served by MOF, and the main server showed no indication
of congestion and it's resource utilization were successfully kept at the very minimum.

Page 12
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Overview of the proposed server structure for Budget 2008 presentation day

Page 13
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.0 BUDGET DAY SERVER OPERATION REPORT

5.1 Server Preparation Activities

All servers has been freshly installed with Linux CentOS 5 one week before the actual event.
Several round of stress test were done on all machines to make sure they don't have any
problem particularly on the hardware aspect. An overnight stress test also have be done using
combination of AB stress tool and cron job to make sure that the servers are stable.

5.2 Production Server Setup & Configuration

5.2.1 Sysctl.conf

Exact file location: /etc/sysctl.conf

#additional parameter to increase performance


kernel.shmmax = 436883456
kernel.shmall = 268435456
kernel.sem = 500 51200 64 2048
kernel.shmmni = 4096
fs.file-max = 65536
net.core.rmem_default = 262144
net.core.wmem_default = 262144
net.core.rmem_max = 262144
net.core.wmem_max = 262144
net.ipv4.ip_local_port_range = 1024 65000
kernel.msgmni = 2048
kernel.msgmax = 65536
vm.page-cluster = 20
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 87380 16777216
net.ipv4.tcp_tw_reuse = 1

Page 14
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.2.2 Synchronization scripts

The main script (called via command line at the primary server by the system administrator)

Exact file location: /usr/local/bin/rsync-mof

#!/bin/bash
# mirror-script.sh
# created by Jamal
if [ $(whoami) = bajet08 ]; then
echo -e "\n\nProcess started. Please wait..."
/usr/local/bin/rsync-mdec2
sleep 1
/usr/local/bin/rsync-oscc
sleep 1
/usr/local/bin/rsync-treasury
echo -e "Process finished\n\n"
else
echo -e "Denied: Only bajet08 user can run this script\n"
fi

The above script will launch three series of rsync instances.

/usr/local/bin/rsync-mdec2

#!/bin/sh
# mirror-script.sh
# created by Jamal
DATE=`/bin/date +%y%m%d-%H%M%S`
OUTFILE=/var/log/mirror/mdec2-$DATE.log
date >> /var/log/mirror/mdec2-exec.log
if [ -f "/home/bajet08/rsync-mof.pid" ]; then
RUNPID=`cat /home/bajet08/rsync-mof.pid`
if ps -p $RUNPID; then
echo "Mirror is already running..."
echo "Mirror is already running..." >> /var/log/mirror/mdec2-
exec.log
exit 1
else
echo "Mirror pid found but process dead, cleaning up"
>> /var/log/mirror/mdec2-exec.log
fi

Page 15
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

else
echo "No process Detected" >> /var/log/mirror/mdec2-exec.log
fi
echo $$ > /home/bajet08/rsync-mof.pid
echo -n "MDEC2 Server Mirroring Started at "
echo "Mirror Started " >> /var/log/mirror/mdec2-exec.log
date
#$rsync $mirror $local > $OUTFILE 2>&1
/usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no
-i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \
/var/www/html/ 202.75.59.26:/var/www/html > $OUTFILE 2>&1

/usr/local/bin/rsync-oscc

#!/bin/sh
# mirror-script.sh
# created by Jamal
DATE=`/bin/date +%y%m%d-%H%M%S`
OUTFILE=/var/log/mirror/oscc-$DATE.log
date >> /var/log/mirror/oscc-exec.log
if [ -f "/home/bajet08/rsync-mof.pid" ]; then
RUNPID=`cat /home/bajet08/rsync-mof.pid`
if ps -p $RUNPID; then
echo "Mirror is already running..."
echo "Mirror is already running..." >> /var/log/mirror/oscc-exec.log
exit 1
else
echo "Mirror pid found but process dead, cleaning up"
>> /var/log/mirror/oscc-exec.log
fi
else
echo "No process Detected" >> /var/log/mirror/oscc-exec.log
fi
echo $$ > /home/bajet08/rsync-mof.pid
echo -n "OSCC Server Mirroring Started at "
echo "Mirror Started " >> /var/log/mirror/oscc-exec.log
date
/usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no
-i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \
/var/www/html/ 210.187.27.213:/var/www/html > $OUTFILE 2>&1

Page 16
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

/usr/local/bin/rsync-treasury

#!/bin/sh
# mirror-script.sh
# created by Jamal
DATE=`/bin/date +%y%m%d-%H%M%S`
OUTFILE=/var/log/mirror/treasury-$DATE.log
date >> /var/log/mirror/treasury-exec.log
if [ -f "/home/bajet08/rsync-mof.pid" ]; then
RUNPID=`cat /home/bajet08/rsync-mof.pid`
if ps -p $RUNPID; then
echo "Mirror is already running..."
echo "Mirror is already running..." >> /var/log/mirror/treasury-
exec.log
exit 1
else
echo "Mirror pid found but process dead, cleaning up"
>> /var/log/mirror/treasury-exec.log
fi
else
echo "No process Detected" >> /var/log/mirror/treasury-exec.log
fi
echo $$ > /home/bajet08/rsync-mof.pid
echo -n "Treasury Server Mirroring Started at "
echo "Mirror Started " >> /var/log/mirror/treasury-exec.log
date
/usr/bin/rsync -r -a -v -e "ssh -o GSSAPIAuthentication=no
-i /var/www/.ssh/mdec1-rsync-key -l bajet08" --delete \
/var/www/html/ 202.75.6.53:/var/www/html > $OUTFILE 2>&1

Page 17
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.3 Budget Day Operation Report

Several OSCC staffs have been located at all critical points where the servers reside. Each of
them will monitor the log files activity of each server for any kind of problem. Live report file
uploading processes were done by MOF's staff directly to the primary server and the
synchronization scripts will distribute and duplicate the changes to other backup servers.
There are no occurrence of error detected for the whole day and the backup servers were not
utilized at all as the primary server shows any symptom of resources drainage.

5.4 Visitors Statistic For The Budget Day

Below is the visitor statistic collected during the Budget 2008 Presentation Day which was
held on 7th September 2007. All data were taken from web access log and was analyzed
using Awstats. Only the primary server was used during that day, therefore all statistics shown
here are purely from a single server.

5.4.1 General statistic

Date : 7th September 2007

Total number of unique visitors 9, 874


Total number of visits 12, 796 (1.29 visits/visitor)
Total number of pages viewed 130, 398 (10.19 Pages/Visit)
Total number of hits generated 519, 184 (40.57 Hits/Visit)
Total bandwidth consumed 4.58 GB (374.95 KB/Visit)

Page 18
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.2 Visitors per hour

Hours Pages Hits Bandwidth


00:00 am 282 1263 7,619,401
01:00 am 145 601 4,713,187
02:00 am 114 486 3,400,969
03:00 am 96 377 2,695,992
04:00 am 56 160 973,597
05:00 am 45 144 1,096,283
06:00 am 110 504 3,377,156
07:00 am 671 3,800 18,702,079
08:00 am 1,979 10,428 56,068,174
09:00 am 2,505 11,851 70,603,683
10:00 am 2,739 12,972 79,936,375
11:00 am 3,046 14,192 79,977,401
12:00 pm 2,192 10,347 59,969,313
01:00 pm 1,626 7,457 44,138,365
02:00 pm 5,388 23,544 142,280,704
03:00 pm 16,097 76,505 393,637,888
04:00 pm 32,647 150,655 580,046,848
05:00 pm 28,605 104,234 1,040,812,032
06:00 pm 12,070 33,375 835,983,360
07:00 pm 5,166 16,029 343,683,072
08:00 pm 3,335 11,222 264,849,408
09:00 pm 5,187 12,175 405,623,808
10:00 pm 4,551 10,335 380,430,336
11:00 pm 1,746 6,529 92,384,038
* The above data doesn't includes traffic generated by robots, worms,
or replies with special HTTP status codes.

Page 19
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.3 Visitors by countries (Top 20)

No Country Pages Hits Bandwidth


1. Malaysia 119,908 485,441 4.29 MB
2. United States 2,559 7,589 59.42 MB
3. Singapore 2,468 6,838 61.50 MB
4. Japan 1,125 3,672 20.01 MB
5. Australia 715 2,862 22.97 MB
6. India 551 953 45.21 MB
7. Hong Kong 541 2,103 12.63 MB
8. European country 439 1,640 14.87 MB
9. Great Britain 379 1,422 17.34 MB
10. France 191 755 3.86 MB
11. Indonesia 179 636 4.95 MB
12. China 161 672 3.30 MB
13. Germany 154 466 3.92 MB
14. South Korea 134 646 2.31 MB
15. Philippine 74 198 1.62 MB
16. Taiwan 67 290 1.97 MB
17. New Zealand 61 278 1.24 MB
18. Qatar 48 141 1.56 MB
19. Switzerland 45 224 1.22 MB
20. United Arab Emirates 42 177 0.53 MB

Page 20
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

5.4.4 Visitors by operating system types

Operating Systems Hits Percent


1. Windows 500,848 96.40%
2. Unknown 14,574 2.80%
3. Macintosh 1,829 0.30%
4. Linux 1,559 0.30%
5. Symbian OS 332 0%
6. Sun Solaris 42 0%

5.4.5 Visitors by browser types

Browsers Hits Percent


1. MS Internet Explorer 445,607 85.80%
2. Firefox 54,316 10.40%
3. NetAnts 10,638 2.00%
4. Mozilla 2,244 0.40%
5. Unknown 1,919 0.30%
6. Opera 1,826 0.30%
7. Safari 1,764 0.30%
8. Netscape 570 0.10%
9. RssReader (RSS Reader) 82 0%
10. K-Meleon 37 0%
11. Others 181 0%

Page 21
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

6.0 BENEFITS OF OSCC'S PARTICIPATION

Benefits for OSCC

1. OSCC gained significant visibility during Budget Day 2008 by having its logo
embedded within the treasury.gov.my website from 2.00pm until 5.00pm. More than
250,000 hits generated during that time-frame.

2. Valuable knowledge based on research about comparison between 2 open-source web


server (Apache/Lighttpd).

3. Data will be used for OSCC OSS benchmarking reports as part of RND department
deliverables

4. Transfer of technology, exposure and knowledge sharing about Open Source


technology to MOF.

5. Providing solid proof about reliability, flexibility and future potential of open source
products .

6. Valuable lessons and experience for all OSCC Technical and RND department staffs .

7. Helping MOF in substantially reducing the total cost for preparing budget day server
compared to previous years.

Page 22
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

7.0 CONCLUSION

Overall, our recommended server infrastructure solution performs reliably in serving such high
number of web access for the www.treasury.gov.my portal during the budget 2008
presentation day. All requests were successfully served and the server did not encounter
any kind of problem such as network congestion or service interruption during the production
period. The resource utilization of the server also kept at very minimum with majority of the
system resources such as CPU and RAM were underutilized which means that the same
setup could theoretically handles even larger number of web access request in the future if
the same infrastructure solution and practices were to be reused.

Both MOF and OSCC have gained valuable experiences and knowledge throughout each of
the project phase especially during the benchmarking, installation and production phase.
Those knowledge and experience would be helpful in improving OSCC operation most
importantly in the technical aspects in the future. The benchmarking activities have provided
valuable knowledge especially in realizing the solidness of open source web server products
particularly for Lighttpd web application. Although the team did not took the results as
absolute declaration of which web server is the better compared to others as there a a lot of
external variables should be considered in making any justification, nevertheless it was a
good indicator of the wide variety of possibilities offered by the open source world where there
are so many alternatives to choose from in catering any specific needs.

Based on number of visitors divided by operating system types and internet browser types,
Microsoft has proven that they dominated the operating system and internet browser
application market especially for desktop workstation among the internet users particularly in
Malaysia. This information is crucial to the future strategic planning for OSCC as it could be
used as a guideline or reference in tabulating the trend of open source usage among the
Malaysian people. Only 0.30% of the total visitors were using Linux operating system while for

Page 23
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

Open Source internet browser, Firefox only manage to achieve slightly above 10%.

The number is tremendously small compared to the Microsoft and shows that user
acceptance toward open source technologies for desktop workstation and software
application is still arguable and majority of computer users are still prefer proprietary products.
This is also indicates that there are still a large room for OSCC to work on in the future.

Prepared by: Harifazillah Jamel, OSCC MAMPU

Page 24
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.0 APPENDICES

8.1 Snapshot Treasury Portal during the Budget Day

Page 25
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.2 Snapshot of Budget 2008 pop-up page with OSCC/MAMPU logo


embedded

Page 26
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.3 Snapshot of Awstats reports

Page 27
MALAYSIAN PUBLIC SECTOR OPEN SOURCE SOFTWARE PROGRAMME
Phase II - Benchmark/Evaluation Report on Web Servers for Budget 2008 Day

8.4 Snapshot of appreciation letter from MOF

Page 28

Você também pode gostar