Method to insert the missing frame on a video.

Focus: Video Streaming

Abstract- This paper discuss about the lost frame on video streaming. As we know, video
streaming can be like the moving of images. Some images or video frames displayed with
specific speed which call as frame rate and measured in frame per second scale. Video streaming
can be mean as a method which used streaming server to transmite digital video through a data
network possible to playback video directly without waiting for finished downloading process or
saving previously in client computer. Streaming technology characteristic disposed dependent-
bandwidth, so it is very depend on network conditions. Slow internet accsess influences to video
facilities cause video played streamed. There are other factor which decreased quality the video
streaming. In this paper will discuss about causes and forms of such damages. Also discuss
codec (compression and decompression on video) method video used to which show how to
know the position of the missing frames and insert new frames on the video and how the quality
of the video quality after the insertion of this frame and codec process.
keyword : video streaming, lost frame, codec, watermaking video, steganografi

I. Introduction

Currently, data communication services have been wide spread. To increase the user
comfortable of data communications services, a video can be accessed directly on the internet
while using the service without having to make the process of downloading. This called video
streaming. Multimedia streaming is becoming one of the most popular applications in today’s
computer networks.

Video streaming penetrates every aspect of our lives, ranging from communications to
entertainment. With the wide deployment of IEEE 802.11 Wireless Local Area Networks
(WLANs), video streaming over WLANs is very common. Video quality measurement, based on
criteria and metrics that can be measured objectively and automatically by a computer program,
is important to various parties, including government and industries[1].

Streaming technology depend on bandwidth-dependent, so it is very depend on network

conditions. For data stream can be a good payback, needs to some consideration so that, the data

1
stream has a bit rate/data transfer rate is quite low, because by reducing the bit rate means the
same thing by sending less data. By reducing the bit rate can be done by among others: make a
video frame dimensions become smaller, make a number of frames per second (fps) video will
be lower, to reduce the amount of information in each video frame through the compression
process. Video streaming can be used in many applications, such as video conference, e-
learning/distance learning, video surveillance, remote monitoring, and others. The presence of a
network that allows the server as a video source can be separate physical distance from the client
is differentiation factor video streaming of pre-recorded video that is commonly used by
consumer electronics, such as CD/DVD. Therefore, video streaming has the following main
characteristics: streaming technology allows access to real time streaming or demand data
transmitted from the server side, immediate playback on the client side after received and
processed previously and it doesn’t leave residue on the client side data after the streaming
process is complete[2].

II. Damages of Video Streaming

a. Network and Performance of Video Streaming[2]

Internet network quality also determines the quality of Video Streaming. This can affect
significantly of the facility, because the Video Streaming will be played directly without
intermediary of other applications. The solution for this, we wait for the computer
connected to the internet to complete buffering of the video or in other words is collect
secondary data to play the video[3]. Video streaming provides a much more efficient
information than sentence structure. An information data can be transmitted over the
network in unicast or multicast.

a. Unicast, end-to-end, where every client get the different data streams from other
clients, even though delivered simultaneously. By using the same server, unicast
connection model will require the same number of links connection with the large
number of clients. Unicast configuration shown in figure 1.

2
 Figure1. Unicast configuration[2]

b. Multicast, the server sends only one type of data streams are then duplicated by a
particular router before being sent across the network to the clients. Technically, the
model of multicast connections are only one-way communication that is not much
different from broadcast television system, so that the facilities on- demand is almost
impossible. Multicast configuration shown in figure 2.

Figure 2. Muticast configuration[2]

A network can be called ideal if it can transmit any information, not limited to the number and
size, and without delay or loss. But in practice will be very difficult to create a network with such
characteristics, due to bit errors, bit loss, delay, latency, and the limited bandwidth of the things
that are temporal. Factor performance of streaming video system in conjunction with the network
can be explained as follows, before that the factor can be show causes the damaged of the video
streaming.

Bandwidth is the amount of data that can be via a network, or part of a network, for any given
time. Bandwidth on the network are divided, limited, and varies with time. A network is not able
to guarantee the bandwidth required to transmit the video will always be available.

3
Delay. If the video data to spend too much time at the moment are in a network, it will become
useless, even though the video data is eventually successfully received by the client. This is
caused on the client systemis stillin the process of decoding and displaying the video, so the total
time spent would be too od to be called as real-time.

Error. The loss of a portion of video data transmitted over the network can be caused by many
thing, such as congestion, rejection by the system because delay is too long, or fault on the
network it self. A streaming video system can not ignore the possibility of data errors or data loss
during transmission process, because it will lead to low quality of the video at the time shown.
Loss is happening on the network can lead to a more severe condition at the client side, suppose
that the first data packet from video frames are transmitted is damaged or lost while in the
network, then all the remaining data packets will not be dispayed even if successfully transmitted
and received by the client.

The parameters mentioned above is the main parameter of QoS on the network. Almost
all the network. Almost all the network do not memiliki specific mechanisms (QoS control) to
priority network resources to facilitate the data stream as the main priority of time sensitive. Due
to unavailable QoS control, streaming video system is usually an end-based, in the sense that the
network is not expected to be able to provide any support for the security of the transmission of
video streas on a network, namely heteregenity and the variance of the time.
A heterogeneous network is a network whose parts may have different resources. For
example, some networks may have large bandwidth and congestion is perfect, while the other
has a small bandwidth resulting in overload occurs, this causes inter-client will feel the
performance character are not the same. Variance of time also affects the bandwidth, delay, loss,
or other network characteristics that can change significantly following the time and often
change dramatically in a matter of seconds. To this needed capability from the server side so it
can adapt to any changes in the condition of the network. Therefore, better video data firstly
configured in such a way, and that can be transmitted over the network.

4
 b. Lost Frame

To see how the lost frames can occur and the method used to solve that problem, there
has been previous resource by Winastwan Gora Swajati and Moch. Taufik, "Development Of
Applications Web-Based Video Streaming For Enhancing Learning Activities."[4] In this
research, we can see how the lost frames occur due to compression of the video. To build this
research has built a network in Lampung University by utilizing local computer network in the
campus environment. By testing on type of service Video on Demand (VOD) and live broadcast
tested on cable network and local wireless Sultan Agung Islamic University, Semarang. Type of
video compression studied were compression on MPEG-1, MPEG-4, and DivX1, during the
research process used HTTP protocol as their network protocol for VOD and UDP protocol for
live broadcast service. This experiment uses four units Personal Computer (PC) connected to a
local network (LAN) cable and wireless. Two computers function as servers Video on Demand
and live broadcast servers, and two other computers to function as a client. The software is the
statistical facilities (Stream and Media Info) contained in the application VideoLAN Client, the
application is found on the client computer. The analysis process is done by seeing parameter
Frame Lost, Lost and Delay Buffers that appear on the user side. The greater the value of Lost
Frame, Lost Buffer and Delay, the more bad quality of the service. This showing a lost frame,
lost buffers and delay, through experiments using various methods of compression is expected
this research to find the type of bandwidth-efficient compression and has a good quality service.
Tests only used a video with 320x240 pixel frame size, frame rate of 25 frames per second (fps).
Video of the stream is then re-encoded when doing streaming service (either in real-time
encoding as well as through pre-encoded) in a variety of bitrate, is 1024 Kbps, 512 Kbps and 384
Kbps using VideoLAN. The process of encoding the video bitrate variations are intended to
observe how much influence Bitrate with video capabilities to adapt in wired and wireless
networks, video bitrate values as low as 384 Kbps Bitrate chosen because in this small video can
still be said to have a good quality (that still can be enjoyed with good).
The results showed that the type of compression and bitrate is very significant effect on
the number of frames lost (Lost Frame) during the streaming process. The greater the value of
the video bitrate is used, the greater the value of Lost Frames. While the types of compression

5
that show Lost Frame as low, both when in-stream video in wired or wireless network is MPEG-
4 compression.
In the results performed within the wireless network seems that the Lost Frame
parameters showed a larger number compared with the same parameters, observed in a wired
network. This shows that it takes a specific type of compression and low bitrate to adapt the
wireless network, in this case mPEG-4 compression displayed the most appripiate.
In conclusion, video streaming in wireless networks generate Lost frames are larger than
the streaming video in a wired network. This is shown in a live broadcast service research,
precisely at MPEG-4 compression with Bitrate 1024 Kbps (on computer 1) that in-stream on the
cable network to produce Lost Frame rate of 3 frames, while similar services that are streamed
on the wireless network to produce Lost Frame by 7 frames. This indicates that the wireless
network does not show good performance when used video data stream, to be precise when using
UDP or HTTP protocol compared with wired networks.
Many things must be considered if we want to do compression-decompression process
media files. For instance, the greater our media files, then the greater the size of the file. The
more we compress the file, it will also diminishing the quality of the file when it enjoyed back.
For video files, the less we define small frames per second (fps), then the resulting image will be
broken. To overcome this, then we will often find that streaming video screen size is relatively
smaller than the size of our monitors.

c. Insert a Frame
Inserted a frame on video do to particular purpose. For example in steganografy.
Steganography is one part of cryptography, the science and art of hiding a secret message on
video so that people can not recognize the existence of the message.
Research by Paul Gunawan Hariyanto "Study and Implementation of Steganography in
Digital Video On Mobile Phone With DCT Modification".[5]. Study about how steganography in
digital video media. Video used to have a format 3GP and H.263 codecs, and steganographic
techniques will use the DCT Modification, which make changes to the coefficient DCT (Discrete
Cosine Transform) on a video in accordance with the input message. Modification DCT, who
works in the frequency domain. Therefore, this method can only be worn on the image format is
stored in the frequency domain, such as the JPEG Discrete Cosine Transform using (DCT) as a

6
domain transformation process. Steganography process there is usually an additional key input,
which allows you to add a safety factor, so that only the keys that are used at the time of
insertion that can extract the message. The process of embedding a message in steganography
requires two inputs, which message you want to insert and lock for security. H.263 video codec
that is used has two kinds of frames. Type the first frame is I-frame, which uses intraframe
compression with DCT. Then the second frame type is P-frames using interframe compression is
motion estimation and compensation.
Message insertion technique to be used is the DCT Modification, which means making
changes to the DCT coefficients. Therefore, the insertion can only be done on the I-frame DCT
coefficient storing in it. Changes to this frame will affect all subsequent P-frames, because
interframe compression makes the I-frame this as a frame of reference, so changes in the I-
frames will be carried on. Having obtained a suitable frame, also sought coefficients that can be
inserted, namely INTRA-DC, which is the DC coefficient of the frequency matrix in the image
output generated object is a stego-object, namely a video that already have a message in it.

d. Issue about Quality of Video after Frame Insertion

Depend on the research by Paul Gunawan Hariyanto, we can campare the quality of video before
and after insertion. Method of video quality measurement process will be done subjectively and
objectively. How subjective is by direct observation of the insertion videos and original video.
While an objective way will use techniques Structural Similarity (SSIM). Selection of this
method would be more suitable due to the measurement of the video that has undergone
compression, and comparison of image-based structure is more similar to human perception.

The test is done by comparing the results of embedding videos, both subjective and objective
manner. The frame of the second video you want to compare the extracted first, into JPG images.
For an objective manner, sought SSIM value of each image, then taken the average value or its
value MSSIM. The test results can be seen in Table 1.

7
 Type of file Screenshot video SSIM value
Text file 0.99987

Image file 0.99627

Tabel 1. Result of the objectively measurement on video quality[5]

On the way subjective, video insertion results considered similar to the original video.
Meanwhile, in an objective manner, all the comparisons get SSIM values above 0.7. This proves
that the process of embedding the DCT method Modification does not alter significantly the
quality of the video structure. And the high value is due to 3GP video resolution is small enough,
and SSIM will be more accurate with a higher resolution frame, so that the frame structure is
more visible. However, it is still consistent with human perception can not see the difference
from the video resolution or frame a little.

III. Conclusions

In this paper, we purpose to explain about causes the damaged video streaming. In building a
video streaming needs to consider parameters that affect the quality of streaming video to get
good video quality. The parameters are categorized into encoding parameters, network
parameters and other parameters. Encoding Parameters include encoding algorithms, output bit
rate, frame rate. They determine the number of securities of other parameters. In addition, the

8
decline in quality can occur during the encoding because the compression process. Network
parameters including packet loss, delay and delay variation. Packet loss or a long delay may
cause distortion of video quality. Another parameter could feature content in a frame (color, size,
contrast), the social character of the viewer (age, experience, psychological state. Packet loss can
also cause packet initial data from video frames lost or damaged during transmission, so the
video will not be displayed even though the rest managed to dkirim and received client.

Reference
[1] An (Jack) Chan, Kai Zeng, Prasant Mohapatra, Sung-Ju Lee and Sujata Banerjee.
"Metrics for Evaluating Video Streaming Quality in Lossy IEEE 802.11 Wireless
Networks".Department of Computer Science, University of California, Davis, CA 95616.
[2] http://www.ittelkom.ac.id/library/index.php?
view=article&catid=10%3Ajaringan&id=291%3A-video-
streaming&option=com_content&Itemid=15
[3] http://novaku.wordpress.com/apaan-sih-video-streaming-itu/
[4] Winastwan Gora Swajati dan Moch. Taufik. "Development Of Applications Web-Based
Video Streaming For Enhancing Learning Activities". Lampung University
[5] Paul Gunawan Hariyanto. "Study and Implementation of Steganography in Digital Video
On Mobile Phone With DCT Modification".Bandung Technology Institute.
[6]