Euro Python 2007

Flumotion: streaming with Python, Twisted and GStreamer
T&o+a1 2ander Stic&ele t&o+a1 3at4 fluendo 3dot4 co+
10-7-7
Europython 2007, Vilnius
Fluendo S.L. - World Trade Center Edificio Norte 2 Pl. - Moll de Barcelona, 0803 B!"CEL#N! $ SP!%N &tt'())***.fluendo.co+ - ,3- 33./0.03
C alibration
Adjusting the talk to the audience
Overview
Introduction Flumotion architecture internals new in 0.4 a real customer making a product happy hacking
Introduction
Who is Fluendo ? overview of Flumotion overview of GStreamer and Twisted a sample run
Fluendo

Spanish (group of) companies built around GStreamer focusing on: streaming server and platform plugins and applications for GStreamer consultancy for multimedia and GStreamer Elisa
Flumotion the project

A streaming server (*) GPL or Advanced license written in Python using GStreamer, Twisted focused on live streaming distributed and extensible multi-format end to end including player
Flumotion the company
exploits a platform using Flumotion (the project) customers mostly in Spain built an additional layer on top of Flumotion for HA/load balancing
History
June 29 2004: First public use, 90 Mbit/sec Oct 20 2004: 0.1.0 Mar 03 2006: 0.2.0 Dec 22 2006: 500 Mbit/sec on one stream Jan 19 2007: 0.4.0
Flumotion features: components
sources: Firewire, soundcard, videocard,

webcam, test, looper, DVB, playlist, ivtv
codecs: Vorbis, Theora, mulaw, JPEG,

smoke (but also ...)
consumption: effects:
HTTP streaming, RTSP streaming (coming soon), archiving colorbalance, overlaying, volume
Flumotion features
friendly UI localized code distribution from central server runtime checks of software, devices, ...
Flumotion target users
people and companies that want to extend the basic use scenario use media sources in multiple ways provide media in different codecs nice user experience use a free stack
Flumotion users
Conferences: GUADEC FUDCON FISL LCA Radio stations A series of mosques RTVE, Antena3 a bunch of random people
GStreamer
written in C multimedia library elements in pipelines abstracting away lots of MM libraries optimized for speed threaded comes with bindings (*)
wisted
written in Python event-based framework central concepts: reactor (main loop) deferreds (promise of result) PB (client/server protocol) cooperative multitasking
sample run
Flumotion architecture
manager, worker, and admin components planets, atmosphere and flows
processes
one manager process one or more workers connect to manager, receive code run components as a forked process one or more admin clients connect to manager, receive code sends commands to manager presents UI for components through manager all across the network
processes
components

run inside a spawn of the worker produce/consume/convert/combine feeds Twisted connection setup GStreamer data protocol or provide services (authentication, testing) combination of set of parameters collection of GStreamer elements wizard pages for configuration administration pages
configuration
planet is managed by a manager contains one or more flows separated from each other containing feed components contains one atmosphere containing components used by flow components
Flumotion internals

streaming bundles wizard authentication state objects translatables Feel free to discuss these with me !
State objects
job processes have state from job to manager pid, mood, ... components have state from manager to admin mood, type, worker requested, ip, ... planet, flows, atmosphere have state -> tree Implements MVC for admin (*)
State objects
StateCacheable/StateRemoteCac he .addKey(), .addListKey() .get(), .set(), .append(), .remove() IStateListener for listeners to StateRemoteCache changes
ranslations An error happens in a component An admin client connects to the manager after the error ... ... and the admin client needs to show the translated error How do you make gettext do this ?
ranslations !"# Create a Translatable class That holds the format string, the arguments, and the domain Send this object to the admin Admin downloads bundles with .mo file for the language and translates locally show (*)
Streaming
connection setup in python our code steals the socket from reactor we hand the fd to GStreamer all actual streaming is done on the C level
$undles partitioned module namespace to import code from transferred from the manager cached locally in workers and admin clients method registers bundle and modifies modules so normal import statements work
$undles

BundledFile: .hasChanged() Bundle: .setZip(), .getZip() Bundler: .add(), .bundle() BundlerBasket: registry of bundles .add(), .depend() getBundlerByName() getBundlerNameByFile(), ByImport()
$undles
Unbundler: .unbundle() flumotion.common.common.regi sterPackagePath() go in sys.path find package candidates add to __path__ of already loaded packages and modules
%eycards and bouncers something wants a service provided keycards are created: serializable abstracts away type information challenge/response sent to a bouncer component back and forth can be expired by bouncer
%eycards and bouncers Bouncer can be anywhere in the network Is very easy to write Specific bouncers written for customers GET request and token Filtered on IP HTTP authentication
&i'ard

scenario-based pulls in code while you make choices checks requirements workerside(*) tells manager to ask worker to run a callable from a module manager forwards worker gets bundle, runs and returns
(ew in )*+
porter on demand http server iCal bouncer and disker feeder information IVTV and playlist producer switch component
a real customer a TV channel has a news show not at a fixed time want it recorded and available immediately on the website too difficult to integrate with them we capture from TDT
a real customer
solution one: a web button to start and stop recording easy to miss/forget
a real customer
solution two: a barcode-like bit pattern at start and end of show includes CRC and data bits a component detects this pattern disker starts/stops recording
a real customer
further solutions: colored, not black and white watermarking ...
,roblems
What version of the code is running ? How do we discover network topology ?
-ersion
lots of flumotion processes on different machines modules imported at different times what version is running ?
(etwor. workers connect to managers manager needs to tell worker how to connect to other worker firewalls get in the way each TCP connection has four IP addresses Someone must have done this already
Flumotion future ideas
live integration with PiTiVi video editor screencasts yelp integration bug reporting tools stream preview almost-live translation other admins (web, flash, mud, ...)
future use cases
picture-in-picture streams multi-audio streams live annotation using annodex high-res slides using Ogg + MNG + OpenOffice multiple codecs and bandwidths flash overlaying
/eveloping
Python UI standards focus on usability unit tests hacking the stack
the ,ython challenge
51cri'tin67 lan6ua6e no t8'in6 in declaration1 d8na+ic con1truct1 S'eed
Design document 8our !P% 'ro'erl8 unit test1

3e9a+'le4
i+'le+ent t&e +o1t-u1ed 'at&1 lo*erle:el 3;<!=EC

e9a+'le4
the ,ython nirvana

great bindings GTK, GStreamer easy prototyping quick development during programming great features rebuild modules and objects on the fly Twisted
0I standards
programmers try to avoid thinking about UI we try to follow the GNOME HIG the HIG does not talk about implementation unittest UI (show flumotion.test.test_greeter) ? stolen from gazpacho weird but works
usability
move to run-time checking devices, elements, library versions, ... (show library version check) use a graphic language to describe your program planets, moods, ... centralize all actions in one program
Stac. hac.ing
A bug shows up using Flumotion Could be in Flumotion gst-python GStreamer library Python Kernel driver
Happy Hac.ing
Flumotion template
Sample add-on project Has: Build infrastructure Component code UI code Glade file translations
1uestions 2
thomas <at> fluendo <dot> com http://www.fluendo.com/ http://www.flumotion.net/ http://www.flumotion.com/
<BLINK>GET HIRED!</BLINK>

Euro Python 2007

Enviado por

Dados do documento

Descrição original:

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

Euro Python 2007

Enviado por

Direitos autorais:

Formatos disponíveis

Flumotion: streaming with Python, Twisted and GStreamer

T&o+a1 2ander Stic&ele t&o+a1 3at4 fluendo 3dot4 co+

Adjusting the talk to the audience

Flumotion the project

Flumotion the company

Flumotion features: components

sources: Firewire, soundcard, videocard,

codecs: Vorbis, Theora, mulaw, JPEG,

Flumotion target users

manager, worker, and admin components planets, atmosphere and flows

further solutions: colored, not black and white watermarking ...

What version of the code is running ? How do we discover network topology ?

Flumotion future ideas

future use cases

Python UI standards focus on usability unit tests hacking the stack

the ,ython challenge

51cri'tin67 lan6ua6e no t8'in6 in declaration1 d8na+ic con1truct1 S'eed

Design document 8our !P% 'ro'erl8 unit test1

i+'le+ent t&e +o1t-u1ed 'at&1 lo*erle:el 3;<!=EC

the ,ython nirvana

thomas <at> fluendo <dot> com http://www.fluendo.com/ http://www.flumotion.net/ http://www.flumotion.com/

Você também pode gostar