summaryrefslogtreecommitdiffstats
path: root/gst/avi/README
blob: f1b5441b605ce73e198b2a1a2184c8aa9295ea92 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
The avi decoder plugins 
-----------------------

The avi decoder consists of a set of gstreamer plugins:

 - demuxer (avidemux)
 - avi to gstreamer type converter (avitypes)
 - windows dlls wrappers.

the avidecoder element uses the above plugins to perform the avi
decoding. It is constructed as a custom bin which initially only has
the demuxer element in it. The demuxer has a set of padtemplates for
raw audio and video.

  (------------------------------------)
  ! avidecoder                         !
  !                                 (video/raw)...
  !     (----------)                   !
  !     ! demuxer (video/x-msvideo, auds)..
  !     !          !                   !
  !   -src         !                   !
  !  /  !         (video/x-msvideo, vids)..
 - src  !          !                   !
  !     (----------)                (audio/raw)...
  !                                    !
  (------------------------------------)

the demuxer has a set of padtemplates for the raw avi header properties.

The avi decoder will act on the new_pad signal of the demuxer element
and will attach an avitype plugin to the new pad. Caps negotiation will
convert the raw avi caps to the gstreamer caps. If the src pad of the
avitypes plugin are compatible with the avidecoder padtemplate, the 
avitype pad is ghosted to the avidecoder bin, this is the case where no
codec is needed (for raw PCM samples, for example).

When the avitypes caps are not compatible with one of the avidecoder 
templates, a static autoplugger is used the find an element to connect
the demuxers pad to the decoders padtemplate.

When no element could be found, an windec plugin is attached to the 
demuxers pad and the avitypes plugin is removed from the decoder.


example:
--------

 An avidecoder that has a video pad (decoded with windows dlls) and an
 audio pad (raw PCM).

  (----------------------------------------------------------------)
  ! avidecoder               (--------)    (------)                !
  !                          !avitypes!    !windec!       /-- (video/raw)
  !     (----------)     /-sink      src--sink   src -----         !
  !     !demuxer (video/x-msvideo,    !    !      !                !
  !     !          ! auds).. (--------)    (------)                !  
  !   -sink        !         (--------)                            !
  !  /  !        (video/x-..,!avitypes!                            !
 -sink  !          ! vids).. !        !                            !
  !     (----------)     \-sink      src -------------------- (audio/raw)
  !                          (--------)                            !
  (----------------------------------------------------------------)



TODO
----

automatically generate the padtemplates from all possible avi types
found in the registry.