forked from GStreamer/gstreamer
-
Notifications
You must be signed in to change notification settings - Fork 0
/
NEWS
786 lines (573 loc) · 38.8 KB
/
NEWS
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
# GStreamer 1.8 Release Notes
**GStreamer 1.8.0 was released on 24 March 2016.**
The GStreamer team is proud to announce a new major feature release in the
stable 1.x API series of your favourite cross-platform multimedia framework!
As always, this release is again packed with new features, bug fixes and other
improvements.
See [https://gstreamer.freedesktop.org/releases/1.8/][latest] for the latest
version of this document.
*Last updated: Thursday 24 March 2016, 10:00 UTC [(log)][gitlog]*
[latest]: https://gstreamer.freedesktop.org/releases/1.8/
[gitlog]: https://cgit.freedesktop.org/gstreamer/www/log/src/htdocs/releases/1.8/release-notes-1.8.md
## Highlights
- **Hardware-accelerated zero-copy video decoding on Android**
- **New video capture source for Android using the android.hardware.Camera API**
- **Windows Media reverse playback** support (ASF/WMV/WMA)
- **New tracing system** provides support for more sophisticated debugging tools
- **New high-level GstPlayer playback convenience API**
- **Initial support for the new [Vulkan][vulkan] API**, see
[Matthew Waters' blog post][vulkan-in-gstreamer] for more details
- **Improved Opus audio codec support**: Support for more than two channels; MPEG-TS demuxer/muxer can now handle Opus;
[sample-accurate][opus-sample-accurate] encoding/decoding/transmuxing with
Ogg, Matroska, ISOBMFF (Quicktime/MP4), and MPEG-TS as container;
[new codec utility functions for Opus header and caps handling][opus-codec-utils]
in pbutils library. The Opus encoder/decoder elements were also moved to
gst-plugins-base (from -bad), and the opus RTP depayloader/payloader to -good.
[opus-sample-accurate]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiometa.html#GstAudioClippingMeta
[opus-codec-utils]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstpbutilscodecutils.html
- **GStreamer VAAPI module now released and maintained as part of the GStreamer project**
[vulkan]: https://www.khronos.org/vulkan
[vulkan-in-gstreamer]: http://ystreet00.blogspot.co.uk/2016/02/vulkan-in-gstreamer.html
## Major new features and changes
### Noteworthy new API, features and other changes
- New GstVideoAffineTransformationMeta meta for adding a simple 4x4 affine
transformation matrix to video buffers
- [g\_autoptr()](https://developer.gnome.org/glib/stable/glib-Miscellaneous-Macros.html#g-autoptr)
support for all types is exposed in GStreamer headers now, in combination
with a sufficiently-new GLib version (i.e. 2.44 or later). This is primarily
for the benefit of application developers who would like to make use of
this, the GStreamer codebase itself will not be using g_autoptr() for
the time being due to portability issues.
- GstContexts are now automatically propagated to elements added to a bin
or pipeline, and elements now maintain a list of contexts set on them.
The list of contexts set on an element can now be queried using the new functions
[gst\_element\_get\_context()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstElement.html#gst-element-get-context)
and [gst\_element\_get\_contexts()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstElement.html#gst-element-get-contexts). GstContexts are used to share context-specific configuration objects
between elements and can also be used by applications to set context-specific
configuration objects on elements, e.g. for OpenGL or Hardware-accelerated
video decoding.
- New [GST\_BUFFER\_DTS\_OR\_PTS()](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstBuffer.html#GST-BUFFER-DTS-OR-PTS:CAPS)
convenience macro that returns the decode timestamp if one is set and
otherwise returns the presentation timestamp
- New GstPadEventFullFunc that returns a GstFlowReturn instead of a gboolean.
This new API is mostly for internal use and was added to fix a race condition
where occasionally internal flow error messages were posted on the bus when
sticky events were propagated at just the wrong moment whilst the pipeline
was shutting down. This happened primarily when the pipeline was shut down
immediately after starting it up. GStreamer would not know that the reason
the events could not be propagated was because the pipeline was shutting down
and not some other problem, and now the flow error allows GStreamer to know
the reason for the failure (and that there's no reason to post an error
message). This is particularly useful for queue-like elements which may need
to asynchronously propagate a previous flow return from downstream.
- Pipeline dumps in form of "dot files" now also show pad properties that
differ from their default value, the same as it does for elements. This is
useful for elements with pad subclasses that provide additional properties,
e.g. videomixer or compositor.
- Pad probes are now guaranteed to be called in the order they were added
(before they were called in reverse order, but no particular order was
documented or guaranteed)
- Plugins can now have dependencies on device nodes (not just regular files)
and also have a prefix filter. This is useful for plugins that expose
features (elements) based on available devices, such as the video4linux
plugin does with video decoders on certain embedded systems.
- gst\_segment\_to\_position() has been deprecated and been replaced by the
better-named gst\_segment\_position\_from\_running\_time(). At the same time
gst\_segment\_position\_from\_stream\_time() was added, as well as \_full()
variants of both to deal with negative stream time.
- GstController: the interpolation control source gained a new monotonic cubic
interpolation mode that, unlike the existing cubic mode, will never overshoot
the min/max y values set.
- GstNetAddressMeta: can now be read from buffers in language bindings as well,
via the new gst\_buffer\_get\_net\_address\_meta() function
- ID3 tag PRIV frames are now extraced into a new GST\_TAG\_PRIVATE\_DATA tag
- gst-launch-1.0 and gst\_parse\_launch() now warn in the most common case if
a dynamic pad link could not be resolved, instead of just silently
waiting to see if a suitable pad appears later, which is often perceived
by users as hanging -- they are now notified when this happens and can check
their pipeline.
- GstRTSPConnection now also parses custom RTSP message headers and retains
them for the application instead of just ignoring them
- rtspsrc handling of authentication over tunneled connections (e.g. RTSP over HTTP)
was fixed
- gst\_video\_convert\_sample() now crops if there is a crop meta on the input buffer
- The debugging system printf functions are now exposed for general use, which
supports special printf format specifiers such as GST\_PTR\_FORMAT and
GST\_SEGMENT\_FORMAT to print GStreamer-related objects. This is handy for
systems that want to prepare some debug log information to be output at a
later point in time. The GStreamer-OpenGL subsystem is making use of these
new functions, which are [gst\_info\_vasprintf()][gst_info_vasprintf],
[gst\_info\_strdup\_vprintf()][gst_info_strdup_vprintf] and
[gst\_info\_strdup\_printf()][gst_info_strdup_printf].
- videoparse: "strides", "offsets" and "framesize" properties have been added to
allow parsing raw data with strides and padding that do not match GStreamer
defaults.
- GstPreset reads presets from the directories given in GST\_PRESET\_PATH now.
Presets are read from there after presets in the system path, but before
application and user paths.
[gst_info_vasprintf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-vasprintf
[gst_info_strdup_vprintf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-strdup-vprintf
[gst_info_strdup_printf]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/gstreamer-GstInfo.html#gst-info-strdup-printf
### New Elements
- [netsim](): a new (resurrected) element to simulate network jitter and
packet dropping / duplication.
- New VP9 RTP payloader/depayloader elements: rtpvp9pay/rtpvp9depay
- New [videoframe_audiolevel]() element, a video frame synchronized audio level element
- New spandsp-based tone generator source
- New NVIDIA NVENC-based H.264 encoder for GPU-accelerated video encoding on
suitable NVIDIA hardware
- [rtspclientsink](), a new RTSP RECORD sink element, was added to gst-rtsp-server
- [alsamidisrc](), a new ALSA MIDI sequencer source element
### Noteworthy element features and additions
- *identity*: new ["drop-buffer-flags"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-identity.html#GstIdentity--drop-buffer-flags)
property to drop buffers based on buffer flags. This can be used to drop all
non-keyframe buffers, for example.
- *multiqueue*: various fixes and improvements, in particular special handling
for sparse streams such as substitle streams, to make sure we don't overread
them any more. For sparse streams it can be normal that there's no buffer for
a long period of time, so having no buffer queued is perfectly normal. Before
we would often unnecessarily try to fill the subtitle stream queue, which
could lead to much more data being queued in multiqueue than necessary.
- *multiqueue*/*queue*: When dealing with time limits, these elements now use the
new ["GST_BUFFER_DTS_OR_PTS"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstBuffer.html#GST-BUFFER-DTS-OR-PTS:CAPS)
and ["gst_segment_to_running_time_full()"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer/html/GstSegment.html#gst-segment-to-running-time-full)
API, resulting in more accurate levels, especially when dealing with non-raw
streams (where reordering happens, and we want to use the increasing DTS as
opposed to the non-continuously increasing PTS) and out-of-segment input/output.
Previously all encoded buffers before the segment start, which can happen when
doing ACCURATE seeks, were not taken into account in the queue level calculation.
- *multiqueue*: New ["use-interleave"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-multiqueue.html#GstMultiQueue--use-interleave)
property which allows the size of the queues to be optimized based on the input
streams interleave. This should only be used with input streams which are properly
timestamped. It will be used in the future decodebin3 element.
- *queue2*: new ["avg-in-rate"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gstreamer-plugins/html/gstreamer-plugins-queue2.html#GstQueue2--avg-in-rate)
property that returns the average input rate in bytes per second
- audiotestsrc now supports all audio formats and is no longer artificially
limited with regard to the number of channels or sample rate
- gst-libav (ffmpeg codec wrapper): map and enable JPEG2000 decoder
- multisocketsink can, on request, send a custom GstNetworkMessage event
upstream whenever data is received from a client on a socket. Similarly,
socketsrc will, on request, pick up GstNetworkMessage events from downstream
and send any data contained within them via the socket. This allows for
simple bidirectional communication.
- matroska muxer and demuxer now support the ProRes video format
- Improved VP8/VP9 decoding performance on multi-core systems by enabling
multi-threaded decoding in the libvpx-based decoders on such systems
- appsink has a new ["wait-on-eos"](https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-plugins/html/gst-plugins-base-plugins-appsink.html#GstAppSink--wait-on-eos)
property, so in cases where it is uncertain if an appsink will have a consumer for
its buffers when it receives an EOS this can be set to FALSE to ensure that the
appsink will not hang.
- rtph264pay and rtph265pay have a new "config-interval" mode -1 that will
re-send the setup data (SPS/PPS/VPS) before every keyframe to ensure
optimal coverage and the shortest possibly start-up time for a new client
- mpegtsmux can now mux H.265/HEVC video as well
- The MXF muxer was ported to 1.x and produces more standard conformant files now
that can be handled by more other software; The MXF demuxer got improved
support for seek tables (IndexTableSegments).
### Plugin moves
- The rtph265pay/depay RTP payloader/depayloader elements for H.265/HEVC video
from the rtph265 plugin in -bad have been moved into the existing rtp plugin
in gst-plugins-good.
- The mpg123 plugin containing a libmpg123 based audio decoder element has
been moved from -bad to -ugly.
- The Opus encoder/decoder elements have been moved to gst-plugins-base and
the RTP payloader to gst-plugins-good, both coming from gst-plugins-bad.
### New tracing tools for developers
A new tracing subsystem API has been added to GStreamer, which provides
external tracers with the possibility to strategically hook into GStreamer
internals and collect data that can be evaluated later. These tracers are a
new type of plugin features, and GStreamer core ships with a few example
tracers (latency, stats, rusage, log) to start with. Tracers can be loaded
and configured at start-up via an environment variable (GST\_TRACER\_PLUGINS).
Background: While GStreamer provides plenty of data on what's going on in a
pipeline via its debug log, that data is not necessarily structured enough to
be generally useful, and the overhead to enable logging output for all data
required might be too high in many cases. The new tracing system allows tracers
to just obtain the data needed at the right spot with as little overhead as
possible, which will be particularly useful on embedded systems.
Of course it has always been possible to do performance benchmarks and debug
memory leaks, memory consumption and invalid memory access using standard
operating system tools, but there are some things that are difficult to track
with the standard tools, and the new tracing system helps with that. Examples
are things such as latency handling, buffer flow, ownership transfer of
events and buffers from element to element, caps negotiation, etc.
For some background on the new tracing system, watch Stefan Sauer's
GStreamer Conference talk ["A new tracing subsystem for GStreamer"][tracer-0]
and for a more specific example how it can be useful have a look at
Thiago Santos's lightning talk ["Analyzing caps negotiation using GstTracer"][tracer-1]
and his ["GstTracer experiments"][tracer-2] blog post. There was also a Google
Summer of Code project in 2015 that used tracing system for a graphical
GStreamer debugging tool ["gst-debugger"][tracer-3].
This is all still very much work in progress, but we hope this will provide the
foundation for a whole suite of new debugging tools for GStreamer pipelines.
[tracer-0]: https://gstconf.ubicast.tv/videos/a-new-tracing-subsystem-for-gstreamer/
[tracer-1]: https://gstconf.ubicast.tv/videos/analyzing-caps-negotiation-using-gsttracer/
[tracer-2]: http://blog.thiagoss.com/2015/07/23/gsttracer-experiments/
[tracer-3]: https://git.gnome.org/browse/gst-debugger
### GstPlayer: a new high-level API for cross-platform multimedia playback
GStreamer has had reasonably high-level API for multimedia playback
in the form of the playbin element for a long time. This allowed application
developers to just configure a URI to play, and playbin would take care of
everything else. This works well, but there is still way too much to do on
the application-side to implement a fully-featured playback application, and
too much general GStreamer pipeline API exposed, making it less accessible
to application developers.
Enter GstPlayer. GstPlayer's aim is to provide an even higher-level abstraction
of a fully-featured playback API but specialised for its specific use case. It
also provides easy integration with and examples for Gtk+, Qt, Android, OS/X,
iOS and Windows. Watch Sebastian's [GstPlayer talk at the GStreamer Conference][gstplayer-talk]
for more information, or check out the [GstPlayer API reference][gstplayer-api]
and [GstPlayer examples][gstplayer-examples].
[gstplayer-api]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/player.html
[gstplayer-talk]: https://gstconf.ubicast.tv/videos/gstplayer-a-simple-cross-platform-api-for-all-your-media-playback-needs-part-1/
[gstplayer-examples]: https://github.com/sdroege/gst-player/
### Adaptive streaming: DASH, HLS and MSS improvements
- dashdemux now supports loading external xml nodes pointed from its MPD.
- Content protection nodes parsing support for PlayReady WRM in mssdemux.
- Reverse playback was improved to respect seek start and stop positions.
- Adaptive demuxers (hlsdemux, dashdemux, mssdemux) now support the SNAP_AFTER
and SNAP_BEFORE seek flags which will jump to the nearest fragment boundary
when executing a seek, which means playback resumes more quickly after a seek.
### Audio library improvements
- audio conversion, quantization and channel up/downmixing functionality
has been moved from the audioconvert element into the audio library and
is now available as public API in form of [GstAudioConverter][audio-0],
[GstAudioQuantize][audio-1] and [GstAudioChannelMixer][audio-2].
Audio resampling will follow in future releases.
- [gst\_audio\_channel\_get\_fallback\_mask()][audio-3] can be used
to retrieve a default channel mask for a given number of channels as last
resort if the layout is unknown
- A new [GstAudioClippingMeta][audio-4] meta was added for specifying clipping
on encoded audio buffers
- A new GstAudioVisualizer base class for audio visualisation elements;
most of the existing visualisers have been ported over to the new base class.
This new base class lives in the pbutils library rather than the audio library,
since we'd have had to make libgstaudio depend on libgstvideo otherwise,
which was deemed undesirable.
[audio-0]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-GstAudioConverter.html
[audio-1]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-GstAudioQuantize.html
[audio-2]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiochannels.html#gst-audio-channel-mix-new
[audio-3]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiochannels.html#gst-audio-channel-get-fallback-mask
[audio-4]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-base-libs/html/gst-plugins-base-libs-gstaudiometa.html#GstAudioClippingMeta
### GStreamer OpenGL support improvements
#### Better OpenGL Shader support
[GstGLShader][shader] has been revamped to allow more OpenGL shader types
by utilizing a new GstGLSLStage object. Each stage holds an OpenGL pipeline
stage such as a vertex, fragment or a geometry shader that are all compiled
separately into a program that is executed.
The glshader element has also received a revamp as a result of the changes in
the library. It does not take file locations for the vertex and fragment
shaders anymore. Instead it takes the strings directly leaving the file
management to the application.
A new [example][liveshader-example] was added utilizing the new shader
infrastructure showcasing live shader edits.
[shader]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/gst-plugins-bad-libs-gstglshader.html
[liveshader-example]: https://cgit.freedesktop.org/gstreamer/gst-plugins-bad/tree/tests/examples/gtk/glliveshader.c
#### OpenGL GLMemory rework
[GstGLMemory] was extensively reworked to support the addition of multiple
texture targets required for zero-copy integration with the Android
MediaCodec elements. This work was also used to provide IOSurface based
GLMemory on OS X for zero-copy with OS X's VideoToolbox decoder (vtdec) and
AV Foundation video source (avfvideosrc). There are also patches in bugzilla
for GstGLMemoryEGL specifically aimed at improving the decoding performance on
the Raspberry Pi.
[GstGLMemory]: https://gstreamer.freedesktop.org/data/doc/gstreamer/head/gst-plugins-bad-libs/html/gst-plugins-bad-libs-gstglmemory.html
A texture-target field was added to video/x-raw(memory:GLMemory) caps to signal
the texture target contained in the GLMemory. Its values can be 2D, rectangle
or external-oes. glcolorconvert can convert between the different formats as
required and different elements will accept or produce different targets. e.g.
glimagesink can take and render external-oes textures directly as required for
effecient zero-copy on android.
A generic GL allocation framework was also implemented to support the generic
allocation of OpenGL buffers and textures which is used extensively by
GstGLBufferPool.
#### OpenGL DMABuf import uploader
There is now a DMABuf uploader available for automatic selection that will
attempt to import the upstream provided DMABuf. The uploader will import into
2D textures with the necesarry format. YUV to RGB conversion is still provided
by glcolorconvert to avoid the laxer restrictions with external-oes textures.
#### OpenGL queries
Queries of various aspects of the OpenGL runtime such as timers, number of
samples or the current timestamp are not possible. The GstGLQuery object uses a
delayed debug system to delay the debug output to later to avoid expensive calls
to the glGet\* family of functions directly after finishing a query. It is
currently used to output the time taken to perform various operations of texture
uploads and downloads in GstGLMemory.
#### New OpenGL elements
glcolorbalance has been created mirroring the videobalance elements.
glcolorbalance provides the exact same interface as videobalance so can be used
as a GPU accelerated replacement. glcolorbalance has been added to glsinkbin so
usage with playsink/playbin will use it automatically instead of videobalance
where possible.
glvideoflip, which is the OpenGL equiavalant of videoflip, implements the exact
same interface and functionality as videoflip.
#### EGL implementation now selects OpenGL 3.x
The EGL implementation can now select OpenGL 3.x contexts.
#### OpenGL API removal
The GstGLDownload library object was removed as it was not used by anything.
Everything is performed by GstGLMemory or in the gldownloadelement.
The GstGLUploadMeta library object was removed as it was not being used and we
don't want to promote the use of GstVideoGLTextureUploadMeta.
#### OpenGL: Other miscellaneous changes
- The EGL implementation can now select OpenGL 3.x contexts. This brings
OpenGL 3.x to e.g. wayland and other EGL systems.
- glstereomix/glstereosplit are now built and are usable on OpenGL ES systems
- The UYVY/YUY2 to RGBA and RGBA to UYVY/YUY2 shaders were fixed removing the
sawtooth pattern and luma bleeding.
- We now utilize the GL\_APPLE\_sync extension on iOS devices which improves
performance of OpenGL applications, especially with multiple OpenGL
contexts.
- glcolorconvert now uses a bufferpool to avoid costly
glGenTextures/glDeleteTextures for every frame.
- glvideomixer now has full glBlendFunc and glBlendEquation support per input.
- gltransformation now support navigation events so your weird transformations
also work with DVD menus.
- qmlglsink can now run on iOS, OS X and Android in addition to the already
supported Linux platform.
- glimagesink now posts unhandled keyboard and mouse events (on backends that
support user input, current only X11) on the bus for the application.
### Initial GStreamer Vulkan support
Some new elements, vulkansink and vulkanupload have been implemented utilizing
the new Vulkan API. The implementation is currently limited to X11 platforms
(via xcb) and does not perform any scaling of the stream's contents to the size
of the available output.
A lot of infrasctructure work has been undertaken to support using Vulkan in
GStreamer in the future. A number of GstMemory subclasses have been created for
integrating Vulkan's GPU memory handling along with VkBuffer's and VkImage's
that can be passed between elements. Some GStreamer refcounted wrappers for
global objects such as VkInstance, VkDevice, VkQueue, etc have also been
implemented along with GstContext integration for sharing these objects with the
application.
### GStreamer VAAPI support for hardware-accelerated video decoding and encoding on Intel (and other) platforms
#### GStreamer VAAPI is now part of upstream GStreamer
The GStreamer-VAAPI module which provides support for hardware-accelerated
video decoding, encoding and post-processing on Intel graphics hardware
on Linux has moved from its previous home at the [Intel Open Source Technology Center][iostc]
to the upstream GStreamer repositories, where it will in future be maintained
as part of the upstream GStreamer project and released in lockstep with the
other GStreamer modules. The current maintainers will continue to spearhead
the development at the new location:
[http://cgit.freedesktop.org/gstreamer/gstreamer-vaapi/][gst-vaapi-git]
[gst-vaapi-git]: http://cgit.freedesktop.org/gstreamer/gstreamer-vaapi/
GStreamer-VAAPI relies heavily on certain GStreamer infrastructure API that
is still in flux such as the OpenGL integration API or the codec parser
libraries, and one of the goals of the move was to be able to leverage
new developments early and provide tighter integration with the latest
developments of those APIs and other graphics-related APIs provided by
GStreamer, which should hopefully improve performance even further and in
some cases might also provide better stability.
Thanks to everyone involved in making this move happen!
#### GStreamer VAAPI: Bug tracking
Bugs had already been tracked on [GNOME bugzilla](bgo) but will be moved
from the gstreamer-vaapi product into a new gstreamer-vaapi component of
the GStreamer product in bugzilla. Please file new bugs against the new
component in the GStreamer product from now on.
#### GStreamer VAAPI: Pending patches
The code base has been re-indented to the GStreamer code style, which
affected some files more than others. This means that some of the patches
in bugzilla might not apply any longer, so if you have any unmerged patches
sitting in bugzilla please consider checking if they still apply cleany and
refresh them if not. Sorry for any inconvenience this may cause.
#### GStreamer VAAPI: New versioning scheme and supported GStreamer versions
The version numbering has been changed to match the GStreamer version
numbering to avoid confusion: there is a new gstreamer-vaapi 1.6.0 release
and a 1.6 branch that is roughly equivalent to the previous 0.7.0 version.
Future releases 1.7.x and 1.8.x will be made alongside GStreamer releases.
While it was possible and supported by previous releases to build against
a whole range of different GStreamer versions (such as 1.2, 1.4, 1.6 or 1.7/1.8),
in the future there will only be one target branch, so that git master will
track GStreamer git master, 1.8.x will target GStreamer 1.8, and
1.6.x will target the 1.6 series.
[iostc]: http://01.org
[bgo]: http://bugzilla.gnome.og
#### GStreamer VAAPI: Miscellaneous changes
All GStreamer-VAAPI functionality is now provided solely by its GStreamer
elements. There is no more public library exposing GstVaapi API, this API
was only ever meant for private use by the elements. Parts of it may be
resurrected again in future if needed, but for now it has all been made
private.
GStreamer-VAAPI now unconditionally uses the codecparser library in
gst-plugins-bad instead of shipping its own internal copy. Similarly,
it no longer ships its own codec parsers but relies on the upstream
codec parser elements.
The GStreamer-VAAPI encoder elements have been renamed from vaapiencode_foo
to vaapifooenc, so encoders are now called vaapih264enc, vaapih265enc,
vaapimpeg2enc, vaapijpegenc, and vaapivp8enc. With this change we now follow
the standard names in GStreamer, and the plugin documentation is generated
correctly.
In the case of the decoders, only the jpeg decoder has been split from the
general decoding element vaapidecode: vaapijpegdec. This is the first step to
split per codec each decoding element. The vaapijpegdec has also been given
marginal rank for the time being.
#### GStreamer VAAPI: New features in 1.8: 10-bit H.265/HEVC decoding support
Support for decoding 10-bit H.265/HEVC has been added. For the time being
this only works in combination with vaapisink though, until support for the
P010 video format used internally is added to GStreamer and to the
vaGetImage()/vaPutimage() API in the vaapi-intel-driver.
Several fixes for memory leaks, build errors, and in the internal
video parsing.
Finally, vaapisink now posts the unhandled keyboard and mouse events to the
application.
### GStreamer Video 4 Linux Support
Colorimetry support has been enhanced even more. It will now properly select
default values when not specified by the driver. The range of color formats
supported by GStreamer has been greatly improved. Notably, support for
multi-planar I420 has been added along with all the new and non-ambiguous RGB
formats that got added in recent kernels.
The device provider now exposes a variety of properties as found in the udev
database.
The video decoder is now able to negotiate the downstream format.
Elements that are dynamically created from /dev/video\* now track changes on
these devices to ensure the registry stay up to date.
All this and various bug fixes that improve both stability and correctness.
### GStreamer Editing Services
Added APIs to handle asset proxying support. Proxy creation is not the
responsibility of GES itself, but GES provides all the needed features
for it to be cleanly handled at a higher level.
Added support for changing playback rate. This means that now, whenever a
user adds a 'pitch' element (as it is the only known element to change playback
rate through properties), GES will handle everything internally. This change
introduced a new media-duration-factor property in NleObject which will
lead to tweaking of seek events so they have the proper playback range to be
requested upstream.
Construction of NLE objects has been reworked making copy/pasting fully
functional and allowing users to set properties on effects right after
creating them.
Rework of the title source to add more flexibility in text positioning,
and letting the user get feedback about rendered text positioning.
Report nlecomposition structural issues (coming from user programing mistakes)
into ERROR messages on the bus.
Add GI/pythyon testsuite in GES itself, making sure the API is working as expected
in python, and allowing writing tests faster.
### GstValidate
Added support to run tests inside gdb.
Added a 'smart' reporting mode where we give as much information as possible about
critical errors.
Uses GstTracer now instead of a LD\_PRELOAD library.
## Miscellaneous
- encodebin now works with "encoder-muxers" such as wavenc
- gst-play-1.0 acquired a new keyboard shortcut: '0' seeks back to the start
- gst-play-1.0 supports two new command line switches: -v for verbose output
and --flags to configure the playbin flags to use.
## Build and Dependencies
- The GLib dependency requirement was bumped to 2.40
- The -Bsymbolic configure check now works with clang as well
- ffmpeg is now required as libav provider, incompatible changes were
introduced that make it no longer viable to support both FFmpeg and Libav
as libav providers. Most major distros have switched to FFmpeg or are in
the process of switching to it anyway, so we don't expect this to be a
problem, and there is still an internal copy of ffmpeg that can be used
as fallback if needed.
- The internal ffmpeg snapshot is now FFMpeg 3.0, but it should be possible
to build against 2.8 as well for the time being.
## Platform-specific improvements
### Android
- Zero-copy video decoding on Android using the hardware-accelerated decoders
has been implemented, and is fully integrated with the GStreamer OpenGL stack
- ahcsrc, a new camera source element, has been merged and can be used to
capture video on android devices. It uses the android.hardware.Camera Java
API to capture from the system's cameras.
- The OpenGL-based QML video sink can now also be used on Android
- New tinyalsasink element, which is mainly useful for Android but can also
be used on other platforms.
### OS/X and iOS
- The system clock now uses mach\_absolute\_time() on OSX/iOS, which is
the preferred high-resolution monotonic clock to be used on Apple platforms
- The OpenGL-based QML video sink can now also be used on OS X and iOS (with
some Qt build system massaging)
- New IOSurface based memory implementation in avfvideosrc and vtdec on OS X
for zerocopy with OpenGL. The previously used OpenGL extension
GL_APPLE_ycbcr_422 is not compatible with GL 3.x core contexts.
- New GstAppleCoreVideoMemory wrapping CVPixelBuffer's
- avfvideosrc now supports renegotiation.
### Windows
- Various bugs with UDP and multicast were fixed on Windows, mostly related to
gst-rtsp-server.
- A few bugs in directsoundsrc and directsoundsink were fixed that could cause
the element to lock up. Also the "mute" property on the sink was fixed, and
a new "device" property for device selection was added to the source.
## Known Issues
- Building GStreamer applications with the Android NDK r11 is currently not
supported due to incompatible changes in the NDK. This is expected to be
fixed for 1.8.1.
[Bugzilla #763999](https://bugzilla.gnome.org/show_bug.cgi?id=763999)
- vp8enc crashes on 32 bit Windows, but was working fine in 1.6. 64 bit
Windows is unaffected.
[Bugzilla #763663](https://bugzilla.gnome.org/show_bug.cgi?id=763663)
## Contributors
Adam Miartus, Alban Bedel, Aleix Conchillo Flaqué, Aleksander Wabik,
Alessandro Decina, Alex Ashley, Alex Dizengof, Alex Henrie, Alistair Buxton,
Andreas Cadhalpun, Andreas Frisch, André Draszik, Anthony G. Basile,
Antoine Jacoutot, Anton Bondarenko, Antonio Ospite, Arjen Veenhuizen,
Arnaud Vrac, Arun Raghavan, Athanasios Oikonomou, Aurélien Zanelli, Ben Iofel,
Bob Holcomb, Branko Subasic, Carlos Rafael Giani, Chris Bass, Csaba Toth,
Daniel Kamil Kozar, Danilo Cesar Lemes de Paula, Dave Craig, David Fernandez,
David Schleef, David Svensson Fors, David Waring, David Wu, Duncan Palmer,
Edward Hervey, Egor Zaharov, Etienne Peron, Eunhae Choi, Evan Callaway,
Evan Nemerson, Fabian Orccon, Florent Thiéry, Florin Apostol, Frédéric Wang,
George Kiagiadakis, George Yunaev, Göran Jönsson, Graham Leggett,
Guillaume Desmottes, Guillaume Marquebielle, Haihua Hu, Havard Graff,
Heinrich Fink, Holger Kaelberer, HoonHee Lee, Hugues Fruchet, Hyunil Park,
Hyunjun Ko, Ilya Konstantinov, James Stevenson, Jan Alexander Steffens (heftig),
Jan Schmidt, Jason Litzinger, Jens Georg, Jimmy Ohn, Joan Pau Beltran,
Joe Gorse, John Chang, John Slade, Jose Antonio Santos Cadenas, Josep Torra,
Julian Bouzas, Julien Isorce, Julien Moutte, Justin Kim, Kazunori Kobayashi,
Koop Mast, Lim Siew Hoon, Linus Svensson, Lubosz Sarnecki, Luis de Bethencourt,
Lukasz Forynski, Manasa Athreya, Marcel Holtmann, Marcin Kolny, Marcus Prebble,
Mark Nauwelaerts, Maroš Ondrášek, Martin Kelly, Matej Knopp, Mathias Hasselmann,
Mathieu Duponchelle, Matt Crane, Matthew Marsh, Matthew Waters, Matthieu Bouron,
Mersad Jelacic, Michael Olbrich, Miguel París Díaz, Mikhail Fludkov,
Mischa Spiegelmock, Nicola Murino, Nicolas Dufresne, Nicolas Huet,
Nirbheek Chauhan, Ognyan Tonchev, Olivier Crête, Pablo Anton, Pankaj Darak,
Paolo Pettinato, Patricia Muscalu, Paul Arzelier, Pavel Bludov, Perry Hung,
Peter Korsgaard, Peter Seiderer, Petr Viktorin, Philippe Normand,
Philippe Renon, Philipp Zabel, Philip Van Hoof, Philip Withnall, Piotr Drąg,
plamot, Polochon\_street, Prashant Gotarne, Rajat Verma, Ramiro Polla,
Ravi Kiran K N, Reynaldo H. Verdejo Pinochet, Robert Swain, Romain Picard,
Roman Nowicki, Ross Burton, Ryan Hendrickson, Santiago Carot-Nemesio,
Scott D Phillips, Sebastian Dröge, Sebastian Rasmussen, Sergey Borovkov,
Seungha Yang, Sjors Gielen, Song Bing, Sreerenj Balachandran, Srimanta Panda,
Stavros Vagionitis, Stefan Sauer, Steven Hoving, Stian Selnes, Suhwang Kim,
Thiago Santos, Thibault Saunier, Thijs Vermeir, Thomas Bluemel, Thomas Roos,
Thomas Vander Stichele, Tim-Philipp Müller, Tim Sheridan, Ting-Wei Lan,
Tom Deseyn, Vanessa Chipirrás Navalón, Víctor Manuel Jáquez Leal,
Vincent Dehors, Vincent Penquerc'h, Vineeth T M, Vivia Nikolaidou,
Wang Xin-yu (王昕宇), William Manley, Wim Taymans, Wonchul Lee, Xavi Artigas,
Xavier Claessens, Youness Alaoui,
... and many others who have contributed bug reports, translations, sent
suggestions or helped testing.
## Bugs fixed in 1.8
More than [~700 bugs][bugs-fixed-in-1.8] have been fixed during
the development of 1.8.
This list does not include issues that have been cherry-picked into the
stable 1.6 branch and fixed there as well, all fixes that ended up in the
1.6 branch are also included in 1.8.
This list also does not include issues that have been fixed without a bug
report in bugzilla, so the actual number of fixes is much higher.
[bugs-fixed-in-1.8]: https://bugzilla.gnome.org/buglist.cgi?bug_status=RESOLVED&bug_status=VERIFIED&classification=Platform&limit=0&list_id=107311&order=bug_id&product=GStreamer&query_format=advanced&resolution=FIXED&target_milestone=1.6.1&target_milestone=1.6.2&target_milestone=1.6.3&target_milestone=1.7.0&target_milestone=1.7.1&target_milestone=1.7.2&target_milestone=1.7.3&target_milestone=1.7.4&target_milestone=1.7.90&target_milestone=1.7.91&target_milestone=1.7.92&target_milestone=1.7.x&target_milestone=1.8.0
## Stable 1.8 branch
After the 1.8.0 release there will be several 1.8.x bug-fix releases which
will contain bug fixes which have been deemed suitable for a stable branch,
but no new features or intrusive changes will be added to a bug-fix release
usually. The 1.8.x bug-fix releases will be made from the git 1.8 branch, which
is a stable branch.
### 1.8.0
1.8.0 was released on 24 March 2016.
### 1.8.1
The first 1.8 bug-fix release (1.8.1) is planned for April 2016.
## Schedule for 1.10
Our next major feature release will be 1.10, and 1.9 will be the unstable
development version leading up to the stable 1.10 release. The development
of 1.9/1.10 will happen in the git master branch.
The plan for the 1.10 development cycle is yet to be confirmed, but it is
expected that feature freeze will be around late July or early August,
followed by several 1.9 pre-releases and the new 1.10 stable release
in September.
1.10 will be backwards-compatible to the stable 1.8, 1.6, 1.4, 1.2 and 1.0
release series.
- - -
*These release notes have been prepared by Tim-Philipp Müller with
contributions from Sebastian Dröge, Nicolas Dufresne, Edward Hervey, Víctor
Manuel Jáquez Leal, Arun Raghavan, Thiago Santos, Thibault Saunier, Jan
Schmidt and Matthew Waters.*
*License: [CC BY-SA 4.0](http://creativecommons.org/licenses/by-sa/4.0/)*