Geek Answers Handbook

In Gstreamer, playing in the pipeline in iOS 8, and after entering the background and returning to the foreground does not work :(?

- In fact, I downloaded the sample tutorial for gstreamer from the link,

http://cgit.freedesktop.org/~slomo/gst-sdk-tutorials/

git: //people.freedesktop.org/~slomo/gst-sdk-tutorials

  • Now I modified the following code in tutorial 3,

    -(void) app_function
 {
GstBus *bus;
GSource *bus_source;
GError *error = NULL;

GST_DEBUG ("Creating pipeline");

pipeline = gst_pipeline_new ("e-pipeline");


/* Create our own GLib Main Context and make it the default one */
context = g_main_context_new ();
g_main_context_push_thread_default(context);

/* Build pipeline */
// pipeline = gst_parse_launch("videotestsrc ! warptv ! videoconvert ! autovideosink", &error);


source = gst_element_factory_make("udpsrc", "source");

g_object_set( G_OBJECT ( source),   "port", 8001, NULL );

GstCaps *caps;

caps = gst_caps_new_simple ("application/x-rtp",
                            "encoding-name", G_TYPE_STRING, "H264",
                            "payload", G_TYPE_INT, 96,
                            "clock-rate", G_TYPE_INT, 90000,
                            NULL);

g_object_set (source, "caps", caps, NULL);




rtp264depay = gst_element_factory_make ("rtph264depay", "rtph264depay");
h264parse = gst_element_factory_make ("h264parse", "h264parse");
vtdec = gst_element_factory_make ("vtdec", "vtdec");
glimagesink  = gst_element_factory_make ("glimagesink", "glimagesink");

gst_bin_add_many (GST_BIN(pipeline), source,  rtp264depay, h264parse, vtdec, glimagesink, NULL);




if (error) {
    gchar *message = g_strdup_printf("Unable to build pipeline: %s", error->message);
    g_clear_error (&error);
    [self setUIMessage:message];
    g_free (message);
    return;
}

/* Set the pipeline to READY, so it can already accept a window handle */
gst_element_set_state(pipeline, GST_STATE_READY);

video_sink = gst_bin_get_by_interface(GST_BIN(pipeline), GST_TYPE_VIDEO_OVERLAY);
if (!video_sink) {
    GST_ERROR ("Could not retrieve video sink");
    return;
}
gst_video_overlay_set_window_handle(GST_VIDEO_OVERLAY(video_sink), (guintptr) (id) ui_video_view);

/* Instruct the bus to emit signals for each received message, and connect to the interesting signals */
bus = gst_element_get_bus (pipeline);
bus_source = gst_bus_create_watch (bus);
g_source_set_callback (bus_source, (GSourceFunc) gst_bus_async_signal_func, NULL, NULL);
g_source_attach (bus_source, context);
g_source_unref (bus_source);
g_signal_connect (G_OBJECT (bus), "message::error", (GCallback)error_cb, (__bridge void *)self);
g_signal_connect (G_OBJECT (bus), "message::state-changed", (GCallback)state_changed_cb, (__bridge void *)self);
gst_object_unref (bus);

/* Create a GLib Main Loop and set it to run */
GST_DEBUG ("Entering main loop...");
main_loop = g_main_loop_new (context, FALSE);
[self check_initialization_complete];
g_main_loop_run (main_loop);
GST_DEBUG ("Exited main loop");
g_main_loop_unref (main_loop);
main_loop = NULL;

/* Free resources */
g_main_context_pop_thread_default(context);
g_main_context_unref (context);
gst_element_set_state (pipeline, GST_STATE_NULL);
gst_object_unref (pipeline);

return;

    }

-Why do I run the application on the ipad and the application starts playing.

  • Now I go into the background and come back to the foreground Gstreamer streaming updates do not appear in the user interface, but in the use of the xcode network I could see the packets being received .... :(

Thanks in advance .... iOS GEEKS ....

+4
source share
2 answers

Update: get UDP to work.

UDP h264 linux ( x86), IOS ( avdec_h264 ( ) vtdec).

TCP UDP:

:

  • IP: 1- , UDP TCP-: UDP- IP-, udpsink, IP, .. gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=1 pt=96 ! udpsink host=$CLIENTIP port=5000

TCP IP ( tcpserversink), .. gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=1 pt=96 ! gdppay ! tcpserversink host=$SERVERIP port=5000

  • / : , , TCP gdppay, payloader . de-payloader gdpdepay, .

gst-launch-1.0 -v fdsrc! h264parse! rtph264pay config-interval = 1 pt = 96! gdppay! tcpserversink host = $SERVERIP port = 5000

UDP gdpay, CAPS udpsink, . . p >

  • IP: UDP IP-. TCP IP- ( tcpclientsrc), .. gst-launch-1.0 -v tcpclientsrc host=$SERVERIP port=5000 ! gdpdepay ! rtph264depay ! avdec_h264 ! videoconvert ! autovideosink sync=false enable-last-buffer=false
  • / : , TCP- payloader gdppay, - .

UDP caps udpsrc, .. CAPS='application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96'

gst-launch-1.0 -v udpsrc port = 5000 caps = $CAPS! rtph264depay! avdec_h264! ! autovideosink sync = false enable-last-buffer = false`

: , : UDP-, -v, . gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=1 pt=96 ! udpsink host=$CLIENTIP port=5000

:

Setting pipeline to PAUSED ... Pipeline is PREROLLING ... /GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:src: caps = video/x-h264, width=(int)1280, height=(int)720, parsed=(boolean)true, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1000e27640028ac2b402802dd00f1226a01000428ee1f2c /GstPipeline:pipeline0/GstRtpH264Pay:rtph264pay0.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, sprop-parameter-sets=(string)"J2QAKKwrQCgC3QDxImo\=\,KO4fLA\=\=", payload=(int)96, ssrc=(uint)3473549335, timestamp-offset=(uint)257034921, seqnum-offset=(uint)12956 /GstPipeline:pipeline0/GstUDPSink:udpsink0.GstPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, sprop-parameter-sets=(string)"J2QAKKwrQCgC3QDxImo\=\,KO4fLA\=\=", payload=(int)96, ssrc=(uint)3473549335, timestamp-offset=(uint)257034921, seqnum-offset=(uint)12956 /GstPipeline:pipeline0/GstRtpH264Pay:rtph264pay0.GstPad:sink: caps = video/x-h264, width=(int)1280, height=(int)720, parsed=(boolean)true, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1000e27640028ac2b402802dd00f1226a01000428ee1f2c /GstPipeline:pipeline0/GstRtpH264Pay:rtph264pay0: timestamp = 257034921 /GstPipeline:pipeline0/GstRtpH264Pay:rtph264pay0: seqnum = 12956 Pipeline is PREROLLED ... Setting pipeline to PLAYING ...

, caps = application/x-rtp , rtp. , , UDP- rtp .

, , raspivid pi. ( linux)

UDP

  • : raspivid -t 0 -w 1280 -h 720 -fps 25 -b 2500000 -o - | gst-launch-1.0 -v fdsrc ! h264parse ! rtph264pay config-interval=1 pt=96 ! udpsink host=$CLIENTIP port=5000
  • : CAPS='application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)H264, payload=(int)96' gst-launch-1.0 -v udpsrc port=5000 caps=$CAPS ! rtph264depay ! avdec_h264 ! videoconvert ! autovideosink sync=false enable-last-buffer=false

TCP

  • : raspivid -t 0 -w 1280 -h 720 -fps 25 -b 2500000 -o - | gst-launch-0.10 -v fdsrc ! h264parse ! rtph264pay config-interval=1 pt=96 ! gdppay ! tcpserversink host=$SERVERIP port=5000

  • : gst-launch-1.0 -v tcpclientsrc host=$SERVERIP port=5000 ! gdpdepay ! rtph264depay ! avdec_h264 ! videoconvert ! autovideosink sync=false enable-last-buffer=false

. Raspivid h264 cat, .. cat myfile.h264 | gst-launch...

+1

, RaspberryPi IOS8, h264, API Apple VideoToolBox gstreamer vtdec.

, braincorp (https://github.com/braincorp/gstreamer_ios_tutorial)

: http://cgit.freedesktop.org/~slomo/gst-sdk-tutorials/

, , 3:

  • RaspberryPi pi Camera Raspivid + gstreamer:
    raspivid -t 0 -w 1280 -h 720 -fps 25 -b 2500000 -p 0,0,640,480 -o - | gst-launch-0.10 -v fdsrc! h264parse! rtph264pay config-interval = 1 pt = 96! gdppay! tcpserversink host = ServerIPRaspberryPi port = any_port_on_Rpi

  • IOS 8:
    tcpclientsrc host = ServerIPRaspberryPi port = any_port_on_Rpi! gdpdepay! rtph264depay! h264parse! vtdec! glimagesink

, glimagesink autovideosink.

, . udpsink tcpserversink, .

=== ===
factory gst_element_factory_make() + gst_bin_add_many (GST_BIN (),...) . pipe = gst_parse_launch (...).

, IOS:
= gst_parse_launch ( "tcpclientsrc host = 172.19.20.82 port = 5000! gdpdepay! rtph264depay! h264parse! vtdec! autovideosink", & );

: , , gstreamer 0.10 1.0: http://gstreamer.freedesktop.org/data/doc/gstreamer/head/manual/html/chapter-porting-1.0.html

, "factory" , gstreamer 1.0 0,1, .. trph264depay avdec_h264 ( , linux) h264 IOS vtdec).

, Factory, - "gst_parse_launch()" , IOS Linux.

, , UDP, TCP, tcpclientsrc , , , udp, PLS , .

, , .

Romain S

+1

More articles:


All Articles