Github gstreamer-unity plugins.

Getting 3D to the Dimenco display

The idea is to create 2 suitably large images on a Canvas. One for the image data, one for the depth data. Attach a camera to each of the images. The create a shader to output the correct dimenco image format.

The suitably large Canvas is exactly the native 4K resolution.

Unity Video rendering.

As a firt test vlc can be used to provide a http stream for the Unity video player asset.

Command line:

vlc sample_sdp_file.sdp :sout=#transcode{acodec=none}:http{dst=:8080/video.mpg} :sout-keep

The sdp file contains

v=0
c=IN IP4 10.11.13.154
m=video 1234 RTP/AVP 96
a=rtpmap:96 H264/90000
a=fmtp:96 media=video sprop-parameter-sets=Z2QAKawrQDIBLyA\=\,aO48sA\=\=; encoding-name=H264

The 96 is a format parameter for the RTP stream type. The sprop is a format parameter for the video. This format parameter can be found from

gst-launch-1.0 -vvv videotestsrc ! "video/x-raw,width=1600,height=1200,format=YUY2,framerate=24/1" ! videoconvert ! omxh264enc bitrate=40000000 profile=8 quality-level=2 control-rate=2 temporal-tradeoff=0 no-B-Frames=false insert-sps-pps=true low-latency=true ! "video/x-h264,stream-format=(string)byte-stream" ! h264parse ! rtph264pay pt=96 ! udpsink host=10.11.3.154 port=1234

Unity has been discarded for a dedicated client see dirtpc.