Richardcartwright

An Open Source IoT for IP Media Workflow Dr Richard Cartwright – CTO Streampunk Media Ltd. http://www.streampunk.media

Introduction First appearing at NAB 2016, Streampunk Media Ltd is a brand new start up company based in Scotland, UK, aiming to democratize professional content production with commodity infrastructure. We develop open-source software for stream-based media production, supporting a transition to dynamic software infrastructure.

Dr Richard Cartwright is CTO and founder of Streampunk Media.

Richard holds a PhD in Computer Science from the University of Warwick. He has previously worked at the BBC, SAM & as Technical Steering Committee Chair of the AMWA. Richard is a co-author of the JT-NM Reference Architecture.

The story so far …

• Open-source is a well-established business model • Start a company: no bespoke hardware, smart home “IoT” approach • Apply expertise from file-based workflow and Internet to real time streams

• Software only: cloud-fit, secure, intuitive, scalable, IT • Professional media standards - easy for millennials to work with • Demonstrate agility & new workflows enabled by the JT-NM RA

• Commodity platform: CPU, GPU, virtual, PC/Mac/Linux/RPi • Node.JS/C++, Node-RED, Github, Blackmagic, Windows RIO, ansible, REST

• Trialled as part of BBC Northern Ireland’s IP PoC lab • Linked to AMWA Labs – more info www.amwa.tv

Node-RED set up 1. Install: • Node.JS LTS; • node-gyp prereq.; • Node-RED.

2. Run node-red • http://localhost:1880

nodes capabilities

flow-based IoT programming

Dynamic media extension 1. Install: • Node.JS LTS; • node-gyp prereq.; • Node-RED.

2. Run node-red • http://localhost:1880

3. Menu -> Manage palette • Install tab • Search dynamorse

4. Install core module 5. Add other modules

1.

Install core + specific modules

Wire up infrastructure

Capabilities https://flows.nodered.org/ search for ‘dynamorse’

Efficiently use compute

flows of grains

asynchronous, non-blocking, reactive

producer

devices

error

error consumer

Agility & IT optimisation HTTP(S) • Application-layer scaling • Trade latency/bandwidth - L/WAN • TCP: hardware accel., security, reliability

RTP • Multicast scaling • Low latency – LAN • UDP: build reliability, performance

RTP sender

HTTP server

1 4 7

2 5 8

sequential / unidirectional

3 6 9

9

8

A B C parallel / bidirectional

…

2

1

HTTP requester

1 4 7

2 5 8

3 6 9

Going beyond SDI

RTP receiver

Replicating SDI

Commodity Platform

THE IT platform - virtualizable core ‌ with legacy broadcast at the edge

Commodity Platform

on-the-fly software capabilities

THE IT platform - virtualizable ‌ with legacy broadcast at the edge

Commodity Platform runtime configuration via web UI or REST API

on-the-fly software capabilities

THE IT platform - virtualizable ‌ with legacy broadcast at the edge

Scale, virtualize, IT!

computer b

computer x

Scale, virtualize, IT! IT real time monitoring

media workflow

NMOS IS-04

automated software deployment

physical or virtual compute

common clock – NTP/PTP

dynamic software infrastructure (aka cloud)

computer a shared storage

computer b

computer x

Scale, virtualize, IT! IT real time monitoring

media workflow

NMOS IS-04

automated software deployment

physical or virtual compute

common clock – NTP/PTP

dynamic software infrastructure (aka cloud)

media specific

computer a shared storage

computer b

computer x

Key takeaways • • • • • • •

The JT-NM RA is an enabler for dynamic media workflows – go beyond SDI Dynamic, software-only, stream-based infrastructure - feasible today Smart home? Why not smart media infrastructure? – ride the IoT Efficient use of THE IT platform: cloud-fit; secure; scalable; IT toolsets Open-source prototypes: funnels, valves, spouts, fittings, gauges Agility: trade latency / bandwidth – glue RTP, HTTP(S), MPEG-TS, file etc.

Next steps: More devices & codecs. Virtual vision mixer. http://www.streampunk.media furnace@streampunk.media