An Open Source IoT for IP Media Workflow Dr Richard Cartwright – CTO Streampunk Media Ltd. http://www.streampunk.media
Introduction First appearing at NAB 2016, Streampunk Media Ltd is a brand new start up company based in Scotland, UK, aiming to democratize professional content production with commodity infrastructure. We develop open-source software for stream-based media production, supporting a transition to dynamic software infrastructure. Dr Richard Cartwright is CTO and founder of Streampunk Media. Richard holds a PhD in Computer Science from the University of Warwick. He has previously worked at the BBC, SAM & as Technical Steering Committee Chair of the AMWA. Richard is a co-author of the JT-NM Reference Architecture.
The story so far … • Open-source is a well-established business model • Start a company: no bespoke hardware, smart home “IoT” approach • Apply expertise from file-based workflow and Internet to real time streams
• Software only: cloud-fit, secure, intuitive, scalable, IT • Professional media standards - easy for millennials to work with • Demonstrate agility & new workflows enabled by the JT-NM RA
• Commodity platform: CPU, GPU, virtual, PC/Mac/Linux/RPi • Node.JS/C++, Node-RED, Github, Blackmagic, Windows RIO, ansible, REST
• Trialled as part of BBC Northern Ireland’s IP PoC lab • Linked to AMWA Labs – more info www.amwa.tv
Node-RED set up 1. Install: • Node.JS LTS; • node-gyp prereq.; • Node-RED.
2. Run node-red • http://localhost:1880
nodes capabilities
flow-based IoT programming
Dynamic media extension 1. Install: • Node.JS LTS; • node-gyp prereq.; • Node-RED.
2. Run node-red • http://localhost:1880
3. Menu -> Manage palette • Install tab • Search dynamorse
4. Install core module 5. Add other modules
1.
Install core + specific modules
Wire up infrastructure
Capabilities https://flows.nodered.org/ search for ‘dynamorse’
Efficiently use compute
flows of grains
asynchronous, non-blocking, reactive
producer
devices
error
error consumer
Agility & IT optimisation HTTP(S) • Application-layer scaling • Trade latency/bandwidth - L/WAN • TCP: hardware accel., security, reliability
RTP • Multicast scaling • Low latency – LAN • UDP: build reliability, performance
RTP sender
HTTP server
1 4 7
2 5 8
sequential / unidirectional
3 6 9
9
8
A B C parallel / bidirectional
…
2
1
HTTP requester
1 4 7
2 5 8
3 6 9
Going beyond SDI
RTP receiver
Replicating SDI
Commodity Platform
THE IT platform - virtualizable core ‌ with legacy broadcast at the edge
Commodity Platform
on-the-fly software capabilities
THE IT platform - virtualizable ‌ with legacy broadcast at the edge
Commodity Platform runtime configuration via web UI or REST API
on-the-fly software capabilities
THE IT platform - virtualizable ‌ with legacy broadcast at the edge
Scale, virtualize, IT!
computer b
computer x
Scale, virtualize, IT! IT real time monitoring
media workflow
NMOS IS-04
automated software deployment
physical or virtual compute
common clock – NTP/PTP
dynamic software infrastructure (aka cloud)
computer a shared storage
computer b
computer x
Scale, virtualize, IT! IT real time monitoring
media workflow
NMOS IS-04
automated software deployment
physical or virtual compute
common clock – NTP/PTP
dynamic software infrastructure (aka cloud)
media specific
computer a shared storage
computer b
computer x
Key takeaways • • • • • • •
The JT-NM RA is an enabler for dynamic media workflows – go beyond SDI Dynamic, software-only, stream-based infrastructure - feasible today Smart home? Why not smart media infrastructure? – ride the IoT Efficient use of THE IT platform: cloud-fit; secure; scalable; IT toolsets Open-source prototypes: funnels, valves, spouts, fittings, gauges Agility: trade latency / bandwidth – glue RTP, HTTP(S), MPEG-TS, file etc. Next steps: More devices & codecs. Virtual vision mixer. http://www.streampunk.media furnace@streampunk.media