Time Compensated Remote Production in the All-IP World Ed Calverley Product Director – Suitcase TV
Introduction Suitcase TV has been developing innovative solutions for broadcast since 1999. Based in the UK, it was one of the first companies to offer disk-based compliance recording and developed a wide range of software tools for file-based workflows. The company continues to innovate and is now focussed on end-to-end IP-based solutions for live production with its Iphrame platform. Ed Calverley started in broadcast in 1999 with the BBC as a Project Manager where he oversaw the digitisation of a number of playout services. Whilst at OmniBus (later acquired by Miranda-now GV) he was involved in the implementation of a number of large automation, newsroom and MAM installations before becoming a key player in the delivery and product management for the new iTX platform which brought about the 'channel-in-a-box' revolution in playout. Now at Suitcase TV, Ed continues to embrace new ways of working and to make use of emerging technologies to empower the next revolution.
JT-NM Reference Architecture Joint Task Force on Network Media:
• ‘Reference Architecture’ published in September 2015 • Defines the elements required for a fully IP-based TV studio (i.e. multi-vendor interoperable systems without SDI)
• http://www.jt-nm.org/RA-1.0
Roadmap Reminder
Roadmap Reminder SMPTE 2022-6 • SDI carried over IP • All-In-One package (video, embedded audio, timecode, VANC data, +lots of ‘blank’ signal)
Roadmap Reminder TR-04 (Technical Recommendation published by VSF) • Transport and sync. of separate audio streams (AES67) alongside a SMPTE 2022-6 signal
• Enables more flexible audio workflows
Roadmap Reminder TR-03 (Technical Recommendation published by VSF) • Transport and sync. of separate essence streams • More efficient use of network bandwidth RFC4175 only carries active video (no HANC/VANC)
• Enables fully-flexible ‘IP-studio’ architectures
Roadmap Reminder SMPTE 2110 • Standardisation of concepts outlined in TR-03/TR-04 • Currently in final drafting stage
Interoperable systems exist today!
IP Studio • Separate transport of video and audio essence (SMPTE 2110) is dependant on accurate timing to ensure accurate sync. • Systems referenced over the network using PTP (SMPTE 2059) replaces genlock reference & LTC house clock • Low-latency hardware processing allow ‘traditional’ studio architectures/workflows to be achieved using IP to link systems
What’s the point if all we’re doing is replacing SDI with IP?
A Better Studio • Automatic device discovery • Hybrid real-time/non-real-time workflows • Tracking of media processes and actions against time (PTP) • Efficient system management using COTS hardware
Advanced Media Workflow Association www.amwa.tv
IS-04: (Interface Specification) NMOS Discovery and Registration
IP Studio audio and video takes Receiving devices also register and different paths through dynamically connect to multicastthe flows system with different (some devices may be senders asprocessing well) latencies devices register as senders and lock to PTP clock
video and audio samples can be accurately aligned for monitoring and output
all flows (audio/video streams) are timestamped against PTP time processing devices may preserve or overwrite timestamps depending on use
Outside Events • IP studio architectures are already being deployed in outside broadcast facilities (OB Trucks)
Onsite live production, whether IP or not, is typically too costly for many events
Remote Production • People onsite are a significant cost and can also be very inefficient for low-profile/short events
Remote production keeps operational staff at a central location reducing costs
Remote Production Relocating facilities and people
Remote Production Relocating facilities and people
Remote Production Relocating facilities and people
EVENT LOCATION
Sources captured/relocated over highbandwidth links allowing use of fixed studio facilities at production centre
PRODUCTION CENTRE
Compression reduces link cost but introduces latency
Remote Production Relocating facilities and people
EVENT LOCATION
PRODUCTION CENTRE
Link costs scale-up with number of sources
Remote Production Relocating facilities and people
EVENT LOCATION
Link bandwidth can be significantly reduced by keeping all sources on-site, only sending back proxies/multi-viewer feeds and final Mixer-Out
But…
PRODUCTION CENTRE
The Problem with Remote Control
Example latency for IP link (compressed): 4 frames
What the operator intends:
Source 1
Source 3
What actually gets switched (what the viewers sees): Assuming near-zero latency in control messages Would only get worse if messages were delayed
This is unacceptable for fast moving events (e.g. Sports/Music)
The Solution: Embrace the Latency
TIMELOCK
Switch/Mix delayed feeds with timestamped commands
Proxy
TIMELOCK
Instant-switch simulated mix using Proxies
Timestamped Proxy Generation
What the operator intends:
Source 1
What gets switched:
Source 3
Frame accurate switching capable of handling any* link latency
That’s good but… what about these guys?
Proxy
Proxy
? EVENT LOCATION
PRODUCTION CENTRE
Multi-Stage Switching Can Use The Same Concept Proxy
Proxy
PRODUCTION CENTRE
EVENT LOCATION
Downstream switch/mix between event feed and local sources
Remote Production Trail At Euro 2016
Remote Production Trail At Euro 2016
STUDIO CAMERAS
4x HDSDI with 4 separate stereo audio feeds - or 1 stereo audio (common mix)
PARIS PGM MIXER - Full Resolution Vision Mixing & Keying - Uncompressed Audio Mixing
SBC (PARIS) IBC (PARIS) LONDON SALFORD PGM (Full-res/Compressed)
FINAL TX MIXER - Full Resolution Vision Mixing & Keying - Uncompressed Audio Mixing
FINAL TX OUT (SDI)
PARIS OUT (SDI)
OUTSIDE SOURCES
2x HDSDI
each with 2x stereo audio (FX+COM)
PARIS INPUT SERVERS STUDIO GRAPHICS
2x HDSDI
SALFORD SOURCES
SOURCE PROXIES
2x HDSDI
SOURCE PROXIES SOURCE PROXIES (multicast)
SOURCE PROXIES
- Low Latency Proxy Generation
(multicast)
- Key & Fill no audio
Proxy Mix
- Low Latency Proxy Generation
SALFORD GRAPHICS
2x HDSDI - Key & Fill no audio
CONTROL & TALLIES Control UI UI Control with Instant with Instant Proxy Mix
SALFORD INPUT SERVER
each with 2x stereo audio (FX+COM)
Control UI with Instant Proxy Mix
Remote Production Trail At Euro 2016