AN2012-12 Audio watermarking (SyncNow).pdf

Audio Watermarking (SyncNow©)

GEP100 - HEP100

Audio watermarking for Second Screen SyncNow© with 3Gb/s, HD, SD embedded domain Dolby E to PCM the Synapse DAW77 module

decoder with audio shuffler

A

A

®

® product application note

Quad speed

Upgradable to

3Gb/s Embedded

Metadata S2020

COPYRIGHT©2011 AXON DIGITAL DESIGN B.V. COPYRIGHT©2012 ALL RIGHTS RESERVED NO PART OF THIS DOCUMENT MAY BE REPRODUCED IN ANY FORM WITHOUT THE PERMISSION OF AXON DIGITAL DESIGN B.V.

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©)

Introduction In a report published in January 2011 86% of people surveyed use their mobile Internet enabled device while watching television. Of those using their mobile device, 25% say they are browsing content related to the program they are watching (source: Yahoo’s advertising division).

Broadcasters have identified these mobile devices (also known as Second Screens or Companion Devices) as an area where they can provide added value to the viewer or gain additional revenue from targeted advertising or by providing premium content.

Viewers are offered the opportunity to download program or product related applications to their Smartphone or tablet and these provide the basic

level of interaction between the broadcaster and the viewer or between groups of viewers.

This experience can be further enhanced by the automatic content recognition and synchronization of the companion device application with the TV program. This brings value-added functionality such as content-specific background information, hyperlinks, voting applications and synchronized social newsfeeds, all being displayed at exactly the right time.

If the concept is expanded into connected devices, such as Smart TVs, it could be used to trigger content replacement or other events based on the identity of the content.

Watermarking for synchronization of companion apps In response Civolution developed SyncNow© – a state-of-the-art content identification platform which allows broadcasters, content producers and interactive application providers to offer timesynchronized-to-media applications.

enables accurate time synchronization between the content being played on TV and the application on companion devices (Second Screen) allowing the viewer to play-along with a quiz or vote in a talent show.

Based on Civolution’s powerful watermarking technologies, it allows for accurate and rapid synchronization of interactive content.

Because the timing information is embedded within the program audio real-time interactivity automatically handles distribution delays and supports time shifted viewing.

Digital audio watermarking is based on humanly imperceptible modifications to the audible audio signals; these watermarked sounds can be picked up by any device with a microphone such as a Smartphone or tablet PC. By loading a SyncNow© enabled application on the mobile device it allows for the automatic identification of the TV channel being watched and the content being played. Upon identification it

Axon has worked in conjunction with Civolution to package the SyncNow© watermark embedding technology into a Synapse form-factor module – the DAW77. For embedded operations the same technology is available in a 3G capable module with local video inputs and outputs, the GAW010.

HAW010 provides HD-SDI inputs and outputs and SAW010 SDI I/O.

What is Watermarking?

Digital watermarking embeds indelible and imperceptible data into a media asset to provide a persistent identity. This data can later be extracted and interpreted to identify, manage or monetize the asset.

The audio watermark information survives signal compression and transitions in the broadcast chain.

It will travel through the air from the TV speakers so that the Second Screen device can detect it via the microphone input.

Digital audio watermarking inserts information into the audio bit-stream or audio file without the information being perceptible to the listener, and without it affecting the audio quality of the original source material.

Watermarking is mainly used for the protection of Intellectual Property rights, especially protection against music piracy where it provides information about content ownership and can be used to track the original source of material. Watermarking is increasingly used to identify the source of transmitted material and the time of transmission, information used by audience measuring and second screen synchronization systems.

The information that is inserted may be static and simply be the title of the item, name of the channel etc., or it can have dynamic elements such as a timecode indicating the time of transmission or a specific location within a program.

page 2

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©)

Other uses of Watermarking - Audience measurement Imperceptible audio watermarks are embedded in to audible audio signals. These watermarked sounds can be picked up by suitable device with an in-built microphone or which can have an audio connection from the receiver.

By placing a suitable device within audible range of a TV, or other receiver with audio output, it is possible to continuously monitor the channel(s) being viewed.

Channel name and transmission time is embedded as a digital audio watermark upon play-out by each TV station. When this audio watermark is detected by the suitable device in a panelist home,

a record (log) of the programs being watched can be made. Because this system is based on placing identification information into the program audio it is equally suited to viewing in real-time, timeshifted channels or replaying programs from a video recorder.

Civolution have developed an audience measurement system based on this technology known as NexTracker©. Axon produce modules to support this process (separate audio - DAW88, embedded audio - G/H/SAW100) and also modules which insert watermarking for both audience measurement and SyncNow© (separate audio DAW99, embedded audio - G/H/SAW110 ).

Benefits of the audio watermarking technology Digital Audio Watermarking technology can be quickly and easily integrated within a transmission or post production environment. Because it uses signals embedded within the audio elements of a program, it supports all distribution methods including linear playout, Catch-up TV, VOD, recordings on personal recorders including PCs and TV broadcast to mobile devices.

The use of audio based identification makes watermarking ideally suited for second screen synchronization as the companion device simply needs to be able to “hear” the program audio in order to detect the media’s identity.

The application will automatically follow the viewing behavior of the individual consumer and the technology provides automatic and reliable detection of the content being watched within a few seconds.

The identification and synchronization are accurate even in case of time shifting; e.g. the viewer receives a phone call, uses ‘’pause’’ on his PVR, resumes two minutes later, and the application is automatically re-synchronized on the companion device.

SyncNow© (2nd Screen) Modes op operation There are two methods of synchronizing the companion device application to the program material being transmitted: time related and event triggered.

Time related applications are driven based on the time of transmission. The SyncNow payload consists of a program ID and the TimeStamp (timing reference) used by the playout system, normally Time-of-Day timecode (TOD LTC).

The application is authored to listen for the ID and TimeStamp and display the appropriate information on the device’s screen when it reaches the appropriate time based on the value in the audio watermark. There is an application management system which pushes “to-do lists” to the applications on the companion devices, taking into account the actual start time of the show and sending this as an offset, it also sends known event times during the show.

The TimeStamp is a repeating time value which starts at 00:00:00 and continues for period defined in the license supplied with the module. Typical values of the TimeStamp Loop are 1-hour (the counter resets to 00:00:00 at every hour), or 4-days (the counter resets to 00:00:00 at midnight every 4-days).

Event Triggered applications have a different payload structure; it is made up of an extended ID without any time reference information. In this case each ID is sent when the broadcaster wants the companion device to change what it is displaying.

Each ID is a single numerical or binary value and the broadcaster determines the structure allocating the available data between channel ID and event ID. Each event ID represents a pre-defined interaction step to be activated in the application running on the companion device.

page 3

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©)

SyncNow© (2nd Screen) - Workflow Time related synchronization

SDI with Embedded Audio including Watermarking

SDI with Embedded Audio

Compressed Video and Audio Signals

TV Receiver

DAW77 (G/H/SAW010) Presentation System

Station Timecode

Digital Audio Watermarking Engine

Local Clock

Channel Identifier

Viewer’s mobile device with SyncNow application relating to transmitted program

Mobile Device (2nd Screen)

Transmission Recording Device (PVR) VIEWER

Schedule Information Program Information

Application Manager Original Program

Application Authoring

Program Timing Information BROADCASTER

Adverts Application Server

Voting

Internet Alternative Video Source

1. The 2nd Screen application is authored using time references from the original program as triggers for the mobile application to display different elements or download blocks of data from the Internet.

2. The program is played out by the Presentation System and is watermarked by the DAW77 module with the TimeStamp, the on-board clock can be referenced to an external clock which would normally be the station’s timecode or NTP. The watermark engine will also include information about which application is related to the program. Watermark embedding is done on either AES streams or on the audio tracks within the SDI or 3G stream.

3. The output is transmitted live to the viewer via terrestrial or satellite transmission, or stored and viewed later via a catch-up TV, Video-on-Demand service or personal video recording device.

4. An Application Management System pushes the “to-do” list to the companion devices; this includes information regarding the actual start time of the show which is used as an offset in the synchronization of the device to the timecode information embedded as a watermark.

5. Even if the show is recorded and viewed at a later date the application would still be able to synchronize with the program because the timing information was inserted within the program’s audio tracks.

6. The companion device detects the time reference information from the program’s audio and displays the appropriate element from the application at the correct time.

Example: an application related to a reality TV show is authored with the biography of each participant.

The post-production of a given episode defines that program timecode 3:00 is the right time to popup the biography of one of the participants. The episode starts airing at 20:45:00. The to-do list and start time are pushed to the applications which then know that upon reaching watermarked timecode 20:48:00 it should display the biography.

page 4

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©) Event triggered synchronization

SDI with Embedded Audio

SDI with Embedded Audio including Watermarking

Compressed Video and Audio Signals

TV Receiver

DAW77 (G/H/SAW010) Live Program

Digital Audio Watermarking Engine

Local Clock

Combined Identifier

Viewer’s mobile device with SyncNow application relating to transmitted program

Mobile Device (2nd Screen)

Transmission Recording Device (PVR) VIEWER

Trigger Generator Channel ID and Event ID

Program Information

Application Authoring

BROADCASTER

Adverts Application Server

Voting

Internet Alternative Video Source

1. The 2nd Screen application is authored based on the content of the program or the intended content if the program is not yet made or will be broadcast live. The application may include background information on the participants, links to on-line voting systems etc. and is basically a list of events each with an associated event ID. 2. As the program is played out it is watermarked by the DAW77 module in a similar way to Time Related synchronization however the watermark does not include time references. For Event Triggered Synchronization a new ID is generated for each element of the application at the time it should be displayed on the companion device.

3. The output is transmitted live to the viewer via terrestrial or satellite transmission, or stored and viewed later via a catch-up TV, Video-on-Demand service or personal video recording device.

4. The companion device detects the event ID information from the program’s audio and displays the appropriate element from the application at the correct time.

Example: an application related to sport events is authored with information about each player. During the live transmission of a game, decisions regarding what should be shown on the companion device are made. When one of the players scores a goal, the related event ID is activated and transmitted as audio watermark so that the application starts displaying the relevant information.

page 5

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©)

Synapse DAW77 Digital Audio Watermark Encoder In order to facilitate the embedding (encoding) of the Civolution SyncNow digital audio watermark, Axon and Civolution have closely cooperated in the design and development in a range of modules for the Synapse system.

The DAW77 is a 16-channel AES watermark encoder module, utilizing both local AES connections and the Synapse Quad-Speed Audio Bus. The DAW77 module has 4 dual channel (8 mono) watermark encoders, it can be configured to encode the digital audio watermark into a PCM stereo audio track, into just one of the audio tracks making of

a PCM pair or, with a suitable license, 3 encoding engines can be grouped together to encode the watermark into a 5.1 surround sound mix.

Depending on the implementation, the watermark will carry one or more of the following piece of information:

▪▪

A SyncNow Identifier which can be used to identify the application that should be used with the program that is currently being transmitted The Timestamp which is the timing reference for the program

▪▪

Example 1: DAW77 block schematic DAW77

[QUAD SPEED AUDIO BUS] ACTIVE BYPASS

AES/EBU IN 1/2

AES/EBU IN 3/4

AES/EBU IN 5/6

AES/EBU IN 7/8

SRC

SRC

SRC

UP TO 4 MONO, 4 STEREO OR 2 SURROUND WATERMARKING EMBEDDERS

40x8 INPUT MUX

SRC

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 1/2

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 3/4

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 5/6

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 7/8

HIGH POWER DSP SUB MODULE REAL TIME CLOCK WITH BATTERY BACK-UP

32 CHANNEL

TIME CODE (LTC)

ADD-ON EMBED MULTIPLEXING OPTIONAL RE4 X 2-CHANNELS INTO 32 INSERTING OF PROCESSED AUDIO

COMP

GPI (2 IN/2 OUT)

1

ΜP

32CH IN FROM NEXT ADD-ON

32CH 32CH OUT OUT TO MASTER

MUX

TO NEXT ADD-ON

REFERENCE INPUTS 2

32CH IN FROM MASTER

PLL

QUAD SPEED MULTIPLEXING AUDIO BUS

RACK CONTROLLER

INTERNAL SYNAPSE BUS

Time Reference For the companion device synchronization system to be effective it needs to have an accurate timing source normally referenced to either the station’s timecode or the IT network time reference.

The DAW77 has a local connection for Linear Timecode (LTC) which is commonly distributed within broadcast centers; it can also use Network Time Protocol (NTP) which is frequently distributed across professional IT networks. NTP is also readily available from a number of sources on the Internet.

NTP distribution to modules is supported in the current range of rack controllers (ERCxxx). However

the previous Synapse rack controllers (RRCxx and RRSxx) are not able to distribute NTP directly to the modules in a frame. In this instance NTP can be supported by running an instance of Cortex, Axon’s control and monitoring application. Details of how to freely obtain Cortex and deploy it for this use are given in the DAW77 Quickstart Guide available from the Axon website www.axon.tv.

If neither LTC nor NTP is available the DAW77 has an internal, battery backed-up, clock system which can be used to generate the time to be used by the watermarking engines.

page 6

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©)

DAW77 configuration Licensing The DAW77 requires a license from Civolution which specifies the type of synchronization (time or event based), the time based synchronization license also specifies the duration of the TimeStamp Loop.

The capacity for watermark processing on the DAW77 is defined by the Civolution license; the license defines the maximum number of mono/

stereo (maximum 4) or number of surround (maximum 2) embedders. It is also possible to combine 1 surround with 1 or 2 mono/stereo processors.

If users wish to change the DAW77’s application type or the number of channels that can be processed an upgraded license can be obtained from Civolution and loaded by the user.

Example 2: Cortex screen showing DAW77 license and payload information Civolution license information. LEDs show the licenses are valid.

Information regarding payload size and timeStamp Loop duration. This is license dependant.

Watermarking application type and the number of watermarking engines that are licensed.

Type of Watermark that will be embedded (inserted).

This screen is showing an SyncNow© encoder.

Identification of the SyncNow application relating to the program being broadcast.

For time based synchronization the payload is made up of the SyncNow ID together with the TimeStamp. For trigger based synchronization the payload has only SyncNow ID information and the number of ID and Payload bits would be equal.

Example 3: Cortex screen showing DAW77 license Usage Number of watermarking engines that the Civolution license allows

Number of watermarking engines that have been allocated

page 7

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©) Watermark Engines The DAW77 has a total of 8 stereo PCM processing channels which can be accessed by either local AES audio connections or audio derived from the Synapse Quad Speed Add-On Audio Bus, see Audio Routing below.

if 16 audio channels are input to the module not all channels may be watermarked; some may only be time-delayed only to maintain their time relationship with the watermarked channels. These un-watermarked channels would be configured as “None” processing in the engine configuration.

The module has 4 watermarking engines, each may be used for either 1 mono audio or 1 stereo audio pair (or 2 channels of a surround sound mix). A watermark engine cannot process 2 mono channels.

In the case of a surround sound (5.1) mix the Surround Left and Right (Ls/Rs) are not watermarked and therefore do not utilize any “active” engines, only the Left-Front, Right-Front (Lf/Rf) and Centre, LFE’’ use active engines and only the Centre channel is watermarked, the LFE passes through the engine un-watermarked.

The maximum processing capacity is defined by the Civolution license. The routing and processing also depends on the AES connections of the DAW77 board and/or the use of audio channels from/to the MasterCard via the Quad-Speed Add-On bus.

The processing capacity of the DAW77 is up to 4 “active” engines (4 pairs of channels), therefore,

The watermark licenses define the processing capacity for the DAW77 which can be up to 4 mono, or 4 stereo, or 2 surround; or combinations of 1 surround and mono and/or stereo as described in the table below.

Signal Configuration

Audio Channels

Active Watermark Engines

Audio Connectivity

Up to 4 Mono

Up to 4

Up to 4

Local or ADD-ON bus

Up to 4 Stereo

Up to 8

Up to 4

Local or ADD-ON bus

Mix of up to 4 Mono and Stereo

Up to 8

Up to 4

Local or ADD-ON bus

1 Surround (5.1)

6

2

Local or ADD-ON bus

1 Surround (5.1) + 1 Mono

7

3

Local or ADD-ON bus

1 Surround (5.1) + 2 Mono

8

4

ADD-ON bus required

1 Surround (5.1) + 1 Stereo

8

3

Local or ADD-ON bus

1 Surround (5.1) + 2 Stereo

10

4

ADD-ON bus required

1 Surround (5.1) + 1 Stereo + 1 Mono

9

4

ADD-ON bus required

2 Surround (5.1)

12

4

ADD-ON bus required

Audio Routing The DAW77 module has three audio routing configurations for its local connections. The default setting configures the module to utilize the AES connections on the rear module as 4 inputs and 4 outputs. In this mode all of the module’s 4 Watermark Engines can be accessed.

The other two configurations use a combination of the local AES connections and the Synapse Quad-Speed Add-On Audio bus (QSB) (Example 4) to provide routing to/from all of the Watermark Engines.The three routing configurations are shown in Example 6.

The Quad-Speed Add-On Audio bus is used to route audio between a video MasterCard, such as a HRB100, and the DAW77 module. This bus is bidirectional and when used with a module such as the HRB100 audio can be de-embedded from all 16 tracks and routed to the DAW77 for processing. The same audio bus is then used to route the 16-tracks back to the HRB100 for re-embedding the audio channels into the SDI stream. All of this is achieved

without the use of external cables.

Synapse MasterCards can also process embedded Dolby-E and present decoded audio to the DAW77 for watermarking. Example 5 shows a HEP100 embedding and decoding a 5.1 surround sound mix and routing the audio, via the QSB, to the DAW77.

The bus is also used to route the watermark embedded audio back to the HEP100 for reembedding into the SDI stream.

In addition when the module’s Synchronization Mode is set to MasterCard the module’s reference is derived from clock signals originating from the MasterCard via the Add-On bus.The configuration of this routing is shown in Example 7, Example 8 and Example 9.

The DAW77 can use AES1, the MasterCard or the reference signals distributed across the frame as its local reference. Routing signals to or from the Quad-Speed Add-On Audio bus is only enabled when the module is using the MasterCard as a reference source.

page 8

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©) Example 4: DAW77 connected to GRB100 re-embedding module via Synapse Quad Speed audio bus GRB100 - HRB100

3Gb/s, HD, SD IN 1

3Gb/s, HD, SD IN 2

[QUAD SPEED AUDIO BUS]

3Gb/s, HD, SD OUT 1

Eq

2x1

ADJUSTABLE OFFSET DELAY 0-500ms

AUTO MUX

Eq

16 CHANNEL EMBEDDER

S2020 INSERT

3Gb/s, HD, SD OUT 2

META DATA

16 CHANNEL DE-EMBEDDER SDI IN 1 16 CHANNEL DE-EMBEDDER SDI IN 2

16 Ch

4 4 4 4

64X16 MUX 16 DE-EMBED 1 16 DE-EMBED 2

16 Ch

Ch Ch Ch Ch

GRB100 3Gb/s SDI capable embedder/ de-embedder (re-embedder) module

16 CHANNEL DELAY GAIN PHASE

32 QUAD SPEED

S2020 READER METADATA

De-embedded audio routed to DAW77 via Synapse Quad Speed ADD-ON bus

METADATA HANDLING METADATA

32 Ch

TDM MUX

PLL

TDM DE-MUX

32CH OUT TO ADD-ON

1

GPI/O

µP

32CH IN

2

FROM ADD-ON

REFERENCE INPUTS

METADATA IN/OUT

QUAD SPEED MULTIPLEXING AUDIO BUS

Watermarked audio from DAW77 returned to GRB100 re-embedder

Rack controller

INTERNAL SYNAPSE BUS

DAW77

[QUAD SPEED AUDIO BUS] ACTIVE BYPASS

AES/EBU IN 1/2

AES/EBU IN 3/4

SRC

SRC UP TO 8 CHANNELS OF WATERMARKING

AES/EBU IN 5/6

AES/EBU IN 7/8

SRC

40x8 INPUT MUX

SRC

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 1/2

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 3/4

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 5/6

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 7/8

HIGH POWER DSP SUB MODULE REAL TIME CLOCK WITH BATTERY BACK-UP

32 CHANNEL

TIME CODE (LTC)

ADD-ON EMBED MULTIPLEXING OPTIONAL RE4 X 2-CHANNELS INTO 32 INSERTING OF PROCESSED AUDIO

COMP

GPI (2 IN/2 OUT)

1

ΜP

32CH IN FROM NEXT ADD-ON

32CH 32CH OUT OUT TO MASTER

MUX

TO NEXT ADD-ON

REFERENCE INPUTS 2

32CH IN FROM MASTER

PLL

QUAD SPEED MULTIPLEXING AUDIO BUS

RACK CONTROLLER

INTERNAL SYNAPSE BUS

page 9

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©) Example 5: DAW77 connected to GEP100 embedding/Dolby-D decoding/re-embedding Module via Synapse

Quad Speed Audio Bus GEP100 - HEP100

3Gb/s, HD, SD IN 1

3Gb/s, HD, SD IN 2

[QUAD SPEED AUDIO BUS]

3Gb/s, HD, SD OUT 1

Eq

2x1

ADJUSTABLE OFFSET DELAY 0-500ms

AUTO MUX

Eq

16 CHANNEL EMBEDDER

S2020 INSERT

3Gb/s, HD, SD OUT 2

META DATA

Dolby-E encoded 5.1 audio de-embedded from SDI stream

16 CHANNEL DE-EMBEDDER

4 4 4 4

16 Ch 56X16 MUX

Ch Ch Ch Ch

16 CHANNEL

16 DE-EMBED 8 DECODED E 32 QUAD SPEED

S2020 READER METADATA

DELAY GAIN PHASE

Dolby E

8 Ch DECODER

PCM METADATA HANDLING METADATA

32 Ch

Decoded 5.1 surround sound audio routed to DAW77 via Synapse Quad Speed ADD-ON bus

TDM MUX

TDM DE-MUX

32CH OUT

METADATA IN/OUT

GPI/O

µP

TO ADD-ON

FROM ADD-ON

32CH IN

QUAD SPEED MULTIPLEXING AUDIO BUS

5.1 Watermarked audio from DAW77 routed to GEP100 for re-embedding

Rack controller

INTERNAL SYNAPSE BUS

DAW77

[QUAD SPEED AUDIO BUS] ACTIVE BYPASS

AES/EBU IN 1/2

AES/EBU IN 3/4

SRC

SRC UP TO 8 CHANNELS OF WATERMARKING

AES/EBU IN 5/6

AES/EBU IN 7/8

SRC

40x8 INPUT MUX

SRC

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 1/2

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 3/4

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 5/6

2 CHANNEL GAIN

2 CHANNEL DELAY

AES/EBU OUT 7/8

HIGH POWER DSP SUB MODULE REAL TIME CLOCK WITH BATTERY BACK-UP

32 CHANNEL

TIME CODE (LTC)

ADD-ON EMBED MULTIPLEXING OPTIONAL RE4 X 2-CHANNELS INTO 32 INSERTING OF PROCESSED AUDIO

COMP

GPI (2 IN/2 OUT)

1

ΜP

32CH IN FROM NEXT ADD-ON

32CH 32CH OUT OUT TO MASTER

MUX

TO NEXT ADD-ON

REFERENCE INPUTS 2

32CH IN FROM MASTER

PLL

QUAD SPEED MULTIPLEXING AUDIO BUS

RACK CONTROLLER

INTERNAL SYNAPSE BUS

DAW77 SyncNow© module, licensed with surround watermark embedders, uses 3 engines to watermark the surround mix

page 10

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOWŠ) Audio input routing and watermarking engine configuration Example 6: Cortex screens showing DAW77 audio routing configurations

Configuration 1

Configuration 2

Configuration 3

The DAW77 is configured to use its local AES connection for both input and output. In this mode only 4 of the available watermarking engines can be used.

The DAW77 is configured so that all the local AES connections are inputs to the module. This provides local audio inputs to all 8 watermarking engines, the output is returned to the MasterCard via the QuadSpeed Add-On bus.

The DAW77 is configured so that all the local AES connections are outputs from the module. This provides local audio outputs from all 8 watermarking engines, the output is also returned to the MasterCard via the QuadSpeed Add-On bus.

Note; audio from the MasterCard can also be used as the source for some or all of the watermarking engines if required.

In this mode the input to the watermarking engines comes solely from the MasterCard.

If the Synchronization Mode was changed to MasterCard the other 4 engines could use audio connections provided by the Quad-Speed Add-On bus.

Note that the LEDs indicate that a signal is present on the named input.

Example 7: Stereo watermarking with audio from local connections Source of audio: Local inputs 1/2

Status and format of the audio input to the watermarking engine

Operating mode of the watermarking engine: Stereo

Watermark engine status: 1 engine fully in use

Example 7 shows the audio routing configuration for the Watermark Engine for channels 1 and 2; the two left-hand boxes show that the audio is routed locally from the DAW77 module’s own audio connectors, the centre box shows the audio format is PCM and that the status of both tracks in OK. The right-hand boxes show the audio mode is 2-channel stereo and that watermarking is being embedded into both tracks, fully utilizing the active watermark engine.

page 11

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOWŠ) Audio input routing and watermarking engine configuration Example 8: Watermarking a 5.1 surround sound mix with audio routed from Mastercard Operating mode of the watermarking engines – showing the 5.1 surround mix is being processed through 3 engines.

Source of audio: ADD-ON bus slots 1-6

Status and format of the audio input to the watermarking engines: the level of channel7 (Left Surround) is clipping

Note: only Lf, Rf and C have watermarks embedded, the other channels are passed through the system unwatermarked Watermark engine status showing that 2 engines are active (for Lf/Rf and for C) in a 5.1 surround sound

Example 8 shows the audio routing configuration for encoders 3/4, 5/6 and 7/8; the left-hand boxes show that the audio is routed from the Quad-Speed Audio Bus (Master channels 1 to 6), the centre boxes show the audio format is PCM and that the status of five of the tracks is OK whilst the level of the audio on channel 7 (Surround Left) is too high. The right-hand boxes show which track pairs of the 5.1 audio are being processed by each engine and which tracks watermarks are being embedded. The first engine (for channels 3 and 4) is active and fully utilized, the second (5/6) is active for one channel, and the third (7/8) is not active.

Example 9: Quad Speed ADD-ON bus audio output routing

The Quad Speed ADD ON bus has 32 audio slots. The DAW77 is configured to insert the output of all of its watermarking engines in the first 16 slots.

Here slots 17 to 24 have been configured to pass the audio from the local inputs directly on to the MasterCard

Example 9 shows the output audio routing from the DAW77 to the MasterCard using the Quad Speed ADD-ON bus. The bus is capable of conveying 16-pairs of audio tracks, the configuration shown here places the output of the 8 watermark embedders onto the first 8-pairs and then also routes the audio from the 4 local AES connectors onto the next 4 Quad Speed Bus pairs.

page 12

EMBEDDED AUDIO WATERMARKING AUDIO PROCESSING (SYNCNOW©)

Associated Synapse modules There are several modules within the Synapse range which utilize Civolution watermarking technologies for audience research, SyncNow (2nd Screen) or a combination of both. The DAW range presents the watermarking engines with AES audio connections.

In recognition of the widespread use of embedded audio in broadcast facilities the same watermarking technology is also available on a range of modules with video connections covering SDI, HD-SDI and 3G.

Synapse modules with Civolution watermarking technology: Audience measurement Second Screen (NexTracker©) (SyncNow©)

Both technologies (NexTracker© + SyncNow©)

AES

DAW88

DAW77

DAW99

SD-SDI

SAW100

SAW010

SAW110

HD-SDI

HAW100

HAW010

HAW110

3Gb/s SDI

GAW100

GAW010

GAW110

Example 10: Embedded watermark embedder block schematic GAW/HAW/SAW010/100/110

3Gb/s, HD, SD IN 1

[QUAD SPEED AUDIO BUS]

3Gb/s, HD, SD OUT 1

2x1

Eq

ADJUSTABLE OFFSET DELAY 0-1000ms

AUTO MUX 3Gb/s, HD, SD IN 2

Eq

16 CHANNEL EMBEDDER

3Gb/s, HD, SD OUT 2

AUTO PHASER

16 CHANNEL DE-EMBEDDER

56X16 MUX

16 Ch

16 DE-EMBED 32 QUAD SPEED 8X AUDIO WM

4 4 4 4

Ch Ch Ch Ch

16 CHANNEL DELAY GAIN PHASE

2Ch 2Ch 2Ch 2Ch

+ 24Ch

ACTIVE BY-PASS TIME CODE (LTC)

48X8 MUX

COMP

16 DE-EMBED 32 QUAD SPEED

PLL

NexTracker™(100/110) SyncNow™ (010/110) HIGH POWER DSP SUB MODULE REAL TIME CLOCK WITH BATTERY BACK-UP

GPI/O (2x out 1x in)

µP

TO ADD-ON

32CH IN FROM ADD-ON

1

2Ch 2Ch

32 Ch TDM MUX/DE-MUX 32CH OUT

REFERENCE INPUTS 2

2Ch 2Ch

UP TO 8 CHANNELS OF WATERMARKING

QUAD SPEED MULTIPLEXING AUDIO BUS

Rack controller

INTERNAL SYNAPSE BUS

Example 10 shows the block diagram of the embedded Watermarking modules. The module can be specified with SD, HD or 3G inputs and outputs and modules can be field upgraded. The modules have the same Watermarking embedding capabilities as the separate audio units and additional Watermark embedding engines can be added by connecting further, separate audio modules, via the Quad Speed Audio ADD-ON bus.

page 13