JP7546191B1 - Communication system, communication method, and sound collection unit - Google Patents

Abstract

Provided is a communication system, a communication method, and a sound collection unit that can reduce the labor required for laying communication cables, reduce wireless output, or expand the range in which sound information or video information can be obtained. In the communication system (10), an editing device (400) switches or mixes sound information obtained by each microphone (310) of a plurality of sound collection units (300) and outputs the information. Each wireless router (350) of the plurality of sound collection units (300) forms a mesh network (60). Sound information signals from the microphones (310) are transmitted from each sound collection unit (300) to the editing device (400) via the mesh network (60). [Selected Figure] Figure 2

Description

The present invention relates to a communication system, a communication method, and a sound collection unit, and more particularly to a communication system, a communication method, and a sound collection unit that can be suitably used for live broadcasts of sports, music, etc.

Systems that can be used for live broadcasts of sports, music, etc. have been developed (for example, Patent Document 1 and Patent Document 2). Patent Document 1 aims to provide a program provision system and a program provision method that can provide a video from a viewpoint desired by a user ([0014], Abstract). In order to achieve this aim, the program provision system, which is a first embodiment of the invention related to Patent Document 1 (Abstract), is configured to include a program production device (1), a communication line carrier device (2), and a user terminal (3). The communication line carrier device (2) and the user terminal (3) are connected via a communication line network (100). Video data captured from a plurality of different directions of a subject captured by the program production device (1) is distributed to the communication line network (100) by the communication line carrier device (2) as different channels for each video data. The user terminal (3) selects and displays a channel that is distributing a video desired by the user from among the programs (channels) distributed to the communication line network (100).

Furthermore, Patent Document 1 shows a configuration for broadcasting baseball games ([0072]-[0075], [0092], Figures 7 and 11). In this configuration, television cameras (A-I) are positioned at multiple points within a baseball field ([0072], Figure 7). The images (a-i) captured by the television cameras (A-I) are each recorded independently as images on videotapes (a1-i1) and sent to editing equipment ([0073]).

Furthermore, Patent Document 1 shows a configuration for distributing a play ([0082]-[0089], Figure 9). In this configuration, television cameras (A-D) and CCD cameras (E-G) are used at multiple points within the performance area ([0082], Figure 9). The images (a-g) captured by the television cameras (A-D) and CCD cameras (E-G) are each recorded on videotapes (a3-g3) and sent to editing equipment ([0086]).

In Patent Document 1, during live broadcasting, video data from a television camera and a CCD camera (program production equipment (1)) is transmitted to a communication line operator equipment (2) via a high-speed digital communication line ([0051], [0090]).

The objective of Patent Document 2 is to appropriately identify scenes and cut-out ranges using an analysis engine ([0005]). To achieve this objective, the information processing device of Patent Document 2 (abstract) has a control unit that performs a first control process and a second control process. The first control process determines an analysis engine for scene detection from multiple analysis engines based on scene detection information for scene detection in an input video. The second control process determines an analysis engine for obtaining second result information related to a scene from multiple analysis engines based on scene-related information about the scene obtained as first result information by the analysis engine determined in the first control process.

In addition, in Patent Document 2, moving image data and still image data captured by one or more imaging devices installed in a stadium (100) are transmitted to a broadcast van (101) located near the stadium (100) ([0027], Figure 1). The broadcast van (101) is equipped with antenna equipment used for transmitting and receiving data, a CCU (Camera Control Unit) that controls the imaging devices, a switcher that switches between the imaging devices used for broadcasting and recording, and a monitor device for checking the images ([0028]). The moving image data (broadcast video data) created in the broadcast van (101) is transmitted to, for example, a broadcasting system (102) owned by a broadcasting company.

JP 2001-309342 A International Publication No. 2021/241430

As described above, Patent Document 1 discloses a configuration for distributing images using multiple video cameras (television cameras and CCD cameras) in a baseball stadium, performance arena, etc. (e.g., Abstract, [0072]-[0075], [0082]-[0089], [0092], Figures 7, 9, and 11). In addition, during live broadcasts, video data from the television cameras and CCD cameras (program production device (1)) is transmitted to communication line carrier device (2) via high-speed digital communication lines ([0051], [0090]).

In the case of high-end broadcasting equipment for live broadcasting, the video camera and microphone are often separate (not integrated). In such cases, an operator is assigned to each video camera and microphone, and they move and operate the video camera and microphone separately. In such cases, communication cables may be used for data communication, and the broadcaster (the video camera operator and the microphone operator) must take great effort in laying the communication cables. In this regard, Patent Document 1 only discloses the use of high-speed digital communication lines. In addition, Patent Document 1 only mentions video data (video information), and does not make any special mention of audio data (audio information). The same is true for Patent Document 2.

As described above, in Patent Document 2, data is transmitted from one or more imaging devices in a stadium (100) to a broadcast vehicle (101) ([0027], FIG. 1). If data transmission from imaging devices (video cameras) or microphones used in sports stadiums, concert venues, etc. to a broadcast vehicle were to be performed by direct wireless communication between the two, this could result in an increase in wireless output or a restriction on the range in which sound or video information can be obtained.

The present invention has been made in consideration of the above-mentioned problems, and aims to provide a communication system, communication method, and sound collection unit that can reduce the hassle of running communication cables, reduce wireless output, or expand the range in which sound or video information can be obtained.

A communication system according to an aspect of the present invention includes:
A plurality of sound collection units each including a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal to the outside;
a communication device that communicates with the wireless router to receive the sound information signal, and an editing device that edits and outputs the sound information,
The editing device switches or mixes the sound information acquired by each microphone and outputs the information,
The wireless routers of the plurality of sound collection units form a mesh network,
The sound information signal is transmitted from each sound collection unit to the editing device via the mesh network.

According to the present invention, sound information signals indicating sound information acquired by the microphones of each sound collection unit are transmitted to an editing device via a mesh network including the wireless routers of each sound collection unit. This makes it possible to transmit sound information from the microphones to the editing device without communication cables connecting each microphone to the editing device. This reduces the effort required to lay communication cables.

In addition, compared to direct wireless communication between each microphone and the editing device, wireless communication between each sound collection unit and the editing device via a mesh network makes it possible to suppress wireless output or expand the range in which sound information can be obtained.

Furthermore, by adopting a mesh network configuration rather than a daisy chain configuration, even if an abnormality occurs in one of the wireless routers, it is possible to transmit sound information acquired by microphones other than the microphone paired with that wireless router to the editing device. This makes it possible to improve the robustness of the communication system.

The communication system may include a plurality of video cameras that acquire surrounding video information and transmit a video report signal indicating the video information to the editing device via a communication cable or wireless communication. The plurality of microphones may be used separately from the plurality of video cameras. The editing device may switch the video information acquired by each video camera and output it together with the sound information. This makes it possible to output the sound information and the video information in association with each other even when the microphones and the video cameras are used separately (without being integrated) in a configuration using a mesh network with a wireless router of a sound collection unit (particularly common in high-end applications).

The communication system may include a time lag correction unit that corrects the time lag of each sound information signal based on the delay amount of the sound information signal reaching the editing device from each sound collection unit. This makes it possible to reduce discomfort caused by the time lag when a viewer (a person receiving the sound information edited by the editing device) perceives the sound information.

The time lag correction unit may send a ping signal to each wireless router and determine the amount of delay of each sound information signal based on a response signal from each wireless router. The time lag correction unit may also correct the time lag of each sound information signal based on the determined amount of delay. This makes it possible to correct the time lag without performing special processing on the wireless router side.

Alternatively, each wireless router may assign a time stamp to the sound information signal that it relays. The time offset correction unit may correct the time offset of each sound information signal based on the time stamp assigned to the sound information signal. This makes it easy to correct the time offset even if the signal transmission path changes in the mesh network.

Alternatively, the time lag correction unit may impart a delay amount, which is a fixed value set for each wireless router, to the sound information signal for each wireless router. This makes it possible to correct the time lag without performing special processing in each wireless router or editing device once each delay amount, which is a unique value, is set.

Each wireless router constituting the mesh network may be located in a position where it can transmit the sound information signal to at least two other wireless routers, excluding the wireless router that directly communicates with the editing device. This makes it possible to communicate via the mesh network even if a communication error occurs in one of the wireless routers that relays the sound information signal (excluding the wireless router that directly communicates with the editing device).

A communication method according to another aspect of the present invention includes the steps of:
a plurality of node units each including a peripheral sensor that acquires peripheral information including peripheral sound information or video information and outputs a peripheral information signal indicating the peripheral information, and a router that transmits the peripheral information signal to the outside;
A communication method using a communication system including a communication device that communicates with the router to receive the peripheral information signal, and an editing device that edits and outputs the peripheral information,
A mesh network is formed by the routers of the plurality of node units,
The peripheral information signal is transmitted from each node unit to the editing device via the mesh network.

According to the present invention, a peripheral information signal indicating peripheral information (including audio information or video information) acquired by a peripheral sensor of each node unit is transmitted to an editing device via a mesh network including a router of each node unit. As a result, by communicating between each node unit and the editing device via the mesh network, it is possible to suppress the output of peripheral information signals or expand the range in which peripheral information can be acquired, compared to when communication is performed directly between each peripheral sensor and the editing device.

Furthermore, by adopting a mesh network configuration rather than a daisy chain configuration, even if an abnormality occurs in one of the routers, it is possible to transmit peripheral information acquired by peripheral sensors other than the one paired with that router to the editing device. This makes it possible to improve the robustness of the communication system.

A sound collecting unit according to yet another aspect of the present invention includes:
a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information;
and a wireless router that transmits the sound information signal to the outside,
The wireless router forms a mesh network together with the wireless routers of the other sound collecting units,
The wireless router relays the sound information signal received from the wireless router of the other sound collection unit to an editing device via the mesh network.

According to the present invention, it is possible to reduce the labor required for laying communication cables, reduce wireless output, or expand the range in which audio or video information can be obtained.

1 is a schematic diagram illustrating a communication system according to an embodiment of the present invention; FIG. 4 is a schematic configuration diagram of a second sensor group according to the embodiment. FIG. 4 is a perspective view illustrating a simplified appearance of a sound collecting unit included in the second sensor group of the embodiment. FIG. 2 is a schematic diagram illustrating each component of the relay van according to the embodiment. 1 is a diagram showing an example of the arrangement of the video cameras, microphones, and broadcast vehicle of the embodiment in a baseball stadium. FIG. 11 is a flowchart of a new sound collection unit connection determination process executed by the editing device of the embodiment. 5 is a flowchart showing an outline of control of the sound collecting unit in the embodiment.

A. One embodiment <A-1. Configuration>
[A-1-1. Overall configuration]
1 is a simplified configuration diagram of a communication system 10 according to an embodiment of the present invention. The communication system 10 broadcasts (particularly live broadcasts) baseball games and the like held at a baseball stadium 90. The communication system 10 has a first sensor group 20, a second sensor group 30, a broadcast vehicle 40, and a broadcast center facility 50.

The first sensor group 20 includes a plurality of video cameras 200 as first peripheral sensors or image sensors. The second sensor group 30 includes a plurality of microphones 310 as second peripheral sensors or sound sensors. The relay vehicle 40 processes the image information signals (video signals) from the plurality of video cameras 200 and the sound information signals from the plurality of microphones to broadcast the broadcast content itself, or transmits a broadcast signal indicating the broadcast content to the broadcast center equipment 50. The broadcast center equipment 50 broadcasts the broadcast signal received from the relay vehicle 40 either as is or after processing it.

[A-1-2. First sensor group 20]
As described above, the first sensor group 20 includes a plurality of video cameras 200 as first surrounding sensors or image sensors. The video cameras 200 acquire surrounding video information and output a video information signal (video signal) indicating the video information. Although three video cameras 200 are illustrated in FIG. 1, the number of video cameras 200 may be any other number (for example, any number between 4 and 50). In this embodiment, each video camera 200 is connected to a relay van 40 (or an editing device 400 described later) by a communication cable 202. The video information signal (video signal) indicating the video information acquired by the video camera 200 is transmitted to the relay van 40 via the communication cable 202. Note that, for the sake of simplicity, only one communication cable 202 is illustrated in FIG. 1, but in reality, a communication cable 202 is disposed between each video camera 200 and the relay van 40. Also, as described later, the video camera 200 may perform wireless communication with the relay van 40.

[A-1-3. Second sensor group 30]
FIG. 2 is a schematic diagram of the second sensor group 30 of this embodiment. FIG. 3 is a perspective view showing a simplified appearance of the sound collection unit 300 included in the second sensor group 30 of this embodiment. As described above, the second sensor group 30 includes a plurality of microphones 310 as second peripheral sensors or sound sensors. More specifically, the second sensor group 30 has a plurality of sound collection units 300 each having a microphone 310. Note that each sound collection unit 300 (microphone 310) of this embodiment is not integrated with the video camera 200. It is also possible to integrate the video camera 200 and the sound collection unit 300 (microphone 310).

2, in addition to the microphone 310, the sound collection unit 300 has an analog/digital converter 320 (hereinafter referred to as "A/D converter 320"), a sound collection unit control unit 330, a sound collection unit storage unit 340, a wireless router 350, and a battery 360. The wireless router 350 is also referred to as a sensor-side router 350 to distinguish it from the wireless router 412 (FIG. 4) of the editing device 400 described later. Note that in FIG. 2, these components are only shown in the lower left sound collection unit 300, but the other sound collection units 300 have the same configuration.

The microphone 310 acquires surrounding sound information and outputs an analog sound information signal indicating the sound information. The A/D converter 320 converts the analog sound information signal from the microphone 310 into a digital sound information signal. The sound collection unit control unit 330 controls the entire sound collection unit 300. For example, the sound collection unit control unit 330 performs a predetermined signal processing on the digital sound information signal from the A/D converter 320, and then transmits it to the relay vehicle 40 via the wireless router 350 of the same sound collection unit 350 as itself and the wireless router 350 of the other sound collection unit 300. In addition to transmitting the sound information signal, the sound collection unit control unit 330 also performs a predetermined transmission and reception with the editing device 400 (details will be described later with reference to FIG. 7, etc.). The sound collection unit storage unit 340 stores programs executed by the sound collection unit control unit 330, data used by the sound collection unit control unit 330, etc.

The wireless router 350 performs a predetermined routing process by wireless communication. Specifically, the wireless router 350 of this embodiment performs dynamic routing process. The wireless router 350 of each sound collection unit 300 performs dynamic routing process, and the second sensor group 30 forms a mesh network 60 (Figure 2). Therefore, the sound information signal is transmitted from each sound collection unit 300 to the editing device 400 of the relay vehicle 40 via the mesh network 60.

Therefore, the wireless router 350 transmits the sound information signal (already processed by the sound collection unit control unit 330) of the sound collection unit 300 to which it belongs to the relay vehicle 40 via the wireless router 350 of the other sound collection unit 300 based on the routing table. The wireless router 350 also relays the sound information signal received from the wireless router 350 of the other sound collection unit 300 to the editing device 400 via the mesh network 60 based on the routing table. The wireless router 350 may have its own control unit and memory unit for performing the above-mentioned processing and the like.

The wireless router 350 of this embodiment communicates over a communication distance of, for example, 50 to 100 m and at a communication speed of, for example, 10 to 500 Mbps. The communication distance and communication speed of the wireless router 350 can be selected as appropriate.

The battery 360 supplies power to each part of the sound collection unit 300.

As shown in Figure 3, in the sound collection unit 300, the A/D converter 320, the control circuit 370 (sound collection unit control unit 330, sound collection unit memory unit 340, and wireless router 350) and the battery 360 are housed inside the housing 380. The microphone 310 is also disposed on the upper side of the top cover 381 of the housing 380. Signal lines, power lines, etc. are omitted in Figure 3.

Although Figure 1 illustrates three microphones 310 and Figure 2 illustrates seven microphones 310 (sound collection units 300), the number of microphones 310 (sound collection units 300) may be any other number (e.g., 2, 4 to 6, or 8 to 50).

[A-1-4. Relay car 40]
4 is a schematic diagram showing the components of the broadcast van 40 of this embodiment. As described above, the broadcast van 40 edits and processes the video information (video information) from the multiple video cameras 200 and the audio information from the multiple microphones to broadcast the broadcast content itself, or transmits a broadcast signal indicating the broadcast content to the broadcast center facility 50.

The relay vehicle 40 has an editing device 400 (FIG. 4) that edits and outputs image information (video information) from multiple video cameras 200 and audio information from multiple microphones. The editing device 400 has functions such as a switcher. The editing device 400 has a communication unit 410, an operation input unit 420, an editing control unit 430, an editing memory unit 440, and an information output unit 450.

The communication unit 410 performs various communications between the editing device 400 and the outside, and has a video signal input unit 411, a wireless router 412, and a broadcast antenna 413. The video signal input unit 411 is an input interface for a video information signal (video signal) from the video camera 200, and has a plurality of input terminals (not shown). The wireless router 412 communicates with the sensor side router 350 constituting the mesh network 60 to receive a video information signal (video signal) and a sound information signal. The wireless router 412 is also referred to as the editing device side router 412 to distinguish it from the sensor side router 350 of the sound collection unit 300. The broadcast antenna 413 transmits a broadcast signal indicating the video information and sound information edited by the editing device 400 to a home television (not shown) or the like, and broadcasts the broadcast content to each home or the like.

The operation input unit 420 accepts operation input from the user for editing video information and audio information, and includes a plurality of operation switches 421. The operation switches 421 may include switches for selecting (switching) video information and/or audio information, zooming in/out of video, playback, adjusting volume, displaying multiple videos on one screen, mixing audio information, and the like.

The editing control unit 430 controls the entire editing device 400. The editing control unit 430 switches between the video information acquired by each video camera 200 and the audio information acquired by each microphone 310, and outputs it as broadcast content. At this time, video information from multiple video cameras 200 may be included together on one screen. Audio information from multiple microphones 310 may also be mixed. Furthermore, video or audio effect processing (insertion of text information, audio processing, etc.) may be performed. The broadcast signal including the edited broadcast content (video information and audio information) can be broadcast to each home, etc. via the broadcast antenna 413, and can also be transmitted to the broadcast center equipment 50 via the broadcast antenna 413 (or wireless router 412).

The editing control unit 430 of this embodiment includes a time lag correction unit 431 that determines the amount of delay of the sound information signal from each sound collection unit 300 to the editing device 400 and corrects the time lag of each sound information signal. The specific processing of the time lag correction unit 431 will be described in detail with reference to FIG. 6.

The editing memory unit 440 stores various information in the editing device 400. For example, the editing memory unit 440 stores a program executed by the editing control unit 430 and data used by the editing control unit 430. The data here includes broadcast content edited by the editing control unit 430. The editing memory unit 440 may also store video information and/or audio information before editing. The information output unit 450 outputs various information to the user of the editing device 400. The information output unit 450 includes one main monitor 451 and multiple sub-monitors 452. Each of the main monitor 451 and the sub-monitor 452 has a display device (such as a liquid crystal panel), a speaker, etc. (not shown). The main monitor 451 can output video information and audio information of the broadcast content after editing. The sub-monitor 452 outputs video information (and audio information) before editing.

The basic configuration of each part of the editing device 400 can be the same as that of Patent Document 1 or Patent Document 2.

[A-1-5. Broadcasting center equipment 50]
The broadcasting center facility 50 (FIG. 1) broadcasts the broadcast signal received from the broadcasting van 40 either directly or after processing it. The broadcasting center facility 50 may also upload the broadcast signal to a distribution server (not shown) and distribute it to homes or the like in the form of video-on-demand from the distribution server via the Internet.

<A-2. Control and operation>
[A-2-1. Overall flow]
Next, various controls and operations for the same in the communication system 10 of the present embodiment will be described. The following describes the arrangement of the first sensor group 20, the second sensor group 30, and the relay vehicle 40, the operations and controls at the start-up of the first sensor group 20, the second sensor group 30, and the relay vehicle 40, and the operations and controls at the normal use of each section.

[A-2-2. Placement of each part]
5 shows an example of the arrangement of the video camera 200, microphone 310, and broadcast vehicle 40 of this embodiment in a baseball stadium 90. In the example of Fig. 5, a worker carries the video camera 200 and the microphone 310 to each of the arrangement points A to L (hereinafter also referred to as "points A to L"). In addition, the broadcast vehicle 40 is arranged at a predetermined position outside the baseball stadium 90 (outside the first base side stand in the example of Fig. 5).

As described above, in this embodiment, the video camera 200 is connected to the editing device 400 via the communication cable 202, so the operator of the video camera 200 needs to run the communication cable 202 (as will be described later, the video camera 200 can also be a wireless system). On the other hand, the microphone 310 is a wireless system, so the operator of the microphone 310 simply carries the sound collection unit 300 (Figure 3) to each point A to L to complete the placement.

Each wireless router 350 (sensor-side router 350) arranged at each of points A to L to configure the mesh network 60 (FIG. 2) is arranged in a position where it can transmit sound information signals to at least two other wireless routers 350. The number of sensor-side routers 350 that directly communicate with the relay vehicle 40 (editing device-side router 412 of the editing device 400) may be one or more.

[A-2-3. Start-up operations and control of each part]
(A-2-3-1. Operation and control at start-up of relay van 40)
In the relay vehicle 40, the power supply of the editing device 400 is turned on at a predetermined timing (for example, when the placement of the relay vehicle 40 is completed). This enables the communication unit 410 of the editing device 400 to communicate with the video camera 200 and the sound collection unit 300 (input of the video information signal and the sound information signal) (standby state). At this time, the editing device side router 412 starts dynamic routing processing. That is, the editing device side router 412 monitors at a predetermined period whether the sensor side router 350 (another node) exists around itself, and updates the routing table each time. In addition, the editing device side router 412 starts a new sound collection unit connection determination process.

Figure 6 is a flowchart of the new sound collection unit connection determination process executed by the editing device 400 of this embodiment. The new sound collection unit connection determination process determines whether or not a new sound collection unit 300 is connected to the editing device 400 (or the mesh network 60) (step S11 in Figure 6), and if the connection is determined (S11: TRUE), performs predetermined processing (S12 to S15). Further details of the new sound collection unit connection determination process will be described later in association with Figure 7.

(A-2-3-2. Operation and control at start-up of video camera 200)
When the editing device 400 is in a power-on state and the video camera 200 that has been completely arranged is powered on, a video information signal from the video camera 200 is input to the communication section 410 (video signal input section 411) of the editing device 400 via the communication cable 202, and the video information is displayed on one of the sub-monitors 452. In the initial setting, an input terminal (not shown) of the video signal input section 411 is associated with the sub-monitor 452. Therefore, the corresponding sub-monitor 452 is determined according to the input terminal to which the communication cable 202 is connected. Note that the correspondence between the input terminal of the video signal input section 411 and the sub-monitor 452 may be switchable by operating the operation switch 421.

In addition, the video information displayed on the main monitor 451 is selected according to the initial settings. For example, when only the video information signal of one video camera 200 is input to the editing device 400, video information corresponding to that video information signal is displayed on the main monitor 451. When the video information signals of multiple video cameras 200 are input to the editing device 400, video information corresponding to the video information signal input to a preset input terminal of the video signal input unit 411 is displayed on the main monitor 451. During normal use, the video information displayed on the main monitor 451 is switched by operating the operation switch 421.

(A-2-3-3. Operation and control at start-up of the sound collection unit 300)
(A-2-3-3-1. Overview)
7 is a flowchart showing an outline of the control of the sound collection unit 300 in this embodiment. When a power switch (not shown) of the sound collection unit 300 is turned on, the sound collection unit 300 (sound collection unit control unit 330) executes start-up control (step S21). The start-up control includes a communication route establishment process (S211) and a delay amount determination auxiliary process (S212).

The communication route establishment process (S211) is a process for establishing a communication route between the activated sound collection unit 300 and the editing device 400. The delay amount determination assistance process (S212) is a process for assisting the delay amount determination process (S13 in FIG. 6) by the editing device 400.

(A-2-3-3-2. Communication route establishment (S11, S12 in FIG. 6, S211 in FIG. 7))
As described above, in the startup control of the sound collection unit 300, a communication route establishment process (S211 in FIG. 7) is executed to establish a communication route between the started sound collection unit 300 and the editing device 400. In the communication route establishment process, the sound collection unit 300 (sound collection unit control unit 330) determines whether or not a connectable node (sensor side router 350 or editing device side router 412) exists in its vicinity. If a connectable node is detected, the sound collection unit 300 transmits its own information to the editing device 400. For example, the sound collection unit 300 reads the IP address of the editing device side router 412 from the sound collection unit storage unit 340 and transmits a startup message (including its own information) to the IP address as the destination. In addition, the self-information includes, for example, its own account name, individual identification number, IP address, and type of node (for example, whether it is a video camera 200 or a microphone 310 (sound collection unit 300)). The text of the startup message may be encrypted in a predetermined manner.

The startup message sent from the new sound collection unit 300 is sent to the editing device side router 412 via the mesh network 60. When the editing control unit 430 of the editing device 400 receives the startup message via the editing device side router 412 (S11: TRUE in FIG. 6), in step S12, it registers information about the new sound collection unit 300 in the management table.

(A-2-3-3-3. Delay amount determination (S13 in FIG. 6, S212 in FIG. 7))
Next, in step S13, the editing device 400 (editing control unit 430) executes a delay determination process. In response to this, the new sound collection unit 300 (sound collection unit control unit 330) executes a delay amount determination auxiliary process in step S212 of FIG. 7. As described above, the delay amount determination process (S13) is a process for determining the communication delay amount between the started sound collection unit 300 (i.e., the sound collection unit 300 that has successfully established communication with the editing device 400) and the editing device 400. In addition, the delay amount determination auxiliary process (S212) assists in the delay amount determination process (S13).

Specifically, the editing device 400 transmits a ping signal to the new sound collection unit 300. The new sound collection unit 300 that receives the ping signal replies to the editing device 400. The editing device 400 measures the communication time of the ping signal using its own timing function, calculates the amount of communication delay from the new sound collection unit 300 to the editing device 400, and registers it in the management table in association with the new sound collection unit 300. As will be described later, the amount of communication delay can also be determined by other methods.

(A-2-3-3-4. New sound collection unit addition notification process (S14 in FIG. 6))
6, the editing device 400 executes a new sound collecting unit addition notification process for notifying the user of the editing device 400 that a new sound collecting unit 300 has been added to the mesh network 60. For example, the editing device 400 displays on the main monitor 451 a message that the new sound collecting unit 300 has been added to the mesh network 60 and the individual identification number of the sound collecting unit 300.

(A-2-3-3-5. Video camera-microphone link processing (S15 in FIG. 6))
In the next step S15 in FIG. 6, the editing device 400 executes a video camera-microphone link process for linking the microphone 310 of the new sound collection unit 300 with the video camera 200. As described above, in this embodiment, each video camera 200 and each microphone 310 are separate. However, each video camera 200 and each microphone 310 are often used in combination. Therefore, in the editing device 400 of this embodiment, the video camera 200 and the microphone 310 can be paired and registered in a management table. This makes it possible to switch the paired sound information together when switching the video information with the operation switch 421.

In addition, in this embodiment, the video information signal is input via the communication cable 202 and the video signal input unit 411, while the audio information signal is input via the wireless routers 350, 412. Therefore, when pairing the microphone 310 with the video camera 200, the editing device 400 displays a pairing list of the video camera 200 and the microphone 310. Then, it is possible to select a video camera 200 that is not paired or has already been paired in the pairing list. Then, the video camera 200 selected by the user is paired with a new microphone 310 and registered in the management table.

[A-2-4. Operation and control of each part during normal use]
During normal use of the video camera 200, a video information signal obtained by the video camera 200 based on the operation of the user of the video camera 200 is input to the editing device 400 via the communication cable 202. During normal use of the microphone 310 (sound collection unit 300), the sound collection unit 300 performs normal operation control (S22 in FIG. 7). Specifically, a sound information signal obtained by the microphone 310 based on the operation of the user of the microphone 310 is transmitted to the editing device 400 via the mesh network 60 (sound signal transmission process of S221 in FIG. 7). Furthermore, each sensor-side router 350 performs dynamic routing process (S222).

During normal use of the editing device 400, video information and sound information are edited based on the operation of the user of the editing device 400 and broadcast as broadcast content. That is, the editing device 400 functions as a switcher or the like. In addition, the editing device 400 (time lag correction unit 431) corrects the time lag of each sound information signal based on the communication delay amount determined in the delay amount determination process (S13 in FIG. 6). That is, the editing device 400 processes each sound information signal so that the time lag of each sound information signal from each sound collection unit 300 approaches zero. For example, the delay amount of the sound information signal Ss1 is 0.1 seconds, the delay amount of the sound information signal Ss2 is 0.2 seconds, and the delay amount of the sound information signal Ss3 is 0.3 seconds. In this case, the editing device 400 adjusts the delay amounts of the sound information signals Ss1 to Ss3, for example, by delaying the sound information signal Ss1 by 0.2 seconds and the sound information signal Ss2 by 0.1 seconds.

<A-3. Effects of this embodiment>
According to this embodiment, the sound information signal indicating the sound information acquired by the microphone 310 of each sound collection unit 300 is transmitted to the editing device 400 via the mesh network 60 including the wireless router 350 of each sound collection unit 300 (S221, S222 in FIG. 2 and FIG. 7). This makes it possible to transmit sound information from the microphone 310 to the editing device 400 without a communication cable connecting each microphone 310 and the editing device 400. This makes it possible to reduce the effort required for laying communication cables.

Furthermore, compared to direct wireless communication between each microphone 310 and the editing device 400, wireless communication between each sound collection unit 300 and the editing device 400 via the mesh network 60 makes it possible to suppress wireless output or expand the range in which sound information can be obtained.

Furthermore, by adopting the mesh network 60 configuration rather than the daisy chain configuration, even if an abnormality occurs in one of the wireless routers 350, it is possible to transmit sound information acquired by microphones 310 other than the microphone 310 paired with that wireless router 350 to the editing device 400. This makes it possible to improve the robustness of the communication system 10.

In this embodiment, the communication system 10 includes a plurality of video cameras 200 that acquire surrounding video information and transmit a video report signal indicating the video information to the editing device 400 via a communication cable 202 (FIG. 1). A plurality of microphones 310 are used separately from the plurality of video cameras 200 (FIG. 1). The editing device 400 switches the video information acquired by each video camera 200 and outputs it together with sound information (FIG. 4). As a result, in a configuration using a mesh network 60 using a wireless router 350 of the sound collection unit 300, even if the microphone 310 and the video camera 200 are used separately (without being integrated) (particularly common in high-end applications), it is possible to output the sound information and the video information in association with each other.

In this embodiment, the communication system 10 includes a time lag correction unit 431 that determines the amount of delay of the sound information signal arriving from each sound collection unit 300 to the editing device 400 and corrects the time lag of each sound information signal (FIG. 4). This makes it possible to reduce the discomfort caused by the time lag when the viewer (the person receiving the sound information edited by the editing device 400) perceives the sound information.

In this embodiment, the time lag correction unit 431 transmits a ping signal to the wireless router 350 of each sound collection unit 300, and determines the amount of delay of each sound information signal based on the response signal from each wireless router 350 (S13 in FIG. 6). The time lag correction unit 431 also corrects the time lag of each sound information signal based on the determined amount of delay. This makes it possible to correct the time lag without performing special processing on the wireless router 350 side.

In this embodiment, each of the wireless routers 350 constituting the mesh network 60 is arranged in a position where it can transmit a sound information signal to at least two other wireless routers 350, except for the wireless router 350 that communicates directly with the editing device 400 (FIG. 5). This makes it possible to communicate via the mesh network 60 even if a communication error occurs in one of the wireless routers 350 that relays the sound information signal (excluding the wireless router 350 that communicates directly with the editing device 400).

B. Modifications The present invention is not limited to the above-described embodiment, and various configurations can be adopted based on the contents of the present specification. For example, the following configurations can be adopted.

<B-1. Configuration>
In the above embodiment, the first sensor group 20 (video camera 200) and the second sensor group 30 (microphone 310) are used in a baseball stadium 90 (FIGS. 1 and 5). However, this is not limited to the above, if attention is paid to the point of forming a mesh network of node units in relation to live broadcasting, for example. For example, the first sensor group 20 and/or the second sensor group 30 can be used in other sports stadiums, theaters, or concert halls.

In the above embodiment, the video information signal from the video camera 200 was transmitted to the editing device 400 via the communication cable 202 (FIG. 1). However, for example, if attention is focused on the point of transmitting the video information signal to the editing device 400, the video camera 200 may perform wireless communication with the broadcast vehicle 40. In that case, similar to the sound information signal from the microphone 310, the video information signal from the video camera 200 may be transmitted to the editing device 400 via a wireless router. In other words, the first sensor group 20 may be constituted by a plurality of node units including the video camera 200 and a wireless router, and a mesh network may be constituted by the wireless router paired with the video camera 200.

If a wireless router is also used in the first sensor group 20, the mesh network of the first sensor group 20 and the mesh network 60 of the second sensor group 30 may be configured separately. In that case, the specifications (communication speed, etc.) of the two mesh networks may be different. Alternatively, the first sensor group 20 and the second sensor group 30 may configure a single mesh network.

In the above embodiment, the sound collection unit 300 is used as a node unit that configures the mesh network 60 using the wireless router 350 (FIG. 2). However, this is not limited to the above, for example, if the mesh network of node units is configured in relation to live broadcasting. For example, the mesh network may be configured only from a node unit including a video camera 200 and a wireless router that is paired with the video camera 200. Alternatively, in a configuration in which the microphone 310 is integrated with the video camera 200, the mesh network may be configured from a node unit including the video camera 200 with the microphone 310 integrated therein and a wireless router that is paired with the video camera 200. In addition, instead of a wireless router, it is also possible to configure a mesh network using multiple node units (a video unit having a video camera 200 and/or a sound collection unit 300 having a microphone 410) using a router connected by wire.

In the above embodiment, the editing device side router 412 is used as the communication device of the editing device 400 that communicates with the mesh network 60 by the sensor side router 350 (Figure 4). However, for example, if attention is focused on communication with the mesh network 60, other communication devices (e.g., gateway devices other than a router) may be used in the editing device 400. In that case, communication settings with the sensor side router 350 located closest to the editing device 400 may be configured in advance.

<B-2. Control>
In the above embodiment, the ping signal is used to determine the amount of communication delay (S13 in FIG. 6, S212 in FIG. 7). However, for example, if attention is paid to correcting the time lag of the sound information signals from each sound collection unit 300, the present invention is not limited to this.

For example, the time lag may be corrected in the following manner. That is, each wireless router 350 of the sound collection unit 300 assigns a time stamp (the time at which the signal is relayed) to the sound information signal it relays. The time lag correction unit 431 calculates the amount of delay based on the time stamp assigned to the sound information signal and corrects the time lag of each sound information signal. This makes it easy to correct the time lag even if the signal transmission path changes in the mesh network 60.

Alternatively, the time lag correction unit 431 may impart a delay amount, which is a fixed value set for each wireless router 350, to the sound information signal for each wireless router 350. In other words, with each wireless router 350 placed, the delay amount is measured using a measuring device (not shown), and the measured delay amount is stored in association with each wireless router 350. Then, the time lag of the sound information signal from each wireless router 350 is corrected based on the delay amount (fixed value) stored for each wireless router 350. As a result, once each delay amount, which is a unique value, is set, it becomes possible to correct the time lag without performing special processing in each wireless router 350 or the editing device 400.

10: communication system 20: first sensor group 30: second sensor group 40: relay vehicle 50: broadcast center equipment 60: mesh network 90: baseball field 200: video camera (periphery sensor)
202... communication cable 300... sound collection unit (node unit)
310...Microphone (peripheral sensor)
350: Wireless router 400: Editing device 412: Wireless router (communication device)
431...Time lag correction unit

Claims (8)

A plurality of sound collection units each including a microphone that acquires surrounding sound information and outputs a sound information signal indicating the sound information, and a wireless router that transmits the sound information signal to the outside;
A communication system including: a communication device that communicates with the wireless router to receive the sound information signal; and an editing device that edits and outputs the sound information,
The editing device switches or mixes the sound information acquired by each microphone and outputs the information,
The wireless routers of the plurality of sound collection units form a mesh network,
The sound information signal is transmitted from each sound collection unit to the editing device via the mesh network. 2. The communication system according to claim 1,
the communication system includes a plurality of video cameras that acquire surrounding video information and transmit a video report signal indicating the video information to the editing device via a communication cable or wirelessly;
the plurality of microphones are used separately from the plurality of video cameras;
A communication system, wherein the editing device switches the video information acquired by each video camera and outputs the video information together with the audio information. 3. The communication system according to claim 1,
The communication system further comprises a time lag correction unit that corrects a time lag of each sound information signal based on an amount of delay of the sound information signal reaching the editing device from each sound collection unit. 4. The communication system according to claim 3,
The time lag correction unit
Transmitting a ping signal to each wireless router, and determining the delay amount of each sound information signal based on a response signal from each wireless router;
A communication system comprising: a communication unit for correcting a time lag of each sound information signal based on each determined amount of delay. 4. The communication system according to claim 3,
Each wireless router assigns a time stamp to the sound information signal that it relays,
The communication system according to claim 1, wherein the time offset correction unit corrects a time offset of each sound information signal based on the time stamp added to the sound information signal. 4. The communication system according to claim 3,
The communication system according to claim 1, wherein the time lag correction unit imparts a delay amount, which is a fixed value set for each of the wireless routers, to the sound information signal for each of the wireless routers. 3. The communication system according to claim 1,
A communication system characterized in that each wireless router constituting the mesh network is positioned in a position where it can transmit the sound information signal to at least two other wireless routers, except for a wireless router that communicates directly with the editing device. a plurality of node units each including a peripheral sensor that acquires peripheral information including peripheral sound information or video information and outputs a peripheral information signal indicating the peripheral information, and a router that transmits the peripheral information signal to the outside;
A communication method using a communication system including a communication device that communicates with the router to receive the peripheral information signal, and an editing device that edits and outputs the peripheral information,
A mesh network is formed by the routers of the plurality of node units,
a communication method comprising: transmitting the peripheral information signal from each node unit to the editing device via the mesh network;

Images