JP2008172606A - Solid-state imaging apparatus and camera system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain a camera system by which high speed tracking of a moving subject and high definition imaging for appreciation can be performed using one solid-state imaging apparatus. <P>SOLUTION: As structure of the camera system with the solid-state imaging apparatus 1 and a camera signal processor 2, the solid-state imaging apparatus 1 is provided with a pixel array part 6 in which a plurality of pixels 8 are two-dimensionally arranged like a matrix and a control means for performing control so as to read a pixel signal once in all pixels reading modes from the pixel array part 6 whenever a pixel signal is read for n times (n is an integer ≥2) by thinning mode from the pixel array part 6 and the camera signal processor 2 is provided with a signal processing part which performs motion detection of a subject using an image obtained by thinning reading for n times. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a solid-state imaging device and a camera system using the same.

  A camera system that uses a current solid-state imaging device when you want to keep a moving subject (hereinafter also referred to as a “moving subject”) at the center of the angle of view, for example, when you want to take a picture of your child at an athletic meet, etc. Then, the photographer must shoot with an awareness that the subject always falls within the angle of view. For this reason, inconvenience is often imposed on shooting.

  In recent years, surveillance cameras using solid-state imaging devices have attracted attention for security purposes. For example, in a port facility or an airport facility, multipoint monitoring using a plurality of surveillance cameras is generally used for the purpose of monitoring criminal acts such as terrorism or natural disasters. However, in this case, a plurality of monitoring cameras are required, the installation cost becomes enormous, and it may be difficult to monitor a large number of images. Therefore, in these applications, an automatic tracking camera that detects a moving subject and keeps it within an angle of view is used.

  As a conventional technique related to such an automatic tracking camera, for example, a technique described in Patent Document 1 is known. In this technique, images for two frames taken by a camera are stored in an image memory, a difference image is obtained from the frame images, a moving amount and a moving range of a moving subject are calculated, and an image processor and a CPU are calculated based on the calculated moving amount and moving range. An instruction is sent to the pan / tilt head drive controller to track the shooting direction of the camera in the moving direction of the moving subject.

JP 2000-175101 A

  However, in the above-described prior art, when acquiring images for two frames, for example, if the camera frame rate is 30 (frames / second), only one image can be obtained in 1/30 seconds. However, there is a disadvantage that automatic tracking is difficult for a moving subject moving at high speed. Furthermore, the amount of computation required when obtaining a difference image increases in proportion to the number of pixels in the image. Therefore, when obtaining a high-resolution image, computation processing at frame intervals is difficult, There is a disadvantage that the power consumption required for the increase. In order to eliminate these drawbacks, for example, by reducing the number of pixels to enable high-speed imaging, and reducing the amount of calculation, the resolution is reduced by reducing the number of pixels compared to normal ornamental imaging. Degradation of image quality such as a drop occurs.

  The present invention has been made to solve the above-described problems, and the object of the present invention is to perform high-speed tracking of moving subjects and high-quality imaging for viewing using a single solid-state imaging device. Is to realize a simple camera system.

  The solid-state imaging device according to the present invention includes a pixel array unit in which a plurality of pixels are two-dimensionally arranged in a matrix, a first readout mode for reading out a pixel signal from the pixel array unit with a first number of pixels, and the pixels A second readout mode in which pixel signals are read out from the array unit with a second number of pixels smaller than the first number of pixels, and pixel signals are output n times (where n is 2 or more) in the second readout mode. (Integer) comprising a control means for controlling the pixel signal to be read once in the first reading mode each time reading is performed. In addition, a camera system according to the present invention includes the solid-state imaging device having the above-described configuration and a signal processing device that detects a motion of a subject using an image obtained by the n times of reading.

  In the solid-state imaging device and the camera system using the solid-state imaging device according to the present invention, each time the pixel signal is read n times in the second readout mode when driving the solid-state imaging device, the pixel signal is 1 in the first readout mode. By performing the reading once, the pixel signal reading based on the first reading mode and the n times of pixel signal reading based on the second reading mode can be performed intermittently. For this reason, an image based on one pixel signal read in the first readout mode is used for ornamental purposes while performing motion detection of the subject using an image based on the n pixel signals read in the second readout mode. It can be captured as an image.

  According to the present invention, it is possible to realize a camera system capable of performing high-speed tracking of moving subjects and high-quality imaging for viewing using a single solid-state imaging device.

  Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is an overall configuration diagram of a camera system according to an embodiment of the present invention. This camera system generally includes a solid-state imaging device 1, a camera signal processing device 2, an image memory 3, a display device 4, and a camera platform 5.

  The solid-state imaging device 1 is configured using, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The solid-state imaging device 1 includes a pixel array unit 6, a vertical scanning circuit 7, a column amplifier 8, a horizontal scanning circuit 9, and a pixel drive controller 10.

  A plurality of unit pixels (hereinafter simply referred to as “pixels”) are two-dimensionally arranged in a matrix in the pixel array unit 6. The vertical scanning circuit 7 selectively scans each pixel of the pixel array unit 6 in units of rows and drives each pixel in the selected row. The column amplifier 8 performs processing such as CDS (Correlated Double Sampling) and signal amplification for removing fixed pattern noise peculiar to the pixels output from each pixel in the pixel array unit 6. Is to do.

  The horizontal scanning circuit 9 sequentially outputs pixel signals for one row processed by the column amplifier 8 to the horizontal signal lines by horizontal scanning. The pixel signal output to the horizontal signal line is output to the camera signal processing device 2 as a video signal. The pixel drive controller 10 sends control signals for driving the pixels to the vertical scanning circuit 7 and the horizontal scanning circuit 9 in accordance with the pixel driving signal input from the camera signal processing device 2.

  The camera signal processing device 2 includes a microprocessor 11, an A / D converter 12, a camera signal processing unit 13, a drive processing unit 14, and an ornamental signal processing unit 15. Among these, the camera signal processing unit 13, the drive processing unit 14, and the ornamental signal processing unit 15 are each configured by a DSP (Digital signal processor).

  The microprocessor 11 controls the entire processing of the camera signal processing device 2. The A / D converter 12 converts the form of a video signal input from the solid-state imaging device 1 to the camera signal processing device 2 from an analog signal to a digital signal.

  The camera signal processing unit 13 performs camera signal processing such as offset (clamp) adjustment, white balance, and demosaicing on the video signal converted by the A / D converter 12. The imaging data subjected to the camera signal processing is stored in the image memory 3 as image data. In the thinning readout mode, the image data stored in the image memory 3 is read out to the camera signal processing unit 13 and the drive processing unit 14. The camera signal processing unit 13 uses the image data read from the image memory 3 to perform processing related to subject motion detection. Further, the drive processing unit 14 performs a process of generating a pixel drive signal or a pan head drive signal using the image data read from the image memory 3. In the all-pixel readout mode, the image data stored in the image memory 3 is read out to the ornamental signal processing unit 15. The ornamental signal processing unit 15 performs processing for outputting the image data read from the image memory 3 to, for example, the display device 4. The display device 4 may be connected to the camera signal processing device 2 as an external device separately from the camera system.

  The pixel drive signal generated by the drive processing unit 14 is input to the pixel drive controller 10 of the solid-state imaging device 1. The pan head drive signal generated by the drive processing unit 14 is input to the pan head 5.

  The camera platform 5 is mounted with the solid-state imaging device 1 and is driven to change the imaging direction of the solid-state imaging device 1. The camera platform 5 includes a camera platform drive device 16 and a camera platform drive controller 17. The camera platform drive controller 17 receives the camera platform drive signal. The pan head drive controller 17 drives the pan head drive device 16 based on the pan head drive signal. The pan / tilt head driving device 16 is driven to change the imaging direction of the solid-state imaging device 1.

  FIG. 2 is a schematic diagram illustrating a configuration example of an internal circuit of the solid-state imaging device. Each pixel (unit pixel) 18 two-dimensionally arranged in a matrix in the pixel array unit 6 includes a transfer transistor Tr1, a reset transistor Tr2, an amplification transistor Tr3, and a selection transistor Tr4, in addition to the photodiode PD serving as a photoelectric conversion element. The pixel circuit has four MOS (Metal Oxide Semiconductor) transistors. Further, in each pixel 18, a transfer wiring L1, a reset wiring L2, and a row selection wiring L3 are wired in common to the pixels in the same row. In addition, the vertical signal line L4 is wired to each pixel 18 in common to the pixels in the same column.

  When driving each pixel 18 of the pixel array unit 6, the vertical scanning circuit 7 outputs the reset signal rst, the transfer signal trg, and the row selection signal sel, while the horizontal scanning circuit 9 outputs the column selection signal h. . In FIG. 2, the reset signal rst, the transfer signal trg, and the row selection signal sel output from the vertical scanning circuit 7 for the unit pixel 18 in the i-th row are suffixed i, and the unit pixel 18 in the j-th column. On the other hand, the column selection signal h output from the horizontal scanning circuit 9 has a suffix j. Therefore, for example, assuming that the pixel array of the pixel array unit 6 is VGA (640 pixels × 480 pixels), i = 1, 2,..., 480, j = 1, 2,. It will be.

  The solid-state imaging device 1 has a first readout mode and a second readout mode as readout modes when readout of pixel signals from each pixel of the pixel array unit 6. The first readout mode is a readout mode in which pixel signals are read out from the pixel array unit 6 with the first number of pixels, and the second readout mode is a second mode in which the pixel array unit 6 has a smaller number than the first number of pixels. This is a read mode in which pixel signals are read according to the number of pixels. In the present embodiment, the all-pixel readout mode is applied as the first readout mode, and the thinning readout mode is applied as the second readout mode. The all-pixel readout mode is an ornamental readout mode, and the thinning readout mode is a readout mode for high-speed tracking. Switching of the readout mode is performed by the pixel drive controller 10.

  FIG. 3 is a timing chart in the case where each pixel of the pixel array unit is driven in the all-pixel reading mode. In the case of all pixel readout, the driving of the pixels in the i-th row of the pixel array unit 6 is started with the falling edge of the signal XHS as a trigger. In the i-th pixel row, first, when the row selection signal seli rises, the i-th pixel output becomes valid. Next, when the pixel reset signal rsti rises, the reset signal rsti is read from the pixel in the i-th row. Next, when the transfer signal trgi rises, the pixel signal is read from the pixel in the i-th row.

  Next, the pixel signal after the CDS processing of the difference between the pixel signal and the reset signal is sampled / held, and the column selection signal hj rises in this state, whereby the pixel signal in the jth column is output as a video signal. By performing such pixel driving operations in order of i + 1, i + 2,... And selecting them in the column direction as j, j + 1, j + 2,. A video signal corresponding to is output.

  FIG. 4 is a timing chart in the case where each pixel of the pixel array unit is driven in the thinning readout mode. In the case of thinning readout, the driving of the pixels in the i-th row of the pixel array unit 6 is started with the falling edge of the signal XHS as a trigger. Then, the pixel signal of the jth column is output as a video signal in the same manner as in the case of all pixel readout. At that time, the column selection signal hj + 1 is not raised so that the pixel signal of the j + 1th column is not output as a video signal. Furthermore, when the next signal XHS falls, the row selection signal seli + 1, the reset signal rsti + 1, and the transfer signal trgi + 1 in the i + 1 row are not raised, so that the pixel in the i + 1 row Do not select. Thereby, thinning-out reading is realized.

  In the case of thinning readout, the number of pixels of the video signal output from the solid-state imaging device 1 is smaller than in the case of all pixel readout. For this reason, thinning-out readout can perform imaging at a higher speed than all-pixel readout. For example, when thinning driving is performed with even-numbered rows selected as i, i + 2, i + 4,..., It is possible to realize imaging that is twice as fast as all pixel readout.

  FIG. 5A is a diagram illustrating an example of a color filter array corresponding to the pixel array of the pixel array unit. The arrangement of the color filters shown in the figure is called a Bayer arrangement that is often used in the solid-state imaging device 1, and the primary color filters of R (red), G (green), and B (blue) that are the three primary colors of light are used. One row has an array of B, G, B, G,..., And the next row has an array of R, B, R, B,. In the case of all pixel readout, pixel signals are read out with the same Bayer arrangement as the original color filter.

  In general, when thinning readout is performed, the color arrangement of pixel signals after thinning is often maintained in the same Bayer arrangement as in the case of all pixel readout. This is because the color signal processing can be performed with the same algorithm. Therefore, when thinning out, as shown in FIG. 5B, for example, one row is read out every three rows so that every two pixels are read out in the vertical direction, and pixel signals are read out also in the horizontal direction. By reading one column out of every three columns so that the column is every two pixels, the color arrangement of the pixel signals after thinning can be maintained in the same Bayer arrangement as in the case of all pixel readout. Note that in FIG. 5B, pixel portions from which signals are read out in the thinning mode are displayed in a shaded pattern.

  When such thinning readout is performed, the number of pixels to be actually driven is smaller than that for all pixel readout, so that the frame rate can be increased accordingly. In the example of FIG. 5B, since one row is read out in three rows, the frame rate is three times faster than in the all-pixel readout. In addition to the example of FIG. 5B, for example, by combining a signal thinning operation and an addition operation, reading with improved sensitivity while performing a thinning operation is also possible.

  FIG. 6 is a timing chart showing the signal readout operation of the solid-state imaging device. Here, as an example, a solid-state imaging device in which the pixel rows of the pixel array unit are configured with 8 rows is assumed. First, the reading of the pixel signal is started with the falling edge of the signal XVS as a trigger. That is, when the signal XVS falls, every time the signal XHS falls, pixel signals are read in order from the even-numbered (i = 2, 4, 6, 8) pixel rows. In this case, odd-numbered (i = 1, 3, 5, 7) pixel rows are thinned out. Such thinning-out reading is repeated four times each time the signal XVS falls, so that the thinning-out reading for tracking is performed four times from frame 1 to frame 4.

  Next, as the first reset operation, the pixel signal is read sequentially from all the pixel rows every time the signal XHS falls, triggered by the fall of the signal XVS after four thinning-out readings. When a CMOS image sensor is used for the solid-state imaging device 1, since simultaneous reading cannot be performed, there are rows with different exposure times in reading between frames having different frame rates. For this reason, here, pixel signals are once read from all pixel rows as a reset operation between the tracking thinning readout frame and the ornamental all pixel readout frame.

  Next, with the falling edge of the signal XVS after the first reset operation as a trigger, the pixel signals are sequentially read from all the pixel rows every time the signal XHS falls. Thereby, all the pixels for ornamental reading are read once.

  Next, as a second reset operation, every time the signal XHS falls using the falling edge of the signal XVS after reading out all the pixels as a trigger, the pixels from the even-numbered (i = 2, 4, 6, 8) pixel rows in order. The signal is read out. Thereafter, the above-described thinning readout for tracking for 4 frames, the first reset operation, the readout of all pixels for viewing for 1 frame, and the second reset operation are repeated in order.

  The pixel signal read from each pixel of the pixel array unit 6 in this manner is a camera signal from the solid-state imaging device 1 as a video signal representing an image of each frame corresponding to the above-described four-time thinning-out reading or one-time all-pixel reading. It is transferred to the processing device 2. At that time, as shown in FIG. 7, the solid-state imaging device 1 transfers the video signal to the camera signal processing device 2 while performing thinning readout for tracking. On the other hand, the camera signal processing device 2 performs subject motion detection using an image obtained by the above-described four-time thinning out of the images represented by the video signal sent from the solid-state imaging device 1. Thereby, in the camera system including the solid-state imaging device 1 and the camera signal processing device 2, the thinning-out readout for tracking and the motion detection of the subject are simultaneously performed.

  FIG. 8 is a flowchart showing a processing procedure applied to the camera system according to the embodiment of the present invention. First, the solid-state imaging device 1 performs the first thinning out of the four times to generate an image signal of the thinned readout frame 1 and transfers the image signal to the camera signal processing device 2 to perform the thinning out. The image signal of the read frame 1 (hereinafter referred to as “frame image 1”) is taken into the image memory 3 (step S1).

  Next, by performing the second thinning out of the four times in the solid-state imaging device 1, an image signal of the thinned readout frame 2 is generated, and the image signal is transferred to the camera signal processing device 2. The image signal of the thinned readout frame 2 (hereinafter referred to as “frame image 2”) is taken into the image memory 3 (step S2).

  Next, in the camera signal processing device 2, the camera signal processing unit 13 calculates the difference between the frame image 1 and the frame image 2 stored in the image memory 3, and binarizes the calculation result (step S3). Thereby, when a moving subject is included in the frame images 1 and 2, images of the moving subject are extracted by binarization. At this time, depending on the arithmetic processing method of the camera signal processing unit 13, the frame image 2 may or may not be captured into the image memory 3 by writing the coordinates of the subject in the internal register.

  Next, in the camera signal processing apparatus 2, the camera signal processing unit 13 calculates the center of gravity 1 of the image binarized in step S3, and takes in the calculation result to the image memory 3 (step S4).

  FIG. 9 is a diagram for explaining the principle of centroid calculation. In the calculation of the center of gravity, the image data of the moving subject obtained by the difference calculation and binarization of the two frame images is divided into meshes with a certain interval, and the coordinates of the meshes are (Xm, Yn) (m, n). Are both integers). Then, if the moving subject image data exists on the mesh coordinates (Xm, Yn), amn = 1, and if not, amn = 0. In this way, the coordinates (X, Y) of the binarized moving subject's center of gravity can be calculated by the following equation (1).

  Next, by performing the third thinning out of the four times in the solid-state imaging device 1, an image signal of the thinned readout frame 3 is generated, and the image signal is transferred to the camera signal processing device 2. The image signal of the thinning readout frame 3 (hereinafter referred to as “frame image 3”) is taken into the image memory 3 (step S5).

  Next, by performing the fourth thinning out of the four times in the solid-state imaging device 1, an image signal of the thinned readout frame 4 is generated, and the image signal is transferred to the camera signal processing device 2. The image signal of the thinned readout frame 4 (hereinafter referred to as “frame image 4”) is taken into the image memory 3 (step S6).

  Next, in the camera signal processing apparatus 2, the camera signal processing unit 13 calculates the difference between the frame image 3 and the frame image 4 stored in the image memory 3, and binarizes the calculation result (step S7). Thereby, when a moving subject is included in the frame images 3 and 4, the image of the moving subject is extracted by binarization.

  Next, in the camera signal processing apparatus 2, the camera signal processing unit 13 calculates the centroid 2 of the image binarized in step S7 in accordance with the principle of centroid calculation described above, and the calculation result is taken into the image memory 3. (Step S8).

  Next, in the camera signal processing device 2, from the center of gravity 1 to the center of gravity 2 based on the center of gravity 1 of the image captured in the image memory 3 in step S4 and the center of gravity 2 of the image captured in the image memory 3 in step S8. Is calculated by the camera signal processing unit 13 (step S9).

  Next, in the camera signal processing device 2, the camera signal processing unit 13 calculates a movement vector estimated in the next frame based on the center-of-gravity movement vector obtained in step S9 (step S10). Specifically, the center-of-gravity movement belt obtained in step S9 is doubled in the vector direction of the center-of-gravity movement vector to obtain the center-of-gravity movement position estimated in the next frame (movement vector of the next frame). .

  FIG. 10 is a diagram schematically showing the processing contents of motion detection. FIG. 10 shows the principle of calculating the center of gravity of a moving subject by calculation between frames and predicting the movement of the subject in the next frame from the movement of the center of gravity. Specifically, after extracting the moving subject image by calculating the difference between the frame image 1 and the frame image 2 and binarizing, the center of gravity 1 of the moving subject image is calculated by calculating the center of gravity. Next, after extracting the moving subject image by calculating the difference between the frame image 3 and the frame image 4 and binarizing, the center of gravity 2 of the moving subject image is calculated by calculating the center of gravity. Then, after calculating a movement vector from the center of gravity 1 to the center of gravity 2, a movement vector of the center of gravity estimated in the next frame is obtained. In FIG. 10, the frame image 2 and the frame image 3 are shown to be a common image, but actually, the images are captured at different timings.

  Thereafter, the camera signal processing apparatus 2 determines whether or not the center-of-gravity movement position in the next frame estimated in step S10 is within the angle of view of the pixel that has been subjected to the thinning readout (hereinafter referred to as “thinning pixel”). The determination is made by the camera signal processing unit 13 (step S11). When the center-of-gravity movement position of the next frame falls within the angle of view of the thinned pixel, a pixel drive signal necessary for changing the angle of view by the same amount as the movement vector estimated in step S10 is calculated. The pixel drive signal is transferred to the solid-state imaging device 1 (step S12).

  Thereby, in the next frame (all pixel readout frame), the pixel array unit 6 of the solid-state imaging device 1 starts reading pixel signals (hereinafter, “ (Referred to as “readout start pixel”). Specifically, a rectangular imaging area having a predetermined size is set in the pixel array unit 6 with a certain pixel out of all the pixels in the pixel array unit 6 as a read start pixel, and the size of the imaging area is set. 11, in the frame image A captured by reading all pixels at a certain timing, the pixel indicated by the coordinates (Ha, Va) on the pixel array unit 6 is captured as a readout pixel, as shown in FIG. On the other hand, in the frame image B picked up by all pixel readout at the next timing, the coordinates (Hb, Vb) on the pixel array unit 6 are changed by changing the position of the readout start pixel in the row direction and the column direction. The pixel indicated by () is imaged as a readout start pixel. Since the change of the readout start pixel is performed using the result of the motion detection described above, even when the subject is moving, the subject can be easily within the angle of view by changing the readout start pixel.

  On the other hand, when the center-of-gravity movement position of the next frame does not fall within the angle of view of the thinned pixel, a pan head drive signal necessary for changing the angle of view as much as the movement vector estimated in step S10 is calculated. Then, the camera platform 5 is driven by transferring the camera platform drive signal to the camera platform 5 (steps S13 and S14).

  As a result, in the next frame (all-pixel readout frame), the direction of the camera platform 5 can be changed so that the moving subject comes to the center of the angle of view. Specifically, as shown in FIG. 12, the subject can be easily within the angle of view by appropriately changing the direction of the camera platform 5 on which the solid-state imaging device 1 is mounted to the pan direction and the tilt direction. .

  After changing the angle of view in this way, the solid-state imaging device 1 receives an imaging instruction from the user and performs one-time all-pixel readout, thereby generating an image signal of the all-pixel readout frame and this image. The signal is transferred to the camera signal processing device 2 (steps S15 and S16). Thereafter, the process returns to step S1 and the same processing is repeated. If there is no imaging instruction from the user, the process returns to step S1 without reading all pixels.

  Through the above processing, it is possible to control so that the moving subject always falls within the angle of view. Therefore, for example, after performing an imaging request from the user such as shutter-on or a thinning-out readout for tracking a certain number of frames, a moving subject always exists in the angle of view by performing all-pixel readout for viewing. You can get good quality images.

  In addition, according to the present invention, it is possible to realize a camera system capable of capturing an image so that a moving subject always falls within an angle of view for reading all pixels. In addition, since tracking imaging is performed by thinning readout, high-speed frame imaging can be realized. Therefore, it is possible to track a moving subject that moves at high speed. In addition, since the amount of calculation can be reduced for tracking a moving subject, the burden of signal processing (circuit scale, power consumption, etc.) can be reduced. In addition, the capacity of the external memory used for computation can be reduced.

  Furthermore, since ornamental imaging is performed by reading out all pixels, a high-quality image with high resolution can be obtained. In addition, since the readout start pixel of the pixel array unit 6 is changed or the camera platform 5 is driven according to the tracking calculation result, the angle of view is always changed by driving the camera platform 5. Compared to the case, the power consumption for driving the pan head 5 can be reduced. In addition, according to the tracking calculation result, it is possible to recognize the position of the moving subject in the frame image obtained by the all-pixel readout at the time of all-pixel readout, so that the user's favorite image can be obtained. It is done.

1 is an overall configuration diagram of a camera system according to an embodiment of the present invention. It is the schematic which shows the structural example of the internal circuit of a solid-state imaging device. It is a timing chart in the case of driving each pixel of a pixel array part by all pixel read-out mode. It is a timing chart in the case of driving each pixel of the pixel array unit in a thinning readout mode. It is a figure which shows an example of a color filter arrangement | sequence corresponding to the pixel arrangement | sequence of a pixel array part, and an example of a pixel arrangement | sequence which performs thinning-out reading. It is a timing chart which shows signal read-out operation of a solid imaging device. It is a figure which shows the operation example of a solid-state imaging device and a camera signal processing apparatus. It is a flowchart which shows the process sequence applied to the camera system which concerns on embodiment of this invention. It is a figure explaining the principle of a gravity center calculation. It is a figure which shows typically the processing content of a motion detection. It is a figure which shows the example which changes a read start pixel and changes an angle of view. It is a figure which shows the example which changes the direction of a pan head and changes an angle of view.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Solid-state imaging device, 2 ... Camera signal processing apparatus, 5 ... Pan head, 6 ... Pixel array part, 8 ... Pixel, 10 ... Pixel drive controller

Claims (6)

A pixel array unit in which a plurality of pixels are two-dimensionally arranged in a matrix;
A first readout mode in which pixel signals are read out from the pixel array section with a first number of pixels, and a second readout in which pixel signals are read out from the pixel array section with a second number of pixels smaller than the first number of pixels. And a control means for controlling the pixel signal to be read once in the first readout mode every time the pixel signal is read n times (n is an integer of 2 or more) in the second readout mode. A solid-state imaging device comprising: The solid-state imaging device according to claim 1, wherein the first readout mode is an all-pixel readout mode, and the second readout mode is a thinning readout mode. A pixel array unit in which a plurality of pixels are two-dimensionally arranged, a first readout mode in which a pixel signal is read from the pixel array unit with a first number of pixels, and the first number of pixels from the pixel array unit A second readout mode for reading out a pixel signal with a smaller number of second pixels, and each time the pixel signal is read out n times (n is an integer of 2 or more) in the second readout mode, A solid-state imaging device comprising control means for controlling the pixel signal to be read once in the readout mode of
And a signal processing device for detecting a motion of a subject using an image obtained by the n times of reading. The signal processing device binarizes the difference between the images obtained by the n times of reading, obtains the centroid of the binarized image by moment calculation, and tracks the movement of the centroid in the image. The camera system according to claim 3, wherein the movement of the subject is detected. 4. The camera system according to claim 3, wherein a readout start pixel of a pixel array unit of the solid-state imaging device is changed based on detection of the movement of the subject. Comprising a pan head mounted with the solid-state imaging device;
The camera system according to claim 3, wherein the direction of the camera platform is changed based on the motion detection of the subject.

Images