Сканер для получения панорамных снимков и трехмерных моделей окружающего пространства

Устройство относится к области компьютерной графики и компьютерного зрения, в частности к системе трёхмерной реконструкции окружающего пространства. Сканер для получения панорамных снимков и трехмерных моделей окружающего пространства содержит корпус, имеющий основание, играющее роль базовой плоскости, и к которому жестко крепятся все остальные элементы сканера, блок позиционирования, включающий в себя червячный редуктор и шаговый двигатель, камеру высокого разрешения, включающую в себя RGB матрицу и объектив типа «рыбий глаз», причем главная оптическая ось камеры расположена параллельно базовой плоскости, а сама камера выполнена с возможностью съемки в широком динамическом диапазоне и настройкой баланса белого непосредственно в процессе съемки без его прерывания, сенсор глубины, сконфигурированный производить сбор трёхмерных данных как внутри, так и снаружи помещений, курсовертикаль, выполненную с возможностью определения углового положения сканера, бортовой вычислительный блок, на который ...

ПАРАЛЛЕЛЬНОЕ ИЛИ ВЫПОЛНЯЕМОЕ ПОСЛЕДОВАТЕЛЬНО В ОНЛАЙН- И ОФФЛАЙН- РЕЖИМАХ ФОРМИРОВАНИЕ РЕКОНСТРУКЦИЙ ДЛЯ ТРЕХМЕРНОГО ОБМЕРА ПОМЕЩЕНИЯ

... 1. Измерительное приспособление (3) для автоматического трехмерного обмера помещения (1), содержащее съемочный аппарат (7), выполненный с возможностью получения видеоизображений низкого разрешения и автоматического получения снимков высокого разрешения в геометрически подходящих точках (15) помещения, причем автоматическое получение снимков высокого разрешения осуществляется на основе трехмерной реконструкции (23) помещения, формируемой по видеоизображениям в режиме реального времени.2. Измерительное приспособление (3) по п.1, содержащее устройство (17) вывода, выполненное с возможностью вывода формируемой в режиме реального времени трехмерной реконструкции (23), за счет чего реализуется непрерывное руководство (35) перемещением пользователя в режиме реального времени.3. Измерительное приспособление (3) по п.1 или 2, содержащее устройство (18, 19) для определения местоположения, выполненное с возможностью определения для каждого из видеоизображений и снимков высокого разрешения расстояния ...

Digitally controlled or controllable cameras coupling device for synchronous and quality-same three-dimensional recording of e.g. video, has two cameras coupled or couplable with each other by communication device and coupling device

The device has two cameras (1, 2) coupled or couplable with each other by a communication device e.g. communication bus and communication chip (61), and a micro-male-male coupling device e.g. plug-in connectors (3, 5), infrared transceiver (7), bushing (31), plug-in parts and Bluetoothconnection device (63). The cameras are arranged to each other in a preset or adjustable angle. A recognition device recognizes a coupling type between the cameras, and an activation device activates and/or inspects a coupling mode for the cameras. An independent claim is also included for a method for coupling digitally controlled or controllable cameras.

Fahrzeugaußenumgebungerkennungsvorrichtung

Es wird eine Fahrzeugaußenumgebungerkennungsvorrichtung 120 bereitgestellt. Eine Fahrzeugaußenumgebungerkennungsvorrichtung 120 weist auf ein Dreidimensionale-Position-Herleitungsmodul 162, das dreidimensionale Positionen von Subjektteilen in einem realen Raum herleitet, basierend auf einem Bild, erhalten durch Abbilden eines Detektionsbereichs, ein Objektidentifizierungsmodul 164, das die Subjektteile, deren Differenzen in den dreidimensionalen Positionen innerhalb eines vorbestimmten Bereichs sind, gruppiert, um ein Objekt zu identifizieren, ein Positionspunkt-Herleitung-Modul 166, das einen Positionspunkt herleitet, basierend auf Positionsinformation des Objektes, ein Erscheinungspunkt-Herleitung-Modul 168, das einen Erscheinungspunkt herleitet, basierend auf Erscheinungsinformation des Objektes, und ein Fußgängeridentifizierungsmodul 172, das das Objekt dahingehend identifiziert, ein Fußgänger zu sein, wenn ein Fußgängerpunkt, der erhalten wird durch zumindest Addieren des Positionspunktes ...

Methods and apparatuses relating to the handling of a plurality of content streams

A method comprises selecting at least one content stream from a plurality of content streams based on at least one detected characteristic (property, parameter) associated with the content streams or an intended viewer of the content streams, each content stream being captured by a corresponding recording (e.g. camera) device and at least one of the plural content streams not being selected, and compressing data representing the at least one selected content stream such that the content has a lower quality (e.g. reduced resolution, by low-pass filtering, downsampling, sample domain quantization, transform domain quantization) compared to the content of the at least one non-selected content stream. Characteristics may relate to the recording (capture) devices, such as relative position, direction, or spatial or temporal resolution; content stream characteristics may include amount of high frequency components, disparity, presence of regions of interest (ROI) or motion. User or viewer related ...

A method of determining the 3D positions of points on the surface of an object

Display control apparatus and method of controlling display control apparatus

Aufnahmeverfahren für zumindest zwei ToF-Kameras

The invention relates to a method for recording a scene (3) using at least two time-of-flight cameras (1, 2) each having a light source (5) and an image sensor (6), wherein image recording operations which comprise a measuring operation for determining depth information are carried out using each of the at least two time-of-flight cameras (1, 2), wherein the measuring operation comprises the emission of modulated light (11) by the light source (5), the detection of modulated light (12) after reflection at objects (4) in the scene (3) using the image sensor (6) and the calculation of depth information from the propagation time of the modulated light between emission and detection. In order to increase the image quality, a first time-of-flight camera (1) uses the measurement results of the measuring operation carried out by said camera to determine the extent to which modulated light from a second time-of-flight camera (2) was also detected in this measuring operation in addition to the light ...

APPARATUS AND CAMERA FOR FILMING THREE-DIMENSIONAL VIDEO

The present invention relates to an apparatus for filming high depth three-dimensional video, comprising: a horizontal track in which front and rear moving tracks are perpendicular to left and right moving tracks; a moving body moving in front, rear, left, and right directions along the horizontal track; a horizontal rotation bar to which one end of the moving body is connected by a rotary shaft; and a camera installation unit provided at the other end of the horizontal rotation bar, wherein a front part of the camera installation unit is always directed to a frontal filming direction even if the horizontal rotation bar is rotated. The present invention can film visible three-dimensional moving video without optical loss and the use of equipment such as three-dimensional glasses by utilizing a single camera or an image sensor. Additionally, by using the present invention problems due to flickers and afterimages in the video filmed thereby are removed and a person blind in one eye is enabled ...

Photogrammetrische Vorrichtung zur Herstellung von Karten mit photographisch aufgebrachter topographischer Information

fotokamernoe device frame photography for producing three-dimensional image with variable depth perception

Head-mounted display and its binocular 3 D video display method and apparatus

Depth image synthesis method and device

Three dimensional cine and television photographic system - for moving camera perpendicular to optical axis

ENGINE FOR VIDEO PROJECTION/DIGITISER/DIGITAL RADAR WITH [...] ELECTROMAGNETIC, REALIZING PROJECTION AND/OR IN A [...] (S)

Moteur de vidéo projection/Numériseur/Radar numérique à balayage multifaisceaux électromagnétiques, réalisant la projection et/ou capture, 2D/3D, sur une surface et/ou dans un volume quelconque(s). L'invention concerne un dispositif de vidéo projection numérique optique permettant la projection multifaisceaux sur une surface et/ou dans un volume quelconque(s) en 2D/3D, p.ex. à 180°/270°/360°. Ce dispositif peut aussi être utilisé en fonction numériseur et/ou radar pour la capture/numérisation d'informations spatiales et fréquentielles. Le traitement des faisceaux électromagnétiques, p.ex. visible, infrarouge, ultraviolet, micro-onde au niveau temporel, spatial et fréquentiel de type passif et actif, p.ex. à l'aide de fenêtres miroirs/filtres permet de réaliser une fonction de filtrage spécifique en fonction des applications visées. Le dispositif utilise, p.ex. comme source lumineuse un certain nombre de lasers de faible / moyenne / haute puissance, couplé à un certain nombre de sources ...

METHOD OF PROVIDING THREE-DIMENSIONAL GEOGRAPHIC INFORMATION SYSTEM WEB SERVICE

According to the present invention, a method of providing a three-dimensional geographic information system (GIS) web service by using a web client and a server comprises: an information processing step of processing information to be transmitted to the web client by a server side; and an information transmission step where the server transmits information, to be displayed on a screen of the web client, to the web client in accordance with a request of the web client. In the step of processing the information, the processed information includes information about a building. The information about the building sets one or more first sub-cubes and second sub-cubes. If a camera is placed in each first sub-cube, an object positioned in a corresponding second sub-cube seen by the camera is indexed to process a visibility index for each space index. COPYRIGHT KIPO 2018 (AA) Internet ...

Critical Alignment Of Parallax Images For Autostereoscopic Display

ENVIRONMENTAL VOICE SOURCE RECOGNITION SYSTEM AND ENVIRONMENTAL VOICE SOURCE RECOGNIZING METHOD THEREOF

MONITORING APPARATUS AND SYSTEM USING 3D INFORMATION OF IMAGES AND MONITORING METHOD USING THE SAME

A monitoring apparatus using three-dimensional (3D) information of images includes: an image acquisition unit to acquire a two-dimensional (2D) image from a pan/tilt/zoom (PTZ) camera; an information extraction unit to extract 2D coordinate information of an object based on a pan/tilt angle of the PTZ camera and extract distance information between the PTZ camera and the object; an operation unit to calculate at least one of variation of the 2D coordinate information and the distance information by comparing a current frame and a previous frame of the 2D image, and variation of the 2D coordinate information and height information of the object by comparing a current frame and a previous frame of a 3D image of the object; and a position tracking unit to track a position of the object by controlling the PTZ camera based on the at least one of the two variations.

HERMETICALLY SEALED ENDOSCOPE WITH OPTICAL COMPONENT ATTACHED TO INNER PROTECTIVE WINDOW

In one embodiment, an endoscopic camera for a robotic surgical system includes a stereo camera module mounted to a robotic arm of a patient side cart. The optical and electro-optic components of the camera module are hermetically sealed within a first housing. Signals from an electro-optic component travel through traces in a ceramic substrate forming one side of the hermetically sealed first housing. A second housing surrounds the first housing and optical fibers are dispersed between the housings to provide lighting in a body cavity. The camera module may be sterilized by an autoclave.

METHOD AND APPARATUS FOR TRANSMITTING AND RECEIVING EXTENDED BROADCAST SERVICE IN DIGITAL BROADCASTING

A method and apparatus for transmitting and receiving digital broadcasting. The method includes transmitting and receiving main broadcast data and supplemental broadcast data, wherein the main broadcast data is able to independently provide a basic broadcast service and the supplemental broadcast data is able to provide an extended broadcast service in combination with the main broadcast data, by using methods that are different from each other and thus the extended broadcast service may be provided.

BROADCAST RECEIVER AND 3D VIDEO DATA PROCESSING METHOD THEREOF

A broadcast receiver and a 3D video data processing method thereof are disclosed herein. a 3D video data processing method of a broadcast receiver according to an embodiment of the present invention includes receiving, by a receiving unit, a broadcast signal including 3D video data and 3D complementary video information, wherein the 3D video data include half-resolution base video data and complementary video data for configuring a full-resolution image; parsing, by 3D video information processing unit, a 3D complementary video information; decoding, by a base video decoder, the half-resolution base video data; decoding, by a complementary video decoder, the complementary video data for configuring a full-resolution image; and combining and formatting, by an output formatter, the base video data and the complementary video data using the 3D complementary video information, thereby outputting a full-resolution 3D image.

REAL-TIME STEREO MATCHING USING A HIERARCHICAL ITERATIVE REFINEMENT NETWORK

According to an aspect, a real-time active stereo system includes a capture system configured to capture stereo data, where the stereo data includes a first input image and a second input image, and a depth sensing computing system configured to predict a depth map. The depth sensing computing system includes a feature extractor configured to extract features from the first and second images at a plurality of resolutions, an initialization engine configured to generate a plurality of depth estimations, where each of the plurality of depth estimations corresponds to a different resolution, and a propagation engine configured to iteratively refine the plurality of depth estimations based on image warping and spatial propagation.

Real-time monocular visual odometry

Systems and methods are disclosed for multithreaded visual odometry by acquired with a single camera on-board a vehicle; using 2D-3D correspondences for continuous pose estimation; and combining the pose estimation with 2D-2D epipolar search to replenish 3D points.

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND PROGRAM

There is provided an information processing apparatus, an information processing method, and a program, the information processing apparatus including: a control unit that determines a display method for an object in a virtual space on a basis of a positional relationship between the object and a viewpoint. A binocular parallax regarding the object which is to be imparted to a user varies depending on the determined display method.

Spherical lighting device with backlighting coronal ring

A method for capturing three-dimensional photographic lighting of a spherical lighting device is described. Calculation of boundaries of the spherical lighting device based on lighting properties of at least one light source in a set location of the spherical lighting device is performed. A mapping of multitude points of the spherical lighting device to three-dimensional vectors of at least one camera device using a logical grid is performed. A measurement of brightness of the logical grid of the spherical lighting device is performed. The method further comprises determining brightest grid point of the logical grid of the spherical lighting device, wherein the brightest grid point of the logical grid is measured within a region brightness of the spherical lighting device. The method further comprises calculating the region of brightness of the spherical lighting device based on the determined brightest grid point of the logical grid.

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТДЕЛЕНИЯ НОМЕРА КАДРА И/ИЛИ СЧЕТЧИКА ОЧЕРЕДНОСТИ ИЗОБРАЖЕНИЯ (РОС) ДЛЯ МУЛЬТИВИДОВОГО ВИДЕОКОДИРОВАНИЯ И ВИДЕОДЕКОДИРОВАНИЯ

Изобретение относится к видеодекодированию и, в частности, к устройству для отделения номера кадра и/или счетчика очередности изображения (POC) для мультивидового видеокодирования и видеодекодирования (MVC). Техническим результатом является создание способа и устройства для отделения номера кадра и POC для MVC. Указанный технический результат достигается тем, что устройство содержит декодер для декодирования по меньшей мере одного из по меньшей мере двух видов, соответствующих мультивидовому видеоконтенту, в котором указанный декодер декодирует по меньшей мере один из по меньшей мере двух видов с использованием переопределенных переменных в процессе построения стандартного списка опорных изображений и переупорядочивания списка опорных изображений, при этом по меньшей мере одно из информации о количестве видов и информации об идентификаторе вида используют для переопределения переменных. 1 табл., 24 ил.

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТДЕЛЕНИЯ НОМЕРА КАДРА И/ИЛИ СЧЕТЧИКА ОЧЕРЕДНОСТИ ИЗОБРАЖЕНИЯ (РОС) ДЛЯ МУЛЬТИВИДОВОГО ВИДЕОКОДИРОВАНИЯ И ВИДЕОДЕКОДИРОВАНИЯ

Изобретение относится к видеокодированию и видеодекодированию и, в частности, к способу и устройству для отделения номера кадра и/или счетчика очередности изображения (РОС) для мультивидового видеокодирования и видеодекодирования (MVC). Техническим результатом является создание способа и устройства для отделения номера кадра и РОС для MVC. Предложено устройство для мультивидового видеодекодирования, содержащее: декодер для декодирования по меньшей мере одного изображения, соответствующего по меньшей мере одному из по меньшей мере двух видов мультивидового видеоконтента из битового потока, причем в битовом потоке по меньшей мере от одного вида, которому соответствует по меньшей мере одно изображение, отделяют по меньшей мере одно из информации о порядке кодирования и информации о порядке вывода для по меньшей мере одного изображения. Декодер определяет по меньшей мере одно из второй информации о порядке кодирования и второй информации о порядке вывода с использованием идентификатора вида ...

ДВИГАТЕЛЬ ДЛЯ ВИДЕОПРОЕЦИРОВАНИЯ, ЦИФРОВОГО ПРЕОБРАЗОВАТЕЛЯ ИЛИ ЦИФРОВОГО РАДАРА С МНОЖЕСТВОМ ЛУЧЕЙ ЭЛЕКТРОМАГНИТНОГО ИЗЛУЧЕНИЯ

... 1. Двумерное или трехмерное многолучевое сканирующее синхронное видеопроекционное и/или цифровое записывающее устройство, отличающееся тем, что включает: ! радиальную конструкцию головки оптической матрицы (6) и (42), состоящей из пирамидального (8, 56) или конусообразного (20) центрального перископа адресации, причем указанный перископ снабжен зеркалами и фильтрами (9), (14), (28), (29) и (31), при этом вышеуказанная конструкция оснащена лазерными источниками, разделяющимися на периферии перископа адресации, где источники могут отклоняться ! a) как модули оптических источников (35, 36), или ! b) как радиальные головки оптической матрицы (42) с пирамидой из зеркал и лазерными источниками на периферии, ! c) как крепления зеркал и фильтров (43); ! определенное число световых лучей, выходящих из головки оптической матрицы, структурированных в форме матрицы, и ориентированных на определенное число оптических вращающихся дисков с определенным числом зеркал и фильтров (10), (40), (41) и (44) ...

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТДЕЛЕНИЯ НОМЕРА КАДРА И/ИЛИ СЧЕТЧИКА ОЧЕРЕДНОСТИ ИЗОБРАЖЕНИЯ (РОС) ДЛЯ МУЛЬТИВИДОВОГО ВИДЕОКОДИРОВАНИЯ И ВИДЕОДЕКОДИРОВАНИЯ

... 1. Устройство, содержащее декодер (250) для декодирования по меньшей мере одного изображения, соответствующего по меньшей мере одному из по меньшей мере двух видов мультивидового видеоконтента из битового потока, где в битовом потоке по меньшей мере от одного вида, которому соответствует по меньшей мере одно изображение, отделяют по меньшей мере одно из информации о порядке кодирования и информации о порядке вывода для по меньшей мере одного изображения.2. Устройство по п.1, в котором декодер (200) определяет факт отделения по меньшей мере одного из информации о порядке кодирования и информации о порядке вывода по меньшей мере для одного изображения с использованием по меньшей мере одного существующего синтаксического элемента, соответствующего стандарту The International Organization for Standardization/International Electrotechnical Commission Moving Picture Experts Group-4 Part 10 Advanced Video Coding standard/International Telecommunication Union, Telecommunication Sector H.264 recommendation ...

Display control apparatus and method of controlling display control apparatus

Information is acquired relating to a focusing degree of a plurality of focal point detection areas in an image, e.g. using a ranging unit to measure a distance to each object from signals from an image pickup element detecting a phase difference. A focus guide for objects in the image (e.g. identifying a front or rear focus state or defocus amount) is superimposed on the image indicating focusing degree information obtained from calculating a defocus amount of each object in the image. A simple (i.e. reduced detail) display is generated by displaying a low focusing degree area guide to be smaller (flower pots in fig. 6A) than a high focusing degree area guide (child in fig. 6A), or by not displaying information in the low focusing degree area guide (dog in fig. 6A). A user may adjust the focus of a capturing lens using a focus ring by referring to the screen of the display unit. A less complex display simplifies operation for the user. Such generation of simplified focus guide display ...

Stereoscopic image photographing apparatuses and methods

3D Camera system

Method and device for generating, storing, transmitting, receiving and reproducing depth maps by using the color components of an image

A method of determining the 3D positions of points on the surface of an object

Methods and apparatuses relating to the handling of a plurality of content streams

RAPID GROUND-PLANE DISCRIMINATION IN STEREOSCOPIC IMAGES

A stereoscopic vision system captures stereoscopic images. The stereoscopic images are processed to rapidly discriminate between portions of the images that are on a ground-plane and those that are off the ground plane. The discrimination is based on comparing locations within the images using an expected disparity shift.

A SURGICAL CAMERA SYSTEM WITH AUTOMATIC ALTERNATION BETWEEN TWO DEPTHS OF FIELD

A surgical camera system with automatic alternation between two depths of field is provided, comprising: a tunable iris configured to automatically alternate between a first depth of field ("DOF") and a second DOF larger than the first DOF; one or more lenses configured to collect light using the iris; a body containing the iris and at least a portion of the lenses; a sensor configured to produce images from the light; a video processing unit configured to: produce an image stream from first images and second images produced by the sensor from the light, the first images acquired at the first DOF and the second images acquired at the second DOF; and adjust one or more lighting parameters of the first images and the second images prior to producing the image stream; and, a display device in communication with the video processing unit, configured to render the image stream.

LIGHT FIELD IMAGING DEVICE AND METHOD FOR DEPTH ACQUISITION AND THREE-DIMENSIONAL IMAGING

A light field imaging device and method are provided. The device can include a diffraction grating assembly receiving a wavefront from a scene and including one or more diffraction gratings, each having a grating period along a grating axis and diffracting the wavefront to generate a diffracted wavefront. The device can also include a pixel array disposed under the diffraction grating assembly and detecting the diffracted wavefront in a near-field diffraction regime to provide light field image data about the scene. The pixel array has a pixel pitch along the grating axis that is smaller than the grating period. The device can further include a color filter array disposed over the pixel array to spatio-chromatically sample the diffracted wavefront prior to detection by the pixel array. The device and method can be implemented in backside-illuminated sensor architectures. Diffraction grating assemblies for use in the device and method are also disclosed.

METHOD AND APPARATUS FOR TRIANGULATION-BASED 3D OPTICAL PROFILOMETRY

A method for determining a centerline for a triangulation-based optical profilometry system, compensating for the spatial variations of the reflectance of an object's surface. The method comprises providing a luminous line on the object, the luminous line being a triangulation line superposed with a compensation line; capturing an image of the triangulation line and of the compensation line; for each position along the imaged triangulation line, determining a transverse triangulation profile from the imaged triangulation line and a transverse compensation profile from the imaged compensation line; determining a transverse correction profile given by the reciprocal of the transverse compensation profile; multiplying the transverse triangulation profile with the transverse correction profile to obtain a corrected transverse triangulation profile; computing a center of the corrected transverse triangulation profile. The centers determined at positions along the triangulation line form the ...

ENGINE FOR VIDEO PROJECTION/DIGITISER/DIGITAL RADAR WITH MULTIPLE ELECTROMAGNETIC RADIATION BEAMS

METHOD AND APPARATUS FOR PROCESSING VIDEO SIGNAL

The present invention relates to a method and apparatus for processing a video signal, which involve acquiring the prediction value for the current texture block and performing an inter-view compensation on the prediction value for the current texture block using a first compensation coefficient and a second compensation coefficient. The first compensation coefficient is acquired using the neighboring pixel of the current texture block and the neighboring pixel of a reference block. The second compensation coefficient is acquired using the neighboring pixel of the current texture block, the neighboring pixel of the reference block, and the first compensation coefficient. The method and apparatus of the present invention compensate for inter-view differences caused by imaging conditions, such as lighting or a camera, during the capture of multi-view images so as to achieve improved accuracy in inter-view inter-prediction.

SYSTEM AND METHOD FOR TRACKING A NON-VISIBLE STRUCTURE OF A BODY

A monitoring system tracks the non-visible structure of a body in three dimensions. A tracker (508) obtains image information of the object and instruments (506) in its vicinity, all bearing 3D tracking markers (504). A controller spatially relates the image information with previously obtained scan data of the object revealing a non- visible structure (612') of the object. For the scan a fiducial reference detectable in the scan is removably attached to a location on the object. The scan data and image information is used by the controller to provide the user with real time information on the relative 3D locations and orientations of the instruments and the non-visible structure of the body. In a further embodiment the monitoring system may be used to model and track the changes in the body itself. In other embodiments, a model of the body and instruments is used to track contemplated actions and warn about possibly inappropriate instrument procedures.

Changing perspectives of a microscopic-image device based on a viewer's perspective

Structured light imaging system and method

Camera combination and corresponding panoramic picture collection system

방송 수신기 및 3Ｄ 비디오 데이터 처리 방법

... 방송 송신기 및 방송 수신기의 3D 비디오 데이터 처리 방법이 개시된다. 본 발명의 일 실시예에 따른 방송 송신기의 3D 비디오 데이터 처리 방법은, 3D 비디오 데이터 및 3D 부가 비디오 정보를 포함하는 방송 신호 수신하는 단계로서, 상기 3D 비디오 데이터는 하프 레졸루션의 베이스 비디오 데이터, 및 풀 레졸루션의 이미지를 구성하기 위한 부가 비디오 데이터를 포함하는 수신 단계; 3D 부가 비디오 정보를 파싱하는 단계; 하프 레졸루션의 베이스 비디오 데이터를 디코딩하는 단계; 풀 레졸루션의 이미지을 구성하기 위한 부가 비디오 데이터를 디코딩하는 단계; 및 상기 3D 부가 비디오 정보를 사용하여 베이스 비디오 데이터 및 부가 비디오 데이터를 결합 및 포매팅하여 풀 레졸루션의 3D 이미지를 출력하는 단계를 포함한다.

Environmental voice source recognition system and environmental voice source recognizing method thereof

An environmental voice source recognition system and an environmental voice source recognizing method thereof are disclosed. The system includes a plurality of voice sensing module, a three-dimensional scanning device, a signal recording module, and a processing module. The plurality of voice sensing module are disposed in different planes for receiving a voice emitted by a target individually, in order to obtain a plurality of sound sensing signals. The three-dimensional scanning device is used for scanning the environment to produce a three-dimensional environment image data. The signal recording module is used for recording the plurality of sound sensing signals and the three-dimensional environment image data. The processing module is used to calculate a location of the target based on a relative position of the plurality of voice sensing module and the plurality of sound sensing signals and create a three-dimensional sound field according to the three-dimensional environment image ...

Method for three-dimensional high resolution localization microscopy

A three-dimensional high-resolution localization microscopy method including illuminating a sample by excitation radiation to excite fluorescence markers in the sample to luminesce, and imaging the sample in an image frame via imaging optics along an imaging direction, wherein the image frame contains images of the luminescing fluorescence markers, and the imaging optics have a plane of focus and an optical resolution. The excitation step and imaging steps are repeated multiple times to generate a plurality of image frames, wherein the excitation steps are performed to isolate the images of the luminescing fluorescence markers in each image frame for at least some of the luminescing fluorescence markers. The location of the corresponding fluorescence marker is determined in each instance in the generated plurality of image frames from the isolated images of the luminescing fluorescence markers, and a highly resolved total image is generated from the locations determined in this way.

VEHICLE EXTERNAL ENVIRONMENT RECOGNITION DEVICE

A vehicle exterior environment recognition device includes a three-dimensional position deriving module that derives three-dimensional positions of subject parts in a real space based on an image obtained by imaging a detection area, an object identifying module that groups the subject parts of which differences in the three-dimensional positions are within a predetermined range to identify an object, a positional point deriving module that derives a positional point based on positional information of the object, an appearance point deriving module that derives an appearance point based on appearance information of the object, and a pedestrian identifying module that identifies the object to be a pedestrian when a pedestrian point that is obtained by at least adding the positional point to the appearance point equals to or greater than a predetermined threshold.

Method and system for 3D display calibration with feedback determined by a camera device

Several embodiments of 3D display system and systems and methods for their calibration are disclosed herein. In one embodiment, a method and system for calibrating a 3D display using feedback indicative of measurements of light, emitted from the 3D display (typically during display of a test pattern), by a camera device. In one embodiment, the camera device is a handheld camera device including an inexpensive, uncalibrated camera. In another class of embodiments, a system including a 3D display (to be recalibrated), a video preprocessor coupled to the display, and a feedback subsystem including a camera device operable to measure light emitted by the display are also disclosed.

Stereoscopic imaging device and shading correction method

Provided is a technique for improving the quality of an image obtained by a pupil-division-type stereoscopic imaging device. First and second images obtained by the stereoscopic imaging device according to the present invention have the shading of an object in a pupil division direction. Therefore, when the first and second images are composed, reference data in which shading is cancelled is generated. The amount of shading correction for the first and second images is determined on the basis of the reference data and shading correction is performed on the first and second images on the basis of the determined amount of shading correction.

CHANGING PERSPECTIVES OF A MICROSCOPIC-IMAGE DEVICE BASED ON A VIEWER' S PERSPECTIVE

This document describes various apparatuses and techniques for changing perspectives of a microscopic-image device based on a viewer's perspective. Various embodiments of these techniques sense a change to a viewer's perspective based on the viewer's head position and control a microscopic-image device effective to display images of an object based on the change to the viewer's perspective.

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТДЕЛЕНИЯ НОМЕРА КАДРА И/ИЛИ СЧЕТЧИКА ОЧЕРЕДНОСТИ ИЗОБРАЖЕНИЯ (РОС) ДЛЯ МУЛЬТИВИДОВОГО ВИДЕОКОДИРОВАНИЯ И ВИДЕОДЕКОДИРОВАНИЯ

... 1. Устройство, содержащее декодер (250) для декодирования по меньшей мере одного из по меньшей мере двух видов, соответствующих мультивидовому видеоконтенту, в котором указанный декодер декодирует по меньшей мере один из по меньшей мере двух видов с использованием переопределенных переменных в процессе построения стандартного списка опорных изображений и переупорядочивания списка опорных изображений согласно стандарту The International Organization for Standardization/International Electrotechnical Commission Moving Picture Experts Group-4 Part 10 Advanced Video Coding standard/International Telecommunication Union, Telecommunication Sector H.264 recommendation.2. Устройство по п.1, в котором для переопределения переменных используют по меньшей мере одно из информации о количестве видов и информации об идентификаторе вида.3. Устройство по п.1, в котором для переопределения переменных используют по меньшей мере одно из информации о длине группы изображений и информации об идентификаторе ...

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТДЕЛЕНИЯ НОМЕРА КАДРА И/ИЛИ СЧЕТЧИКА ОЧЕРЕДНОСТИ ИЗОБРАЖЕНИЯ (РОС) ДЛЯ МУЛЬТИВИДОВОГО ВИДЕОКОДИРОВАНИЯ И ВИДЕОДЕКОДИРОВАНИЯ

... 1. Устройство, содержащее декодер (250) для декодирования по меньшей мере одного изображения, соответствующего по меньшей мере одному из по меньшей мере двух видов мультивидового видеоконтента из битового потока, где в битовом потоке по меньшей мере от одного вида, которому соответствует по меньшей мере одно изображение, отделяют по меньшей мере одно из информации о порядке кодирования и информации о порядке вывода для по меньшей мере одного изображения. ! 2. Устройство по п.1, в котором декодер (200) определяет факт отделения по меньшей мере одного из информации о порядке кодирования и информации о порядке вывода по меньшей мере для одного изображения с использованием по меньшей мере одного существующего синтаксического элемента, соответствующего стандарту The International Organization for Standardization/International Electrotechnical Commission Moving Picture Experts Group-4 Part 10 Advanced Video Coding standard/International Telecommunication Union, Telecommunication Sector H.264 ...

СПОСОБ И УСТРОЙСТВО ДЛЯ ОБРАБОТКИ ВИДЕОСИГНАЛА

... 1. Способ обработки видеосигнала, содержащий этапы, на которых:получают межвидовой вектор движения;получают опорный блок, используя межвидовой вектор движения, при этом опорный блок расположен в опорном виде;получают предсказанное значение текущего блока текстуры, используя опорный блок;получают первый коэффициент компенсации;получают второй коэффициент компенсации;выполняют межвидовую компенсацию для предсказанного значения текущего блока текстуры, используя первый коэффициент компенсации и второй коэффициент компенсации; идекодируют текущий блок текстуры, используя предсказанное значение текущего блока текстуры, подвергнутого межвидовой компенсации,при этом первый коэффициент компенсации получают, используя соседний пиксель текущего блока текстуры и соседний пиксель опорного блока, ипри этом второй коэффициент компенсации получают, используя соседний пиксель текущего блока текстуры, соседний пиксель опорного блока и первый коэффициент компенсации.2. Способ по п. 1, дополнительно содержащий ...

Selbsttaetiges Kartierungssystem

A surgical camera system with automatic alternation between two depths of field

A surgical camera system with automatic alternation between two depths of field is provided, comprising: a tunable iris configured to automatically alternate between a first depth of field ("DOF") and a second DOF larger than the first DOF; one or more lenses configured to collect light using the iris; a body containing the iris and at least a portion of the lenses; a sensor configured to produce images from the light; a video processing unit configured to: produce an image stream from first images and second images produced by the sensor from the light, the first images acquired at the first DOF and the second images acquired at the second DOF; and adjust one or more lighting parameters of the first images and the second images prior to producing the image stream; and, a display device in communication with the video processing unit, configured to render the image stream.

APPARATUS FOR MONITORING FIELD OF VIEW FROM A ROAD VEHICLE

Apparatus for monitoring the field of view observed from the interior of a road vehicle comprises a base structure 1a for support by a front seat within the vehicle, a pair of video cameras (36a) 36b carried by the base structure, and a V.D.U. (not shown) for monitoring the field of view observed by the video cameras. The video cameras may be placed side by side, in a binocular-like manner or, alternatively, one above the other so as to monitor different fields of view. When placed side by side, the video cameras are movable in a substantially horizontal plane, so as to simulate eye movement of the occupant of the front seat of the vehicle, and the direction of view may be measured on a protractor 41 imaged by one or other camera via beam splitter 44. The ion displays the image from a selected camera. ...

A Camera

ENGINE FOR VIDEO PROJECTION/DIGITALISIERER WITH SEVERAL ELECTROMAGNETIC JETS

Sitzmöbel mit berührungsloser Abtastung der Fingerbewegungen des darin sitzenden Operators zur Steuerung von elektrischen und elektronischen Geräten

Vorrichtung zur berührungslosen Steuerung verschiedenartigster elektrischer und elektronischer Geräte von einem Sitzmöbel (1) aus, mit eingebauten Sensoren (101) für die berührungslose Abtastung der Fingerbewegungen des Operators zur Steuerung verschiedener elektrischer und elektronischer Geräte. Im drehbaren Teil des Sitzmöbels ist ein Sensor (102) zur Drehwinkelmessung angebracht und ein Sensor (103) zur Messung der Lageverschiebung. Die Sensordaten werden an eine zentrale Recheneinheit (106) gesendet. In der Rückenlehne des Sitzmöbels (1) ist ein Vibrationselement (104) eingebaut, durch das die zentrale Recheneinheit (106) taktile Nachrichten an den Operator schicken kann. In der zentralen Recheneinheit (106) ist auch das geometrische Modell des das Sitzmöbel (1) umgebenden Raumes und aller darin zu steuernder Objekte gespeichert, wodurch anhand der Sensordaten die absolute Zeigerichtung im geometrischen Modell errechnet wird. Mit einer weiteren Fingerbewegung wird der Steuerbefehl für ...

Method and apparatus for decoupling frame number and/or picture order count (POC) for multi-view video encoding and decoding

There is disclosed and described a decoder (250) and decoding method (410) for decoding at least one picture corresponding to at least one of at least two views of multi-view video content from a bitstream, wherein in the bitstream at least one of coding order information and output order information for the at least one picture is decoupled from the at least one view to which the at least one picture corresponds. Furthermore, there is disclosed and described an encoder (200) and encoding method (360) for encoding at least one picture corresponding to at least one of at least two views of multi-view video content to form a resultant bitstream, wherein in the resultant bitstream at least one of coding order information and output order information for the at least one picture is decoupled from the at least one view to which the at least one picture corresponds.

Multiple-angle imagery of physical objects

Methods and systems for capturing and displaying multiple-angle imagery of physical objects are presented. For capturing, multiple images of an object are captured from varying angles in response to user input. The images are analyzed to determine whether at least one additional image is desirable to allow generation of a visual presentation of the object. The user is informed to initiate capturing of the at least one more image based on the analysis. The additional image is captured in response to second user input. The presentation is generated based on the multiple images and the additional image. For displaying, a visual presentation of an object is accessed, the presentation having multiple images of the object from varying angles. The presentation is presented to the user of a mobile device according to user movement of the device. The user input determines a presentation speed and order of the images.

METHOD AND APPARATUS FOR PROCESSING VIDEO SIGNAL

The present invention relates to a method and apparatus for processing a video signal, which involve acquiring the prediction value for the current texture block and performing an inter-view compensation on the prediction value for the current texture block using a first compensation coefficient and a second compensation coefficient. The first compensation coefficient is acquired using the neighboring pixel of the current texture block, the neighboring pixel of the reference block, and the first compensation coefficient. The method and apparatus for the present invention compensate for inter-view differences caused by imaging conditions, such as lighting or a camera, during the capture of multiview images so as to achieve improved accuracy in inter-view inter prediction.

APPARATUS AND METHOD FOR MEASURING GOLF CLUB SHAFT FLEX AND GOLF SIMULATION SYSTEM INCORPORATING THE SAME

A method for measuring shaft flex comprises capturing at least one image of a shaft during movement of the shaft through a swing plane and examining the at least one image to determine the flex of the shaft.

CALIBRATION AND TRANSFORMATION OF A CAMERA SYSTEM'S COORDINATE SYSTEM

RENDERING AN OUTPUT IMAGE

Light Field Imaging Device and Method for Depth Acquisition and Three-Dimensional Imaging

A light field imaging device and method are provided. The device can include a diffraction grating assembly receiving a wavefront from a scene and including one or more diffraction gratings, each having a grating period along a grating axis and diffracting the wavefront to generate a diffracted wavefront. The device can also include a pixel array disposed under the diffraction grating assembly and detecting the diffracted wavefront in a near-field diffraction regime to provide light field image data about the scene. The pixel array has a pixel pitch along the grating axis that is smaller than the grating period. The device can further include a color filter array disposed over the pixel array to spatio-chromatically sample the diffracted wavefront prior to detection by the pixel array. The device and method can be implemented in backside-illuminated sensor architectures. Diffraction grating assemblies for use in the device and method are also disclosed.

IMAGE PROCESSING APPARATUS FOR A VEHICLE

An image processing apparatus for a vehicle characterized in that the apparatus includes a first imaging section, a second imaging section, a switching section which switches exposure controls of the first imaging section and the second imaging section to an exposure control for recognizing an object placed on a road and a lamp or to an exposure control for recognizing a three-dimensional object, and a detection section which detects the object placed on a road and the lamp or the three-dimensional object from images captured by the first imaging section and the second imaging section, wherein under the exposure control for recognizing an object placed on a road and a lamp, exposure of the first imaging section and exposure of the second imaging section are different from each other.

Method and system for object reconstruction

A system for object reconstruction includes an illuminating unit, comprising a light source and a generator of a non-periodic pattern. A diffractive optical element (DOE) is disposed in an optical path of illuminating light propagating from the illuminating unit toward an object, thereby projecting the non-periodic pattern onto an object. An imaging unit detects a light response of an illuminated region and generating image data indicative of the object within the projected pattern. A processor reconstructs a three-dimensional (3D) map of the object responsively to a shift of the pattern in the image data relative to a reference image of the pattern.

Method and apparatus for determining a road condition

A method and an apparatus determine a road condition using a vehicle camera. At least one image is acquired using the camera. A first image area that includes an image of the road surface is determined in the at least one image. A classifier assigns the first image area to at least one class (among pre-established classes) that represents a specific road condition of the road surface. Information regarding this specific road condition is output.

Stereo camera and method of controlling stereo camera

A first wide angle image, a second wide angle image, a first telephoto image, and a second telephoto image are acquired from a first imaging unit 11L and a second imaging unit 11R at the same time, and particularly, optical axes of the wide angle optical system and the telephoto optical system constituting the first imaging optical system 12L match each other, and the second imaging optical system is similarly configured, and therefore, it is possible to position the main subject at a center position of the first telephoto image and the second telephoto image by independently performing pan and tilt control on the first and the second imaging unit so that the main subject is captured on the respective optical axes of the first imaging optical system and the second imaging optical system on the basis of the first wide angle image and the second wide angle image.

Stereo camera apparatus, vehicle provided with stereo camera apparatus, and non-transitory recording medium

A stereo camera apparatus, and a vehicle provided with a stereo camera apparatus, can detect an object targeted for detection in a wider spatial range, calculate the distance to a subject with high accuracy, and perform object detection with high accuracy. The stereo camera apparatus includes a first imaging unit configured to image a first area as a first image, a second imaging unit that images a second area as a second image, the second area being partially shifted from the first area in a direction differing from a direction along the baseline length, and a controller that calculates the distance to a subject using an overlapping region between the first image and the second image.

Method and electronic device for displaying a 3D image using 2D image

A method and apparatus are provided for displaying a 3D image using a 2D image in an electronic device. Information related to an inclination of the electronic device is detected from a motion of the electronic device. The 3D image is generated by moving each of a plurality of image layers, which are derived from the 2D image, based on the detected information and motion parallax corresponding to the detected information. The 3D image is displayed.

Information processing apparatus, information processing method, and program

There is provided an information processing apparatus, an information processing method, and a program, the information processing apparatus including: a control unit that determines a display method for an object in a virtual space on a basis of a positional relationship between the object and a viewpoint. A binocular parallax regarding the object which is to be imparted to a user varies depending on the determined display method.

Adjustable parallax distance, wide field of view, stereoscopic imaging system

An imaging system and methods for using an imaging system where the operator is able to variably adjust the parallax distance for enhanced stereo performance are disclosed. In addition, by coordinating the parallax distance with the optical settings of the camera, artificial 3D experiences can be created that give a user the perception of observing a scene from a distance different than that actually employed. The imaging system may also include a plurality of stereo camera supersets, wherein a first one or more stereo camera supersets are positioned at a different height relative to a first stereo camera superset. Novel specific uses of the camera system, such as in capturing events of interest are described. Useful techniques for extracting or encoding wide field of view images from memory are also disclosed.

METHOD TO DETERMINE IMPAIRED ABILITY TO OPERATE A MOTOR VEHICLE

A method and system for determining if an individual is impaired. In one embodiment, physical and cognitive testing of the individual are conducted in the field or at the scene of an event. The test results are compared to previously stored baseline test results taken for the specific individual while the individual is known to be in an unimpaired state or condition. The current test results are electronically compared to the baseline test results and if the results differ or deviate beyond a predetermined level or amount the individual is considered to be impaired. If no baseline test results exist for the specific individual, the current test results can alternatively be compared to previously determined or known scientifically accepted or minimums for the specific tests given to the individual.

APPARATUS AND METHOD FOR SPATIALLY REFERENCING IMAGES

Provided is a method of spatially referencing a plurality of images captured from a plurality of different locations within an indoor space by determining the location from which the plurality of images was captured. The method may include obtaining a plurality of distance-referenced panoramas of an indoor space. The distance-referenced panoramas may each include a plurality of distance-referenced images each captured from one position in the indoor space and at a different azimuth from the other distance-referenced images, a plurality of distance measurements, and orientation indicators each indicative of the azimuth of the corresponding one of the distance-referenced images. The method may further include determining the location of each of the distance-referenced panoramas based on the plurality of distance measurements and the orientation indicators and associating in memory the determined locations with the plurality of distance-referenced images captured from the determined location ...

System for space-based imaging in three dimensions

A system for space-based imaging in three dimensions includes at least two satellites in a geocentric orbit in a same orbital plane, a satellite being equipped with equipment for optical imaging in two dimensions and a system for transmitting to the ground images in two dimensions; at least one data receiving station on the ground, connected to a communications network; at least one center for processing the images received in two dimensions from the satellites in order to create resulting images in three dimensions and to broadcast the resulting images in three dimensions, the processing center being connected to the communications network; and, a system for controlling the satellites such that a geographical area of the Earth of which images are to be taken is seen under an angle of incidence with respect to a nadir greater than a minimum threshold and/or less than a maximum threshold.

Multi-view image processing apparatus, method and computer-readable medium

Provided is an image processing apparatus, method and computer-readable medium. When encoding a multi-view color and depth video, a motion vector calculator of the image processing apparatus may calculate a block motion vector with respect to a first viewpoint color image. A motion vector borrowing unit may borrow, as a block motion vector with respect to a second viewpoint color image, a block motion vector with respect to the first viewpoint color image based on a disparity calculated from a depth video.

СПОСОБ И УСТРОЙСТВО ДЛЯ ОТДЕЛЕНИЯ НОМЕРА КАДРА И/ИЛИ СЧЕТЧИКА ОЧЕРЕДНОСТИ ИЗОБРАЖЕНИЯ (РОС) ДЛЯ МУЛЬТИВИДОВОГО ВИДЕОКОДИРОВАНИЯ И ВИДЕОДЕКОДИРОВАНИЯ

Изобретение относится к области видеокодирования и видеодекодирования. Технический результат заключается в повышении надежности для мультивидового видеодекодирования. Способ декодирования, в котором декодируют по меньшей мере один из по меньшей мере двух видов, соответствующих мультивидовому видеоконтенту, при этом на этапе декодирования декодируют по меньшей мере один из по меньшей мере двух видов с использованием переопределенных переменных стандарта MPEG-4 AVC в процессе построения стандартного списка опорных изображений и переупорядочивания списка опорных изображений таким образом, что команды переупорядочивания списка опорных изображений, заданные в стандарте MPEG-4 AVC, остаются без изменений, при этом для переопределения переменных используют по меньшей мере один из по меньшей мере двух видов, соответствующих мультивидовому видеоконтенту, и информацию об идентификаторе вида. 1 табл., 24 ил.

СТРОБИРУЕМАЯ ТРЕХМЕРНАЯ КАМЕРА

Изобретение относится к аппаратуре видеокамер. Технический результат заключается в повышении пространственной точности местоположения деталей изображения. Камера для определения расстояний до сцены содержит источник света, содержащий VCSEL, управляемый для освещения сцены последовательностью импульсов света, имеющей характеристический спектр, фотоповерхность, оптику для отображения на фотоповерхности отраженного сценой света световых импульсов и затвор, выполненный с возможностью выборочного открывания и закрывания фотоповерхности для света в спектре с учетом ошибки смещения, обусловленной разностью температур в аппаратуре. 3 н. и 13 з.п. ф-лы, 8 ил.

СПОСОБ ПОВЫШЕНИЯ РАЗРЕШЕНИЯ В ОПТИЧЕСКОМ ИЗОБРАЖЕНИИ И СИСТЕМА ДЛЯ ЕГО ОСУЩЕСТВЛЕНИЯ

... 1. Способ формирования изображения объекта с разрешением, которое, по меньшей мере, для части изображения объекта превышает на заданный коэффициент геометрическое разрешение, определяемое пиксельным массивом приемника, включающий оптическую обработку волнового фронта светового сигнала, представляющего, по меньшей мере, часть объекта, изображение которой требуется получить с повышенным разрешением, при распространении указанного волнового фронта в направлении пиксельного массива приемника, при этом параметры оптической обработки предварительно задают с учетом указанного заданного коэффициента повышения разрешения и эффекта алайсинга, имеющего место в плоскости приемника, и таким образом, чтобы обеспечить ортогональность спектральных данных, представляющих семплированный выходной сигнал приемника, и тем самым создать возможность цифровой обработки семплированного выходного сигнала, соответствующего единственному принятому изображению, с реконструированием изображения, по меньшей мере, указанной ...

Multiple view colour reconstruction

This method comprises, for each of plural constituent portions of input image data 311, captured by at least one image sensor 100 overlaid with a colour filter array 315, determining a depth value 310 for each input image pixel in the constituent portion, wherein each constituent portion of the input picture data has a different associated direction of capture and/or a different associated camera location 313 and represents a different view of a scene, and wherein each pixel of input image data is associated with a respective one of the colours of the colour filter array. The method further comprises projecting pixels of the input image data into a combined image based on the determined depth values, the associated directions of capture and/or the camera locations of capture, and information describing the output image perspective. The method further comprises performing colour reconstruction 330 based on the pixels of the input image data projected into the merged image panorama 340. The ...

Three-dimensional imaging system

Camera with reflector for forming images on different sensor portions

A camera (11) comprises an image capture layer (7), image forming means (8) for forming a first image of an object on a first portion (13) of the image capture layer, and an optical arrangement for forming, in combination with the image forming means (lens, 8), a second image of the object on a second different portion (14) of the image capture layer. The optical arrangement comprises a single reflector (10), being arrangeable in at least a first configuration in which it is laterally spaced from and inclined with respect to a principal axis (12) of the camera (11). The first and second images obtained by the camera may form a stereoscopic image pair of the object. Planar reflector 10 may be detachable from camera 11. Inclining the reflector (10) towards the principal axis (12) of the camera (11) increases the field of view of the second image or, alternatively, allows a given field of view for the second image to obtained using a shorter reflector. The camera may be on a mobile phone, ...

Three dimensional imaging by multiple image capture under different illumination conditions

A system for determining a three dimensional (3D) representation of an object or scene comprises one or more light sources and one or more two-dimensional (2D) image capture devices arranged such that multiple images are captured, each of which shows the scene illuminated differently. Various means are described for coupling the illumination and image capture to associate images with the particular light source and/or location from which the image was taken, for analysis to determine an approximate three dimensional surface of the scene, as in photometric stereo systems. The light sources may be polarized, and illumination light intensity may vary gradually with time. One of the illumination sources can be natural light. Location sensors may determine the positions of the light sources and/or image capture cameras. Some light sources may be outside the visible spectrum e.g. infrared, and the image capturing and 3D processing means may be combined in a common, integral device. Illumination ...

Stereoscopic image photographing apparatuses and methods

Aufnahmeverfahren für zumindest zwei ToF-Kameras

The invention relates to a method for recording a scene (3) using at least two time-of-flight cameras (1, 2), which respectively comprise a light source (5) and an image sensor (6), wherein image recording operations which comprise a measuring operation for determining depth information are carried out using each of the at least two time-of-flight cameras (1, 2), wherein the measuring operation comprises the emission of modulated light (11) by the light source (5), the detection of modulated light (12) after the reflection on objects (4) of the scene (3) using the image sensor (6), and the calculation of depth information from the propagation time of the modulated light between the emission and the detection. In order to increase the image quality, a first time-of-flight camera (1) uses the measurement results of the measuring operation carried out by said camera to determine the extent to which modulated light from a second time-of-flight camera (2) was also detected in this measuring ...

Sitzmöbel mit berührungsloser Abtastung der Fingerbewegungen des darin sitzenden Operators zur Steuerung von elektrischen und elektronischen Geräten

Vorrichtung zur berührungslosen Steuerung verschiedenartigster elektrischer und elektronischer Geräte von einem Sitzmöbel (1) aus, mit eingebauten Sensoren (101) für die berührungslose Abtastung der Fingerbewegungen des Operators zur Steuerung verschiedener elektrischer und elektronischer Geräte. Im drehbaren Teil des Sitzmöbels ist ein Sensor (102) zur Drehwinkelmessung angebracht und ein Sensor (103) zur Messung der Lageverschiebung. Die Sensordaten werden an eine zentrale Recheneinheit (106) gesendet. In der Rückenlehne des Sitzmöbels (1) ist ein Vibrationselement (104) eingebaut, durch das die zentrale Recheneinheit (106) taktile Nachrichten an den Operator schicken kann. In der zentralen Recheneinheit (106) ist auch das geometrische Modell des das Sitzmöbel (1) umgebenden Raumes und aller darin zu steuernder Objekte gespeichert, wodurch anhand der Sensordaten die absolute Zeigerichtung im geometrischen Modell errechnet wird. Mit einer weiteren Fingerbewegung wird der Steuerbefehl für ...

DIGITAL PICTURE GIVING PROCEDURE FOR SYNTHESIZING A PICTURE USING WITH OF AN POLARIZE-OPTICAL CAMERA NOTED DATA

Critical alignment of parallax images for autostereoscopic display

Abstract A method and system are provided for generating an autostereoscopic 5 display. The method includes acquiring a first parallax image and at least one other parallax image. At least a portion of the first parallax image may be aligned with a corresponding portion of the at least one other parallax image. Alternating views of the first parallax image and the at least one other parallax image may be displayed. 2160240_1 (GHMatters) ce e CY) bL CV)oV ...

Imaging device and method of three-dimensional image

Recording device and recording method, image processing device and image processing method, and program

The invention discloses a recording device and a recording method, an image processing device and an image processing method and a program. The recording device includes an image acquiring section which acquires 3D image data, a filming condition acquiring section which acquires filming condition information indicating filming conditions during filming of the 3D image data, and a recording controlling section which causes a recording medium to record the 3D image data and the filming condition information by making the data and the information correspond to each other.

SUBJECT SPATIAL MOVEMENT TRACKING SYSTEM USING MULTIPLE STEREO CAMERAS

Parallel online-offline reconstruction for three-dimensional space measurement

Two-dimensional or three-dimensional digital image creating device for use during shooting, has RAM storing scan lines that are sent by thyristor towards sequencer replacing lines for restoring digital image by converter into analog

Dispositif pour créer une image numérique 2D ou 3D et fait référence au brevet Au numéro de publication 2867645. L'invention concerne un dispositif constitué d'un (ou 3) optique électronique à balayage verticale (1), d'un (ou 3) convertisseur analogique numérique (2), d'une (ou 3) RAM (3) contenant successivement chaque ligne de balayage verticale de l'optique électronique,d'un (ou 3) thyristor (4) qui laisse passer chaque ligne de balayage à la suite l'une de l'autre, d'un séquenceur d'ordre (5) qui envoie successivement les lignes de balayage, d'un convertisseur numérique analogique (6) qui restitue l'image en analogique. Le dispositif selon l'invention est particulièrement destiné à créer une image Numérique 2D ou 3D.

IMAGE PROCESSING APPARATUS AND METHOD

... 영상 처리 장치가 제공된다. 다시점 칼라 및 깊이 비디오를 부호화 하는 경우, 상기 영상 처리 장치의 모션 벡터 계산부는 제1 시점 칼라 영상에 대한 블록 모션 벡터들을 계산한다. 그러면 모션 벡터 차용부는 깊이 비디오를 통해 계산되는 디스페러티를 고려하여 상기 계산된 제1 시점 칼라 영상에 대한 블록 모션 벡터을 제2 시점 칼라 영상에 대한 블록 모션 벡터로 차용한다.

Метамерический датчик трехмерной навигации

Полезная модель относится к области получения цифровых изображений и касается метамерического датчика трехмерной навигации. Датчик включает в себя источник света и размещенные в корпусе: блок управления, соединенный с источником света, объектив, блок памяти, а также последовательно соединенные датчик изображения, блок обработки сигнала и дисплей. Кроме того, датчик содержит блок фотоэлементов, который через блок обработки сигнала соединен с блоком управления источником света. Блок обработки сигнала соединен с блоком памяти, который имеет обратную связь с блоком обработки сигнала. Объектив соединен с датчиком изображения. Техническим результатом является в упрощение конструкции устройства. 1 з.п. ф-лы,1 ил. РОССИЙСКАЯ ФЕДЕРАЦИЯ (19) RU (11) (13) 166 757 U1 (51) МПК G01C 3/08 (2006.01) H04N 13/02 (2006.01) ФЕДЕРАЛЬНАЯ СЛУЖБА ПО ИНТЕЛЛЕКТУАЛЬНОЙ СОБСТВЕННОСТИ (12) ТИТУЛЬНЫЙ (21)(22) Заявка: ЛИСТ ОПИСАНИЯ ПОЛЕЗНОЙ МОДЕЛИ К ПАТЕНТУ 2016127997/28, 11.07.2016 (24) Дата начала отсчета срока действия патента: 11.07.2016 (72) Автор(ы): Копылов Андрей Михайлович (RU) Приоритет(ы): (22) Дата подачи заявки: 11.07.2016 (45) Опубликовано: 10.12.2016 Бюл. № 34 1 6 6 7 5 7 R U (57) Формула полезной модели 1. Метамерический датчик трехмерной навигации, содержащий источник света и размещенные в корпусе: блок управления, соединенный с источником света, объектив, блок памяти, а также последовательно соединенные датчик изображения, блок обработки сигнала и дисплей, причем блок обработки сигнала соединен с блоком памяти, отличающийся тем, что он дополнительно содержит блок фотоэлементов, при этом блок фотоэлементов через блок обработки сигнала соединен с блоком управления источником света, блок памяти имеет обратную связь с блоком обработки сигнала, а объектив соединен с датчиком изображения. 2. Метамерический датчик трехмерной навигации по п. 1, отличающийся тем, что источник света выполнен в виде светодиодного RGB прожектора с видимым спектром излучения. Стр.: 1 U 1 U 1 (54) ...

Apparatus and method for producing images for stereoscopic viewing

Disclosed are methods and apparatus for producing images for stereoscopic, three-dimensional viewing generated with existing mobile graphical devices, such as cameras, video recorders, PDAs, telephones, and other devices, such as the iPhone™. Two reflectors, which may be mirrors or prisms, are positioned to separate the field of view of a camera lens on the mobile graphical device into a direct field of view and an offset field of view and to record and display the separated fields in a two-paned format on the mobile graphical device. Eye lenses are used to separately view the split images. An integrated housing and cradle receive the mobile graphical device and are coupled to the reflectors and the eye lenses. An area of each pane may be provided to display control icons for three-dimensional viewing, and a control area may be provided out of view on a touch screen for user control.

Multi-Path Compensation Using Multiple Modulation Frequencies in Time of Flight Sensor

A method to compensate for multi-path in time-of-flight (TOF) three dimensional (3D) cameras applies different modulation frequencies in order to calculate/estimate the error vector. Multi-path in 3D TOF cameras might be caused by one of the two following sources: stray light artifacts in the TOF camera systems and multiple reflections in the scene. The proposed method compensates for the errors caused by both sources by implementing multiple modulation frequencies.

Light quantity adjustment apparatus and photographing apparatus including the same

A light quantity adjustment apparatus includes a support plate with a first through hole, a rotation plate with a second through hole corresponding to the first through hole and rotatable with respect to the support plate, 2D iris plates rotatably connected to the support plate so as to move between a location in which the first through hole is completely opened and another location in which the first through hole is completely closed, two 3D iris plates each having one end rotatably connected to the support plate and another end engaged with the rotation plate, a shading plate, and a shading plate driving unit. The 2D iris plates adjust an open area of the first through hole. The two 3D iris plates move between a retreat location away from the first through hole and a photographing location where a first photographing hole and a second photographing hole are formed.

Method of data acquisition for three-dimensional imaging

Described are embodiments of methods of obtaining three-dimensional (3D) surface data of an object scene such as an intra-oral cavity. For example, measured surfaces may include the enamel surface of teeth, the dentin substructure of teeth, gum tissue and various dental structures. The methods can also be applied in medical applications and other applications in which 3D measurement data are acquired with maneuverable 3D measurement devices. In certain embodiments, the measurement device is positioned and translated to enable 3D data to be acquired for a backbone 3D data set. Subsequent controlled motion of the measurement device enables additional 3D data to be acquired and accurately joined to the backbone 3D data set.

Stereo video for gaming

A real-time stereo video signal of a captured scene with a physical foreground object and a physical background is received. In real-time, a foreground/background separation algorithm is used on the real-time stereo video signal to identify pixels from the stereo video signal that represent the physical foreground object. A video sequence may be produced by rendering a 3D virtual reality based on the identified pixels of the physical foreground object.

Automatically tracking user movement in a video chat application

A system for automatically tracking movement of a user participating in a video chat application executing in a computing device is disclosed. A capture device connected to the computing device captures a user in a field of view of the capture device and identifies a sub-frame of pixels identifying a position of the head, neck and shoulders of the user in a capture frame of a capture area. The sub-frame of pixels is displayed to a remote user at a remote computing system who is participating in the video chat application with the user. The capture device automatically tracks the position of the head, neck and shoulders of the user as the user moves to a next location within the capture area. A next sub-frame of pixels identifying a position of the head, neck and shoulders of the user in the next location is identified and displayed to the remote user at the remote computing device.

Apparatus and method for creating three-dimensional panoramic image by using single camera

An apparatus and method for creating a three-dimensional (3D) panoramic image using a single camera are provided. The method includes capturing an object from a plurality of viewpoints, determining at least one capture viewpoint from which an image is obtained by capturing the object, among the plurality of viewpoints, collecting at least one image of the captured object from the at least one capture viewpoint, and creating a 3D image from the collected at least one image.

Three-dimensional image pickup device

The 3D image capture device of this invention includes: a light-transmitting section 2 with light-transmitting areas C 1 , C 2 and C 3 that have mutually different transmission wavelength ranges; a solid-state image sensor 1 arranged to receive the light that has been transmitted through the light-transmitting section 2 ; and an optical system 3 configured to produce an image on an imaging area of the solid-state image sensor 1 , which includes a photosensitive cell array and a color filter array on the imaging area. The transmission wavelength ranges of the light-transmitting areas and the color filters are defined such that the light that has been transmitted through at least one of the light-transmitting areas C 1 , C 2 and C 3 is transmissible through at least two of the color filters. A signal processing section generates data of at least two images with parallax by generating signals representing at least two of the respective intensities of light rays that are incident on the light-transmitting areas based on the output signals of the photosensitive cells.

Apparatus for obtaining 3-dimensional content

An apparatus for obtaining 3D content is provided. The apparatus comprises: a lighting unit for outputting a lighting pattern having coordinate information; a depth sensor for receiving a returning beam output from the lighting unit and reflected from an object; a 2D image capturing unit for obtaining a second-dimensional image; a data processor for calculating the depth of each region using the distribution of characteristics represented on an image obtained by the depth sensor, and processing the 2D image data obtained by the 2D image capturing unit and the calculated depth data and encoding the same according to a predetermined format; and a controller for controlling the lighting unit, the 2D image capturing unit, and the data processor. The lighting unit comprises a light source and an optical element comprising a plurality of sub-grid regions for modulating beams coming from the light source.

Imaging apparatus and electronic apparatus

An imaging apparatus includes: a first lens group disposed on a subject side of a diaphragm in the vicinity of which two polarizers that polarize light from a subject are disposed, the polarizers being first and second polarizers whose polarization directions are perpendicular to each other; a second lens group disposed on the side of the diaphragm where an imaging device is present, over a photodetection surface of which third and fourth polarizers are disposed, the third and fourth polarizers having polarization directions parallel to the polarization direction of the first and second polarizers, respectively; and an image processor that produces stereoscopic images based on image data produced by converting light incident on the imaging device through the first lens group and the second lens group. The second lens group has positive refracting power, and characteristics of the first lens group and the second lens group satisfy certain conditions.

Milking Box With Robotic Attacher

In certain embodiments, a system includes a front wall, a rear wall positioned substantially parallel to the front wall, and first and second side walls each extending between the front wall and the rear wall. The first side wall includes a gate, and the second side wall is spaced apart from the first side wall such that the front wall, the rear wall, the first side wall, and the second side wall define a milking box stall of a size sufficient to accommodate a dairy livestock. The system includes an equipment portion located adjacent to the rear wall. The equipment portion houses a robotic attacher configured to extend between the rear legs of a dairy livestock located within the milking box stall in order to attach milking equipment to the dairy livestock.

System and Method for Analyzing Data Captured by a Three-Dimensional Camera

In an exemplary embodiment, a system includes a three-dimensional camera and a processor communicatively coupled to the three-dimensional camera. The processor is operable to determine a first edge of a dairy livestock, determine a second edge of the dairy livestock, determine a third edge of the dairy livestock, and determine a fourth edge of the dairy livestock.

Acquiring, Editing, Generating and Outputting Video Data

Systems and methods are directed to acquiring, generating, manipulating and/or editing refocusable video data/frames. The refocusable video frames may be light field video frames that may be focused and/or refocused after acquisition or recording of such video frames. In one aspect, a method comprises: selecting a first key frame, wherein the first key frame corresponds to one of a plurality of refocusable light field video frames; selecting a second key frame, wherein the second key frame corresponds to one of the plurality of refocusable light field video frames which is temporally spaced apart from the first key frame such that a plurality of refocusable light field video frames are temporally disposed between the first and the second key frames; determining virtual focus parameters for the first key frame and the second key frame; and generating video data.

Three-dimensional imaging device and method, as well as program

Two or more images having a parallax therebetween are obtained by imaging a subject from different positions using imaging units. Three-dimensional processing for three-dimensional display is applied to the two or more images, and the two or more images are displayed on a display unit. While the imaging units carry out a zoom operation, three-dimensional display with a reduced parallax between the two or more images or two-dimensional display is performed.

Image processing system, image processing device, image processing method, and medical image diagnostic device

An image processing system according to an embodiment includes a stereoscopic display device, a determining unit, and a rendering processor. The stereoscopic display device displays a stereoscopic image that is capable of being viewed stereoscopically using a parallax image group generated from volume data as three-dimensional medical image data. The determining unit identifies positional variation of a predetermined moving substance in a stereoscopic image space as a space in which the stereoscopic image is displayed by the stereoscopic display device from positional variation of the moving substance in a real space in which a coordinate system of the stereoscopic image space is present and determines an operation content on the stereoscopic image based on the identified positional variation. The rendering processor performs rendering processing on the volume data in accordance with the operation content determined by the determining unit to generate a parallax image group newly.

Plane-based Self-Calibration for Structure from Motion

Robust techniques for self-calibration of a moving camera observing a planar scene. Plane-based self-calibration techniques may take as input the homographies between images estimated from point correspondences and provide an estimate of the focal lengths of all the cameras. A plane-based self-calibration technique may be based on the enumeration of the inherently bounded space of the focal lengths. Each sample of the search space defines a plane in the 3D space and in turn produces a tentative Euclidean reconstruction of all the cameras that is then scored. The sample with the best score is chosen and the final focal lengths and camera motions are computed. Variations on this technique handle both constant focal length cases and varying focal length cases.

Stereoscopic imaging apparatus, face detection apparatus and methods of controlling operation of same

A face image is specified and face image detection is performed in a left-eye image and in a right-eye image. If a face image is detected in only one of these images, then object image detection is performed in the left-eye image and in the right-eye image. The distance to an object represented by an object image contained in one image and the distance to an object represented by an object image contained in the other image are calculated. From among objects represented by object images contained in the other image, the image of an object having a distance equal to the distance to the face represented by the face image detected in the one image is specified as a face image.

Stereoscopic image capture device and control method of the same

An image for a left eye and an image for a right eye are respectively captured. A corresponding point corresponding to each of a plurality of feature points detected from the image for a left eye is searched for using the image for a right eye. The number of corresponding points found by the search is counted, and it is determined whether to be equal to or more than a predetermined ratio with respect to the number of pixels of the image for a right eye. When the number of corresponding points is determined to be less than the predetermined ratio, the image for a right eye is recaptured, and the corresponding point search process and the determination of whether the number of corresponding points is equal to or more than the predetermined ratio are re-executed using an image new for a right eye obtained by recapture.

Stereo camera device

Degradation of a three-dimensional measurement accuracy of a stereo camera device that takes an image of an object in a wide wavelength band is suppressed. In order to achieve the above object, a stereo camera device includes: a stereo image acquiring part for taking an image of light from the object to acquire a stereo image; a corresponding point searching part for performing a corresponding point search between images constituting the stereo image; a wavelength acquiring part for acquiring a representative wavelength of a wavelength component of the light; a parameter acquiring part for acquiring each parameter value corresponding to the representative wavelength with respect to at least one of camera parameters of the stereo image acquiring part in which the parameter value fluctuates according to the wavelength component of the light; and a three-dimensional information acquiring part for acquiring three-dimensional information on the object from a result of the corresponding point search using the each parameter value.

Methods for Interfacing With an Interactive Application Using a Controller With an Integrated Camera

A method for determining a position of a controller in a three-dimensional space is disclosed. One method includes an operation to calibrate a computer program to identify a group of recognized fixed points from a plurality of fixed points within the three-dimensional space using a depth camera integrated with the controller. Another operation activates use of the controller and depth camera during interface with the application. During use of the controller, image and depth data within the three-dimensional space is captured with the depth camera of the controller. The captured data can then be used to enable input to a computer system.

Device, method and program for determining obstacle within imaging range during imaging for stereoscopic display

An obstacle determining unit obtains predetermined index values for each of subranges of each imaging range of each imaging unit, compares the index values of the subranges at mutually corresponding positions in the imaging ranges of the different imaging units, and if a difference between the index values in the imaging ranges of the different imaging units is large enough to satisfy a predetermined criterion, determines that the imaging range of at least one of the imaging units contains an obstacle that is close to the imaging optical system of the at least one of the imaging units.

Single-lens 2d/3d digital camera

A single-lens 2D/3D camera has a light valve placed in relationship to a lens module to control the light beam received by the lens module for forming an image on an image sensor. The light valve has a light valve area positioned in a path of the light beam. The light valve has two or more clearable sections such that only one section is made clear to allow part of the light beam to pass through. By separately making clear different sections on the light valve, a number of images as viewed through slightly different angles can be captured. The clearable sections include a right section and a left section so that the captured images can be used to produce 3D pictures or displays. The clearable sections also include a middle section so that the camera can be used as a 2D camera.

Smart pseudoscopic-to-orthoscopic conversion (spoc) protocol for three-dimensional (3d) display

A smart pseudoscopic to orthoscopic conversion (SPOC) protocol, and method for using the SPOC protocol for three-dimensional imaging, are disclosed. The method allows full control over the optical display parameters in Integral Imaging (InI) monitors. From a given collection of elemental images, a new set of synthetic elemental images (SEIs) ready to be displayed in an InI monitor can be calculated, in which the pitch, microlenses focal length, number of pixels per elemental cell, depth position of the reference plane, and grid geometry of the microlens array (MLA) can be selected to fit the conditions of the display architecture.

System for Space-based Imaging in Three Dimensions

A system for space-based imaging in three dimensions comprises: at least two satellites in a geocentric orbit in the same orbital plane, a satellite being equipped with equipment for optical imaging in two dimensions and means for transmitting to the ground the images in two dimensions; at least one data receiving station on the ground, connected to a communications network; at least one centre for processing the images received in two dimensions from the said satellites in order to create resulting images in three dimensions and to broadcast the said resulting images in three dimensions, said processing centre being connected to the said communications network; and, means for controlling said satellites such that a geographical area of the Earth of which images are to be taken is seen under an angle of incidence with respect to the nadir greater than a minimum threshold and/or less than a maximum threshold.

Imaging device, image display method, and storage medium for displaying reconstruction image

A sub-image extractor extracts a target sub-image from a light field image. A partial area definer defines a predetermined area in the target sub-image as a partial area. A pixel extractor extracts pixels from the partial area, the number of pixels meeting correspondence areas of a generation image. The pixel arranger arranges the extracted pixels to the correspondence areas of the generation image in an arrangement according to the optical path of the optical system which photographs the light field image. Pixels are extracted for all sub-images in the light field image, and are arranged to the generation image to generate a reconstruction image.

Image capturing device

An imaging apparatus can be connected to a 3D adapter having an optical system capable of condensing light for forming an image for a left-eye and light for forming an image for a right-eye and can be set into an adjusting mode for adjusting the optical system. The imaging apparatus includes an image pickup unit operable to capture an image formed based on the lights condensed by the 3D adapter, and a display unit operable to display the image captured by the image pickup unit. When the imaging apparatus is set to the adjusting mode, the display unit overlaps and displays the image for a left-eye and the right-eye image captured by the image pickup unit.

Display Shelf Modules With Projectors For Displaying Product Information and Modular Shelving Systems Comprising the Same

Modular shelving systems and display shelves for modular shelving systems are disclosed. In one embodiment, a modular shelving system includes a shelf support frame comprising a back plane portion and a base portion. At least one display shelf module is removably coupled to the back plane portion of the shelf support frame such that the display shelf module is vertically and horizontally positionable on the back plane portion of the shelf support frame. The display shelf module may include a top and bottom panels, and side panels that define an interior volume. A display panel may be affixed to a front of the display shelf module. A projector may be disposed in the interior volume of the display shelf module. The projector projects an optical signal onto a rear surface of the display panel such that image data is visible on a front surface of the display panel.

Image sensor with optical filters having alternating polarization for 3d imaging

An image sensor for three-dimensional (“3D”) imaging includes a first, a second, and a third pixel unit, where the second pixel unit is disposed between the first and third pixel units. Optical filters included in the pixel units are disposed on a light incident side of the image sensor to filter polarization-encoded light having a first polarization and a second polarization to photosensing regions of the pixel units. The first pixel unit includes a first optical filter having the first polarization, the second pixel unit includes a second optical filter having the second polarization, and the third pixel unit includes a third optical filter having the first polarization.

High dynamic range & depth of field depth camera

In order to maximize the dynamic range and depth of field for a depth camera used in a time of flight system, the light source is modulated at a plurality of different frequencies, a plurality of different peak optical powers, a plurality of integration subperiods, a plurality of lens foci, aperture and zoom settings during each camera frame time. The different sets of settings effectively create subrange volumes of interest within a larger aggregate volume of interest, each having their own frequency, peak optical power, lens aperture, lens zoom and lens focus products consistent with the distance, object reflectivity, object motion, field of view, etc. requirements of various ranging applications.

Occupancy sensor and associated methods

A device to detect occupancy of an environment includes a sensor to capture video frames from a location in the environment. The device may compare rules with data using a rules engine. The microcontroller may include a processor and memory to produce results indicative of a condition of the environment. The device may also include an interface through which the data is accessible. The device may generate results respective to the location in the environment. The microcontroller may be in communication with a network. The video frames may be concatenated to create an overview to display the video frames substantially seamlessly respective to the location in which the sensor is positioned. The overview may be viewable using the interface and the results of the analysis performed by the rules engine may be accessible using the interface.

Three-dimensional image processing apparatus, three-dimensional imaging apparatus, and three-dimensional image processing method

A three-dimensional image processing apparatus which processes a captured image of a scene using distance information indicating a distance of the scene from a camera, and includes: a distance designation unit which receives input of a designated distance that is a target distance in which a stereoscopic effect is to be emphasized; a distance conversion unit which converts the distance indicated in the distance information into a stereoscopic distance for generating three-dimensional images, to emphasize the stereoscopic effect of the scene in the designated distance; and an emphasized image generation unit which, by processing the captured image based on the stereoscopic distance, generates an emphasized image representing the stereoscopic effect to be emphasized in the designated distance.

Imaging pixels with depth sensing capabilities

An imager may include depth sensing pixels that receive and convert incident light into image signals. The imager may have an associated imaging lens that focuses the incident light onto the imager. Each of the depth sensing pixels may include a microlens that focuses incident light received from the imaging lens through a color filter onto first and second photosensitive regions of a substrate. The first and second photosensitive regions may provide different and asymmetrical angular responses to incident light. Depth information for each depth sensing pixel may be determined based on the difference between output signals of the first and second photosensitive regions of that depth sensing pixel. Color information for each depth sensing pixel may be determined from a summation of output signals of the first and second photosensitive regions.

Range measurement using multiple coded apertures

A method of using an image capture device to identify range information for objects in a scene includes providing an image capture device having an image sensor, at least two coded apertures, and a lens; storing in a memory a set of blur parameters derived from range calibration data for each coded aperture; capturing images of the scene having a plurality of objects using each of the coded apertures; providing a set of deblurred images using the captured images from each coded aperture and each of the blur parameters from the stored set; and using the set of deblurred images to determine the range information for the objects in the scene.

Method and system for rfid-assisted imaging

A method includes acquiring imaging data of a scene using an imaging tool. The method also includes extracting radio frequency identification (RFID) data stored in an RFID tag associated with the scene. The method further includes associating the RFID data with the imaging data.

Integrated processor for 3d mapping

A device for processing data includes a first input port for receiving color image data from a first image sensor and a second input port for receiving depth-related image data from a second image sensor. Processing circuitry generates a depth map using the depth-related image data. At least one output port conveys the depth map and the color image data to a host computer.

Three dimensional camera and projector for same

A 3D imaging apparatus comprising a projector, comprising a laser array comprising a plurality of individual emitters, a mask for providing a structured light pattern, wherein a distance between the laser array and the mask is substantially minimized according to a non-uniformity profile of the plurality of individual emitters and according to a uniformity criterion related to the light intensity distribution across the mask plane, projection optics to image the structured light pattern onto an object, an imaging sensor adapted to capture an image of the object with the structured light pattern projected thereon and a processing unit adapted to process the image to determine range parameters.

Two-parallel-channel reflector with focal length and disparity control

A two-parallel-channel reflector (TPCR) with focal length and disparity control is provided. The TPCR is connected to an imaging device, so that an image of a scene is captured to generate a stereoscopic image. The TPCR has two parallel channels that allow the imaging device to generate a left side view image and a right side view image of the shot scene synchronously. Each parallel channel includes an outward reflecting unit and an inward reflecting unit, which are designed to ensure that light rays in the parallel channels are reflected in a collimated and parallel manner. During imaging, a position and an angle of the outward reflecting unit can be adjusted to fulfill the function of controlling the disparity and the focal length.

Dimensioning system

The present invention determines the dimensions and volume of an object by using a novel 3-D camera that measures the distance to every reflective point in its field of view with a single pulse of light. The distance is computed by the time of flight of the pulse to each camera pixel. The accuracy of the measurement is augmented by capture of the laser pulse shape in each camera pixel. The camera can be used on an assembly line to develop quality control data for manufactured objects or on a moving or stationary system that weighs as well as dimensions the objects. The device can also ascertain the minimum size of a box required to enclose an object.

Stereoscopic image generating apparatus, stereoscopic image generating method, and stereoscopic image generating program

At least one of parallax images for left and right eyes to be fusionally displayed to perform stereopsis using binocular parallax is generated at low resolution or low sharpness of such a degree that a subject in the parallax image is observable as a stereoscopic image when an observer observes the subject in an observation mode in which the two fusionally displayed parallax images are stereoscopically viewable, and also of such a degree that the subject is recognizable as a plane image when an observer observes the subject in an observation mode in which the two fusionally displayed parallax images are not stereoscopically viewable.

Single-lens 3-d imaging device using poloarization coded aperture masks combined with polarization sensitive sensor

A device and method for three-dimensional (3-D) imaging using a defocusing technique is disclosed. The device comprises a lens, at least one polarization-coded aperture obstructing the lens, a polarization-sensitive sensor operable for capturing electromagnetic radiation transmitted from an object through the lens and the at least one polarization-coded aperture, and a processor communicatively connected with the sensor for processing the sensor information and producing a 3-D image of the object.

System And Process For Detecting, Tracking And Counting Human Objects of Interest

A system is disclosed that includes: at least one image capturing device at the entrance to obtain images; a reader device; and a processor for extracting objects of interest from the images and generating tracks for each object of interest, and for matching objects of interest with objects associated with RFID tags, and for counting the number of objects of interest associated with, and not associated with, particular RFID tags.

Apparatus including function to generate stereoscopic image, and method and storage medium for the same

An apparatus, a method and a storage medium including a function to generate a stereoscopic image are described. According to one implementation, the imaging apparatus includes an imaging lens; a first driving section; an obtaining section and a generating section. The first driving section rotates the imaging lens around an axis along a first direction orthogonal to an optical axis. The obtaining section obtains two image signals corresponding to two optical images which pass through the imaging lens rotated in two states to make a direction of the optical axis relatively different so that a relationship of a position of background with respect to a subject is different. The generating section generates image data of a stereoscopic image based on the two image signals.

Electronic device, image display method, and image display program

According to an aspect, an electronic device includes: an imaging unit for capturing a subject; and a storage unit for storing therein an image captured by the imaging unit. The image stored in the storage unit is an image that forms a three-dimensional image when displayed in combination with other image of the same subject stored in the storage unit.

Hybrid stitching

In a system or method where three-dimensional data is acquired as a sequence of frames of data along a camera path, disparate sequences are related to one another through a number of geometric stitches obtained by direct registration of three-dimensional data between frames in the disparate sequences. These geometric stitches are then used in addition to or in place of other camera path relationships to form a single virtual stitch graph for the combined model, upon which an integrated global path optimization can be performed.

Portable proprioceptive peripatetic polylinear video player

Departing from one-way linear cinema played on a single rectangular screen, this multi-channel virtual environment involves a cinematic paradigm that undoes habitual ways of framing things, employing architectural concepts in a polylinear video/sound construction to create a type of experience that allows the world to reveal itself and permits discovery on the part of participants. Techniques are disclosed for peripatetic navigation through virtual space with a handheld computing device, leveraging human spatial memory to form a proprioceptive sense of location, allowing a participant to easily navigate amongst a plurality of simultaneously playing videos and to center in front of individual video panes in said space, making it comfortable for a participant to rest in a fixed posture and orientation while selectively viewing any one of the video streams, and providing spatialized 3D audio cues that invite awareness of other content unfolding simultaneously in the virtual environment.

Two-channel reflector based single-lens 2d/3d camera with disparity and convergence angle control

A single-lens two-channel reflector providing the capability to switch between two-dimensional and three-dimensional imaging is provided. The reflector includes displaceable outward reflectors and displaceable inward reflectors that can simultaneously provide left and right images of a scene to an imager, and controllers for controlling relative distance between the outward and the inward reflectors, and for controlling deflection angle of the inward reflectors, so as to enable the adjustment of disparity and convergence angle. Imaging systems and methods for capturing two-dimensional and three-dimensional images are provided also.

Computerized imaging of sporting trophies and method of providing a replica

Methods are disclosed for providing replicas of a sporting trophy and for scoring the sporting trophy. The first method includes providing a sporting trophy to be scanned; scanning the sporting trophy to provide three-dimensional image data of the sporting trophy; and providing the three-dimensional image data of the sporting trophy to a replica generating system to provide a replica of the sporting trophy. The second method includes providing three-dimensional digital data of a sporting trophy having a volume and a surface area; providing at least one sporting-relevant measurement based on the three-dimensional data of the sporting trophy; and providing a score of the sporting trophy based on the at least one sporting-relevant measurement.

Techniques for producing baseline stereo parameters for stereoscopic computer animation

Bounded-parallax constraints are determined for the placement of a pair of stereoscopic cameras within a computer-generated scene. A minimum scene depth is calculated based on the distance from the pair of cameras to a nearest point of interest in the computer-generated scene. A near-parallax value is also calculated based on the focal length and the minimum scene depth. Calculating the near-parallax value includes selecting a baseline stereo-setting entry from a set of stereo-setting entries, each stereo-setting entry of the set of baseline stereo-setting entries includes a recommended scene depth, a recommended focal length, and a recommended near-parallax value. For the selected baseline stereo-setting entry: the recommended scene depth corresponds to the minimum scene depth, and the recommended focal length corresponds to the focal length. The near-parallax value and far-parallax value are stored as the bounded-parallax constraints for the placement of the pair of stereoscopic cameras.

Context-driven adjustment of camera parameters

A system and method for adjusting the parameters of a camera based upon the elements in an imaged scene are described. The frame rate at which the camera captures images can be adjusted based upon whether the object of interest appears in the camera's field of view to improve the camera's power consumption. The exposure time can be set based on the distance of an object form the camera to improve the quality of the acquired camera data.

Capturing and Aligning Three-Dimensional Scenes

Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.

Displays for three-dimensional printers

A variety of techniques are disclosed for incorporating displays into three-dimensional printers.

Image information output method

Provided is a video image data generation system including a database for storing a plurality of image data photographed in various directions in various locations, correlating the directions and the locations with the stored image data, and correlating and storing a photographed sub-region when the image data is acquired, a route view point specifying device which specifies various locations and eye level directions arranged on a view point route, an image search engine which searches an image of an eye level direction specified from a location of a view point route specified by the route view point specifying device and outputs video data, wherein the image search engine searches image data stored in a database and the image data including a sub-region located in an eye level direction in each of a plurality of locations on a view point route by referencing photography direction data correlated with the sub-region.

Image capturing device and program to control image capturing device

With a conventional stereoimage capturing device, it has been difficult to simply determine the present of a depth. An image capturing device includes an image capturing element in which a first parallax pixel group and a second parallax pixel group that output a first parallax image and a second parallax image, respectively, to cause a parallax are arranged at mutually different positions. The image capturing device computes a differential pixel value of each of a plurality of second parallax output pixels in the second parallax image positioned around a target pixel that is a first parallax output pixel of the first parallax image, the differential pixel value being computed with reference to the target pixel, and generates differential data in which a direction of each of the plurality of second parallax output pixels with reference to the target pixel is associated with the corresponding differential pixel value.

Stereoscopic endoscope system

To obtain various types of information on an observed portion such as a body tissue, white halation is effectively generated in images obtained by imaging the observed portion with a plurality of image sensors. A stereoscopic endoscope system including: a light illuminating unit which irradiates an observed portion with illumination light; an endoscope which has an objective optical system including a plurality of image sensors for receiving reflected light from the observed portion; an image analyzing unit which analyzes images obtained by the objective optical system; and a light amount distribution control unit which controls a light amount distribution of the illumination light based on an analysis result of the images.

Devices and Methods for Augmented Reality Applications

In a particular embodiment, a method includes evaluating, at a mobile device, a first area of pixels to generate a first result. The method further includes evaluating, at the mobile device, a second area of pixels to generate a second result. Based on comparing a threshold with a difference between the first result and the second result, a determination is made that the second area of pixels corresponds to a background portion of a scene or a foreground portion of the scene.

Stereo camera apparatus for a mobile device, and imaging method therefor

A method of shooting an OSMU stereoscopic image using a mobile stereoscopic camera is provided. The method includes an operation of placing the mobile stereoscopic camera on a predetermined location of a mobile shooting place, an operation of determining a focusing distance in a wide-angle shooting condition when a far point of the mobile stereoscopic camera is infinity, an operation of calculating a distance between two cameras of the mobile stereoscopic camera by setting the far point of the mobile stereoscopic camera to be infinity at a location of the mobile stereoscopic camera, an operation of adjusting the distance between the cameras of the mobile stereoscopic camera to be the calculated distance between the cameras of the mobile stereoscopic camera, and an operation of shooting the OSMU stereoscopic image using the mobile stereoscopic camera of which the distance between the cameras is adjusted.

Scanner

A method for 3D imaging using phase shifted structured light, in which projection means project multiple phase shifted mask images of a transmission mask on to an object scene, the mask images being captured by a camera to form a camera image, depth information being derived from the camera image by measurement of the camera image and computation from the measurement for each of the phase shifted fringe patterns and a 3D scanner carrying out the method.

Image processor, image capture device, image processing method and program

This image processor 10 includes: an input interface 11 that receives first and second images, on one of which the position of the subject has shifted in a particular direction from the position on the other; a color image generating section 13 a that generates a color image in which the pixel values of respective pixels of the first and second images are used as the values of first and second colors, respectively; a decision section 13 b that calculates an index value indicating the degree of color shift between the first and second colors in the color image and that determines, based on the index value, whether or not the first and second images match each other; and an image moving section 13 c that performs, if the decision has been made that the first and second images do not match each other, the processing of making the second image closer to the first image by replacing the pixel value of each pixel of the second image with the pixel value of a pixel that is adjacent to the former pixel in the particular direction.

Method and Device for 3-D Display Based on Random Constructive Interference

The present invention relates to a method and an apparatus for 3-D display based on random constructive interference. It produces a number of discrete secondary light sources by using an amplitude-phase-modulator-array, which helps to create 3-D images by means of constructive interference. Next it employs a random-secondary-light-source-generator-array to shift the position of each secondary light source to a random place, eliminating multiple images due to high order diffraction. It could be constructed with low resolution liquid crystal screens to realize large size real-time color 3-D display, which could widely be applied to 3-D computer or TV screens, 3-D human-machine interaction, machine vision, and so on.

Grayscale patterns from binary spatial light modulators

Brightness-by-column grayscale and spatial Σ-Δ modulation grayscale allow grayscale patterns to be produced using a binary spatial light modulator as fast as the bright/dark switching speed.

VEHICLE INTERIOR LIGHTING SYSTEM

A vehicle interior lighting system includes an illuminating unit provided in an interior of a vehicle, an imaging unit that captures a depth image including a distance to an object person in the interior, an estimating unit that estimates a three-dimensional human body model of an object person from a depth image captured by the imaging unit, a predicting unit that predicts a movement intention of an object person in an interior based on the human body model estimated by the estimating unit, and an operation controller that controls lighting of the illuminating unit according to the movement intention predicted by the predicting unit. 1. A vehicle interior lighting system comprising:an illuminating unit provided in an interior of a vehicle;an imaging unit that captures a depth image including a distance to an object person in the interior;an estimating unit that estimates a three-dimensional human body model of the object person from the depth image captured by the imaging unit;a predicting unit that predicts a movement intention of the object person in the interior based on the human body model estimated by the estimating unit; andan operation controller that controls lighting of the illuminating unit according to the movement intention predicted by the predicting unit.2. The vehicle interior lighting system according to claim 1 , whereinthe illuminating unit has a plurality of lighting devices, andthe operation controller turns on the lighting devices near the object person whose movement intention is predicted by the predicting unit.3. The vehicle interior lighting system according to claim 2 , whereinthe predicting unit predicts a destination of the object person in the interior based on the human body model estimated by the estimating unit, andthe operation controller turns on the lighting devices at the destination predicted by the predicting unit.4. The vehicle interior lighting system according to claim 3 , whereinthe operation controller turns off the ...

THREE DIMENSIONAL IMAGING WITH INTENSITY INFORMATION

A method for operating a time-of-flight sensor system includes by an array of pixels of a time-of-flight sensor of the time-of-flight sensor system, generating signal data representative of reflected light from an environment; generating an intensity representation of an object in the environment based on the signal data representative of the reflected light from the environment; determining that the intensity representation indicates that an object in the environment includes a target object; and responsive to the determining, generating a three-dimensional representation of the environment based on the data representative of the reflected light. 1. A method for operating a time-of-flight sensor system , the method comprising:by an array of pixels of a time-of-flight sensor of the time-of-flight sensor system, generating signal data representative of reflected light from an environment;generating an intensity representation of an object in the environment based on the signal data representative of the reflected light from the environment;determining that the intensity representation indicates that an object in the environment comprises a target object; andresponsive to the determining, generating a three-dimensional representation of the environment based on the data representative of the reflected light.2. The method according to claim 1 , wherein generating the three-dimensional representation of the environment comprises demodulating the data representative of the reflected light.3. The method according to claim 1 , wherein the generation of the intensity representation of the environment uses less power than the generation of the three-dimensional representation of the environment.4. The method according to claim 1 , comprising claim 1 , by processing circuitry of the time-of-flight sensor claim 1 , determining that an object is present in the environment.5. The method according to claim 4 , comprising generating the intensity representation responsive to ...

Multi-Band Image Sensor For Providing Three-Dimensional Color Images

An imaging system and method for generating a three-dimensional color image include an opening for allowing light from an object to enter the imaging system. Each sensor element in an array of sensor elements receives a portion of the light and generates a signal indicative of an intensity of the received portion of the light. Light from an optical element impinges on a filter comprising a plurality of filter regions, each filter region passes a predetermined band of wavelengths of the light and is associated with and disposed in alignment with one of the sensor elements such that light passing through each filter region impinges on the sensor associated and in alignment with the filter element. At least one of the filter regions is constructed to pass a visible color band, and at least one other of the filter regions is constructed to pass an infrared band.

Image processing device and image processing method

There is provided an image processing device including a first composition setting unit configured to set composition for a two-dimensionally displayed input image based on a first technique, and a second composition setting unit configured to set composition for a three-dimensionally displayed input image based on a second technique different from the first technique.

Apparatus and method for generating or displaying three-dimensional image

A three-dimensional ( 3 D) image generating method is described. A plurality of captured-images is acquired. The plurality of captured-images includes left-eye images and right-eye images. Direction information is acquired when capturing each of the plurality of captured-images. A left-eye spherical image is generated by disposing the left-eye images of the plurality of captured-images in a first spherical coordinate system by using the direction information of the plurality of captured-images. A right-eye spherical image is generated by disposing the right-eye images of the plurality of captured-images in a second spherical coordinate system by using the direction information of the plurality of captured-images. The left-eye spherical image and the right-eye spherical image are stored.

Lens apparatus and image pickup apparatus

A lens apparatus includes a first optical system, and a second optical system disposed in parallel with the first optical system. Each of the first optical system and the second optical system includes, in order from an object side to an image side, a first optical axis, a second optical axis, and a third optical axis. When each of the first optical system and the second optical system rotates around an axis parallel to the third optical axis, a distance between first optical axes of the first optical system and the second optical system changes greater than a distance between third optical axes.

Imaging apparatus

According to an illustrative embodiment an imaging system is provided. The system includes a lens tube; a first polarizing filter; and a second polarizing filter; wherein the first polarizing filter and the second polarizing filter are adjacent each other, and wherein a polarizing imparted by the first polarizing filter is different from a polarizing imparted by the second polarizing filter.

Electronically switching microlenses between optical states

An example electronic apparatus for switching microlenses includes a microlens including a plurality of microstructures to bend light. The electronic apparatus also includes a chamber coupled to the microlens to receive a liquid with an optical index that matches an optical index of the microlens. The electronic apparatus further includes an electronic device coupled to the chamber to manipulate the liquid to achieve a target optical state of the microlens.

Information processing device, communication system, information processing method, and program

Provided is an image that is comfortably viewed and operated by a user. An electronic device acquires user information related to a relative position between a user and a display unit. Then, the electronic device transmits the user information to an information processing device. The information processing device includes a communication unit and a control unit. The communication unit receives the user information related to the relative position of the user and a display unit which is acquired by the electronic device from the electronic device. Further, the control unit performs control to decide a display mode of an image transmitted from a source device on the display unit on the basis of the user information received from the electronic device.

FORMATTING SENSOR DATA FOR USE IN AUTONOMOUS VEHICLE COMMUNICATIONS PLATFORM

A sensor synchronization system for an autonomous vehicle is described. Upon initializing a master clock on a master processing node for a sensor apparatus of the autonomous vehicle, the system determines whether an external timing signal is available. If the signal is available, the system synchronizes the master clock with the external timing signal. Based on a clock cycle of the master clock, the system propagates timestamp messages to the sensors of the sensor apparatus, receives sensor data, and formats the sensor data based on the timestamp messages. 1. A method of operating a sensor apparatus of an autonomous vehicle , the method comprising:upon initializing a master clock on a master processing node for the sensor apparatus, determining whether an external timing signal is available;upon determining that the external timing signal is available, synchronizing the master clock with the external timing signal;based on a clock cycle of the master clock, propagating a plurality of pulse timestamp messages from the master processing node to a plurality of sensors of the sensor apparatus;receiving sensor data from the plurality of sensors; andgenerating, based at least in part on the sensor data and at least in part on the plurality of pulse timestamp messages, output data to enable processing for controlling the autonomous vehicle.2. The method of claim 1 , further comprising:upon determining that the external timing signal is available, determining that the master clock remains synchronized, within a predetermined threshold, with the external timing signal.3. The method of claim 2 , wherein determining that the master clock remains synchronized with the external timing signal includes determining that the master clock time skew remains beneath the predetermined threshold even after the external timing signal is lost.4. The method of claim 1 , further comprising:dividing the clock cycle of the master clock into a plurality of timing intervals; andgenerating a ...

Method for measuring a dental object

A method of imaging a dental object using a dental camera comprising the steps of: recording a plurality of three-dimensional optical images of a dental object using a dental camera; determining whether an overlapping area, formed by at least a partial overlap of the plurality of three-dimensional optical images, satisfies one or more recording requirements; and generating an acoustic sound during the recording using a sound generator; wherein the sound serves as a feedback for the user and imparts to the user information (i) about the current status of a recording of the images and/or (ii) about recording requirements of the dental camera; wherein a speed of movement of the dental camera relative to the object is determined by (i) using a motion sensor on the dental camera or (ii) by analysis of the measured images; and wherein the acoustic sound is generated as a function of the determined speed of movement.

Systems and Methods for Authenticating a User According to a Hand of the User Moving in a Three-Dimensional (3D) Space

Methods and systems for capturing motion and/or determining the shapes and positions of one or more objects in 3D space utilize cross-sections thereof. In various embodiments, images of the cross-sections are captured using a camera based on edge points thereof. 1. A system for authenticating a user according to a hand of the user moving in a three-dimensional (3D) space , the system comprising: analyzing a sequence of images including the hand of the user moving in the 3D space, as captured by a camera from a particular vantage point, to (i) computationally determine a shape of the hand of the user according to one or more mathematically represented 3D surfaces of the hand and (ii) computationally determine a jitter pattern of the hand; and', 'in response to a received authentication determination obtained by performing a comparison of the shape of the hand and the jitter pattern of the hand to a database of hand shapes and jitter patterns, authenticating the user and granting access to the user when the authentication determination indicates that the user is authorized and denying access to the user when the authentication determination indicates that the user is not authorized., 'one or more processors coupled to a memory storing instructions that, when executed by the one or more processors, implement actions including2. The system of claim 1 , further including: at least one source that casts an output onto a portion of the hand of the user.3. The system of claim 1 , further including transmitting to at least one further process claim 1 , a signal that includes at least one selected from (i) trajectory information determined from a reconstructed position of a portion of the hand of the user that the at least one further process interprets claim 1 , and (ii) gesture information interpreted from trajectory information for the portion of the hand of the user.4. The system of claim 1 , further comprising a time-of-flight camera claim 1 , and wherein a plurality of ...

TEMPERATURE COMPENSATION FOR STRUCTURED LIGHT DEPTH IMAGING SYSTEM

Disclosed are an apparatus and a method of compensating temperature shifts of a structured light pattern for a depth imaging system. In some embodiments, a depth imaging device includes a light source, an imaging sensor and a processor. The light source emits light corresponding to a pattern. A temperature drift of the light source can cause a shift of the pattern. The imaging sensor receives the light reflected by environment in front of the depth imaging device and generates a depth map including a plurality of pixel values corresponding to depths of the environment relative to the depth imaging device. The processor estimates the shift of the pattern based on a polynomial model depending on the temperature drift of the light source. The processor further adjusts the depth map based on the shift of the pattern. 1. A depth imaging device , comprising: receive light as reflected by an environment of the depth imaging device;', 'generate, based on the light, a depth map including a plurality of pixel values corresponding to depths of the environment relative to the depth imaging device;, 'an imaging sensor configured toa temperature sensor configured to measure a temperature drift from a reference temperature of one or more of a light source, an optical component of the depth imaging device, or the environment of the depth imaging device; and estimate a shift of a pattern of the light based on the temperature drift; and', 'adjust the depth map based on the shift of the pattern., 'a processor configured to2. The depth imaging device of claim 1 , wherein the pattern is a speckle pattern corresponding to a reference image including a plurality of dots claim 1 , each of the dots of the plurality of dots having known coordinates in the reference image.3. The depth imaging device of claim 1 , wherein the shift of the pattern is estimated by using a polynomial model depending on the temperature drift.4. The depth imaging device of claim 3 , wherein the polynomial model is ...

TOOL-PICKUP SYSTEM, METHOD, COMPUTER PROGRAM AND NON-VOLATILE DATA CARRIER

Tools in an automatic milking arrangement are picked up by using a robotic arm (). The robotic arm () moves a camera () to an origin location (PC) from which the camera () registers three-dimensional image data (DimgD) of at least one tool (). The three-dimensional image data is processed using an image-based object identification algorithm to identify objects in the form of the tools and hoses (). In response to identifying at least one tool, a respective tool position (PT, PT, PT) is determined for each identified tool based on the origin location (PC) and the three-dimensional image data. Then, a grip device () is exclusively controlled to the one or more of the respective tool positions (PT, PT, PT) to perform a pick-up operation. Thus, futile attempts to pick-up non-existing or blocked tools can be avoided. 1. A tool-pickup system for an automatic milking arrangement , the tool-pickup system comprising:{'b': 110', '115', '141', '142', '143', '144', '130', '3, 'a robotic arm () provided with a grip device () configured to pick up tools (, , , ), and a camera () configured to register three-dimensional image data (DimgD); and'}{'b': 120', '120, 'a control unit () operatively connected to the robotic arm, the control unit () configured to{'b': 110', '130', '141', '142', '143', '144', '130, 'control the robotic arm () to move the camera () to an origin location (PC) from which at least one tool of the tools (, , , ) is expected to be visible within a view field (VF) of the camera (),'}{'b': 3', '130, 'obtain three-dimensional image data (DimgD) registered by the camera () at the origin location (PC),'}{'b': 3', '141', '143', '144', '152, 'process the three-dimensional image data (DimgD) using an image-based object identification algorithm to identify objects in a form of the tools (, , ) and/or hoses (), and'}{'b': 141', '143', '144, 'in response to identifying at least one of the tools (, , ){'b': 1', '3', '4', '141', '143', '144', '3, 'i) determine a respective ...

AUTOMATED SPATIAL INDEXING OF IMAGES BASED ON FLOORPLAN FEATURES

A spatial indexing system receives a sequence of images depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model. 1. A method comprising:receiving a sequence of images from an image capture system, the sequence of images captured by a camera of the image capture system as the image capture system is moved along a camera path through an environment;generating a first estimate of the camera path, the first estimate of the camera path specifying, for images in the sequence of images, a position of the image relative to a reference point;obtaining a floorplan of the environment, the floorplan specifying positions of a plurality of physical features in the environment;generating a combined estimate of the camera path based on the first estimate of the camera path and the positions of the plurality of physical features specified in the floorplan; andgenerating an immersive model of the environment, the immersive model specifying, for each image of a plurality of the images, a location of the image within the floorplan and at least one route vector defining a spatial distance between the image and at least one of the other images of the plurality of images.2. The method of claim 1 , wherein the camera is a 360-degree camera and the images are 360-degree images.3. The method of claim 1 , wherein the first estimate of the camera path is generated by performing a simultaneous localization and mapping process on the sequence of images.4. The method of claim 1 , wherein global satellite navigation system (GNSS) signals are substantially attenuated in the environment.5. The method of claim 1 , wherein an indoor positioning system ( ...

Method and Apparatus for Accurate Placement of Electrocardiogram Electrodes

A method for guiding electrocardiogram (ECG) electrode placement on a person includes acquiring an image of the person, identifying an externally discernable anatomical landmark on the image, determining target locations for first through nth electrodes as a function of the location of the landmark, and highlighting the target locations on the person. A system for guiding placement of ECG electrodes comprises an imaging device, an illumination source, a processor, and machine readable instructions. The instructions, when executed by the processor, identify at least one marker in an image acquired by the imaging device, determine, as a function of the location of the at least one marker, target locations on the person at which first through nth ECG electrodes should be placed, and cause the illumination source to illuminate the first through nth target locations. 1. A method for guiding electrocardiogram (ECG) electrode placement on a person comprising:acquiring an image of the person;identifying at least one externally discernable anatomical landmark on the image;determining target locations for first through nth ECG electrodes as a function of the location of the at least one identified landmark; andhighlighting the target locations on the person.2. The method of wherein the first through nth target locations are highlighted one at a time.3. The method of wherein an electrode is associated with each target location claim 2 , and the method includes:assessing whether the actual location of each electrode with respect to its target location satisfies at least one acceptance criterion, and, in response to the assessing step,issuing an electrode placement status indication.4. The method of wherein the status indication is a non-acceptability indication of refraining from highlighting a next target location T(i=2 claim 3 , 3 claim 3 , . . . n) until the assessment reveals that the currently highlighted target location T(i=1 claim 3 , 2 claim 3 , . . . n−1) satisfies the ...

Securable wearable computer interface

A wearable computer interface comprising a three dimensional (3D) range camera and a picture camera that image the user and a controller that process the images to identify the user and determine if the user is authorized to use the interface to access functionalities provided by a computer interfaced by the interface.

IMAGE SCANNER WITH MULTIDIRECTIONAL ILLUMINATION

An image scanner including a two-dimensional matrix sensor, a scanning plane defined by the axes, an optical system, an optical axis perpendicular to the scanning plane and coinciding with an axis, a lighting system including at least four light sources that have its own main axis and are positioned so that each light source is adjacent to one side of the scanning plane and illuminates it from a different direction. Each light source is arranged with its own main axis in a plane parallel to a facing mirror-reflecting surface above said facing mirror-reflecting surface and is oriented so as to radiate the scanning plane by specularly reflecting its light beams on the respective mirror-reflecting surface situated on the opposite side of the scanning plane with respect to the light source. 1. Image scanner comprising a two-dimensional matrix sensor, a scanning plane defined by the axes at right angles each other, an optical system, an optical axis perpendicular to the scanning plane and coinciding with an axis perpendicular to the scanning plane, a lighting system arranged according to the requirements of the Photometric Stereo technique and comprising at least four light sources each of them developing along a main axis parallel to one of said axes, said light sources are positioned so that each light source is adjacent to one side of the scanning plane and illuminates it from a different direction, wherein each light source is arranged with its own main axis in a plane parallel to a facing mirror-reflecting surface above said facing mirror-reflecting surface and is oriented so as to radiate the scanning plane by specularly reflecting its light beams on the respective mirror-reflecting surface situated on the opposite side of the scanning plane with respect to the light source. The present invention relates to an image scanner with multidirectional illumination, based on a two-dimensional matrix sensor for color or grayscale images. Such a two-dimensional matrix ...

STEREO CAMERA

A first mirror has a first reflecting surface convexed in a first direction, a first apex, and a first fan shape. A second mirror has a second reflecting surface convexed in a second direction, a second apex, and a second fan shape. An imaging optical system forms images from a first light emitted from an object, reflected by the first reflecting surface, and subsequently further reflected by the second reflecting surface, and a second light emitted from the object and reflected by the second reflecting surface. The first and second fan shapes have interior angles of 180° or more. A center position of the image sensor is displaced with respect to an optical axis of the imaging optical system. A short side of a photo-receiving surface of the image sensor and a center line of the image of the first or second fan shape are approximately parallel. 1. A stereo camera comprising:a first mirror that has a first reflecting surface as a curved surface convexed in a first direction, a first apex, and a first fan shape;a second mirror that has a second reflecting surface convexed in a second direction opposite to the first direction, a second apex opposing to the first apex, and a second fan shape;an imaging optical system that forms images from a first light and a second light, the first light being emitted from an object, reflected by the first reflecting surface, and subsequently further reflected by the second reflecting surface, the second light being emitted from the object and reflected by the second reflecting surface; andan image sensor that receives the first light and the second light through the imaging optical system,wherein the second mirror includes an inside mirror and an outside mirror, the outside mirror being positioned in an outer circumferential side with respect to the inside mirror, the outside mirror having a conic constant different from a conic constant of the inside mirror,wherein the first fan shape and the second fan shape have interior angles of ...

WEARABLE 3D AUGMENTED REALITY DISPLAY

A wearable 3D augmented reality display and method, which may include 3D integral imaging optics. 1. A 3D augmented reality display , comprising:a microdisplay for providing a virtual 3D image for display to a user;display optics configured to receive optical radiation from the microdisplay and configured to create, from the received radiation, a 3D lightfield extending through a depth range at a reference plane, the display optics including a microlens array having an array width and the display optics including a first lens attached to and in optical communication with the microlens array, the first lens having a diameter at least as large as the array width to receive optical radiation from the microlens array;an eyepiece in optical communication with the display optics configured to receive the 3D lightfield from the display optics and configured to create a virtual image, at a virtual reference plane, of the 3D light field, the reference plane and virtual reference plane being optically conjugate to one another across the eyepiece.2. The 3 D augmented reality display of claim 1 , wherein the display optics comprises a second lens in optical communication with both the first lens and the eyepiece claim 1 , the second lens having a focal length equal to that of the first lens.3. The 3D augmented reality display of claim 2 , wherein the second lens is spaced apart from the first lens by a distance equal to the focal length.4. The 3D augmented reality display of claim 1 , wherein the eyepiece comprises a selected surface configured to receive the 3D lightfield from the display optics and reflect the received radiation to the exit pupil claim 1 , the selected surface also configured to receive optical radiation from a source other than the microdisplay and to transmit the optical radiation to the exit pupil.5. The 3D augmented reality display of claim 1 , wherein the eyepiece comprises a freeform prism shape.6. The 3D augmented reality display of claim 1 , wherein ...

Self-rectification of stereo camera

Embodiments include a method for self-rectification of a stereo camera, wherein the stereo camera comprises a first camera and a second camera, the method comprises creating image pairs from a first images taken by the first camera and second images taken by the second camera, respectively, such that each image pair comprises two images taken at essentially the same time by the first camera and the second camera, respectively. The method comprises creating, for each image pair, matching point pairs from corresponding points in the two images of each image pair, such that each matching point pair comprises one point from each of the first and second image of the respective image pair. For each matching point pair, a disparity is calculated and a plurality of disparities is created for each image pair, and the resulting plurality of disparities is taken into account for the self-rectification.

REGISTRATION METHOD AND SETUP

The invention relates to a registration method for determining position and orientation of an object in relation to a position detection system, wherein the method comprises the steps of 133-. (canceled)34. A method for non-tactile registration of an object with a position detection system , the method comprising:generating a surface model of the object based on one or more images captured with an image sensor unit positioned at a capturing position, wherein the image sensor unit comprises a motion sensor;determining the capturing position in a coordinate system of the position detection system, based on a sensor signal from the motion sensor; andrelating the surface model of the object to the position detection system based at least in part on the determined capturing position.35. The method of claim 34 , wherein the image sensor unit comprises one or more stereographic cameras.36. The method of claim 34 , wherein the image sensor unit comprises one or more cameras in a multi-camera arrangement.37. The method of claim 34 , wherein the image sensor unit comprises an infrared image sensor.38. The method of claim 37 , wherein the infrared image sensor is configured to project a pattern onto the object while capturing the image claim 37 , wherein the projected pattern has known dimensions such that distortions of the pattern as projected onto a surface of the object and used to establish the three-dimensional surface of the object.39. The method of claim 37 , wherein the method further comprises:arranging a plurality of infrared markers on a surface of the object;detecting the infrared markers with the infrared image sensor; andphotogammetrically generating a surface topography of the surface model.40. The method of claim 34 , wherein the motion sensor is configured to detect at least one of an acceleration and a rotational rate of the image sensor unit.41. The method of claim 34 , wherein the surface model comprises a point cloud.42. The method of claim 34 , wherein ...

Camera Array Including Camera Modules

The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules. 1. A system comprising:a camera array comprising a set of camera modules that are each substantially identical relative to one another and communicatively coupled to one another via a daisy chain; and receive video data describing image frames from the camera array captured by the set of camera modules;', 'stitch the image frames together based on a frame sync signal and a relative position of each camera module of the set of camera modules to generate three-dimensional video data;', 'determine that color deficiencies occurred in stitched image frames;', 'determine corrected pixel values to replace original pixel values in stitched image frames that include the color deficiencies in the three-dimensional video data; and', 'generate three-dimensional content that includes the corrected pixel values in a set of pixel values., 'an aggregation system stored on a memory and executed by one or more processors, the aggregation system operable to2. The system of claim 1 , wherein determining the corrected pixel values is based on a robust affine model that transforms one set of color values into another.3. The system of claim 2 , wherein determining the corrected pixel values based on the robust affine model includes applying a downweight to outlier pixel pairs that do not correspond to a same special location.4. The system of claim 1 , wherein the aggregation system is further operable to increase ...

PLANT FEATURE DETECTION USING CAPTURED IMAGES

Described are methods for identifying the in-field positions of plant features on a plant by plant basis. These positions are determined based on images captured as a vehicle (e.g., tractor, sprayer, etc.) including one or more cameras travels through the field along a row of crops. The in-field positions of the plant features are useful for a variety of purposes including, for example, generating three-dimensional data models of plants growing in the field, assessing plant growth and phenotypic features, determining what kinds of treatments to apply including both where to apply the treatments and how much, determining whether to remove weeds or other undesirable plants, and so on. 1. A method for treating a plant comprising:receiving a sequence of stereo image pairs captured as a device passes along a row of plants in a field, each image of each of the stereo pairs capturing at least a portion of one or more of the plants of the row;generating a plurality of probability heatmaps, each probability heatmap corresponding to an image from each stereo image pair of the sequence and comprising probabilities that pixels within the image contain an occurrence of one or more plant features;generating a plurality of depth maps, each depth map corresponding to a stereo image pair of the sequence and comprising points in a three-dimensional space, each of the points corresponding to a pixel in each image of stereo image pair;for each of the stereo image pairs of the sequence of stereo image pairs, combining the probability heat map corresponding to the image in the stereo image pair of the sequence and the depth map corresponding to the stereo image pair in the sequence to generate a combined map representing plants in the row in the three-dimensional space, wherein each plant comprises a plurality of point clusters describing a probability of an occurrence of one or more plant features; andidentifying the occurrence of one or more plant features based on the plurality of ...

TIME-OF-FLIGHT CAMERA SYSTEM

The invention relates to a TOF camera system comprising several cameras, at least one of the cameras being a TOF camera, wherein the cameras are assembled on a common substrate and are imaging the same scene simultaneously and wherein at least two cameras are driven by different driving parameters. 114-. (canceled)15. A sensor device comprising:a plurality of sensors, the plurality of sensors including a time-of-flight (TOF) sensor configured to detect a distance to an object and an image sensor configured to capture an image of the object, wherein the TOF sensor and the image sensor are disposed on a common substrate and are configured to sense the object simultaneously; andcircuitry configured to drive a first sensor of the plurality of sensors with first driving parameters and to drive a second sensor of the plurality of sensors with second driving parameters.16. The sensor device according to claim 15 , wherein the second driving parameters are different than the first driving parameters.17. The sensor device according to claim 15 , wherein the first driving parameters and the second driving parameters comprise at least two different frequencies for implementing a dealiasing algorithm.18. The sensor device according to claim 15 , further comprising an array of lenses claim 15 , each lens of the array of lenses being associated with a respective sensor of the plurality of sensors.19. The sensor device according to claim 17 , wherein the at least two different frequencies comprise modulation frequencies configured to control a timing of the imaging of the scene.20. The sensor device according to claim 17 , wherein the dealiasing algorithm includes instructions to distinguish between two potential distance measurements generated by the TOF sensor.21. The sensor device according to claim 15 , wherein the first sensor and the second sensor are TOF sensors.22. The sensor device according to claim 21 , wherein the circuitry is further configured to generate a dealiased ...

IMAGING APPARATUS, METHOD OF PROCESSING IMAGE, AND STORAGE MEDIUM

An apparatus includes an imaging element for obtaining a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels, and a processor for performing image processing on an image that is obtained by using the imaging element. The processor includes a first obtaining unit that obtains first shape information based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions, a second obtaining unit that obtains second shape information by using the plurality of parallax images, and a third obtaining unit that obtains third shape information by using the first shape information and the second shape information. 1. An apparatus comprising:an imaging element for obtaining a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels; anda processor for performing image processing on an image that is obtained by using the imaging element,wherein the processor includes a first obtaining unit that obtains first shape information of an object based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions, a second obtaining unit that obtains second shape information of the object by using the plurality of parallax images, and a third obtaining unit that obtains third shape information of the object by using the first shape information and the second shape information.2. The apparatus according to claim 1 ,wherein the first shape information is surface normal information, and the second shape information is distance information.3. The apparatus according to claim 1 ,wherein an area of the pupil through which light flux passes when an image that is included ...

IMAGE SENSORS AND SENSING METHODS TO OBTAIN TIME-OF-FLIGHT AND PHASE DETECTION INFORMATION

Indirect time-of-flight (i-ToF) image sensor pixels, i-ToF image sensors including such pixels, stereo cameras including such image sensors, and sensing methods to obtain i-ToF detection and phase detection information using such image sensors and stereo cameras. An i-ToF image sensor pixel may comprise a plurality of sub-pixels, each sub-pixel including a photodiode, a single microlens covering the plurality of sub-pixels and a read-out circuit for extracting i-ToF phase signals of each sub-pixel individually. 1. An image sensor pixel , comprising:a) a plurality of sub-pixels, each sub-pixel including a photodiode;b) a microlens covering the plurality of sub-pixels; andc) a read-out circuit (ROC) for extracting indirect time-of-flight (i-ToF) phase signals of each sub-pixel individually, wherein the image sensor pixel is an i-ToF image sensor pixel.2. The image sensor pixel of claim 1 , wherein the plurality of sub-pixels includes 2 sub-pixels.3. The image sensor pixel of claim 1 , wherein the plurality of sub-pixels includes 4 sub-pixels.4. The image sensor pixel of claim 1 , wherein each sub-pixel is a 4-tap pixel including 4 pulse generators.5. The image sensor pixel of claim 1 , wherein each sub-pixel is a 2-tap pixel including 2 pulse generators.6. The image sensor pixel of claim 1 , wherein the i-ToF image sensor pixel includes a switch claim 1 , wherein in one state the switch is closed so that the sub-pixels together form one pixel and the ROC reads out the one pixel for generating an i-ToF depth map claim 1 , and wherein in another state the switch is opened so that the ROC reads out the sub-pixels individually for generating a stereo depth map.7. The image sensor pixel of claim 1 , included in an image sensor of a camera having a focal length fin the range of 1.5 mm-10 mm.8. The image sensor pixel of claim 1 , included in an image sensor of a camera having a f number f/# in the range of 1-3.9. The image sensor pixel of claim 1 , included in an image ...

PROTECTIVE HEADGEAR WITH DISPLAY AND METHODS FOR USE THEREWITH

Protective headgear includes, for example, a headgear body that is wearable on a head of a baseball umpire. At least one sensor is configured to generate imaging data that includes a batter in proximity to home plate. A processor analyzes the imaging data to determine a strike zone of the batter and to generate augmented reality data in response thereto. A display device generates a heads up display of the strike zone that is viewable to the baseball umpire during a pitch to the batter, based on the augmented reality data. Other embodiments are disclosed. 1. Protective headgear comprising:a headgear body that is wearable on a head of a baseball umpire;at least one sensor, coupled to the headgear body, including at least one camera configured to generate imaging data that includes a visual image of a batter in proximity to home plate, wherein a uniform worn by the batter has pants and wherein the batter has a kneecap and shoulders; analyze the imaging data via a pattern recognition application to recognize a presence or absence of the batter in a batting stance;', 'analyze the imaging data via the pattern recognition application to determine a strike zone of the batter by identifying a region above the home plate between a bottom of the kneecap and a midpoint between a top of the pants and a top of the shoulders; and', 'generate augmented reality data that indicates the strike zone, only when the batter is in the batting stance;, 'a processor, coupled to the sensor, that operates in conjunction with a memory and is configured toa display device, coupled to the headgear body and the processor, configured to generate, based on the augmented reality data that indicates the strike zone, a heads up display of the strike zone that is viewable to the baseball umpire during a pitch to the batter.2. The protective headgear of wherein the at least one camera includes a plurality of cameras that generate a stereoscopic image of the batter.3. The protective headgear of wherein ...

SELF-STABILIZING SPHERICAL UNMANNED AERIAL VEHICLE CAMERA ASSEMBLY

A self-stabilizing spherical unmanned aerial vehicle (UAV) camera assembly, including: a stabilizer assembly; a plurality of motors coupled to the stabilizer assembly; a spherical camera mounting cage assembly disposed about and coupled to the stabilizer assembly; and a plurality of cameras coupled to the spherical camera mounting cage assembly. Preferably, the plurality of cameras include a plurality of stereoscopic cameras coupled to an exterior of the spherical camera mounting cage assembly. The self-stabilizing spherical UAV camera assembly is capable of taking/recording 360 degree×180 degree stereoscopic photo/video content. The self-stabilizing spherical UAV camera assembly can also be used with various real-time visualization and control technologies. 1. An Unmanned Aerial Vehicle (UAV) comprising:a mounting cage;a stabilizer assembly with a plurality of motors, wherein the stabilizer assembly is disposed within the mounting cage and connected to a center portion of the mounting cage such that roll, pitch, and yaw of the mounting cage are controlled based on position of the stabilizer assembly; andone or more cameras located on an exterior of the mounting cage.2. The UAV of claim 1 , wherein the stabilizer assembly connects to a central member connected to the mounting cage via an inner frame member and an outer frame member claim 1 , such that the inner frame member and the outer frame member rotate.3. The UAV of claim 1 , wherein the plurality of motors are coupled to the stabilizer assembly each via a correspond arm claim 1 , such that the roll claim 1 , pitch claim 1 , and yaw of the mounting cage are controlled based on control of associated motors.4. The UAV of claim 1 , wherein the mounting cage has associated wires disposed in or adjacent to associated members of the mounting cage.5. The UAV of claim 1 , wherein the stabilizer assembly is operable for rotating the spherical camera mounting cage assembly about a central axis with respect to the ...

MULTI-APERTURE IMAGING DEVICE, IMAGING SYSTEM AND METHOD FOR CAPTURING AN OBJECT AREA

Multi-aperture imaging device includes at least one image sensor, an array of juxtaposed optical channels, wherein each optical channel has optics for projecting at least one partial area of an object area on an image sensor area of the image sensor, and a beam deflector for deflecting an optical path of the optical channels in beam-deflecting areas of the beam deflector. The beam deflector is formed as an array of facets arranged along a line-extension direction of the array of optical channels. One facet is allocated to each optical channel. Each facet has a beam-deflecting area. A stray light suppressing structure is arranged between a first beam-deflecting area of a first facet and a second beam-deflecting area of a juxtaposed second facet, which is configured to reduce transition of stray light between the first beam-deflecting area and the second beam-deflecting area. 1. A multi-aperture imaging device comprising:at least one image sensor; andan array of juxtaposed optical channels, wherein each optical channel comprises optics for projecting at least one partial area of an object area on an image sensor area of the image sensor;a beam deflector for deflecting an optical path of the optical channels in beam-deflecting areas of the beam deflector;wherein the beam deflector is formed as an array of facets arranged along a line-extension direction of the array of optical channels and wherein one facet is allocated to each optical channel and wherein each facet comprises at least one beam-deflecting area;wherein a stray light suppressing structure is arranged between a first beam-deflecting area of a first facet and a second beam-deflecting area of a juxtaposed second facet, which is configured to reduce transition of stray light between the first beam-deflecting area and the second beam-deflecting area.2. The multi-aperture imaging device according to claim 1 , wherein the stray light suppressing structure is arranged on a main side of the beam deflector.3. The ...

INFORMATION PROCESSING APPARATUS, OBJECT RECOGNITION APPARATUS, DEVICE CONTROL SYSTEM, MOVABLE BODY, IMAGE PROCESSING METHOD, AND COMPUTER-READABLE RECORDING MEDIUM

According to an embodiment, an information processing apparatus includes a calculating unit and a discarding unit. The calculating unit is configured to calculate a distance between two objects, detected based on distance information on the objects that are overlapped in detection areas of the objects, in a depth direction in the detection areas. The discarding unit is configured to determine whether each of the two objects in the detection areas is to be discarded by using a method that corresponds to the distance calculated by the calculating unit. 1. An information processing apparatus comprising:a calculating unit configured to calculate a distance between two object, detected based on distance information on the objects that are overlapped in detection areas of the objects, in a depth direction in the detection areas; anda discarding unit configured to determine whether each of the two objects in the detection areas is to be discarded by using a method that corresponds to the distance calculated by the calculating unit.2. The information processing apparatus according to claim 1 , whereinthe calculating unit includes:a first calculating unit configured to calculate a distance between two objects, detected based on distance information on the objects, in a depth direction in detection areas of the objects;a second calculating unit configured to calculate an overlap size that is a size of an overlapped area with regard to the two detection areas by using a method that corresponds to the distance calculated by the first calculating unit; andthe discarding unit is configured to determine whether the objects in the detection areas is to be discarded in accordance with the overlap size calculated by using the method that corresponds to the distance.3. The information processing apparatus according to claim 2 , further comprising a determining unit configured to determine whether the distance calculated by the first calculating unit is included in a first distance ...

THREE-DIMENSIONAL (3D) DEPTH IMAGING SYSTEMS AND METHODS FOR DYNAMIC CONTAINER AUTO-CONFIGURATION

Three-dimensional (3D) depth imaging systems and methods are disclosed for dynamic container auto-configuration. A 3D-depth camera captures 3D image data of a shipping container located in a predefined search space during a shipping container loading session. An auto-configuration application determines a representative container point cloud and (a) loads an initial pre-configuration file that defines a digital bounding box having dimensions representative of the predefined search space and an initial front board area; (b) applies the digital bounding box to the container point cloud to remove front board interference data from the container point cloud based on the initial front board area; (c) generates a refined front board area based on the shipping container type; (d) generates an adjusted digital bounding box based on the refined front board area; and (e) generates an auto-configuration result comprising the adjusted digital bounding box containing at least a portion of the container point cloud. 1. A three-dimensional (3D) depth imaging system for dynamic container auto-configuration , the 3D depth imaging system comprising:a 3D-depth camera configured to capture 3D image data, the 3D-depth camera oriented in a direction to capture 3D image data of a shipping container located in a predefined search space during a shipping container loading session, the shipping container having a shipping container type; anda container auto-configuration application (app) configured to execute on one or more processors and to receive the 3D image data, the container auto-configuration app configured to determine, based on the 3D image data, a container point cloud representative of the shipping container,wherein the container auto-configuration app is further configured to execute on the one or more processors to:(a) load an initial a pre-configuration file corresponding to the predefined search space, the pre-configuration file defining a digital bounding box having ...

Methods and systems of spatiotemporal pattern recognition for video content development

A media system generally includes a memory device that stores an event datastore that stores a plurality of event records, each event record corresponding to a respective event and event metadata describing at least one feature of the event. The media system (a) receives a request to generate an aggregated clip comprised of one or more media segments, where each media segment depicts a respective event; (b) for each event record from at least a subset of the plurality of event records, determines an interest level of the event corresponding to the event record; (c) determines one or more events to depict in the aggregated clip based on the respective interest levels of the one or more events; (d) generates the aggregated clip based on the respective media segments that depict the one or more events; and (e) transmits the aggregated clip to a user device.

DEVICE FOR DETERMINING THE ATTENTIVENESS OF A DRIVER OF A VEHICLE, ON-BOARD SYSTEM COMPRISING SUCH A DEVICE, AND ASSOCIATED METHOD

A device () for determining a state of attentiveness of a driver of a vehicle () is disclosed. The device includes an image capture unit () onboard said vehicle (), said image capture unit () being suitable for capturing at least one image of a detection area (D) located in said vehicle (), and an image processing unit () suitable for receiving said captured image and programmed to determine the state of attentiveness of the driver (), according to the detection of the presence of a distracting object in one of the hands of the driver (), which hand being located in the detection area (D). 1. A device for determining a state of attentiveness of a driver of a vehicle comprising:an image capture unit onboard said vehicle, said image capture unit being capturing at least one image of a detection area located in said vehicle, andan image processing unit for receiving said captured image and programmed to determine the state of attentiveness of the driver, according to the detection of the presence of a distracting object in one of the hands of the driver, which hand being located in the detection area.2. The device as claimed in claim 1 , in which the image capture unit comprises at least one sensor for capturing a three-dimensional image of the detection area claim 1 , said three-dimensional image including information relating to the distance claim 1 , with respect to said sensor claim 1 , at least of said distracting object or of said hand located in the detection area.3. The device as claimed in claim 1 , in which the image capture unit comprises at least:a sensor for capturing at least one image of a first kind including a first type of information relating to said distracting object or to said hand located in the detection area, anda sensor for capturing at least one image of a second kind different from the first kind, including a second type of information relating to said distracting object or to said hand located in the detection area.4. The device as claimed ...

Image capture with a camera integrated display

Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display can include several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. A processor initiates light emission from a plurality of display elements. The processor can suspend the light emission from the plurality of display elements for a period of time imperceptible to a human observer. The processor initiates a camera to capture an image during the period of time the plurality of display elements are suspended. The processor can capture a plurality of images corresponding to a plurality of pixels and produce an image comprising depth information.

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD THEREOF AND STORAGE MEDIUM

An image processing apparatus, which executes image processing for generating a virtual viewpoint image using a plurality of images captured by a plurality of imaging units that image an imaging space from different viewpoints, identifies a specific object among a plurality of objects inside the imaging space, and carries out image processing for generating the virtual viewpoint image on the plurality of objects inside the imaging space. The image processing apparatus executes the image processing on the identified specific object using images captured by more imaging units than in the image processing executed on other objects. 1. An image processing apparatus that executes image processing for generating a virtual viewpoint image using a plurality of images captured by a plurality of imaging units that image an imaging space from different viewpoints , the apparatus comprising:an identification unit configured to identify a specific object among a plurality of objects inside the imaging space; anda processing unit configured to carry out image processing for generating the virtual viewpoint image on the plurality of objects inside the imaging space,wherein the processing unit executes the image processing on the specific object identified by the identification unit using images captured by more imaging units than in the image processing executed on other objects.2. The image processing apparatus according to claim 1 ,wherein the image processing executed by the processing unit is processing for generating a three-dimensional model of an object.3. The image processing apparatus according to claim 1 ,wherein the image processing executed by the processing unit is processing for rendering an image of an object from an arbitrary viewpoint.4. The image processing apparatus according to claim 1 , further comprising:a selecting unit configured to select the imaging units providing the images used in the image processing on the specific object and the imaging units ...

SYSTEM FOR UV STERILIZATION WITH INTEGRATED IMAGING AND REPORTING SYSTEM

System for sterilization which includes imaging device in register with a UV light to allow a user to visually see the surface sterilized and surfaces that are missed by displaying on a graphic user interface. 1. A real time system for sterilization of a substrate surface comprising:a) a UV light source with a UV emitter designed to paint the substrate surface with sterilizing UV light of a given area on the substrate surface when the UV light is shined on the substrate surface;b) an imaging device having a measuring laser, light, camera, or the like such that the imaging device creates data therefrom;c) a computer graphics program for converting the scanning device data into an image of the surface of the substrate that has been scanned; andd) a user interface for depicting the image of the surface of the substrate that has been scanned and creates data about the sterilization.2. The system according to wherein the UV light is polychromatic.3. The system according to wherein the UV light is at least one of UVA claim 1 , UVB claim 1 , and UVC.4. The system according to wherein the UV light source is selected from the group consisting of high pressure claim 1 , medium pressure claim 1 , low pressure claim 1 , or LED lamp.5. The system according to wherein the UV emitter is a light guide with a wand type emitter.6. The system according to wherein exposure period claim 1 , UV light energy claim 1 , distance to substrate claim 1 , and time to completion are reported with the image.7. The system according to wherein the user interface is a computer graphic user interface.8. The system according to wherein the imaging device is a 3D imager.9. A method of sterilizing a substrate surface with UV light comprising:a) selecting a UV light source with a UV emitter designed to paint the substrate surface with sterilizing UV light of a given area on the substrate surface;b) selecting an imaging device which when sterilizing the substrate surface with the UV light source is being ...

CRANE CONTROL COMPRISING A VISUALISATION APPARATUS

A crane control for a crane includes a visualization apparatus which is adapted to visualize a camera image having depth information of a working environment of the crane for an operator of the crane control. The visualization apparatus is configured to display in a representation overlying the camera image a graphic auxiliary representation visualizing a dimension which can be recognized per se in the camera image, and the visualization apparatus includes a display device which displays the stereoscopically visualized camera image together with the overlying graphic auxiliary representation. 15. A crane control for a crane comprising a visualization apparatus which is adapted to visualize a camera image having depth information of a working environment of the crane for an operator of the crane control , characterised in that the visualization apparatus is configured to display in a representation overlying the camera image a graphic auxiliary representation visualizing a dimension which can be recognized per se in the camera image and the visualization apparatus includes a display device which displays the stereoscopically visualized camera image together with the overlying graphic auxiliary representation ().2. The crane control according to claim 1 , wherein the display device is in the form of virtual reality goggles or a 3D display screen.3. The crane control according to claim 1 , wherein the graphic auxiliary representation visualizes a spacing of a predeterminable or predetermined working part of the crane in relation to a predeterminable or predetermined reference object in the working environment of the crane.4. The crane control according to claim 3 , wherein the graphic auxiliary representation includes a warning representation which is visualized when the spacing between the predeterminable or predetermined working part of the crane and the predeterminable or predetermined reference object is below a predeterminable value.5. The crane control according ...

DYNAMIC STRUCTURED LIGHT FOR DEPTH SENSING SYSTEMS BASED ON CONTRAST IN A LOCAL AREA

A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements. 1. A depth camera assembly (DCA) comprising:a structured light (SL) projector configured to project one or more SL patterns into a local area in accordance with illumination instructions;a camera assembly configured to capture images of a portion of the local area including the one or more SL patterns; and provide first illumination instructions to the SL projector, wherein the first illumination instructions cause the SL projector to project a first SL pattern having a first pattern element density into a first region of interest based on a first amount of contrast in the first region of interest; and', 'provide second illumination instructions to the SL projector, wherein the second illumination instructions cause the SL projector to project a second SL pattern having a second pattern element density into a second region of interest based on a second amount of contrast in the second region of interest, wherein the second amount of contrast is greater than the first amount of contrast., 'a controller configured to2. The DCA of claim 1 , ...