SYSTEM AND METHOD FOR GENERATING COMBINED EMBEDDED MULTI-VIEW INTERACTIVE DIGITAL MEDIA REPRESENTATIONS

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view. 1. A method for automatic generation of a multi-view interactive digital representation (MIDMR) recording , the method comprising:obtaining a first MIDMR, wherein the first MIDMR includes a convex or concave motion capture using a recording device, wherein the first MIDMR is a general object MIDMR;obtaining a second MIDMR, wherein the second MIDMR is a specific feature MIDMR; andgenerating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR.2. The method of claim 1 , wherein the combined embedded MIDMR comprises the second MIDMR being embedded in the first MIDMR claim 1 , thereby forming an embedded second MIDMR.3. The method of claim 2 , wherein the third MIDMR includes a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device.4. The method of claim 3 , wherein the embedded second MIDMR is not available for viewing in the general view.5. The method of claim 4 , wherein the general ...

Three-dimensional scene reconstruction from set of two dimensional images for consumption in virtual reality

To enable better sharing and preservation of immersive experiences, a graphics system reconstructs a three-dimensional scene from a set of images of the scene taken from different vantage points. The system processes each image to extract depth information therefrom and then stitches the images (both color and depth information) into a multi-layered panorama that includes at least front and back surface layers. The front and back surface layers are then merged to remove redundancies and create connections between neighboring pixels that are likely to represent the same object, while removing connections between neighboring pixels that are not. The resulting layered panorama with depth information can be rendered using a virtual reality (VR) system, a mobile device, or other computing and display platforms using standard rendering techniques, to enable three-dimensional viewing of the scene.

Matching segments of video for virtual display of a space

Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.

DREIDIMENSIONALE-FORM-MESSVORRICHTUNG, DREIDIMENSIONALE-FORM-MESSVERFAHREN, DREIDIMENSIONALE-FORM-MESSPROGRAMM, COMPUTERLESBARES DREIDIMENSIONALE-FORM-MESSEN-SPEICHERMEDIUM UND COMPUTERLESBARE DREIDIMENSIONALE-FORM-MESSEN-SPEICHEREINRICHTUNG

Eine Dreidimensionale-Form-Messvorrichtung (500) umfasst: eine Bühne (140) mit einem Translationsbühnenteil (141), der eine Platzierungsfläche (142), auf der ein Messobjekt (WK) platziert wird, umfasst und die Platzierungsfläche (142) verschieben kann; eine Beleuchtungseinrichtung (110), die eine Vielzahl von unabhängig steuerbaren und zweidimensional angeordneten Projektionseinrichtungen enthält und das auf der Bühne (140) platzierte Messobjekt (WK) mit einem Messlicht beleuchtet, das ein vorbestimmtes Projektionsmuster mit alternierenden hellen und dunklen Intervallen aufweist; einen Photorezeptor (120), der das von dem durch die Beleuchtungseinrichtung (110) beleuchteten Messobjekt (WK) reflektierte Licht empfängt und ein Projektionsmusterbild erzeugt; und eine Bewegungssteuereinrichtung (144), die die Translationsbewegung des Translationsbühnenteils (141) mit einem Bewegungsinkrement, das kleiner als die minimale Breite des auf die Bühne (140) projizierten Projektionsmusters ist, steuert ...

Real-scene roaming method based on building information model

OPTICAL MEASURING METHOD AND OPTICAL MEASURING DEVICE

Occupant support

A seat for an occupant in a vehicle with limited space in the axial direction of the vehicle, configured to support the occupant in a sitting position and a recline position including a recline position with a downward sloping seat bottom to allow a greater level of recline of the seat and baggage storage in drawer.

Aerial image acquisition method and system for investigating traffic accident site by unmanned aerial vehicle

Disclosed are an aerial image acquisition method and a system for investigating a traffic accident site by an unmanned aerial vehicle. The method comprises selecting a corresponding unmanned aerial vehicle low-altitude shooting scheme of traffic accident site according to whether three-dimensional site reconstruction or site animation simulation is needed; selecting and calculating shooting parameters of the unmanned aerial vehicle according to the unmanned aerial vehicle low-altitude shooting scheme selected; and shooting the traffic accident site according to the unmanned aerial vehicle low-altitude shooting scheme selected and the shooting parameters of the unmanned aerial vehicle, to obtain an aerial image sequence of the traffic accident site.

SYSTEM AND METHOD FOR SUPPORTING THREE-DIMENSIONAL DISPLAY IN FIRST PERSON VIEW (FPV)

System and method can support three-dimensional display. The system can receive a plurality of image frames, which are captured by an imaging device on a movable object. Furthermore, the system can obtian state information of the image device on the movable object, and use the state information to configure a pair of image frames based on the plurality of image frames for supporting a three-dimensional first person view (FPV). Additionally, an image frame selected from the plurality of image frames can be used for a first image in the pair of image frames.

SCANNING MICROSCOPE FOR 3D IMAGING USING MSIA

According to some examples, an instrument for scanning a specimen on a specimen holder. The instrument includes a scanning stage for supporting the specimen, and a detector having a plurality of pixels. The scanning stage and the detector are movable relative to each other to move the specimen in a scan direction during a scan. At least some of the pixels of the detector are operable to collect light from different depths inside the specimen during the scan and generate corresponding image data. The instrument also includes a processor operable to perform MSIA on the image data to generate a 3D image of the specimen.

SYSTEM AND METHOD FOR GENERATING AND OUTPUTTING STEREOSCOPIC VIDEO FILMS

METHOD AND APPARATUS FOR SCANNING AND PRINTING A 3D OBJECT

A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display. Additional techniques include processing and formatting of the three-dimensional representation data to be printed by a three-dimensional printer so a three-dimensional model of the object may be formed. 125-. (canceled)26. A portable electronic device , comprising:a camera configured to acquire a plurality of image frames;one or more inertial sensors configured to acquire a plurality of inertial data, each of the plurality of inertial data being associated with an image frame of the plurality of image frames; obtain a global depth map from at least one computer-readable medium;', determine a first local depth map based on at least the first image frame and the first inertial data;', 'conditionally merge the first local depth map with the global depth map to form a combined depth map; and', 'calculate a surface based on the combined depth map,, 'for a first image frame of the plurality of image frames and a first inertial data of the plurality of inertial data, 'wherein the at least one processor is further configured to store the surface as a three-dimensional file., 'at least one ...

According to the 1st for support person vision (FPV) of the three-dimensional display system and method

CONTROL DEVICE AND MASTER SLAVE SYSTEM

Provided is a control device including a control unit that calculates a first positional relationship between an eye of an observer observing an object displayed on a display unit and a first point in a master-side three-dimensional coordinate system, and controls an imaging unit that images the object so that a second positional relationship between the imaging unit and a second point corresponding to the first point in a slave-side three-dimensional coordinate system corresponds to the first positional relationship. 1. A control device comprising a control unit that:calculates a first positional relationship between an eye of an observer observing an object displayed on a display unit and a first point in a master-side three-dimensional coordinate system; andcontrols an imaging unit that images the object so that a second positional relationship between the imaging unit and a second point corresponding to the first point in a slave-side three-dimensional coordinate system corresponds to the first positional relationship.2. The control device according to claim 1 , wherein the control unit:acquires information regarding a first observation direction of the eye of the observer with respect to the first point in the master-side three-dimensional coordinate system; andcontrols a second observation direction of the imaging unit with respect to the second point so that the second observation direction corresponds to the first observation direction in the slave-side three-dimensional coordinate system.3. The control device according to claim 2 , whereinthe control unit controls the second observation direction so that the second observation direction and the first observation direction are substantially the same.4. The control device according to claim 3 , whereinthe control unit controls the second observation direction so that an angle of the first observation direction with respect to a gravity direction and an angle of the second observation direction with respect to ...

METHOD AND SYSTEM FOR SIMULATING A 3-DIMENSIONAL IMAGE SEQUENCE

A method for simulating a 3-D image sequence from a sequence of 2-D image frames (110), the method comprising: capturing a plurality of 2-D image frames (110) of a scene from a plurality of different observation points, wherein a first, proximal plane and a second, distal plane is identified within each image frame (110) in the sequence, and wherein each observation point maintains substantially the same first, proximal image plane for each image frame; determining a depth estimate for the first, proximal and second, distal plane within each image frame in the sequence; aligning the first, proximal plane of each image frame (110) in the sequence and shifting the second, distal plane of each subsequent image frame (110) in the sequence based on the depth estimate of the second, distal plane for each image frame (110), to produce a modified image frame corresponding to each 2-D image frame; and displaying the modified image frames sequentially. Also disclosed is a system comprising means ...

DEVICE AND METHOD FOR ASSISTING IN 3D SCANNING A SUBJECT

METHOD FOR PROVIDING INTERFACE FOR ACQUIRING IMAGE OF SUBJECT, AND ELECTRONIC DEVICE

An electronic device includes a sensor that detects movement of the electronic apparatus, a camera photographing an external object to the apparatus, a display outputting an image corresponding to the external object to the apparatus, and a processor being electrically connected to the display. The processor obtains a first image of a part of the external object to the apparatus through the camera, wherein the obtaining of the first image includes identifying a first position of the electronic apparatus with respect to the external object to the apparatus using the sensor, determines a movement path of the electronic apparatus from the first position to a second position capable of obtaining a second image to generate a stereoscopic image of the external object to the apparatus with the first image, and outputs a virtual path corresponding to the movement path through the display. 1. An electronic apparatus comprising:a sensor configured to detect movement of the electronic apparatus;a camera configured to photograph an external object to the apparatus;a display configured to output an image corresponding to the external object to the apparatus; anda processor configured to be electrically connected to the display,wherein the processor is configured to:obtain a first image of a part of the external object to the apparatus through the camera, wherein the obtaining of the first image includes identifying a first position of the electronic apparatus with respect to the external object to the apparatus using the sensor;determine a movement path of the electronic apparatus from the first position to a second position capable of obtaining a second image to generate a stereoscopic image of the external object to the apparatus with the first image; andoutput a virtual path corresponding to the movement path through the display.2. The electronic apparatus of claim 1 , wherein the processor is configured to:determine the virtual path based on the movement path and the ...

DEVICE AND METHOD FOR OPTICAL ACQUISITION OF THREE-DIMENSIONAL SURFACE GEOMETRIES

In a device and a method for optical acquisition of three-dimensional surface geometries with a handpiece (), with the handpiece () having one or more means () for output of status reports, at least one means () for output of status reports is a means () for generating oscillations that outputs haptically perceptible status reports. 111222. Device for optical acquisition of three-dimensional surface geometries with a handpiece () , the handpiece () having one or more means () for output of status reports , wherein at least one means () for output of status reports is a means () for generating oscillations.212. Device according to claim 1 , wherein in the handpiece () claim 1 , two or more means () for generating oscillations are arranged spatially offset claim 1 , in particular diagonally to one another and/or opposite one another.3122. Method for optical acquisition of three-dimensional surface geometries with a handpiece claim 1 , the handpiece () having one or more means () for output of status reports claim 1 , wherein at least one means () outputs status reports as haptic signals by oscillations.4. Method according to claim 3 , wherein the haptic signals are output when the quality of recording exceeds or falls below a given threshold value.52. Method according to claim 3 , wherein different spatially offset means () for output of haptic signals oscillate with different intensity and/or staggered in time in order to output direction information.6. Method according to claim 3 , wherein acquisition takes place in different operation states and wherein when the operation state changes claim 3 , the output haptic signal changes.71. Method according to claim 3 , wherein acquisition takes place in at least two defined physical regions in which the handpiece () can be located claim 3 , and wherein the output haptic signal changes when the region in which the handpiece is located changes.8. Method according to claim 3 , wherein the handpiece executes a movement during ...

Augmented reality camera for use with 3D metrology equipment in forming 3D images from 2D camera images

A method uses a two-dimensional (2D) camera in two different positions to provide first and second 2D images having three common cardinal points. It further uses a three-dimensional (3D) measuring device to measure two 3D coordinates. The first and second 2D images and the two 3D coordinates are combined to obtain a scaled 3D image.

Methods and systems for camera calibration

An image capture method may include obtaining two or more sets of images. The two or more sets of images may include a first image captured by a first image capture device and a second image captured by a second image capture device. The method may also include determining, for a set of images, two or more pairs of points. Each of the two or more pairs of points may include a first point in the first image and a second point in the second image, and the first point and the second point may correspond to a same object. The method may also include determining a first rotation matrix based on the pairs of points in the two or more sets of images. The first rotation matrix may be associated with a relationship between positions of the first image capture device and the second image capture device.

Tracking-distance-measuring system for torso tracking and method thereof

A tracking-distance-measuring system capable of tracking a torso object is provided. The tracking-distance-measuring system includes: an image sensor, a controller, a distance-measuring device, and an actuator device. The image sensor is configured to capture an input image. The controller is configured to analyze the input image to recognize a torso object from the input image, and calculate an offset distance between a center of the torso object and a central axis of the input image. The actuator device is configured to carry the distance-measuring device. The controller controls the actuator device to calibrate an offset angle between the distance-measuring device and the recognized torso object according to the offset distance. In response to calibrating the offset angle, the distance-measuring device emits energy and receives reflected energy to detect an object distance of the torso object.

IMAGE GENERATION APPARATUS AND IMAGE GENERATION METHOD

A position and posture acquisition unit of an image generation apparatus acquires position information relating to a view point of a user. A viewscreen setting unit sets a viewscreen. An original image operation unit calculates a correction amount for a pixel from a parallax value of each pixel of an original image and an amount of movement of the view point such that an object looks fixed, and generates, for each of left and right view points, an image reference vector map in which an image reference vector that refers to the position before correction from coordinates of each pixel after correction is stored for each pixel. Along with this, depending upon the view point, the reference destination is set to an original image from a different view point. A display image generation unit refers to an original image on the basis of the image reference vector corresponding to each pixel of the viewscreen to determine a color value. An outputting unit outputs a display image. 1. An image generation apparatus that uses an original image acquired from a plurality of view points to generate an image that allows stereoscopic viewing of an object , comprising:an original image operation unit configured to calculate a displacement to be generated for each pixel of the original image in response to movement of a view point of a user and generate, for each of left and right view points, a vector map in which reference vectors for referring to positions before the displacement on the original image from pixel center positions after the displacement are lined up on an image plane after the displacement;a display image generation unit configured to determine, based on the reference vector at a position on the vector map corresponding to each pixel of a display image, a color value of the display pixel by referring to color values around a corresponding position on the original image, to generate display images corresponding to the left and right view points; andan outputting unit ...

System and method for three dimensional object reconstruction and quality monitoring

A system and method is provided for accurately reconstructing a three-dimensional object using depth maps. An exemplary method includes detecting different positions of an object in a multiple image frames and generating depth maps for the object from the images frames based on the detected different positions of the object. Moreover, the method includes fusing the generated depth maps to generate a three-dimensional model of the object, calculating a variance of points of the fused depth maps for the object, and obtaining respective variances of points of a statistical value prior that correspond to the points of the fused depth maps. Finally, the method calculates a quality fitting result of the generated three-dimensional model of the object based on the calculated variance of the points of the fused depth maps and the respective variances of the corresponding points of the statistical value prior.

EXTRINSIC CALIBRATION OF IMAGING SENSING DEVICES AND 2D LIDARS MOUNTED ON TRANSPORTABLE APPARATUS

Methods and apparatuses for forming a three-dimensional volumetric model of a subject's teeth

Methods and apparatuses for generating a model of a subject's teeth. Described herein are intraoral scanning methods and apparatuses for generating a three-dimensional model of a subject's intraoral region (e.g., teeth) including both surface features and internal features. These methods and apparatuses may be used for identifying and evaluating lesions, caries and cracks in the teeth. Any of these methods and apparatuses may use minimum scattering coefficients and/or segmentation to form a volumetric model of the teeth.

OMNISTEREO CAPTURE FOR MOBILE DEVICES

DREIDIMENSIONALE-FORM-MESSVORRICHTUNG UND DREIDIMENSIONALE-FORM-MESSVERFAHREN

Eine Dreidimensionale-Form-Messvorrichtung (500), die eine dreidimensionale Form eines Messobjekts (WK) misst, umfasst: eine Bühne (140) mit einer Platzierungsfläche (142), auf der ein Messobjekt (WK) platziert wird; eine Beleuchtungseinrichtung (110), die das auf der Bühne (140) platzierte Messobjekt (WK) mit einem Beleuchtungslicht mit einem vorbestimmten Muster beleuchtet; einen Photorezeptor (120), der das von dem durch die Beleuchtungseinrichtung beleuchteten Messobjekt (WK) reflektierte Licht empfängt und Lichtempfangssignale, die eine Lichtempfangsmenge wiedergeben, vorsieht; eine Montageeinrichtung (600), die die Bühne hält (140); eine Fixierungseinrichtung (125), die mit der Montageeinrichtung gekoppelt ist und die Beleuchtungseinrichtung (110) und den Photorezeptor (120) fixiert, um einen mit dem Messlicht zu beleuchtenden Messbereich über der Bühne zu erzeugen und die optischen Achsen der Beleuchtungseinrichtung (110) und des Photorezeptors (120) in Bezug auf die Platzierungsfläche ...

OPTICAL DEVICE AND METHOD FOR EXAMINING AN OBJECT

The present invention relates to an optical device for examining an object (16), comprising: a housing (24); an optical unit (26), arranged in the housing (24), for incident light; a sensor unit (28) having at least one image sensor (30, 32) arranged in the housing (24); a data processing unit (34) which is coupled to the sensor unit (28) and evaluates image signals from the at least one image sensor (30, 32); an illumination unit (42), arranged at least partially on or in the housing (24), for emitting grid light toward the object (16), wherein: by means of grid light reflected by the object (16) and reference light inside the housing, a three-dimensional point grid and associated reference datasets indicative of lateral information and depth information are provided using digital optical holography; by means of the device (10; 100; 120; 140), a relative movement of the device (10; 100; 120; 140) and the objective (16) is sensed, and associated movement information in the lateral and/or ...

ENDOSCOPIC IMAGE PROCESSING APPARATUS, ENDOSCOPE SYSTEM, AND METHOD OF OPERATING ENDOSCOPIC IMAGE PROCESSING APPARATUS

An endoscopic image processing apparatus is configured to create a three-dimensional shape model of an object by performing processing on an endoscopic image group of an inside of the object, and includes a processor. The processor estimates a self-position of the image pickup device based on the endoscopic image group, calculates a first displacement amount corresponding to a displacement amount of the image pickup device based on an estimation result of the self-position of the image pickup device obtained by the estimation, calculates a second displacement amount corresponding to a displacement amount in a direction parallel to a longitudinal axis direction of the insertion portion, based on a detection signal outputted from an insertion/removal state detection device that detects an insertion/removal state of an insertion portion inserted into the object, and generates scale information in which the first displacement amount and the second displacement amount are associated with each other. 1. An endoscopic image processing apparatus configured to create a three-dimensional shape model of an object by performing processing on an endoscopic image group obtained by causing an image pickup device provided at a distal end portion of an elongated insertion portion to pick up images of an inside of the object ,the endoscopic image processing apparatus comprising a processor,the processorestimating a self-position of the image pickup device based on the endoscopic image group,calculating a first displacement amount corresponding to a displacement amount of the image pickup device based on an estimation result of the self-position of the image pickup device obtained by the estimation,calculating a second displacement amount corresponding to a displacement amount in a direction parallel to a longitudinal axis direction of the insertion portion, based on a detection signal outputted from an insertion/removal state detection device that detects an insertion/removal state ...

Portrait image synthesis from multiple images captured on a handheld device

A hand-held digital image capture device (digital camera) has a user-selectable mode in which upon engaging the mode the device detects a face in the field of view of the device and generates a face delimiter on a camera display screen, the delimiter surrounding the initial position of the image of a the face on the screen. The device is arranged to indicate thereafter to the user if the device departs from movement along a predetermined concave path P with the optical axis of the device pointing towards the face, such indication being made by movement of the image of the face relative to the delimiter. The camera captures and stores a plurality of images at successive positions along the concave path.

DEVICE FOR DETECTING A THREE-DIMENSIONAL STRUCTURE

The invention relates to a device for detecting a three-dimensional structure, comprising an imaging device, especially a camera, which is adjustable in the z-direction, a control device which is designed to record an image of a first plane and, after adjustment of the imaging device in the z-direction, to record an image of a second plane, and an evaluation device which is designed to interpolate a sub-plane between the first plane and the second plane.

For generating 3 D panoramic Image of the Image generating apparatus and method

3-DIMENSIONAL FACE MEASURING APPARATUS

METHOD AND APPARATUS FOR GROSS-LEVEL USER AND INPUT DETECTION USING SIMILAR OR DISSIMILAR CAMERA PAIR

An information handling system includes a RGB digital camera and a secondary digital camera that can be any type of two-dimensional or three-dimensional digital camera known in the art and a processor. The processor executes code instructions of a gross-level input detection system to detect objects in images taken contemporaneously by the RGB digital camera and the secondary digital camera using object detection techniques, and to calculate the positions of regions of interest within those objects. Further, the processor executes code instructions to detect the orientation of regions of interest within identified objects, and to associate those orientations, changes in orientations, or movement of regions of interest with user commands.

비전 시스템에 대한 캘리브레이션

... 런-타임 3D 캘리브레이션을 수행할 수 있는 비전 시스템은, 대상을 유지하도록 구성된 마운트로서, 3D 캘리브레이션 구조를 포함하는 마운트; 카메라; 상기 마운트 또는 상기 카메라와 결합되는 모션 스테이지; 및 작동을 수행하도록 구성된 컴퓨팅 장치를 포함하며, 상기 작동은: 상기 마운트가 상기 카메라에 대해 각각의 미리 결정된 방향에 있을 때, 상기 카메라로부터 이미지를 획득하는 것으로서, 상기 획득된 이미지 각각은 동시에 상기 카메라의 시야에 있는 상기 대상의 적어도 일 부분과 상기 3D 캘리브레이션 구조의 적어도 일 부분의 표현을 포함하며; 상기 획득된 이미지에서 이미징된 상기 3D 캘리브레이션 구조에 관한 정보에 기초하여, 상기 획득된 이미지 각각에 대한 3D 캘리브레이션의 적어도 조정을 수행하는 것; 그리고, 상기 대상의 하나 이상의 특징부의 3D 위치, 치수, 또는 양자 모두를 결정하는 것을 포함한다.

2D DIGITAL IMAGE CAPTURE SYSTEM AND SIMULATING 3D DIGITAL IMAGE SEQUENCE

A system to capture a plurality of two dimensional digital source images of a scene by a user, including a smart device having a memory device for storing an instruction, a processor in communication with the memory and configured to execute the instruction, a plurality of digital image capture devices in communication with the processor and each image capture device configured to capture a digital image of the scene, the plurality of digital image capture devices positioned linearly in series within approximately an interpupillary distance, wherein a first digital image capture devices is centered proximate a first end of the interpupillary distance, a second digital image capture devices is centered on a second end of the interpupillary distance, and any remaining the plurality of digital image capture devices are evenly spaced therebetween, and a display in communication with the processor, the display configured to display a multidimensional digital image sequence.

IMAGING SYSTEM FOR OBJECT RECOGNITION AND ASSESSMENT

A method and system for using one or more sensors configured to capture two-dimensional and/or three dimensional image data of one or more objects. In particular, the method and system combine one or more digital sensors with visible and near infrared illumination to capture visible and non-visible range spectral image data for one or more objects. The captured spectral image data can be used to separate and identify the one or more objects. Additionally, the three-dimensional image data can be used to determine a volume for each of the one or more objects. The identification and volumetric data for one or more objects can be used individually or in combination to obtain characteristics about the objects. The method and system provide the user with the ability to capture images of one or more objects and obtain related characteristics or information about each of the one or more objects. 1. A method for automated detection and processing of a plate of food for nutritional values , the method comprising:detecting, by at least one sensor, edges of the plate of food based on a depth of the plate of food in relation to other objects in a field of view;capturing, by the at least one sensor, a three-dimensional model of the plate of food;capturing, by the at least one sensor, image data for the plate of food, the image data comprising a visible light image and at least one near-infrared (NIR) image of the plate of food;transforming, by a processor, the image data into a composite image, the composite image mimicking a single image taken by a single sensor;identifying, by a processor, a food item that corresponds to the composite image;transforming, by a processor, the three-dimensional model of the identified food item into a volume for the identified food item; andcalculating, by a processor, dietary information of the identified food item based on the volume of the food item.2. The method of claim 1 , further comprising:determining an initial volume of the identified ...

Building a depth map using movement of one camera

A method for building a depth map is operable on a mobile device having a single camera integrated therewith. The method includes capturing a plurality of images of a given view using movement of the mobile device between images, capturing data regarding the movement of the mobile device during capture of the plurality of images, determining a relative position of the mobile device corresponding to each of the plurality of images, and building a depth map using the plurality of images and the relative position corresponding to each of the plurality of images.

Forensic video exploitation and analysis tools

Described herein are systems and methods for locating an object detected in a video. The system detects a bounding box at least partially around an object in a first frame at a first time in the video and a second frame in the video corresponding to a second time. The system determines whether there is no motion within the bounding box of the second frame. The system compares edge information, or color information, or intensity information associated with one or more pixels in the first frame, to edge information, or color information, or intensity information associated with one or more pixels within the bounding box. The system generates a score based on the comparison. The system further determines based on the score if the object is present in the second frame. The system also determines an estimated timeframe window of a first appearance of the object.

SYSTEM AND METHOD FOR SUPPORTING THREE-DIMENSIONAL DISPLAY IN FIRST PERSON VIEW (FPV)

DIGITAL MULTI-DIMENSIONAL IMAGE PHOTON PLATFORM SYSTEM AND METHODS OF USE

Camera module and mobile terminal including the same

SYSTEM AND METHOD OF DETERMINING A VIRTUAL CAMERA PATH

A computer-implemented system and method of determining a virtual camera path. The method comprises determining an action path in video data of a scene, wherein the action path includes at least two points, each of the two points defining a three-dimensional position and a time in the video data; and selecting a template for a virtual camera path, the template camera path including information defining a template camera path with respect to an associated template focus path. The method further comprises aligning the template focus path with the determined action path in the scene and transforming the template camera path based on the alignment to determine the virtual camera path.

NAVIGATING AMONG IMAGES OF AN OBJECT IN 3D SPACE

A three-dimensional model of an object is employed to aid in navigation among a number of images of the object taken from various viewpoints. In general, an image of an object such as a digital photograph is displayed in a user interface or the like. When a user selects a point within the display that corresponds to a location on the surface of the object, another image may be identified that provides a better view of the object. In order to maintain user orientation to the subject matter while navigating to this destination viewpoint, the display may switch to a model view and a fly-over to the destination viewpoint may be animated using the model. When the destination viewpoint is reached, the display may return to an image view for further inspection, marking, or other manipulation by the user. 1. A method of navigating among a number of images taken of an object , the method comprising:displaying a first image of an object, the first image selected from a number of images taken of the object, the first image showing a surface of the object from a first viewpoint;receiving a selection of a location on the surface of the object;selecting a second image of the object from the number of images taken of the object, the second image selected to provide an improved view of the location on the surface of the object from a second viewpoint;rendering an animation of a spatial transition from the first viewpoint to the second viewpoint using a three-dimensional model of the object;displaying the animation; anddisplaying the second image upon reaching the second viewpoint in the animation.2. The method of wherein receiving the selection of the location includes receiving the selection from within a graphical user interface.3. The method of wherein receiving the selection includes at least one of a mouse input and a touch screen input.4. The method of wherein the three-dimensional model includes a texture map that is derived from at least one image of the number of images.5. ...

SYSTEM AND METHOD FOR DEPTH ESTIMATION USING A MOVABLE IMAGE SENSOR AND ILLUMINATION SOURCE

Depth estimation may be performed by a movable illumination unit, a movable image sensing unit having a fixed position relative to the illumination unit, a memory, and one or more processors coupled to the memory. The processors read instructions from the memory to perform operations including receiving a reference image and a non-reference image from the image sensing unit and estimating a depth of a point of interest that appears in the reference and non-reference images. The reference image is captured when the image sensing unit and the illumination unit are located at a first position. The non-reference image is captured when the image sensing unit and the illumination unit are located at a second position. The first and second positions are separated by at least a translation along an optical axis of the image sensing unit. Estimating the depth of the point is based on the translation. 1. A system , comprising:a movable illumination unit;a movable image sensing unit having a fixed position relative to the movable illumination unit;a memory; receiving a reference image from the movable image sensing unit, the reference image being captured when the movable image sensing unit and the movable illumination unit are located at a first position;', 'receiving a non-reference image from the movable image sensing unit, the non-reference image being captured when the movable image sensing unit and the movable illumination unit are located at a second position, the second position being separated from the first position by at least a translation along an optical axis of the movable image sensing unit; and', 'estimating a depth of a point of interest that appears in the reference and non-reference images based on the translation along the optical axis of the movable image sensing unit., 'one or more processors coupled to the memory and configured to read instructions from the memory to cause the system to perform operations comprising2. The system of claim 1 , wherein the ...

Omni-directional stereo capture for mobile devices

Augmented reality image display method, device and equipment

The embodiment of the invention provides an augmented reality image display method, device and equipment, and the method comprises the steps: obtaining a figure image collected by a figure camera module, and determining the relative positions of human eyes and the figure camera module through the relation between a human eye region in the figure image and an image where the human eye region is located; determining human eye position information at least based on the relative positions of the human eyes and the figure camera module and the position information of the scene camera module; taking the human eye position information as position information of a scene camera module in rendering parameters, rendering the three-dimensional model to obtain a projection image projected on the display screen, so that the augmented reality display content is changed from the projection image of the visual angle of the camera module to the projection image of the visual angle of the human eye, and the ...

ACTUATOR ASSEMBLIES AND METHODS OF CONTROLLING THE SAME

An actuation assembly comprising: a support structure; a movable element movable relative to the support structure, the movable element having a principal axis; and an actuator arrangement for driving movement of the movable element with respect to the support structure, wherein said movement includes rotational movement of the movable element about an axis which is perpendicular to said principal axis and does not pass through the centre of the movable element, and wherein said movement also includes translational movement of the movable element in a direction perpendicular to the principal axis. The actuation assembly may be used to perform optical image stabilisation or to improve the performance of a 3D sensing system. 1. An actuation assembly comprising:a support structure;a movable element movable relative to the support structure, the movable element having a principal axis; andan actuator arrangement for driving movement of the movable element with respect to the support structure, wherein said movement includes rotational movement of the movable element about an axis which is perpendicular to said principal axis and does not pass through the centre of the movable element, and wherein said movement also includes translational movement of the movable element in a direction perpendicular to the principal axis.2. The actuation assembly according to claim further comprising a control circuit configured to:control the actuator arrangement to drive movement of the movable element relative to the support structure;translate the movable element in a direction perpendicular to the principal axis; androtate the movable element about the axis perpendicular to the principal axis that does not pass through the center of the movable element.3. (canceled)4. The actuation assembly as claimed in claim 2 , wherein the control circuit is arranged to rotate the movable element after the translation.5. The actuation assembly according to claim 1 , further comprising a suspension ...

3-DIMENSIONAL FACE MEASURING APPARATUS

METHOD AND APPARATUS FOR DETERMINING STEREOSCOPIC MULTIMEDIA INFORMATION

DEVICE AND METHOD FOR ASSISTING IN 3D SCANNING A SUBJECT

A device or assisting in performing a 3D scan of a subject includes a camera structured to capture an image of the subject, an indication device structured to provide an indication, and a processing unit structured to determine a difference between a location of the camera and a desired location of the camera based on the captured image and to control the indication device to provide the indication based on the difference between the location of the camera and the desired location of the camera.

ROBOT-BASED 3D PICTURE SHOOTING METHOD AND SYSTEM, AND ROBOT USING THE SAME

The present disclosure provides a robot-based 3D picture shooting method and system and a robot using the same. The method includes: obtaining a distance between a photographed object and the photographing device of the robot based on a received shooting instruction; calculating an inter-axis distance based on the distance; obtaining the first picture after moving the robot for half of the inter-axis distance along the movement direction; obtaining the second picture after moving the robot for entire of the inter-axis distance from a current position along an opposite direction of the movement direction; and synthesizing the first picture and the second picture to obtain a 3D picture of the photographed object. In the process, the robot moves the photographing device according to the calculated inter-axis distance, and obtains two pictures of the left and right of the photographed object, which is not necessary to use a binocular camera.

DIRECTED IMAGE CAPTURE

Systems and methods are disclosed for directed image capture of a subject of interest, such as a physical building. Directed image capture can produce higher quality images such as content more centrally located within an image frame (or an associated viewing device or other display), higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) overlaid within an image frame can facilitate quality assessments for the content or the image frame itself, such as for pixel distance of the subject of interest to a centroid of the image frame (or an associated viewing device or other display), or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

DEVICE AND METHOD FOR ACQUIRING DEPTH OF SPACE BY USING CAMERA

Provided are a device and a method for acquiring the depth of a space by using a camera. A method for acquiring the depth of a feature area by a device by using a camera module comprises the steps of: acquiring multiple images by capturing, while sequentially rotating the camera module at a pre-configured angle, images around the camera multiple times; comparing images adjacent to each other between a first image and an n-th image among the multiple images to identify a first feature area within the first image and an n-th feature area within the n-th image, wherein the n-th feature area is identical to the first feature area; acquiring a base line value of each of the first image and the n-th image; acquiring a disparity value between the first feature area and the n-th feature area; and calculating the depth of the first feature area or the n-th feature area on the basis of the base line value and the disparity value.

DIRECTED IMAGE CAPTURE

A process is provided for graphically guiding a user of a capture device (e.g., smartphone) to more accurately capture a series of images of a building. Images are captured as the picture taker moves around the building—taking a plurality (e.g., 4-16) of images from multiple angles and distances. Before capturing an image, a quality of the image may be determined to prevent low quality images from being captured or to provide instructions on how to improve the quality of the image capture. The series of captured images are uploaded to an image processing system to generate a 3D building model that is returned to the user. The returned 3D building model may incorporate scaled measurements of building architectural elements and may include a dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows, doors or roofing. 1. A method of directed capture of building imagery , the method comprises:retrieving, from an image capture device, an image, the image including at least a portion of a subject building; calculating a percentage of façade pixels present within the image, wherein the façade includes any side of the subject building;', 'determining a distance of the façade pixels from a centroid of the image;', 'determining obfuscated façade areas;', 'outputting the image to a quality classifier, wherein the quality classifier calculates a ranked quality of the image based on or more of: the percentage of façade pixels present within the image, the distance of the façade pixels from a centroid of the image, or the obfuscated façade areas; and, 'determining if the image is usable in creating a multi-dimensional building model byfeeding an indication of the ranked quality to the image capture device along with instructions based on the indication to direct one or more additional image captures.2. The method of claim 1 , wherein the image is displayed on a viewfinder of the image capture device.3. ...

Method and system of discriminative recovery of three-dimensional digital data of a target of interest in a cluttered or controlled environment

A method of discriminative recovery of three-dimensional digital data of a target of interest in a cluttered or controlled environment. The method uses the traditional structure from motion (SFM) 3D reconstruction method on a video of a target of interest to track and extract 3D sparse feature points and relative orientations of the video frames. Desired 3D points are filtered from the 3D sparse feature points in accordance to a user input and a digital cutting tool. Segmented images are generated by separating the target of interest from the background scene in accordance to the desired 3D points. A dense 3D reconstruction of the target of interest is generated by inputting the segmented images and the relative orientations of the video frames.

Virtuelle dreidimensionale Objekte in einem Livevideo

Die vorliegende Erfindung betrifft Verfahren zur Darstellung eines dreidimensionalen Objektsin einem realen Umfeld, dargestellt in einem auf einem Monitor wiedergegebenen Finalvideo. Das Verfahren ist gekennzeichnet durch die Verfahrensschritte- Erzeugen zumindest eines Objektvideos durch Abfilmen des Objekts mit einer Abfilmkamera aus verschiedenen Abfilmrichtungen zur Erzeugung eines Objektvideos, wobei für die jeweilige Abfilmrichtung jeweils der Winkel einer optischen Achse der Abfilmkamera in Bezug auf eine Zentralachse des Objekts bestimmt wird, sodass jeder Abfilmrichtung ein Winkel zugeordnet werden kann,- Erzeugen eines Livevideos, mit mindestens einer Livekamera und gleichzeitiges Einblenden des Objektvideos in das Livevideo an einer definierten Position im Umfeld zur Erzeugung des Finalvideos,- Ändern der Position der Livekamera im Umfeld und gleichzeitig Darstellen des Objekts im Finalvideo in einer gewünschten Perspektive im Umfeld dadurch, dass- die jeweilige Position der ...

Automatic camera removable 3D image shooting device

Intraoral scanner with dental diagnostics capabilities

Methods and apparatuses for generating a model of a subject's teeth. Described herein are intraoral scanning methods and apparatuses for generating a three-dimensional model of a subject's intraoral region (e.g., teeth) including both surface features and internal features. These methods and apparatuses may be used for identifying and evaluating lesions, caries and cracks in the teeth. Any of these methods and apparatuses may use minimum scattering coefficients and/or segmentation to form a volumetric model of the teeth.

ROBOTIC LASER GUIDED SCANNING SYSTEMS AND METHODS OF SCANNING

A robotic laser guided system for scanning of an object includes a processor configured to define a laser center co-ordinate and a relative width for the object from a first shot of the object; and define an exact position for taking each of the one or more shots after the first shot. The exact position for taking the one or more shots is defined based on the laser center co-ordinate and the relative width. The system includes a feedback module for providing at least one feedback about the exact position for taking the shots; a motion-enabling module comprising at least one wheel for enabling a movement to the exact position for taking the shots one by one based on the feedback; cameras for capturing the shots. The processor may stitch and process the shots to generate at least one 3D model comprising a scanned image of the object. 2. The laser guided scanning system of further comprising a laser light configured to switch from a red color to a green color and vice versa claim 1 , wherein the laser light is further configured to indicate the exact position for taking each of the one or more shots separately by turning to the green color.3. The laser guided scanning system of claim 1 , wherein the one or more cameras takes the one or more shots of the object one by one based on the laser center co-ordinate and a relative width of the first shot.4. The laser guided scanning system of claim 2 , wherein the processor is further configured to define a new position co-ordinate for taking a next shot of the one or more shots based on the laser center co-ordinate and the relative width of the first shot.5. The laser guided scanning system of claim 1 , wherein the object comprises at least one of a symmetrical object and an unsymmetrical object.6. A scanning system for a three dimensional (3D) scanning of an object claim 1 , comprising: define a laser center co-ordinate for the object from a first shot of the object, wherein the object comprising at least one of a ...

DIRECTED IMAGE CAPTURE

Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest. 1. A method of directed capture of building imagery , the method comprising:displaying, on an image capture device display, a building of interest subject from a first camera position;overlaying a graphical guide associated with the building of interest subject at the first camera position;receiving a first quality assessment of the building of interest subject in association with the graphical guide; andcapturing a first image of the building of interest subject based on the quality assessment.2. The method of claim 1 , further comprising:displaying, on an image capture device display, a building of interest subject from a second camera position;overlaying a second graphical guide associated with the building of interest subject at the second camera position;receiving a second quality assessment of the building of interest subject in association with the second graphical guide; andcapturing a second image of the building of interest subject based on the second quality assessment.3. The method of further comprising creating a multidimensional building model from at least the first and second captured images.4. The method of claim 1 , wherein receiving the first quality assessment ...

Systems and methods for processing a 2D video

A system includes one or more hardware processors, a head mounted display (HMD), a digital camera device, and a path extraction engine. The path extraction engine is configured to receive two-dimensional (2D) video from the digital camera device, the 2D video presenting a 2D view of a three-dimensional (3D) object, the digital camera device moving along a camera path as the digital camera device captures the 2D video, identify a plurality of 2D features associated with the 3D object within the 2D video, track the plurality of 2D features across multiple frames of the 2D video, estimate motion in pixels associated with each 2D feature of the plurality of 2D features, using the estimated motion in the pixels, identify 2D motion caused by the digital camera device moving along the camera path, and compute a first camera position of the digital camera device based on the identified 2D motion.

DEVICE, CAMERA DEVICE, CAMERA SYSTEM, MOVING BODY, METHOD, AND PROGRAM

A device, comprising a circuit configured to: obtain distance information of a photographing object on the basis of a plurality of pieces of image data obtained by photographing with different focal positions of an optical system comprised by a camera device, and fuzzy characteristic information of the optical system. The circuit is configured to: store fuzzy characteristic information of an optical system corresponding to a specific quadrant in a photographing surface of the camera device. The circuit is configured to: when distance information of photographing objects corresponding to other quadrants is obtained, perform quadrant conversion processing on one of the fuzzy characteristic information of the optical system in the specific quadrant, and image information in each piece of image data corresponding to other quadrants, and obtain, on the basis of the information obtained by performing conversion processing, and the other one of the fuzzy characteristic information of the optical ...

Method and apparatus for constructing three dimensional model of object

A method and an apparatus for constructing a three-dimensional (3D) model of an object are provided. The method includes capturing images of the object by scanning the object along a trajectory around the object, estimating positions of a scanner, which respectively correspond to the captured images, refining the estimated positions of the scanner based on at least two locations on the trajectory, estimating depth maps corresponding to the refined positions of the scanner, generating a surface mesh of the object by fusing the depth maps, and constructing and displaying the 3D model of the object by mapping textures onto the generated surface mesh.

MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME

There are provided a mobile terminal including light emitting devices and a method for controlling the same. A mobile terminal includes a camera, a light emitting unit including a plurality of light emitting devices, the light emitting unit emitting light toward a space corresponding to an image received through the camera, and a controller for controlling light emitting devices, which emit light toward a space corresponding to a portion of the image among the plurality of light emitting devices, to be used in extracting depth information of the portion.

A METHOD FOR MEASURING THE TOPOGRAPHY OF AN ENVIRONMENT

A method for forming a point cloud corresponding to the topography of an imaged environment involves acquiring an image of the environment with a camera having a WFOV lens mounted on a vehicle; changing the camera pose by an adjustment greater than a threshold; and acquiring another image of the environment with the camera at the changed pose. The images are mapped onto respective surfaces to form respective mapped images, defined by the same nonplanar geometry. One of the mapped images is divided into blocks of pixels. For each block, a depth map is formed by performing a search through the other mapped image to evaluate a disparity in the position of the location of the block of pixels in each of the mapped images. The depth map is converted into a partial point cloud corresponding to the local topography of the environment surrounding the vehicle as it moves through the environment.

System and method of mapping elements inside walls

According to one or more embodiments, a system of generating a two-dimensional (2D) map of an environment includes a 2D scanner and a wall sensor positioned at a fixed position with respect to the 2D scanner, the wall sensor detects a presence of an internal element inside a wall in the environment. Further, the system includes one or more processors operably coupled to the 2D scanner and the wall sensor. The processors generate a wall map of a wall in the environment, the wall map including an occupancy grid with a plurality of cells, a cell representative of a corresponding portion of the wall, and the cell indicative of the occupancy of an internal element in the corresponding portion. Further, the processors associate the wall map with a location of the wall in the 2D map of the environment.

모바일 디바이스들을 위한 옴니스테레오 캡처

... 모바일 디바이스를 위해 옴니스테레오 콘텐츠를 캡처하는 시스템 및 방법은, 장면의 복수의 이미지들을 캡처하기 위한 표시를 수신하는 단계, 모바일 디바이스와 관련된 카메라를 사용하여 복수의 이미지들을 캡처하는 단계, 상기 복수의 이미지들의 캡처 동안, 상기 복수의 이미지들에 대한 표현을 상기 모바일 디바이스의 스크린 상에 디스플레이하고 그리고 복합 이미지를 상기 스크린에 제공하는 단계를 포함하고, 상기 복합 이미지는 타겟 캡처 경로와 상기 복수의 이미지들의 캡처 동안의 상기 모바일 디바이스와 관련된 소스 캡처 경로에 대응하는 정렬 정보를 제공하는 표시자를 포함한다. 시스템은 소스 캡처 경로의 일부가 타겟 캡처 경로와 매칭되지 않음을 검출할 수 있다. 시스템은 업데이트된 표시자를 스크린에 제공할 수 있으며, 업데이트된 표시자는 소스 캡처 경로를 타겟 캡처 경로에 정렬시키도록 모바일 디바이스를 조정하기 위한 모바일 디바이스의 사용자에 대한 프롬프트를 포함할 수 있다.

Robot-based 3D picture shooting method and system, and robot using the same

The present disclosure provides a robot-based 3D picture shooting method and system, and a robot using the same. The method includes: obtaining a distance between a photographed object and the photographing device of the robot based on a received shooting instruction; calculating an inter-axis distance based on the distance; obtaining the first picture after moving the robot for half of the inter-axis distance along the movement direction; obtaining the second picture after moving the robot for entire of the inter-axis distance from a current position along an opposite direction of the movement direction; and synthesizing the first picture and the second picture to obtain a 3D picture of the photographed object. In the process, the robot moves the photographing device according to the calculated inter-axis distance, and obtains two pictures of the left and right of the photographed object, which is not necessary to use a binocular camera.

PHOTOGRAMMETRIC SYSTEM AND PHOTOGRAMMETRIC METHOD

A photogrammetric system includes a camera installed in a movable body and including a shutter unit that moves an exposed portion across an imaging surface from one side to the other side for exposure to capture an image, a measuring device configured to measure a position at which the camera captures the image, and a photogrammetry data generator configured to extract a feature point from the image captured by the camera, calculate a feature point capture position at which the feature point is captured based on a measurement result of the measuring device and a moving time of the exposed portion, and generate photogrammetry data including the feature point capture position. 1. A photogrammetric system comprising:a camera installed in a movable body, the camera including a shutter unit that unidirectionally moves an exposed portion across an imaging surface from one side to the other side, the camera being configured to capture an image by causing the shutter unit to expose the imaging surface from the one side to the other side;a capture position measuring unit configured to measure a capture position at which the camera captures the image; anda photogrammetry data generator configured to extract a feature point from the image captured by the camera, calculate a feature point capture position at which the feature point is captured based on the capture position measured by the capture position measuring unit and a moving time where the exposed portion is moved by the shutter unit, and generate data for use in photogrammetry, the data including the feature point capture position.2. The photogrammetric system of claim 1 , wherein the photogrammetry data generator extracts a feature point from the image captured by the camera claim 1 , calculates an offset time that is a time period from when the camera starts capturing the image to when a portion of the feature point is exposed claim 1 , from a relation between a position of the feature point in the image and the ...

Control method and camera terminal

INFORMATION PROCESSING APPARATUS, COMPUTER READABLE MEDIUM, AND INFORMATION PROCESSING METHOD

The invention relates to an information processing apparatus, a computer readable medium, and an information processing method. The purpose of the present invention is to improve the degree of reproduction of the shape of an object when generating a stereoscopic image by integrating a plurality of three-dimensional polygon models. An information processing device (10) generates a stereoscopic image represented by an aggregate of polygons. An information processing device (10) is provided with a control unit (15) that acquires a plurality of distance images from a plurality of distance image sensors (20) that capture an image of an object; generating a plurality of three-dimensional polygon models based on the plurality of distance images; dividing a virtual space surrounding the object to generate a plurality of divided spaces; comparing the number of vertexes of polygons of the plurality of three-dimensional polygon models in each of the divided spaces; selecting the vertex of the three-dimensional ...

Construction machine

A construction machine includes a lower-part traveling body that performs a traveling operation, an upper-part turning body turnably mounted on the lower-part traveling body, an operator's cab mounted on the upper-part turning body, multiple image capturing devices mounted on the upper-part turning body, and a display unit mounted in the operator's cab to simultaneously display an image and operating information regarding an operating condition. The image includes at least one of multiple images captured with the image capturing devices. The display unit is configured to change at least one of the displayed image and a display position of the operating information, in response to an operation of a single changeover switch.

Image generating device and image generating method

An image generating device configured to provide a cloud service to a head-mounted display via a network is provided. A photographed image receiving section 510 receives a plurality of photographed images photographed in different photographing directions. A panoramic image processing section 530 generates a panoramic image by synthesizing the plurality of photographed images photographed in the different photographing directions. A format converting section 540 converts the panoramic image into an image format suitable for specifications of the head-mounted display. A panoramic image transmitting section 550 transmits the panoramic image after format conversion to the head-mounted display.

SCANNING MICROSCOPE FOR 3D IMAGING USING MSIA

METHOD FOR PLAYBACK OF A VIDEO STREAM BY A CLIENT

Rotatable Image Photographing Apparatus

Photogrammetric system and photogrammetric method

A photogrammetric system includes a camera installed in a movable body and including a shutter unit that moves an exposed portion across an imaging surface from one side to the other side for exposure to capture an image, a measuring device configured to measure a position at which the camera captures the image, and a photogrammetry data generator configured to extract a feature point from the image captured by the camera, calculate a feature point capture position at which the feature point is captured based on a measurement result of the measuring device and a moving time of the exposed portion, and generate photogrammetry data including the feature point capture position.

SYSTEM AND METHOD FOR REAL-TIME CAMERA TRACKING TO FORM A COMPOSITE IMAGE

A system and method for tracking the movement of a recording device to form a composite image is provided. The system has a a user device with a sensor array capturing motion data and velocity vector data of the recording device when the recording device is in motion, an attachment member for coupling the user device to the motion capturing device, and a server with program modules. The program modules described are a calibration module for calibrating a position of the user device relative to a position of a lens of the recording device, a recorder module for receiving the motion data and velocity vector data from the sensor array; and a conversion module for combining the position of the user device relative to the lens of the recording device, and the motion data and velocity vector data and transforming the data into a file that is usable by a compositing suite, a three-dimensional application, or both.

Multi-View Aerial Imaging

A method for capturing a multi-view set of images of an area of interest, the multi-view set of images comprising, for each of a plurality of points within the area of interest, at least one nadir image and at least four oblique images from four substantially different viewing directions, the method comprising moving a dual-scan scanning camera along a survey path above the area of interest, and capturing, within selected intervals along the survey path and using the dual-scan scanning camera, subsets of the multi-view set of images of the area of interest along pairs of opposed non-linear scan paths. 1. A method for capturing a multi-view set of images of an area of interest , the multi-view set of images comprising , for each of a plurality of points within the area of interest , at least one nadir image and at least four oblique images from four substantially different viewing directions , the method comprising moving a dual-scan scanning camera along a survey path above the area of interest , and capturing , within selected intervals along the survey path and using the dual-scan scanning camera , subsets of the multi-view set of images of the area of interest along pairs of opposed non-linear scan paths.2. The method of claim 1 , wherein the dual-scan scanning camera comprises two scanning cameras facing in substantially opposite directions claim 1 , the method comprising capturing claim 1 , within each selected interval along the survey path and using each scanning camera claim 1 , a respective subset of the multi-view set of images of the area of interest along a respective non-linear scan path claim 1 , each image in the subset having a unique viewing angle and viewing direction pair.3. The method of claim 2 , the method comprising claim 2 , for each image within the subset claim 2 , rotating a scanning mirror in an optical path of the corresponding scanning camera about a spin axis according to a spin angle claim 2 , the spin axis tilted relative to a camera ...

METHOD AND APPARATUS FOR SCANNING AND PRINTING A 3D OBJECT

SCANNING MICROSCOPE FOR 3D IMAGING USING MSIA

According to some examples, an instrument for scanning a specimen on a specimen holder. The instrument includes a scanning stage for supporting the specimen, and a detector having a plurality of pixels. The scanning stage and the detector are movable relative to each other to move the specimen in a scan direction during a scan. At least some of the pixels of the detector are operable to collect light from different depths inside the specimen during the scan and generate corresponding image data. The instrument also includes a processor operable to perform MSIA on the image data to generate a 3D image of the specimen.

듀얼 모드 깊이 추정기

... 비디오 데이터의 실-시간 깊이 추정을 위해 구성된 시스템-온-칩이 제공된다. 시스템-온-칩은 모노스코픽-타입의 비디오 데이터로부터의 모노스코픽 깊이 추정을 수행하도록 구성된 모노스코픽 깊이 추정기(200), 및 스테레오스코픽-타입의 비디오 데이터로부터의 스테레오스코픽 깊이 추정을 수행하도록 구성된 스테레오스코픽 깊이 추정기(210)를 포함한다. 시스템-온-칩은 선택된 깊이 추정 모드를 정의하는 구성 데이터를 기초로 모노스코픽 깊이 추정 또는 스테레오스코픽 깊이 추정을 수행하도록 재구성가능하다. 깊이 추정기들 둘 모두는 공유 회로들(120, 150)을 포함하며, 공유 회로들(120, 150)은 하드웨어에서 인스턴스화되며, 각각의 깊이 추정기에서 회로의 기능성의 차이들을 설명하도록 재구성가능하다.

Method of obtaining depth information and display apparatus

A method of obtaining depth information and a display apparatus may adjust a sensor area of a sensor panel based on a distance from an object, and may obtain depth information of the object based on the adjusted sensor area.

METHOD FOR PLANNING THREE-DIMENSIONAL SCANNING VIEWPOINT, DEVICE FOR PLANNING THREE-DIMENSIONAL SCANNING VIEWPOINT, AND COMPUTER READABLE STORAGE MEDIUM

Disclosed in the embodiments of the present disclosure are a method for planning three-dimensional scanning viewpoint, a device for planning three-dimensional scanning viewpoint and a computer readable storage medium. After a low-precision digitalized model of an object to be scanned is acquired, viewpoint planning calculation is performed, on the basis of a viewpoint planning algorithm, on point cloud data in the low-precision digitalized model, and then the positions and line-of-sight directions of a plurality of viewpoints in space are calculated when a three-dimensional sensor needs to perform three-dimensional scanning on said object. Calculating viewpoints of a three-dimensional sensor by means of a viewpoint planning algorithm can effectively improve the accuracy and scientific nature of sensor posture determination, greatly improving the efficiency of viewpoint planning, and reducing the time consumed in the whole three-dimensional measurement process.

User interface to assist three dimensional scanning of objects

Methods and apparatuses are disclosed for assisting a user in performing a three dimensional scan of an object. An example user device to assist with scanning may include a processor. The user device may further include a scanner coupled to the processor and configured to perform a three dimensional scan of an object. The user device may also include a display to display a graphical user interface, wherein the display is coupled to the processor. The user device may further include a memory coupled to the processor and the display, the memory including one or more instructions that when executed by the processor cause the graphical user interface to display a target marker for a three dimensional (3D) scan and display a scanner position marker to assist in moving the scanner to a preferred location and direction.

Image capturing device and method thereof

An image capturing device is provided comprising an image sensor for capturing a first image of a scene, a light source for illuminating the scene with a first flash of coded light, and a network interface for communicating with a communications network and/or a further image capturing device. The device is operative to encode information into the first flash, enabling retrieval of the first image from a first data storage, capture the first image, and store the first image in the first data storage. Optionally, the device may be operative to detect a second flash of coded light emitted by the further image capturing device, decode information enabling retrieval of a second image captured by the further image capturing device from a second data storage, retrieve the second image, and create a 3D model from the first image and the second image.

Path detection system and path detection method generating laser pattern by diffractive optical element

A path detection system and a path detection method generating laser patterns by a diffractive optical element (DOE) are revealed. The path detection system is arranged at a mobile device while in use. A laser source projects structured light toward a forward path of the mobile device through the DOE. The structure light includes a transverse baseline and at least one transverse computational line. Then a lens is used to capture images of the structured light. When there is obstacle in a forward path of the mobile device, an image processing unit makes comparisons and performs computation according to changes in position and distance of the image of the respective transverse computational line relative to the X axis and the Y axis of the transverse baseline. Thus the relative position and distance of the obstacle in the forward path is checked in a real time manner.

METHODS AND SYSTEMS FOR CAMERA CALIBRATION

An image capture method may include obtaining two or more sets of images. The two or more sets of images may include a first image captured by a first image capture device and a second image captured by a second image capture device. The method may also include determining, for a set of images, two or more pairs of points. Each of the two or more pairs of points may include a first point in the first image and a second point in the second image, and the first point and the second point may correspond to a same object. The method may also include determining a first rotation matrix based on the pairs of points in the two or more sets of images. The first rotation matrix may be associated with a relationship between positions of the first image capture device and the second image capture device. 1. An image capture system , comprising:at least one storage device including a set of instructions; obtain two or more sets of images, wherein the two or more sets of images includes a first image captured by a first image capture device and a second image captured by a second image capture device;', 'for a set of images, determine two or more pairs of points, wherein each of the two or more pairs of points includes a first point in the first image and a second point in the second image, and the first point and the second point correspond to a same object; and', 'determine a first rotation matrix based on the pairs of points in the two or more sets of images, wherein the first rotation matrix is associated with a relationship between positions of the first image capture device and the second image capture device., 'at least one processor in communication with the at least one storage device, wherein when executing the set of instructions, the at least one processor is directed to cause the system to2. The system of claim 1 , wherein the first image is captured from a first field of view of the first image capture device claim 1 , the second image is captured from a second ...

Digital mapping system based on continuous scanning line of sight

Apparatus for capturing images while in motion, including at least one CCD camera housed within an aircraft traveling along a flight path, for capturing aerial images of ground terrain, a motor for rotating an axis on which the at least one CCD camera is mounted, and for generating a sweeping back-and-forth motion for a field of view of the at least one CCD camera, the sweeping motion being transverse to the aircraft flight path, and an optical assembly connected to said at least one CCD camera.

Directed image capture

Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

Directed image capture

Systems and methods are disclosed for directed image capture of a subject of interest, such as a home. Directed image capture can produce higher quality images such as more centrally located within a display and/or viewfinder of an image capture device, higher quality images have greater value for subsequent uses of captured images such as for information extraction or model reconstruction. Graphical guide(s) facilitate content placement for certain positions and quality assessments for the content of interest can be calculated such as for pixel distance of the content of interest to a centroid of the display or viewfinder, or the effect of obscuring objects. Quality assessments can further include instructions for improving the quality of the image capture for the content of interest.

Three-dimensional imaging method and device, electronic equipment and storage medium

Apparatus for three-dimensional measurement of an object, method and computer program with image-based triggering

An apparatus for three-dimensional measurement of an object includes a trigger configured to obtain image information from a measurement camera and to trigger, in dependence on image content of the image information, a measurement output or an evaluation of the image information by an evaluator for determining measurement results. Further, a respective method and a respective computer program are described.

VR CONTENT CAPTURING METHOD, PROCESSING DEVICE AND SYSTEM, AND STORAGE MEDIUM

Disclosed in the embodiments of the present application is a virtual reality (VR) content capturing method. The method in the embodiments of the present application comprises: acquiring first location information and first rotation information of VR display equipment; acquiring capture parameters, the capture parameters comprising the distance from a virtual camera to a target object displayed in the display equipment, and the virtual camera being an established virtual controller; calculating second location information of the camera according to the first location information and the capture parameters, wherein a processing device calculates second rotation information of the camera according to the first rotation information; calculating a real-time azimuth of the camera according to the second location information and the second rotation information; and recording image information captured by the camera according to the real-time azimuth of the camera. Also provided in the embodiments ...

SYSTEM AND METHOD FOR PRODUCING AND DISPENSING STEREOSCOPIC VIDEO FILMS

3-DIMENSIONAL SCANNER DEVICE

Portrait Image Synthesis from Multiple Images Captured on a Handheld Device

A hand-held digital image capture device (digital camera) has a user-selectable mode in which upon engaging the mode the device detects a face in the field of view of the device and generates a face delimiter on a camera display screen, the delimiter surrounding the initial position of the image of a the face on the screen. The device is arranged to indicate thereafter to the user if the device departs from movement along a predetermined concave path P with the optical axis of the device pointing towards the face, such indication being made by movement of the image of the face relative to the delimiter. The camera captures and stores a plurality of images at successive positions along the concave path.

Imaging apparatus, imaging method, and computer readable storage medium

An imaging apparatus includes an imaging unit that generates a pair of pieces of image data mutually having a parallax by capturing a subject, an image processing unit that performs special effect processing, which is capable of producing a visual effect by combining a plurality of pieces of image processing, on a pair of images corresponding to the pair of pieces of image data, and a region setting unit that sets a region where the image processing unit performs the special effect processing on the pair of images.

Image processing method and apparatus

An image processing method for creating a disparity image for 3D display from a 2D video image includes detecting based on a first image of the 2D video image in a time and a second image in a time different from the first image, motion vectors between the first and second images for each block of the first image, detecting from the motion vectors, a most backward vector of a portion whose depth is on the back side, calculating differential vectors between each motion vector and the most backward vector and giving a depth on a close to the block of the first image corresponding to the motion vector having the larger differential vector and creating one or more disparity images from the first image and the depth.

Image processing apparatus and method, and program

The present invention relates to an image processing apparatus and method, and a program capable of displaying a stereoscopic image having a more appropriate parallax. An image capture apparatus 11 captures a plurality of photographic images P( 1 ) to P(N) in a state of being turned around a center of turn C 11 . In response to an instruction for displaying an image in which a specific region in an area to be captured is displayed, the image capture apparatus 11 selects two photographic images between which parallax having a predetermined magnitude occurs in a subject in the specific region from among photographic images in which the specific region is displayed, and crops regions in which the subject in the specific region is displayed from these photographic images to produce right-eye and left-eye sub-images. These sub-images have an appropriate parallax and therefore are displayed simultaneously using a lenticular method or the like. Thus, a stereoscopic image with depth can be displayed. The present invention can be applied to a camera.

Image processing system, image processing method, and program

An objective of the present invention is to provide a technique capable of generating a virtual viewpoint image without causing any visually uncomfortable feeling. In order to achieve this objective, a first image obtained by being captured from a first viewpoint at a first image capture time, and a second image obtained by being captured at a second image capture time different from the first image capture time are acquired. To each of pixels in a non-image capture area corresponding to a portion of a subject not captured in the first image of a first virtual viewpoint image that is generated in a pseudo manner based upon the first image and can be acquired by being captured from a first virtual viewpoint different from the first viewpoint, a pixel value is added in accordance with the second image.

Stereoscopic image capture device and control method of the same

An image for a left eye and an image for a right eye are respectively captured. A corresponding point corresponding to each of a plurality of feature points detected from the image for a left eye is searched for using the image for a right eye. The number of corresponding points found by the search is counted, and it is determined whether to be equal to or more than a predetermined ratio with respect to the number of pixels of the image for a right eye. When the number of corresponding points is determined to be less than the predetermined ratio, the image for a right eye is recaptured, and the corresponding point search process and the determination of whether the number of corresponding points is equal to or more than the predetermined ratio are re-executed using an image new for a right eye obtained by recapture.

Method for stabilizing a digital video

A method for stabilizing an input digital video. Input camera positions are determined for each of the input video frames, and an input camera path is determined representing input camera position as a function of time. A smoothing operation is applied to the input camera path to determine a smoothed camera path, and a corresponding sequence of smoothed camera positions. A stabilized video frame is determined corresponding to each of the smoothed camera positions by: selecting an input video frame having a camera position near to the smoothed camera position; warping the selected input video frame responsive to the input camera position; warping a set of complementary video frames captured from different camera positions than the selected input video frame; and combining the warped input video frame and the warped complementary video frames to form the stabilized video frame.

Product imaging device, product imaging method, image conversion device, image processing device, image processing system, program, and information recording medium

A product imaging device ( 121 ) is provided which facilitates a user to capture the image sequence of entire surroundings of a product. An image sensor unit ( 201 ) senses incident light from the external world where the product is disposed and outputs an image representing a result of the sensing. An instruction receiving unit ( 202 ) receives an image-capture instruction from the user. A memory unit ( 203 ) stores the image sensed by the image sensor unit ( 201 ) upon reception of an image-capture instruction. A finder display unit ( 204 ) synthesizes the image stored in the memory unit ( 203 ) with an image presently sensed by the image sensor unit ( 201 ) and displays a synthesized image on a finder screen.

Stereoscopic image generating apparatus, stereoscopic image generating method, and stereoscopic image generating program

At least one of parallax images for left and right eyes to be fusionally displayed to perform stereopsis using binocular parallax is generated at low resolution or low sharpness of such a degree that a subject in the parallax image is observable as a stereoscopic image when an observer observes the subject in an observation mode in which the two fusionally displayed parallax images are stereoscopically viewable, and also of such a degree that the subject is recognizable as a plane image when an observer observes the subject in an observation mode in which the two fusionally displayed parallax images are not stereoscopically viewable.

Apparatus including function to generate stereoscopic image, and method and storage medium for the same

An apparatus, a method and a storage medium including a function to generate a stereoscopic image are described. According to one implementation, the imaging apparatus includes an imaging lens; a first driving section; an obtaining section and a generating section. The first driving section rotates the imaging lens around an axis along a first direction orthogonal to an optical axis. The obtaining section obtains two image signals corresponding to two optical images which pass through the imaging lens rotated in two states to make a direction of the optical axis relatively different so that a relationship of a position of background with respect to a subject is different. The generating section generates image data of a stereoscopic image based on the two image signals.

Method and device for obtaining a stereoscopic signal

The invention relates to a method of obtaining a stereoscopic signal from a sequence of monoscopic images. The method includes a step of obtaining a sequence of monoscopic images having been captured by an image acquisition apparatus in an acquisition mode enabling several images to be shot in the course of a regular movement substantially tangential to the plane of the lens of the acquisition apparatus. That step is followed by a step of forming pairs of images from the sequence of images, each pair being formed on the basis of a predetermined temporal distance then a step of calibrating the images of the pairs formed, so as to improve the visual correspondence between the two images. Finally, a stereoscopic signal is constructed from the pairs so calibrated.

METHODS, SYSTEMS, AND COMPUTER-READABLE STORAGE MEDIA FOR GENERATING THREE-DIMENSIONAL (3D) IMAGES OF A SCENE

Disclosed herein are methods, systems, and computer-readable storage media for generating three-dimensional (3D) images of a scene. According to an aspect, a method includes capturing a real-time image and a first still image of a scene. Further, the method includes displaying the real-time image of the scene on a display. The method also includes determining one or more properties of the captured images. The method also includes calculating an offset in a real-time display of the scene to indicate a target camera positional offset with respect to the first still image. Further, the method includes determining that a capture device is in a position of the target camera positional offset. The method also includes capturing a second still image. Further, the method includes correcting the captured first and second still images. The method also includes generating the three-dimensional image based on the corrected first and second still images. 1. A method for generating a three-dimensional image , the method comprising:using at least one processor and at least one image capture device for:capturing a real-time image and a first still image of a scene;displaying the real-time image of the scene on a display;determining one of camera positional offset and pixel offset with respect to the first still image based on at least one of the captured images, an image sensor property, optical property, focal property, and viewing property of the captured images;determining that the at least one image capture device is in the position indicated by the camera positional offset;capturing a second still image;correcting the captured first and second still images to compensate for at least one of camera vertical shift, and rotation on a predetermined axis; andgenerating the three-dimensional image based on the corrected first and second still images.2. The method of claim 1 , further comprising:determining guides based on one of the real-time image and the first still image; ...

ROAD SURFACE DETECTION DEVICE AND ROAD SURFACE DETECTION PROGRAM

A road surface detection device according to an embodiment includes an image acquisition unit that acquires captured image data output from a stereo camera that captures an imaging area including a road surface on which a vehicle travels, a three-dimensional model generation unit that generates a three-dimensional model of the imaging area including a surface shape of the road surface from a viewpoint of the stereo camera based on the captured image data, and a correction unit that estimates a plane from the three-dimensional model, and corrects the three-dimensional model so as to match an orientation of a normal vector of the plane and a height position of the plane with respect to the stereo camera with a correct value of an orientation of a normal vector of the road surface and a correct value of a height position of the road surface with respect to the stereo camera, respectively. 1. A road surface detection device comprising:an image acquisition unit that acquires captured image data output from a stereo camera that captures an imaging area including a road surface on which a vehicle travels;a three-dimensional model generation unit that generates a three-dimensional model of the imaging area including a surface shape of the road surface from a viewpoint of the stereo camera based on the captured image data; anda correction unit that estimates a plane from the three-dimensional model, and corrects the three-dimensional model so as to match an orientation of a normal vector of the plane and a height position of the plane with respect to the stereo camera with a correct value of an orientation of a normal vector of the road surface and a correct value of a height position of the road surface with respect to the stereo camera, respectively.2. The road surface detection device according to claim 1 , whereinthe correction unit matches the orientation of the normal vector of the plane with the correct value of the orientation of the normal vector of the road surface ...

Apparatus for Three-Dimensional Measurement of an Object, Method and Computer Program with Image-based Triggering

An apparatus for three-dimensional measurement of an object includes a trigger configured to obtain image information from a measurement camera and to trigger, in dependence on image content of the image information, a measurement output or an evaluation of the image information by an evaluator for determining measurement results. Further, a respective method and a respective computer program are described. 1. Apparatus for three-dimensional measurement of an object , comprising:a trigger configured to acquire image information from a measurement camera and to trigger, in dependence on image content of the image information, forwarding of the image information to an evaluator for determining measurement results or an evaluation of the image information by an evaluator for determining measurement results;wherein the trigger is configured to detect when the image content has shifted with respect to a reference image content by at least a predetermined shift or by more than a predetermined shift and to trigger, in dependence on the detection of a shift, forwarding of the image information or the evaluation of the image information by the evaluator for determining measurement results.2. Apparatus according to claim 1 , wherein the trigger is configured to trigger claim 1 , in dependence on the detection of a shift claim 1 , forwarding of the image information or the evaluation of the image information by the evaluator for determining measurement results claim 1 , in order to generate measurement results at a specific spatial distance or to obtain measurement results at equal spatial distances.3. Apparatus according to claim 1 , wherein triggering the measurement output is performed exclusively based on the image content.4. Apparatus according to claim 1 , wherein the trigger is configured to perform image analysis and to trigger the measurement output or the evaluation of the image information in dependence on the image analysis.5. Apparatus according to claim 1 , ...

Three-dimensional shape measurement device, three-dimensional shape measurement method, and three-dimensional shape measurement program

A device for measuring a three-dimensional shape includes an imaging unit which sequentially outputs a first two-dimensional image being captured and outputs a second two-dimensional image according to an output instruction, the second two-dimensional image having a setting different from a setting of the first two-dimensional image, an output instruction generation unit which generates the output instruction based on a shape defect ratio obtained by generating a three-dimensional model based on the second two-dimensional image outputted by the imaging unit and viewing a three-dimensional model from a viewpoint at which the first two-dimensional image is captured, and a storage unit which stores the second two-dimensional image outputted by the imaging unit.

Image processing method and image processing device

A picture processing method and device. The method comprises: a picture processing device collecting N pictures for the same object at K positions, K being an integer greater than or equal to 1, and N being greater than or equal to K (S101); and the picture processing device horizontally splicing at least two of the N pictures to generate a 3D picture, the horizontal splicing being splicing two pictures with overlapping parts into one seamless picture (S102). The method and device are advantageous for solving the problems of high cost, poor visual effect, complicated 2D/3D display switching and low practicability.

Systems and methods for obtaining accurate 3d modeling data using uavs for cell sites

Systems and methods for developing a three-dimensional (3D) model of a cell site using an Unmanned Aerial Vehicle (UAV) to obtain photos and/or video include preparing the UAV for flight and programming an autonomous flight path about a cell tower at the cell site, wherein the autonomous flight path comprises a substantially circular flight path about the cell tower with one or more cameras on the UAV facing the cell tower; flying the UAV around the cell tower in a plurality of orbits comprising at least four orbits each with a different set of characteristics of altitude, radius, and camera angle, wherein the flying comprises of at least four orbits for a monopole cell tower and at least five orbits for a self-support/guyed cell tower; obtaining photos and/or video of the cell tower, the cell site, and cell site components during each of the plurality of orbits; and using the photos and/or video to develop the point cloud three-dimensional (3D) model of the cell site.

METHOD AND APPARATUS FOR 3D RECONSTRUCTION OF PLANES PERPENDICULAR TO GROUND

An apparatus for three-dimension (3D) reconstruction includes; an event trigger module that determines whether to perform a 3D reconstruction, a motion estimation module than obtains motion information, and a reconstruction module that receives a first front image having a first view point and a second front image having a second view point, and obtains 3D coordinate values of a camera coordinate system based on the first front image and the second front image. Here, each of the first front image and the second front image includes planes, and each of the planes is perpendicular to the ground and includes feature points.

DISPLAY SYSTEM FOR CAPSULE ENDOSCOPIC IMAGE AND METHOD FOR GENERATING 3D PANORAMIC VIEW

The present disclosure relates to a display system including a capsule image view, a 3D mini-map, and a 3D panoramic view, and a method of generating a 3D panoramic view. Specifically, according to the present disclosure, it is possible to infer the shape of an organ using a 3D mini-map and to simultaneously identify whether or not the capsule endoscope captures the images, and information on the position and posture of the capsule endoscope at primary captured points by visualizing the actual movement path of the capsule endoscope, thereby improving the accuracy of examination, and since multiple 2D images captured by a single capsule endoscope are able to be viewed as a single 3D panoramic image without changing the structure of the capsule endoscope, it is economical and the viewing angle of the image is able to be increased, thereby reducing the examination time and fatigue of the examiner. 1. A display system comprising:a storage unit configured to receive images captured by a capsule endoscope;a controller configured to convert the images into image data;a manipulation unit configured to generate a manipulation command; anda display unit configured to display the image data.2. The display system of claim 1 , wherein the image captured by the capsule endoscope records any one or more pieces of information selected from the group consisting of position information and posture information of the capsule endoscope.3. The display system of claim 1 , wherein the image data comprises a capsule image view claim 1 , and further comprises any one or more selected from the group consisting of a 3D mini-map and a 3D panoramic view.4. The display system of claim 3 , wherein the 3D mini-map is configured to display any one or more pieces of information selected from the group consisting of path information of the capsule endoscope claim 3 , position information of the capsule endoscope claim 3 , posture information of the capsule endoscope claim 3 , and 3D-panoramic view ...

ROBOTIC MAPPING FOR TAPE LIBRARIES

A method for diagnosing problems in tape libraries is disclosed. In one embodiment, such a method includes attaching, to a robot of a tape library, one or more scanning devices to scan internal components and features of the tape library. As the robot moves within the tape library, the method captures, using the one or more scanning devices, three-dimensional (3D) data describing physical locations of the internal features and components. This 3D data is compiled to generate a map of the internal components and features. The method compares the map to a 3D model of the tape library to identify differences between the map and the 3D model. Problems within the tape library may be identified from these differences. A corresponding system and computer program product are also disclosed. 1. A method for diagnosing problems in tape libraries , the method comprising:attaching, to a robot of a tape library, at least one scanning device to scan internal components of the tape library;as the robot moves within the tape library, capturing, using the at least one scanning device, three-dimensional (3D) data describing physical locations of the internal components;compiling the 3D data to generate a map of the internal components;comparing the map to a 3D model of the tape library to identify differences between the map and the 3D model; andidentifying problems within the tape library from the differences.2. The method of claim 1 , wherein the at least one scanning device includes at least one infrared (IR) scanning device.3. The method of claim 1 , wherein the at least one scanning device gathers temperature data associated with the internal components.4. The method of claim 3 , further comprising comparing temperature data associated with the map to temperature data associated with the 3D model.5. The method of claim 4 , wherein identifying problems further comprises identifying differences between the temperature data associated with the map and the temperature data ...

Aerial Image Acquisition Method and System for Investigating Traffic Accident Site by Unmanned Aerial Vehicle

Disclosed are an aerial image acquisition method and a system for investigating a traffic accident site by an unmanned aerial vehicle. The method comprises selecting a corresponding unmanned aerial vehicle low-altitude shooting scheme of traffic accident site according to whether three-dimensional site reconstruction or site animation simulation is needed; selecting and calculating shooting parameters of the unmanned aerial vehicle according to the unmanned aerial vehicle low-altitude shooting scheme selected; and shooting the traffic accident site according to the unmanned aerial vehicle low-altitude shooting scheme selected and the shooting parameters of the unmanned aerial vehicle, to obtain an aerial image sequence of the traffic accident site. 110-. (canceled)11. An aerial image acquisition method for investigating a traffic accident site by an unmanned aerial vehicle , comprising the steps of:selecting a corresponding unmanned aerial vehicle low-altitude shooting scheme of traffic accident site according to whether three-dimensional site reconstruction or site animation simulation is needed, the unmanned aerial vehicle low-altitude shooting scheme of traffic accident site including a global-scope “S-shaped” itinerant vertical high-angle shooting scheme and a combined shooting scheme, and the combined shooting scheme being formed by superimposing the global-scope “S-shaped” itinerant vertical high-angle shooting scheme with a partial three-dimensional site multilevel surrounding inclined shooting scheme;selecting and calculating shooting parameters of the unmanned aerial vehicle according to the unmanned aerial vehicle low-altitude shooting scheme selected; andshooting the traffic accident site according to the unmanned aerial vehicle low-altitude shooting scheme selected and the shooting parameters of the unmanned aerial vehicle, to obtain an aerial image sequence of the traffic accident site.12. The aerial image acquisition method for investigating a traffic ...

Provision of stereoscopic video camera views to aircraft passengers

A processing unit for providing stereoscopic video data on board an aircraft, a system comprising the processing unit, an aircraft comprising the system, a method for providing stereoscopic video data on board an aircraft, as well as a computer program for executing the method. The processing unit comprises: a processing component configured to process at least a part of first video data and second video data to form stereoscopic video data, wherein the first and the second video data represent video images of one or more views external to the aircraft; and a forwarding component configured to forward the formed stereoscopic video data to one or more display devices provided on board the aircraft for presentation to passengers of the aircraft.

TRACKING-DISTANCE-MEASURING SYSTEM FOR TORSO TRACKING AND METHOD THEREOF

A tracking-distance-measuring system capable of tracking a torso object is provided. The tracking-distance-measuring system includes: an image sensor, a controller, a distance-measuring device, and an actuator device. The image sensor is configured to capture an input image. The controller is configured to analyze the input image to recognize a torso object from the input image, and calculate an offset distance between a center of the torso object and a central axis of the input image. The actuator device is configured to carry the distance-measuring device. The controller controls the actuator device to calibrate an offset angle between the distance-measuring device and the recognized torso object according to the offset distance. In response to calibrating the offset angle, the distance-measuring device emits energy and receives reflected energy to detect an object distance of the torso object. 1. A tracking-distance-measuring system capable of tracking a torso object , comprising:an image sensor, configured to capture an input image;a controller, configured to analyze the input image to recognize a torso object from the input image, and calculate an offset distance between a center of the torso object and a central axis of the input image;a distance-measuring device, coupled to the controller; andan actuator device, coupled to the controller, and configured to carry the distance-measuring device;wherein the controller controls the actuator device to calibrate an offset angle between the distance-measuring device and the recognized torso object according to the offset distance;wherein in response to calibrating the offset angle, the distance-measuring device emits energy and receives reflected energy to detect an object distance of the torso object.2. The tracking-distance-measuring system as claimed in claim 1 , wherein the distance-measuring device comprises an ultrasonic emitter and an ultrasonic receiver claim 1 ,wherein the distance-measuring device controls ...

DEVICE AND METHOD TO RECONSTRUCT IN 3D THE SURFACE OF A COMPLETE LOOP AROUND A SUBJECT

The device and method are intended for reconstructing in 3-Dimensions a complete 360° loop of a subject (). 130. A device to achieve 3D reconstruction of a surface of a 360° loop of an object or a body () , comprising:{'b': '10', 'at least one passive stereovision camera 3D equipped with a double optics (), and'}{'b': 10', '30', '21', '10', '30', '30', '10, 'a turn table () which is carrying the object or body to be imaged () or, alternatively, a rotating frame () carrying the at least one 3D camera () and rotating around the object or body to be imaged (), configured such that the object or body () is within the field of view of the at least one 3D camera (), and'}{'b': 40', '20', '41', '41, 'a control mean () that manage the rotation of the turn table () or, respectively, a control mean () that manage the rotation of the rotating frame (), and'}{'b': 50', '10', '30, 'a control mean () for remote triggering of the at least one 3D camera () and for acquiring stereo pairs of images according to viewing angles covering a 360° loop around the object or body (), and'}{'b': '60', 'computation means () for the 3D reconstruction of 3D surfaces from the acquired stereo pairs of images, and'}{'b': 80', '30, 'computation means () for the stitching in 3D of the acquired 3D surfaces into a comprehensive 3D representation of a complete 360° loop of the surface of the imaged object or body ().'}280. The device of claim 1 , wherein the computation means () used for stitching are comprising running a matching algorithm to match the reconstructed 3D surfaces in order to stitch these surfaces together once matched.380. The device of claim 1 , wherein the computation means () used for stitching is comprising a looping algorithm which is adjusting the relative position of the successive reconstructed 3D surfaces in order to spread evenly the matching differences between the matched successive reconstructed 3D surfaces.4203020104020. The device of claim 1 , comprising a turn table () ...

INTRAORAL SCANNER WITH DENTAL DIAGNOSTICS CAPABILITIES

Methods and apparatuses for generating a model of a subject's teeth. Described herein are intraoral scanning methods and apparatuses for generating a three-dimensional model of a subject's intraoral region (e.g., teeth) including both surface features and internal features. These methods and apparatuses may be used for identifying and evaluating lesions, caries and cracks in the teeth. Any of these methods and apparatuses may use minimum scattering coefficients and/or segmentation to form a volumetric model of the teeth. 1. A method for generating a three-dimensional (3D) volumetric model of a subject's teeth using an intraoral scanner , the method comprising:taking a plurality of images into the teeth using an infrared (IR) wavelength with the intraoral scanner as the intraoral scanner is moved over the teeth, so that multiple images of a same internal region of the teeth are imaged;determining, for each of the plurality of images into the teeth, a position of the intraoral scanner relative to the subject's teeth;using the position of the intraoral scanner to project a plurality of grid points corresponding to an inner volume of the patient's teeth on each of the plurality of images into the teeth;determining a scattering coefficient for the projected grid points from the plurality of images into the teeth; andforming the 3D volumetric model of the subject's teeth including internal features using the scattering coefficient for the projected grid points.2. The method of claim 1 , wherein determining the scatter coefficient for the projected grid points comprises determining the minimum scatter coefficient for each of the projected grid points.3. The method of claim 1 , wherein the IR wavelength comprises a near-IR wavelength.4. The method of claim 1 , wherein forming the 3D volumetric model comprises including a model of the gums relative to the teeth.5. The method of claim 1 , further comprising capturing a 3D color model of the teeth as the intraoral scanner is ...

METHOD AND APPARATUS FOR SCANNING AND PRINTING A 3D OBJECT

A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an three-dimensional image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional depth map. Coordinates of the points in the depth map may be estimated with a level of certainty. The level of certainty may be used to determine which points are included in the composite image. The selected points may be smoothed and a mesh model may be formed by creating a convex hull of the selected points. The mesh model and associated texture information may be used to render a three-dimensional representation of the object on a two-dimensional display. Additional techniques include processing and formatting of the three-dimensional representation data to be printed by a three-dimensional printer so a three-dimensional model of the object may be formed. 1. A portable electronic device , comprising:a camera; forming multiple localized point clouds, each localized point cloud comprising probabilities associated with respective points in the localized point cloud indicative of a probability that the representation accurately indicates a location of a first feature of a plurality of features;', 'fusing the localized point clouds into a combined point cloud;', 'adjusting one or more points in the combined point cloud to reduce inconsistency; and', 'smoothing the combined point cloud based at least in part on the probabilities associated with the localized point clouds., 'process a plurality of images acquired with the camera to form a representation of an object depicted in the plurality of images, wherein the representation indicates a surface of the object in three-dimensional space, and wherein the processing comprises, 'at least one ...

Image capturing device and method thereof

An image capturing device is provided comprising an image sensor for capturing a first image of a scene, a light source for illuminating the scene with a first flash of coded light, and a network interface for communicating with a communications network and/or a further image capturing device. The device is operative to encode information into the first flash, enabling retrieval of the first image from a first data storage, capture the first image, and store the first image in the first data storage. Optionally, the device may be operative to detect a second flash of coded light emitted by the further image capturing device, decode information enabling retrieval of a second image captured by the further image capturing device from a second data storage, retrieve the second image, and create a 3D model from the first image and the second image.

Detection method and detection apparatus for detecting three-dimensional position of object

A detection apparatus for detecting a three-dimensional position of an object includes a feature point detecting unit that, with consecutive or at least alternately consecutive two images among multiple images sequentially imaged when a robot is moving being a first image and a second image, detects multiple feature points in the second image including one feature point detected in the first image; a distance calculating unit that calculates a distance between the one feature point of the first image and the multiple feature points of the second image; and a feature point determining unit that determines a feature point for which the distance is the shortest. With consecutive or at least alternately consecutive next two images being the first image and the second image, processing for determining a feature point for which the distance is the shortest is repeated, thereby tracking the feature points of the object.

Operating Method of Three-Dimensional Facial Diagnosis Apparatus

The present invention relates to a three-dimensional face image capturing method and comprises the steps of: capturing a face region of a user in a direction from a right chin to a left forehead; capturing the face region in a direction from a left forehead to a left chin; capturing the face region in a direction from a left chin to a right forehead; and capturing the face region in a direction from a right forehead to a center of face. 1. An operating method of a three-dimensional (3D) face diagnosis apparatus for obtaining 3D image information including face depth information of the front and side views of a face of a user by capturing the face by elevating a camera in the direction of a vertical axis and rotating the camera about the vertical axis along a capturing trajectory around the face of the user by means of a camera moving instrument , the operating method performed at least temporarily by a computer , the operating method comprising:capturing a face region of a user in the direction from center of the face to the right chin;capturing the face region in the direction from the right chin to the right forehead;capturing the face region in the direction from the right forehead to the left chin;capturing the face region in the direction from the left chin to the left forehead; andcapturing the face region in the direction from the left forehead to center of the face.2. The operating method of claim 1 , wherein a moving path in the capturing of the face region in the direction from the right forehead to the left chin passes through center of the face of the user.3. The operating method of claim 2 , wherein a moving path in the capturing of the face region in the direction from the left chin to the left forehead and a moving path in the capturing of the face region in the direction from the right chin to the right forehead convexly move outward from the face of the user.4. The operating method of claim 3 , wherein the capturings of the face region comprise ...

System and method for generating and releasing stereoscopic video films

The invention relates to a system ( 1 ) for releasing a stereoscopic video film ( 2 ). The system ( 1 ) has a data processing unit ( 3 ), which is configured to receive and to process a monoscopic video film ( 7 ), and to release the stereoscopic video film ( 2 ). The monoscopic video film ( 7 ) has been recorded using a video recording device ( 4 ) having a one single objective ( 8 ). The system ( 1 ) is characterized in that the data processing unit ( 3 ) is configured to receive and to evaluate a motion information ( 14 ) allocated to the monoscopic video film ( 7 ), or to determine the motion information ( 14 ) to be allocated to the monoscopic video film ( 7 ). The motion information ( 14 ) is characterized by a motion direction ( 27 ) of the video recording device ( 4 ) in regard to a filmed object ( 11 ). The data processing unit ( 3 ) is configured to generate the stereoscopic video film ( 2 ) from two content-identical and temporally delayed monoscopic video films.

Robot motion planning for photogrammetry

Described herein are systems for generating 3D models using imaging data obtained using an array of light projectors, at least one object boundary detector, and a robotic member with an end effector. A first point cloud of data for an object may be generated based on boundary information obtained by the object boundary detector(s). Dimensions for the object may be determined based on the first point cloud of data. A second point cloud of data may be generated based on the dimensions for the object and a configuration of light projectors where the second point cloud corresponds to potential coordinates for a location where the robotic member and end effector can be positioned along a path around the object to capture the image data of the object. A path may be generated to avoid collision between the object and the robotic member or end effector while optimizing the number of capture location points within the second point cloud of data.

MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME

There are provided a mobile terminal including light emitting devices and a method for controlling the same. A mobile terminal includes a camera, a light emitting unit including a plurality of light emitting devices, the light emitting unit emitting light toward a space corresponding to an image received through the camera, and a controller for controlling light emitting devices, which emit light toward a space corresponding to a portion of the image among the plurality of light emitting devices, to be used in extracting depth information of the portion. 1. An electronic device comprising:a light emitting unit comprising a plurality of light generating elements, wherein the plurality of light generating elements are grouped into a plurality of groups;a camera;a controller operably connected to the light emitting unit and the camera and configured to:control at least one of the plurality of groups to emit light to an object, anddetermine depth information of the object using the at least one image captured via the camera based on the light emitted from the at least one of the plurality of groups to the object,wherein the plurality of light generating elements included in each of the plurality of groups are arranged to form different patterns such that all of the plurality of groups emit different light patterns,wherein the plurality of light generating elements included in each of the plurality of groups generate light to form the different patterns while at least one image of the object is received from the camera,wherein each pattern of the different patterns is formed based on arrangement of the plurality of light generating elements included in a corresponding group of the plurality of groups, andwherein the controller is further configured to control two or more of the plurality of groups to emit light simultaneously during at least a portion of time that the at least one of the plurality of groups are emitting light to the object.2. The electronic device of ...

PORTABLE 3D SCANNING SYSTEMS AND SCANNING METHODS

A portable 3D scanner including a camera for capturing a plurality of image shots of an object for scanning is provided. The camera being mounted on a stack structure configured to expand and close for adjusting a height and an angle of the camera for taking at least one image shot of the plurality of image shots of the object. The stack structure is mounted over a base comprising wheels for movement of the base to multiple positions. The further comprising a processor for: determining a laser center of the object from a first image shot; determining a radius between the object and the a center of the camera, the base may move around the object based on the radius for covering a 360-Degree view of the object; and processing and stitching the plurality of image shots for generating a 3D scanned image of the object. 1. A portable 3D scanner comprising:at least one camera for capturing a plurality of image shots of an object for scanning, wherein the at least one camera is mounted on a stack structure configured to expand and close for adjusting a height and an angle of the at least one camera for taking at least one image shot of the plurality of image shots of the object, wherein the stack structure is mounted over a base comprising one or more wheels for movement of the base to the one or more positions; and determining a laser center of the object from a first image shot of the plurality of image shots;', 'determining a radius between the object and a center of the at least one camera, wherein the base moves around the object based on the radius for covering a 360-Degree view of the object; and', 'processing and stitching the plurality of image shots for generating a 3D scanned image of the object., 'a processor for2. The portable 3D scanner of claim 1 , wherein the processor is configured to determine the one or more position coordinates for taking the plurality of image shots of the object for completing the 360-Degree view of the object; and enable a movement of ...

Tear line 3d measurement apparatus and method

A non-destructive method of measuring tear lines formed in a surface of a resilient automotive trim panel configured for overlaying an inflatable safety device includes the steps of periodically selecting a trim panel for testing from a flow of in-process trim panels, mounting the selected trim panel to a mounting jig configured to support a region of the selected trim panel adjacent a tear line and to temporally fold said selected trim panel to expose opposed edges forming at least a portion of the tear line, scanning a 3D image of the opposed edges, storing said 3D image as data in an associated processor, and removing the selected trim panel from the mounting jig. The mounting jig includes a base forming upwardly facing longitudinally elongated converging guide surfaces intersecting at a common apex, and a cover member forming downwardly facing longitudinally elongated converging support surfaces intersecting at a common apex.

Laser frame tracer

A laser frame tracer ( 12 ) including a laser measuring unit ( 20 ) with a laser ( 36 ) and one or more cameras ( 38, 40 ) for optically measuring dimensions of eyeglass frames ( 10 ). A frame carrier ( 22 ) is provided for moving the eyeglass frames ( 10 ) through a laser line emitted by the laser ( 36 ). The frame carrier ( 22 ) includes a linear carriage ( 44 ) and a rotary carriage ( 88 ). Movement of the linear carriage ( 44 ) and the rotary carriage ( 88 ) are controlled by an on-board computer ( 116 ) which collects image data from the one or more cameras ( 38, 40 ). Image data is processed to determine a 3D model from which selected dimensions for the eyeglass frames ( 10 ) may be measured. The dimensions may be stored in a cloud database for access by others in cutting lenses to fit the eyeglass frames ( 10 ).

DEVICE AND METHOD FOR ASSISTING IN 3D SCANNING A SUBJECT

A device or assisting in performing a 3D scan of a subject includes a camera structured to capture an image of the subject, an indication device structured to provide an indication, and a processing unit structured to determine a difference between a location of the camera and a desired location of the camera based on the captured image and to control the indication device to provide the indication based on the difference between the location of the camera and the desired location of the camera. 1. A device for performing a 3D scan of a subject , the device comprising:a camera structured to capture an image of the subject;an indication device structured to provide an indication; anda processing unit structured to determine a difference between a location of the camera and a desired location of the camera based on the captured image and to control the indication device to provide the indication based on the difference between the location of the camera and the desired location of the camera.2. The device of claim 1 , wherein the processing unit is structured to determine the difference between the camera and a desired location of the camera by determining a difference between a location of subject in the captured image with a desired location of subject in the captured image.3. The device of claim 2 , wherein the processing unit is structured to determine one or more landmarks of the subject in the captured image.4. The device of claim 1 , wherein the indication is at least one of a haptic and an audible indication.5. The device of claim 1 , wherein the indication is a visual indication.6. The device of claim 1 , wherein the processing unit is structured to determine a rate of the indication based on a magnitude of the difference between the location of the camera and the desired location of the camera and to control the indication device to provide the indication at the determined rate.7. The device of claim 1 , further comprising one or more sensors structured to ...

Articulated arm coordinate measurement machine that uses a 2d camera to determine 3d coordinates of smoothly continuous edge features

A measurement device having a camera captures images of an object at three or more different poses. A processor determines 3D coordinates of an edge point of the object based at least in part on the captured 2D images and pose data provided by the measurement device.

System and method of determining a virtual camera path

A computer-implemented system and method of determining a virtual camera path. The method comprises determining an action path in video data of a scene, wherein the action path includes at least two points, each of the two points defining a three-dimensional position and a time in the video data; and selecting a template for a virtual camera path, the template camera path including information defining a template camera path with respect to an associated template focus path. The method further comprises aligning the template focus path with the determined action path in the scene and transforming the template camera path based on the alignment to determine the virtual camera path.

3d image capture method with 3d preview of preview images generated by monocular camera and related electronic device thereof

A three-dimensional (3D) image capture method, employed in an electronic device with a monocular camera and a 3D display, includes at least the following steps: while the electronic device is moving, deriving a 3D preview image from a first preview image and a second preview image generated by the monocular camera, and providing 3D preview on the 3D display according to the 3D preview image, wherein at least one of the first preview image and the second preview image is generated while the electronic device is moving; and when a capture event is triggered, outputting the 3D preview image as a 3D captured image.

Method and System of Discriminative Recovery of Three-Dimensional Digital Data of a Target of Interest in a Cluttered or Controlled Environment

A method of discriminative recovery of three-dimensional digital data of a target of interest in a cluttered or controlled environment. The method uses the traditional structure from motion (SFM) 3D reconstruction method on a video of a target of interest to track and extract 3D sparse feature points and relative orientations of the video frames. Desired 3D points are filtered from the 3D sparse feature points in accordance to a user input and a digital cutting tool. Segmented images are generated by separating the target of interest from the background scene in accordance to the desired 3D points. A dense 3D reconstruction of the target of interest is generated by inputting the segmented images and the relative orientations of the video frames. 1. A method of discriminative recovery of three-dimensional digital data of a target of interest in a cluttered or controlled environment , the method comprises the steps of:(A) providing a personal computing (PC) device, and at least one remote server, wherein the remote server manages a three-dimensional (3D) reconstruction process;(B) providing a stereo 3D reconstruction for a target of interest within a background scene, wherein the stereo 3D reconstruction is compiled from a series of video frames, and wherein each video frame includes a relative orientation;(C) tracking a plurality of 3D sparse feature points of the stereo 3D reconstruction with the remote server;(D) filtering a plurality of desired 3D points from the plurality of 3D sparse feature points with the remote server;(E) generating a plurality of segmented images with the remote server by separating the target of interest from the background scene for each video frame in relation to the desired 3D points, wherein each segmented image is associated to a corresponding frame from the series of video frames; and(F) executing the 3D reconstruction process with the remote server in order to generate a dense 3D reconstruction of the target of interest by inputting ...

Directed image capture

A process is provided for guiding a capture device (e.g., smartphone, tablet, drone, etc.) to capture a series of images of a building. Images are captured as the camera device moves around the building—taking a plurality of images (e.g., video) from multiple angles and distances. Quality of the image may be determined to prevent low quality images from being captured or to provide instructions on how to improve the quality of the image capture. The series of captured images are uploaded to an image processing system to generate a 3D building model that is returned to the user. The returned 3D building model may incorporate scaled measurements of building architectural elements and may include a dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows, doors or roofing.

ROBOT-BASED 3D PICTURE SHOOTING METHOD AND SYSTEM, AND ROBOT USING THE SAME

The present disclosure provides a robot-based D picture shooting method and system and a robot using the same. The method includes: obtaining a distance between a photographed object and the photographing device of the robot based on a received shooting instruction; calculating an inter-axis distance based on the distance; obtaining the first picture after moving the robot for half of the inter-axis distance along the movement direction; obtaining the second picture after moving the robot for entire of the inter-axis distance from a current position along an opposite direction of the movement direction; and synthesizing the first picture and the second picture to obtain a 3D picture of the photographed object. In the process, the robot moves the photographing device according to the calculated inter-axis distance, and obtains two pictures of the left and right of the photographed object, which is not necessary to use a binocular camera. 1. A computer-implemented robot-based 3D picture shooting method for a robot with a photographing device , comprising executing on a processor the steps of:obtaining a distance between a photographed object and the photographing device of the robot based on a received shooting, instruction, in response to a movement direction of the robot being perpendicular to a shooting direction of the photographing device;calculating an inter-axis distance based on the distance between the photographed object and the photographing device, wherein the inter-axis distance comprises a distance between a position the photographing device obtaining, a first picture of the photographed object and another position the photographing device obtaining a second picture of the photographed object;obtaining the first picture after moving the robot for half of the inter-axis distance along the movement direction;obtaining the second picture after moving the robot for entire of the inter-axis distance from a current position along an opposite direction of the ...

Method and apparatus for converting 2d images to 3d images

A method of converting 2D images to 3D images and system thereof is provided. According to one embodiment, the method comprises receiving a plurality of 2D images from an imaging device; obtaining motion parameters from a sensor associated with the imaging device; selecting at least two 2D images from the plurality of 2D images based on the motion parameters; determining a depth map based on the selected 2D images and the motion parameters corresponding to the selected 2D images; and generating a 3D image based on the depth map and one of the plurality of 2D images.

Method for generating three-dimensional images and three-dimensional imaging device

A method for generating three-dimensional images is provided. The method is used for a three-dimensional imaging device including a touch panel and a single lens. The method includes steps of: the touch panel showing a image including a predetermined path; using the single lens to shoot at least two different plane images when detecting a contact point on the touch panel moving along the predetermined path; and outputting the at least two different plane images shot by the single lens to make the touch panel show a three-dimensional image.

Light-field camera

A light-field camera includes a main lens configured to form an image of an object, a lens configured to form, on a curved surface, additional images based on the image of the object, and an image sensor configured to function as a curved image sensor and thereby sense the additional images, at least one of the lens and the image sensor including a flat element.

METHOD AND EQUIPMENT FOR CONSTRUCTING THREE-DIMENSIONAL FACE MODEL

A three-dimensional face model constructing method includes: obtaining front face information to establish a three-dimensional front face model and generate a front planar image corresponding to the three-dimensional front face model, wherein the front planar image includes first feature points; obtaining full face information to establish a three-dimensional full face model and generate a full face planar image corresponding to the three-dimensional full face model, wherein the three-dimensional full face model includes a specific portion and the full face planar image includes second feature points; superimposing a first block of the front plan image to a second block of the full face planar image according to the correspondence between the first feature points and the second feature points, to obtain a complete full face planar image; and generating a three-dimensional face model according to the complete full face planar image. 1. A three-dimensional face model constructing method , comprising:obtaining front face information of a user in a first time interval to establish a three-dimensional front face model and generate a front planar image corresponding to the three-dimensional front face model, wherein the front planar image includes a plurality of first feature points;obtaining full face information of the user in a second time interval to establish a three-dimensional full face model and generate a full face planar image corresponding to the three-dimensional full face model, wherein the three-dimensional full face model includes a specific portion and the full face planar image includes a plurality of second feature points;superimposing a first block of the front plan image corresponding to the specific portion of the three-dimensional full face model to a second block of the full face planar image corresponding to the specific portion of the three-dimensional full-face model according to the correspondence between the first feature points and the second ...

Apparatus and method for generating three-dimensional (3d) shape of object under water

Provided is an apparatus and method for generating a three-dimensional (3D) shape of an object immersed in a liquid, in which the method may include receiving an image captured by photographing a section contour of the object immersed in a matching solution, generating a 3D shape of the object using the image, wherein the section contour may be formed according to a line laser emitted toward a surface of the object.

Damage detection from multi-view visual data

A plurality of images may be analyzed to determine an object model. The object model may have a plurality of components, and each of the images may correspond with one or more of the components. Component condition information may be determined for one or more of the components based on the images. The component condition information may indicate damage incurred by the object portion corresponding with the component.

Damage detection from multi-view visual data

One or more images of an object, each from a respective viewpoint, may be captured at a camera at a mobile computing device. The images may be compared to reference data to identify a difference between the images and the reference data. Image capture guidance may be provided on a display screen for capturing another one or more images of the object that includes the identified difference.

Method and system for 3d capture based on structure from motion with pose detection tool

Method and System for 3D capture based on SFM with simplified pose detection is disclosed. This invention provides a straightforward method to directly track the camera's motion (pose detection) thereby removing a substantial portion of the computing load needed to build the 3D model from a sequence of images.

Method for measuring environment depth using image extraction device rotation and image extraction device thereof

A measurement method for environment depth and the image extraction device thereof is revealed. First, rotate an image extraction unit and extract a plurality of images using an image extraction device according to different viewing angles of a target object. Then, use disparity information of the plurality of images and an image parameter of the image extraction unit to give a plurality pieces of depth-of-field information, which are further used for giving environment depth information. The image extraction device has an image extraction unit and a rotating member. The rotating member is connected with the base; the rotating member is connected to the image extraction unit, which is located on one side of the rotating member. The plurality of images with different viewing angles are extracted to the image extraction unit as the rotating member rotates about a rotating center to different image extracting locations.

SYSTEM AND METHOD FOR GENERATING COMBINED EMBEDDED MULTI-VIEW INTERACTIVE DIGITAL MEDIA REPRESENTATIONS

Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view. 1. A method for automatic generation of a multi-view interactive digital media representation (MIDMR) recording , the method comprising:obtaining a first MIDMR;obtaining a second MIDMR; andgenerating a third MIDMR from the first MIDMR and the second MIDMR, wherein the first and second MIDMRs are obtained using different capture motions, wherein the third MIDMR is a combined embedded MIDMR, wherein the third MIDMR provides a three dimensional view of a first object MIDMR as well as an embedded three dimensional view of a second object MIDMR,wherein the first and second MIDMRS are generated by stitching together two dimensional images, and wherein the third MIDMR is generated by combining the first and second MIDMR, and wherein the first, second, and third MIDMRs each provide a three-dimensional view of content without rendering and/or storing an actual three-dimensional model.2. The method of claim 1 , wherein the combined embedded MIDMR comprises the second MIDMR being embedded in the first MIDMR claim 1 , thereby forming an embedded second MIDMR.3. The method of ...

Image-recording device, Balloon for operation with an image-recording device, method for operating an image-recording device, and control program for an image-recording device

The invention relates to an image-recording device (), comprising a scanning-head guide () for moving the scanning head () across a scanning region () of a cavity, which scanning region () extends around the scanning head (). A planar or film-like, elastically extensible material extends between the scanning head () and the scanning region (), which material can be pressed against the scanning region () by the application of overpressure in the manner of a balloon (). The scanning-head guide () extends through the balloon connection () of the balloon () to the scanning head (). In particular, a control device () determines the shape of the cavity () against which the material rests from the deformation of the material while the overpressure is present. 1. An image-recording device comprising{'b': '20', 'a scanning head (),'}{'b': '18', 'a scanning head guide () for moving the scanning head across a scanning region of a cavity, which scanning region extends around the scanning head,'}{'b': '12', 'a balloon (),'}{'b': 20', '42', '42', '12, 'wherein the balloon comprises a planar or film-like, elastically extensible material that extends between the scanning head () and the scanning region (), which elastically extensible material can be pressed against the scanning region () in a balloon ()-type manner using overpressure, and'}{'b': 18', '16', '12', '20', '32', '40, 'wherein the scanning head guide () passes through a balloon connection () of the balloon () to the scanning head (), and wherein a control device () determines the shape of the cavity () against which the elastically extensible material rests from the deformation of the elastically extensible material in the presence of overpressure of the elastically extensible material.'}2. The image-recording device according to claim 1 ,{'b': 26', '12, 'wherein the elastically extensible material is provided with a reference pattern () that, in relation to the balloon (), is applied on the interior or exterior side of ...

Turn Table for Photographing and Image Photgraphing System Using Same

A technology is provided in which a user generates a 3-D image for a photographing target only by a simple device without the rent of a studio or the use of a professional product and easily controls the generation of the 3-D image. The photographing turn table is installed in one area of a studio device having one area in which a photographing target is located and having an open one surface to allow image photographing through the open one surface. The photographing turn table includes a lower body, which is fixedly located in the one area and provided at a part of one surface thereof located in an opposite direction to a direction of a photographing device to emit light from the outer surface toward an inner wall which is included in the one area to form a background of the studio device, an upper body coupled to a top surface of the lower body rotatably relatively to the lower body, and a rotation module which include a rotation unit to rotate the upper body relatively to the lower body, and a rotation control device including a communication function to receive a control command from an external device and to control driving of the rotation unit according to the control command. 1. A photographing turn table , which is installed in one area of a studio device which allows image-photographing for a photographing target located in the one area , the photographing turn table comprising:a lower body fixedly located at the one area;a light emitting unit installed at a part of one surface of the lower body located in an opposite direction to a direction of a photographing device to emit light from the outer surface toward an inner wall which is included in the one area to form a background of the studio device;an upper body coupled to a top surface of the lower body rotatably relatively to the lower body; anda rotation module which include a rotation unit to rotate the upper body relatively to the lower body, and a rotation control device including a communication ...

SYSTEM AND METHOD OF AUTOMATIC ROOM SEGMENTATION FOR TWO-DIMENSIONAL FLOORPLAN ANNOTATION

A system that includes a coordinate measurement scanner having a first image sensor, one or more processors coupled to the scanner for generating a 2D image of the environment, a portable computing device having a second image sensor coupled to the one or more processors, and a mapping system. The one or more processors correlate a location captured by a first image from the portable computing device with the location in the 2D image of the environment in response to the first image being acquired by the second image sensor. The system further includes a mapping system configured to: generate a 2D map based on the 2D image of the environment, apply image recognition to the first image to identify and label an object in the first image, and update the 2D map based at least in part on the label of the object in the first image. 1. A system of generating a two-dimensional (2D) map of an environment , the system comprising:a coordinate measurement scanner comprising a light source, a first image sensor and a controller, the light source emits a beam of light to illuminate object points in the environment, the first image sensor is arranged to receive light reflected from the object points, the controller being operable to determine a distance value to at least one of the object points;one or more processors operably coupled to the scanner, the one or more processors being responsive to executable instructions for generating a 2D image of the environment in response to an activation signal from an operator and based at least in part on the distance value;a portable computing device having a second image sensor, the portable computing device being coupled for communication to the one or more processors, wherein the one or more processors are responsive to correlate a location captured by a first image from the portable computing device with the location in the 2D image of the environment in response to the first image being acquired by the second image sensor; and ...

A METHOD FOR CREATING A STEREOSCOPIC IMAGE SEQUENCE

There is provided a method for creating a stereoscopic image sequence. The method can include capturing a sequence of static images and forming a plurality of image pairs. Each image pair can include a first image and a second image selected from the sequence of static images. Selection of the first image can be done in a manner so that the image pairs are formed a spatially coherent manner. The stereoscopic image sequence can be created based on the image pairs. Creating the stereoscopic image sequence can, for example, relate to producing a stereoscopic video. 1. A method for creating a stereoscopic image sequence , the method comprising:capturing a sequence of static images; andforming a plurality of image pairs, each image pair comprising a first image and a second image selected from the sequence of static images, selection of the first image being done in a manner so that the image pairs are formed in a spatially coherent manner,wherein each image pair is associable with a stereo-base that is based on separation between the first and second images, the stereo-base being variable, andwherein the stereoscopic image sequence is created based on the image pairs.2. (canceled)3. The method of claim 1 , wherein the stereo-base is variable based on selection of the first and second images of an image pair.4. The method of claim 3 , wherein selection of the first and second images of an image pair is based on at least one of manual based selection and automatic based selection.5. The method of claim 4 , wherein manual based selection is by manner of presenting the sequence of static images on a display screen for user selection of the first and second images of an image pair.6. The method of claim 4 , wherein automatic based selection is based on at least one of variance in focal length associated with at least one static image claim 4 , salient object detection and characteristics associated with the static images.7. The method of claim 1 , wherein the stereoscopic ...

Computer vision algorithm for capturing and refocusing imagery

Systems and methods for the generation of depth data for a scene using images captured by a camera-enabled mobile device are provided. According to a particular implementation of the present disclosure, a reference image can be captured of a scene with an image capture device, such as an image capture device integrated with a camera-enabled mobile device. A short video or sequence of images can then be captured from multiple different poses relative to the reference scene. The captured image and video can then be processed using computer vision techniques to produce an image with associated depth data, such as an RGBZ image.

METHOD OF TEMPORALLY CREATING COUPLES OF STEREOSCOPIC IMAGES, AND DEVICE USING SUCH A METHOD.

3차원 스캐너 장치

본 발명은 3차원 스캐너 장치에 관한 것으로서, 특히, 스캔 공간 상에서 제1회전축을 중심으로 스윙 회동 가능하게 구비되고, 스캔모듈이 구비된 제1프레임, 상기 제1프레임과 연동하여 스윙 회동되되, 상기 제1회전축과 동일 이격거리를 가지도록 상기 제1회전축에 대하여 평행되게 이격된 제2회전축이 형성하는 스윙 궤적을 이루면서 회동되고, 측정 대상물이 안착되는 제2프레임, 일단은 상기 제1프레임과 연동하도록 상기 제1회전축 측에 연결되고, 타단은 상기 제2프레임과 상대 회전 가능하도록 상기 제2회전축 측에 연결되는 연결 프레임 및 상기 연결 프레임을 매개로 상기 제1프레임과 상기 제2프레임을 연결하도록 구비되고, 상기 제1프레임의 스윙 회동에 대하여 연동되는 상기 제2프레임을 수평 유지시키는 연동부를 포함함으로써, 측정 대상물의 스캔 과정 동안 측정 대상물의 유격 및 낙하를 방지하여 보다 정밀한 스캔이 가능한 이점을 제공한다.

Method and apparatus for tracking a medical instrument based on image registration

An apparatus, method and system for tracking a medical instrument, as it is moved in an operating space to a patient target site in the space, by constructing a composite, 3-D rendition of at least a part of the operating space based on an algorithm that registers pre-operative 3-D diagnostic scans of the operating space with real-time, stereo x-ray or radiograph images of the operating space. The invention has particular utility in tracking a flexible medical instrument and/or a medical instrument that moves inside the patient's body and is not visible to the surgeon.

Image processing apparatus, image capturing apparatus, image processing method, and program

【課題】複数の画像から切り出した短冊領域を連結して３次元画像表示に適用する左目用合成画像と右目用合成画像を生成する装置および方法を提供する。 【解決手段】複数画像から切り出した短冊領域を連結して３次元画像表示用の左目用合成画像と右目用合成画像を生成する。画像合成部が視点の異なる左目用合成画像と右目用合成画像を生成可能とするための左および右目用の画像短冊の設定位置の許容範囲をメモリから取得または算出する。この許容範囲に左と右目用の短冊を設定する。具体的には、左目用画像短冊と前記右目用画像短冊の設定領域に重なり領域が発生せず、画像用メモリの格納範囲内となるように短冊設定位置を決定する。これらの短冊設定処理により確実に３次元画像表示処理に適用可能な左目用合成画像と右目用合成画像を生成することができる。 【選択図】図１１

Depth map generation techniques for conversion of 2d video data to 3d video data

본 개시물은 비디오 프레임들 또는 비디오 프레임들의 슬라이스들과 같은 비디오 유닛들에 대한 깊이 맵들을 생성하기 위한 기술들을 설명한다. 이 기술들은 2 차원 (2D) 비디오를 3 차원 (3D) 비디오로 컨버팅하기 위하여 비디오 인코더에 의해 수행될 수도 있다. 이 기술들은 대안적으로, 수신된 2D 비디오를 3D 비디오로 컨버팅하기 위해 비디오 디코더에 의해 수행될 수도 있다. 이 기술들은 깊이 맵 생성 프로세스에서 모션과 컬러 고려 사항들의 조합을 이용할 수도 있다. This disclosure describes techniques for generating depth maps for video units, such as video frames or slices of video frames. These techniques may be performed by a video encoder to convert two-dimensional (2D) video into three-dimensional (3D) video. These techniques may alternatively be performed by a video decoder to convert the received 2D video into 3D video. These techniques may use a combination of motion and color considerations in the depth map generation process.

Image processing apparatus, imaging apparatus, image processing method, and program

一种图像处理装置包括评估作为三维图像的合成图像的适合度的图像评估单元。所述图像评估单元通过由从作为合成图像的块单元的运动矢量的块运动矢量减去指示整个图像的移动的全局运动矢量计算的块对应差矢量的分析，执行评估作为三维图像的合成图像的适合度的处理，比较预定阈值和具有块对应差矢量的块的块面积和移动量相加值之一，以及当块面积等于或大于预定面积阈值时或当移动量相加值等于或大于预定移动量阈值时，执行确定所述合成图像不适合作为三维图像的处理。

Articulated arm coordinate measurement machine that uses a 2D camera to determine 3D coordinates of smoothly continuous edge features

A measurement device having a camera captures images of an object at three or more different poses. A processor determines 3D coordinates of an edge point of the object based at least in part on the captured 2D images and pose data provided by the measurement device.

Articulated arm coordinate measurement machine that uses a 2D camera to determine 3D coordinates of smoothly continuous edge features

A portable articulated arm coordinate measuring machine (AACMM) having an integrated camera captures 2D images of an object at three or more different poses. A processor determines 3D coordinates of a smoothly continuous edge point of the object based at least in part on the captured 2D images and pose data provided by the AACMM.

Method and apparatus for detecting moving objects in two- and three-dimensional scenes

A method and apparatus for detecting moving objects in both two-dimensional and three-dimensional scenes. The method repetitively applies a two-dimensional transformation to a plurality of images representing a scene to identify misaligned regions within the images. Any residual motion represented by the misaligned regions that may be classified as a moving object within the scene is further processed by a three-dimensional technique that removes parallax motion from the residual motion. The result is motion contained in an epipolar flow field which is only due to a moving object within the scene.

Stereoscopic image generation apparatus and method, and program

【課題】左右各眼用の視差画像に対する立体視が可能な観察態様にある観察者と立体視が不可能な観察態様にある観察者の両者が、許容可能な表示品質で立体視用画像を観察することを可能にする。【解決手段】左右各眼用の視差画像のうちの少なくとも一方を、観察者が融合的に表示された視差画像の両方を立体視可能な観察態様で観察した場合には視差画像中の被写体を立体像として観察可能な程度、かつ、観察者が融合的に示された視差画像の両方を立体視不可能な観察態様で観察した場合には被写体を平面像として認識可能な程度の低解像度または低鮮鋭度で生成する。例えば、放射線画像検出器（１５）から放射線画像信号を読み取る際に低解像度で読み取る。あるいは、コンピュータ（８）に解像度変換処理部または非鮮鋭化処理部を設ける。【選択図】図１ Both an observer in an observation mode capable of stereoscopic viewing of parallax images for the left and right eyes and an observer in an observation mode impossible of stereoscopic vision display a stereoscopic image with acceptable display quality. Makes it possible to observe. In a case where at least one of parallax images for left and right eyes is observed in an observation mode in which both of parallax images displayed in an integrated manner can be viewed stereoscopically, an object in the parallax image is selected. Low resolution that allows the subject to be recognized as a planar image when both the parallax images that can be observed as a stereoscopic image and the observer observes both parallax images that are displayed in a stereoscopic manner in an observation mode that cannot be stereoscopically viewed. Produces with low sharpness. For example, when a radiographic image signal is read from the radiographic image detector (15), it is read at a low resolution. Alternatively, a resolution conversion processing unit or an unsharpening processing unit is provided in the computer (8). [Selection] Figure 1

For the method and system that automatic 3D rendering is created

在本文中公开了涉及立体图像创建的方法、设备以及非瞬时计算机可读介质。相机在初始位置处捕捉初始图像。针对期望的立体效果确定从初始位置的目标位移，并且提供指定使相机从初始位置移动的方向的指令。在相机在运动中的同时计算从初始位置的估计位移。当估计位移对应于目标位移时，相机自动地捕捉候选图像。执行可接受性分析以确定候选图像是否具有可接受的图像质量和与初始图像的可接受相似性。如果候选图像通过可接受性分析，则基于初始和候选图像来创建立体图像。

Equipment of Image Stereo Omni-Directional

본 발명은 전(全)방향 스테레오 영상 장치에 관한 것으로, 그 구성은 전방향 영상 스테레오 장치에 있어서, 일정 곡면을 갖는 곡면 거울과 영상 정보를 습득하는 카메라 사이에 위치하는 굴절수단과; 상기 굴절수단과 결합되어 상기 곡면 거울로부터의 거리를 조절할 수 있는 위치조절수단;을 포함하여 이루어지는 것을 특징으로 하는 전방향 영상 스테레오 장치. The present invention relates to an omnidirectional stereo imaging apparatus, the configuration comprising: refractive means positioned between a curved mirror having a constant curved surface and a camera for acquiring image information; And position adjustment means coupled to the refraction means to adjust a distance from the curved mirror. 본 발명은 하나의 곡면을 갖는 거울과 카메라 사이에 오목 렌즈를 위치시켜 카메라 영상면에 곡면 거울을 통한 영상과 오목렌즈에 의해 시각편차를 갖는 영상을 동시에 얻어 비교함으로써 거리를 측정할 수 있도록 하는 효과가 있다. The present invention has the effect of measuring the distance by placing a concave lens between the mirror having a single curved surface and the camera to simultaneously obtain and compare the image having a visual deviation by the concave lens and the image through the curved mirror on the camera image surface There is. 곡면 거울, 오목렌즈, 카메라 Curved mirror, concave lens, camera

Triangulation-based depth and surface visualisation

本发明涉及一种在介入手术范围内对患者的三维表面结构和深处结构进行可视化的、手术中的、无标记的可视化系统和方法。为此提供具有C形臂投射模块(16)和照相机(14)的C形臂(10)，以及具有HMD投射模块(22)和照相机(24)的可视化眼镜(20)。投射模块(16，22)用于投射结构化的光。处理器(25)被确定为用于计算组合的图像数据组(kBD)，以将其投影到可视化眼镜(20)的眼镜片(21)上。

Method for determining a complete depth information of a camera image

Die Erfindung betrifft ein Verfahren zur Ermittlung einer vollständigen Tiefeninformation eines Kamerabilds. Dabei werden Kamerabildpaare aus einer Bildfolge einer bewegten Kamera ermittelt. Aus einer relativen Verschiebung von Objekten oder Objektkanten eines Kamerabildpaars werden jeweils zugeordnete Tiefeninformationen ermittelt. DOLLAR A Bei jedem Kamerabildpaar werden die Tiefeninformationen lediglich für einen innerhalb des Kamerabildpaars vorgegebenen Bildausschnitt bestimmt. Aus den zusammengesetzten Tiefeninformationen der Bildausschnitte wird dann die vollständige Tiefeninformation des gesamten Kamerabilds ermittelt. The invention relates to a method for determining a complete depth information of a camera image. In this case, camera image pairs are determined from a sequence of images of a moving camera. From a relative displacement of objects or object edges of a camera image pair respectively associated depth information is determined. DOLLAR A For each pair of camera images, the depth information is determined only for a frame within the camera image pair. The complete depth information of the entire camera image is then determined from the composite depth information of the image sections.

3-dimensional scanner device

본 발명은 3차원 스캐너 장치에 관한 것으로서, 특히, 스캔 공간 상에서 제1회전축을 중심으로 스윙 회동 가능하게 구비되고, 스캔모듈이 구비된 제1프레임, 상기 제1프레임과 연동하여 스윙 회동되되, 상기 제1회전축과 동일 이격거리를 가지도록 상기 제1회전축에 대하여 평행되게 이격된 제2회전축이 형성하는 스윙 궤적을 이루면서 회동되고, 측정 대상물이 안착되는 제2프레임, 일단은 상기 제1프레임과 연동하도록 상기 제1회전축 측에 연결되고, 타단은 상기 제2프레임과 상대 회전 가능하도록 상기 제2회전축 측에 연결되는 연결 프레임 및 상기 연결 프레임을 매개로 상기 제1프레임과 상기 제2프레임을 연결하도록 구비되고, 상기 제1프레임의 스윙 회동에 대하여 연동되는 상기 제2프레임을 수평 유지시키는 연동부를 포함함으로써, 측정 대상물의 스캔 과정 동안 측정 대상물의 유격 및 낙하를 방지하여 보다 정밀한 스캔이 가능한 이점을 제공한다.

Scene capturing and view rendering based on a longitudinally aligned camera array

In one embodiment, a longitudinal camera array is rotated through a capture cylinder, with each camera in the array capturing multiple images as the array rotates. These images can be looking outward along the radials of the cylinder, or alternatively looking tangential to the cylinder. The longitudinal camera array allows the surrounding scene to be captured from multiple different planes that are substantially parallel to the ends of the capture cylinder, allowing for more accurate subsequent rendering of the scene. A view of the scene can be subsequently rendered by determining a location and direction of view of an observer, and then selecting one or more of the multiple lateral and longitudinally adjacent capture images, as well as one or more pixels within that capture image(s), to use to determine a display value for the pixel.

Method for distinguishing a 3D image from a 2D image and for identifying the presence of a 3D image format by feature correspondence determination

A method identifies the presence of a three-dimensional (3D) image format in received image through the use of feature matching and correspondence. The received image is sampled using a candidate 3D format to generate two sub-images from the received image. Initially, these sub-images are compared to determine whether these sub-images are similar with respect to structure. If the sub-images are not similar, a new 3D format is selected and the method is repeated. If the sub-images are similar, features are detected in the two sub-images and a correspondence is formed between features that match in the two sub-images. Positional differences are computed between corresponding features. The amount and uniformity of the positional differences are then used to determine whether the format is 2D or 3D and, if 3D, which of the 3D formats was used for the received image.

Mapping perceived depth to regions of interest in stereoscopic images

3d scan system

본 발명에 따른 3차원 스캔시스템은, 스탠드와, 상기 스탠드에 회전 가능하게 결합되는 회전아암과, 상기 회전아암에 구비된 다수개의 카메라로 구성되어 스캔대상자의 신체부위를 스캔하는 스캔모듈과, 상기 스캔모듈에 의해 스캔되는 스캔대상자의 신체부위를 안정적으로 지지하기 위한 신체지지모듈을 포함하여 이루어진다. 상기 회전아암은 그 일측단이 일정한 각도로 절곡된 구조로 이루어지고, 상기 각 카메라는 상기 회전아암의 절곡된 부분에 구비된다. 상기 회전아암의 타측단에는 각 카메라의 무게를 상쇄하여 무게균형을 맞추기 위한 밸런스 웨이트가 갖추어진다. 상기 스탠드는 본체부와, 본체부의 하단에 구비된 받침부로 이루어진다. 상기 신체지지모듈은 스캔대상자의 신체부위를 받치는 바디레스트와, 상기 바디레스트에 의해 받쳐지는 신체부위가 정해진 자세를 안정적으로 유지토록 하는 자세유지수단을 포함하여 이루어진다. 상기 자세유지수단은 상기 바디레스트의 그 일측면에 상하 각도조절 가능하게 연결되는 지지프레임과, 상기 지지프레임에 의해 지지되며, 스캔대상자의 발바닥을 받침으로써 발이 일정한 각도로 구부러진 자세를 취하도록 하는 받침패널을 포함하여 이루어진다. 상기 받침패널에는 스캔대상자가 손을 끼워넣어서 손목이 펴진 자세를 취하도록 하는 핸드홀 내지는 스캔대상자가 각 손가락을 따로 끼워넣어서 각 손가락이 벌어진 자세를 취하도록 하는 핑거홀이 갖추어진다. 상기 바디레스트의 상면에는, 상하 높이 조절 가능함과 동시에, 분리 가능하게 장착되는 보조받침대가 갖추어진다. 이와 같은 본 발명에 의하면 사용자가 특정한 자세를 안정적으로 취하도록 하여 해당 신체부위가 정밀하게 스캔될 수 있도록 함으로써 의료용 보조기구의 효율적인 제작에 도움이 된다는 이점이 있다. A three-dimensional scan system according to the present invention comprises: a scan module comprising a stand, a rotating arm rotatably coupled to the stand, and a plurality of cameras provided on the rotating arm to scan a body part of a subject to be scanned; and a body support module for stably supporting the body part of the scan subject to be scanned by the scan module. The rotating arm has a structure in which one end thereof is bent at a predetermined angle, and each camera is provided at a bent portion of the rotating arm. A balance weight for balancing the weight by offsetting the weight of each camera is provided at the other end of the rotating arm. The stand includes a main body and a support provided at the lower end of the main body. The body support module includes a body rest for supporting the body part of the scan target, and a posture maintaining means for stably maintaining a predetermined posture of the body part supported by the body rest. The posture maintaining means includes a support frame that is connected to one side of the bodyrest so as to be able to adjust up and down angles, and a support ...

Stereoscopic display apparatus

A stereoscopic display apparatus that performs a stereoscopic display using a right-eye image and a left-eye image acquired by radiographing a subject plural times while changing an incidence angle of radiation on the subject, includes a display unit that stereoscopically displays the right-eye image and the left-eye image, and changing means that shifts at least one of the right-eye image and the left-eye image displayed on the display unit to change an inter-image distance being a distance between the right-eye image and the left-eye image in a direction parallel to a straight line connecting the right eye and the left eye of an observer.

X-ray image acquisition display method and apparatus for stereoscopic observation

Turn table for photographing and image photographing system using thereof

The present invention relates to a technique capable of enabling a user to generate a three-dimensional image with respect to a subject to be captured by using a simple device without renting a studio or using specialized products, and also capable of enabling the user to easily control the same. More specifically, the studio device has one area where the object to be photographed is positioned, and has an opened one side through which photographing is available, wherein the turn table can be installed in the one area. The turn table of the present invention comprises: a lower body configured to be positioned and affixed to the one open side of the studio apparatus, and including a light emitting means formed on a portion of an outer surface of the turn table in the opposite direction to a direction toward an image photographing means on the outer surface of the turn table, and emitting light from the portion of the outer surface toward an inner wall constituting the studio apparatus constituting the one area; an upper body coupled to an upper surface of the lower body to be relatively rotated; and a rotary module including a rotary means allowing the upper body to be relatively rotated with respect to the lower body, and a rotation control device having a communication function, wherein the rotation control device receives a control command from the outer side, and controls driving of the rotary means in accordance with the control command.

Calibration subject