СПОСОБ СЛИЯНИЯ ИЗОБРАЖЕНИЙ И ЭЛЕКТРОННОЕ УСТРОЙСТВО

Изобретение относится к захвату и обработке изображений. Техническим результатом является повышение качества изображений, полученных электронным устройством обработки изображений. Результат достигается тем, что получают множество изображений с различными признаками, причем процесс получения множества изображений с различными признаками содержит этапы, на которых в ответ на первую операцию получают посредством электронного устройства обработки изображений первое изображение через первую камеру, второе изображение через вторую камеру и третье изображение через третью камеру. При этом электронное устройство обработки изображений может обрабатывать первое изображение, чтобы получить четвертое изображение, где разрешение первого изображения области в четвертом изображении является таким же, как разрешение второго изображения. Затем электронное устройство обработки изображений может выполнять слияние изображений на втором изображении и четвертом изображении, чтобы получить пятое изображение.

Image stitching

A method of compositing video streams comprises: obtaining first 30 and second 40 video streams, where the backgrounds of the streams overlap; identifying a common feature 32 in the background of the streams; and stitching the streams together along the identified feature within the background of the streams. The streams may be captured by a camera and the background may be displayed on a display screen within the field of view of the camera. The backgrounds may be part of a common 3D model. A second invention defines a render engine which receives a first captured stream and a second CGI stream, identifies areas of difference between the streams to define possible subjects for extraction in the first stream, extracts the identified areas, and stitches the areas into the second (CGI) stream. A third invention comprises obtaining a first captured stream where the background is displayed on an LED screen and where the background is based on a 3D model. A second stream is obtained based on ...

Apparatus and method for imaging

An apparatus 100 for compiling an image comprises a deflector 110 operable to deflect light incident thereon by a controllable angular deflection and arranged to receive light from a field of view 10 which is moveable within a field of regard 20 by controlling the angular deflection. A detector 130 receives deflected light from the deflector 110 and is operable to output an image component composed from the deflected light. A processor 140 controls the angular deflection so as to select a part of the field of regard to be received at the detector 130, thereby selecting the size and/or position of an image component within the field of regard 20; and to receive a sequence of such image components from the detector 130. The apparatus 100 receives each image component passively, and the processor 140 compiles the sequence of image components to form a composite image of at least a part of the field of regard 20. The deflector 110 may comprise one or more acoustic-optic deflectors. The detector ...

A camera assembly and a method

Vehicle windshield camera module

A camera module, which is mounted on an inside of a front windshield of a vehicle and to image an external environment of the vehicle, includes a lens unit and an imager to image the external environment by forming an optical image, which is from the external environment through the lens unit.

Image processing device and electronic device

An image processing device includes: an input unit, first image data being a portion of an image with first and second photographic subjects being imaged being inputted therein, the second subject to be displayed after the first, and the first subject again to be displayed by repeating control to shift a portion of the image displayed upon the display unit in a first direction and to display a portion not displayed; and an image generation unit generating, from the first image data, second image data including the first and second subjects, and the second subject is arranged towards the first direction from the first subject, if a first distance by which the image displayed shifts from the first subject being displayed until the second subject is displayed is longer than a second distance by which the image displayed shifts from the second subject until the first subject is displayed.

Synthetic georeferenced wide-field of view imaging system

An imaging system for an aircraft is disclosed. A plurality of image sensors are attached, affixed, or secured to the aircraft. Each image sensor is configured to generate sensor-generated pixels based on an environment surrounding the aircraft. Each of the sensor-generated pixels is associated with respective pixel data including, position data, intensity data, time-of-acquisition data, sensor-type data, pointing angle data, latitude data, and longitude data. A controller generates a buffer image including synthetic-layer pixels, maps the sensor-generated pixels to the synthetic-layer pixels in the buffer image, fills a plurality of regions of the buffer image with the sensor-generated pixels, and presents the buffer image on a head-mounted display (HMD) to a user of the aircraft.

CALIBRATING SYSTEM FOR COLORIZING POINT-CLOUDS

A system includes a three-dimensional (3D) scanner that captures a 3D point cloud corresponding to one or more objects in a surrounding environment. The system further includes a camera that captures a control image by capturing a plurality of images of the surrounding environment, and an auxiliary camera configured to capture an ultrawide-angle image of the surrounding environment. One or more processors of the system colorize the 3D point cloud using the ultrawide-angle image by mapping the ultrawide-angle image to the 3D point cloud. The system performs a limited system calibration before colorizing each 3D point cloud, and a periodic full system calibration before/after a plurality of 3D point clouds are colorized.

Video shooting method and electronic device

A video shooting method includes: enabling a camera function; determining a first video recording template in response to a first operation of a user, where the first video recording template includes a first example sample, a second example sample, and preset audio; maintaining a position of an electronic device and starting video recording in response to a second operation of the user; and automatically generating a synthetic video, where the synthetic video includes a first video clip, a second video clip, and the preset audio, the first video clip is a video clip generated in the first camera movement mode, and the second video clip is a video clip generated in the second camera movement mode. In this manner, a plurality of video clips obtained in various camera movement modes may be synthesized into a video configured with audio.

METHOD AND APPARATUS FOR TRANSMITTING AND RECEIVING VIRTUAL REALITY CONTENT

IMAGE QUALITY ENHANCEMENT FOR AUTONOMOUS VEHICLE REMOTE OPERATIONS

Image pickup apparatus used as action camera

An image pickup apparatus comprises: an observation direction detection unit worn on a body part other than a user’s head; at least one image pickup (capture) unit worn on the user body part; recording direction determination unit to determine recording direction in accordance with observation direction detected; and image recording unit, recording an image corresponding to the recording direction determined from among an images picked up; the observation direction detection and image pickup units are located on a median plane of the user, under a jaw of the user in a worn state, the observation detection unit at a nearer position to the jaw than image pickup unit(s). Also, a similar imaging apparatus wherein the observation direction detection unit includes an optical component having a detection optical axis 0A2, the image pickup unit includes an optical component having an image pickup optical axis OA1; the detection axis and the image pickup axis are in a twisted positional relation ...

AVIAN DETECTION SYSTEMS AND METHODS

Provided herein are detection systems and related methods for detecting moving objects in an airspace surrounding the detection system. In an aspect, the moving object is a flying animal and the detection system comprises a first imager and a second imager that determines position of the moving object and for moving objects within a user selected distance from the system the system determines whether the moving object is a flying animal, such as a bird or bat. The systems and methods are compatible with wind turbines to identify avian(s) of interest in airspace around wind turbines and, if necessary, take action to minimize avian strike by a wind turbine blade.

RECORDING INFORMATION CREATION SYSTEM, METHOD FOR CREATING RECORDING INFORMATION, AND NON-TRANSITORY COMPUTER-EXECUTABLE MEDIUM

A system includes circuitry and a memory that stores an information recording application. When executed at a terminal apparatus, the information recording application creates recording information according to screen information displayed by a teleconference application selected by the information recording application and image information representing a surrounding space around a device acquired by the device.

Automated determination of acquisition locations of acquired building images based on determined surrounding room data

Techniques are described for computing devices to perform automated operations to determine the acquisition locations of images, such as within a building interior based on automatically determined shapes of rooms of the building, and for using the determined image acquisition location information in further automated manners. The image may be a panorama image or of another type (e.g., a rectilinear perspective image) and acquired at an acquisition location in a multi-room building's interior, and the determined acquisition location for such an image may be at least a location on the building's floor plan and optionally an orientation/direction for at least a part of the image—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.

Electronic apparatus and control method thereof

An electronic apparatus according to the present invention, includes at least one memory and at least one processor which function as: an acquisition unit configured to acquire a captured image; and a control unit configured to control so as to extract a partial range of an image acquired by the acquisition unit and record a still image that is not a VR image in a storage, and control so as to record a moving image that is a VR image in the storage based on the acquired image.

CODING SCHEMES FOR VIRTUAL REALITY (VR) SEQUENCES

An improved method for coding video is provided that includes Virtual Reality (VR) sequences that enables more efficient encoding by organizing the VR sequence as a single 2D block structure. In the method, reference picture and subpicture lists are created and extended to account for coding of the VR sequence. To further improve coding efficiency, reference indexing can be provided for the temporal and spatial difference between a current VR picture block and the reference pictures and subpictures for the VR sequence. Further, because the reference subpictures for the VR sequence may not have the proper orientation once the VR sequence subpictures are organized into the VR sequence, reorientation of the reference subpictures is made so that the reference subpicture orientations match the current VR subpicture orientations.

Apparatus and method for recording data to produce a localized panoramic image of a street and method related thereto

An apparatus is disclosed for recording data to produce a localized panoramic image of a street. The apparatus uses a camera and a device for satellite-based position and time determination, as well as a storage unit. A preparation device is provided which encodes time data of the device for satellite-based position and time determination into a format recordable for the camera and forwards this to the camera. The camera is designed to simultaneously record these data and record a continuous film. The storage unit stores the film with the time data as well as position and time data obtained from the device for satellite-based position and time determination. Furthermore, the apparatus operates in accordance with a method for producing a localized panoramic image.

Single image ultra-wide fisheye camera calibration via deep learning

Techniques related to calibrating fisheye cameras using a single image are discussed. Such techniques include applying a first pretrained convolutional neural network to an input fisheye image to generate camera model parameters excluding a principle point and applying a second pretrained convolutional neural network to the fisheye image and a difference of the fisheye image and a projection of the fisheye image using the camera model parameters to generate the principle point.

METHOD AND APPARATUS FOR RECONSTRUCTING 360-DEGREE IMAGE ACCORDING TO PROJECTION FORMAT

Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Method and system of image processing of omnidirectional images with a viewpoint shift

A method and system of image processing of omnidirectional images with a viewpoint shift. Omnidirectional cameras such as cameras equipped with ultra-wide-angle lenses may be used to capture images with a larger field of view (FOV) of a scene than the FOV of other types of lenses. Omnidirectional images are conventionally treated as central projections, ignoring the viewpoint shift due to the motion of entrance pupil of the lens, which causes significant and detectable errors in accuracy. This application operates by obtaining image data of at least one image captured by at least one imaging device, generating viewpoint shift data a viewpoint shift associated with the generation of the image data of the at least one image and separately providing both the image data and the viewpoint shift data to image processing applications to modify the image data depending on the viewpoint shift data which may be embedded in meta-data.

Photography-based 3D modeling system and method, and automatic 3D modeling apparatus and method

IMAGING SYSTEM, IMAGING METHOD, AND COMPUTER PROGRAM

An imaging system includes: a first control unit that controls an imaging unit to capture a first image of a subject at a first pixel density; a detection unit that detects an eye position of the subject from the first image; a setting unit that sets a peripheral area around eyes of the subject on the basis of the eye position; and a second control unit that controls the imaging unit to capture a second image of the peripheral area at a second pixel density that is higher than the first pixel density. According to such an imaging system, it is possible to properly capture an image of the periphery of the eyes of the subject.

AUTONOMOUS MEDIA CAPTURING

A media capture device (MCD) that provides a multi-sensor, free flight camera platform with advanced learning technology to replicate the desires and skills of the purchaser/owner is provided. Advanced algorithms may uniquely enable many functions for autonomous and revolutionary photography. The device may learn about the user, the environment, and/or how to optimize a photographic experience so that compelling events may be captured and composed into efficient and emotional sharing. The device may capture better photos and videos as perceived by one’s social circle of friends, and/or may greatly simplify the process of using a camera to the ultimate convenience of full autonomous operation.

INFORMATION PROCESSING SYSTEM, COMMUNICATION SYSTEM, AND IMAGE SHARING METHOD

An information processing system includes circuitry that: transmits video including a first wide-view image captured by an image capturing apparatus to each of a plurality of communication terminals; transmits an image capturing request to the image capturing apparatus in response to receiving a request for capturing the second wide-view image from a first communication terminal of the plurality of communication terminals, the second wide-view image being captured by the image capturing apparatus in response to the image capturing request; and associates the second wide-view image received from the image capturing apparatus with point-of-view information indicating a predetermined area of the first wide-view image to be displayed, the predetermined area being designated at the first communication terminal.

Image data encoding/decoding method and apparatus

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Image stitching

A method of compositing video streams comprises: obtaining first 30 and second 40 video streams, where the backgrounds of the streams overlap; identifying a common feature 32 in the background of the streams; and stitching the streams together along the identified feature within the background of the streams. The streams may be captured by a camera and the background may be displayed on a display screen within the field of view of the camera. The backgrounds may be part of a common 3D model. A second invention defines a render engine which receives a first captured stream and a second CGI stream, identifies areas of difference between the streams to define possible subjects for extraction in the first stream, extracts the identified areas, and stitches the areas into the second (CGI) stream. A third invention comprises obtaining a first captured stream where the background is displayed on an LED screen and where the background is based on a 3D model. A second stream is obtained based on ...

Wide viewing angle stereo camera apparatus and depth image processing method using the same

Disclosed are a wide viewing angle stereo camera apparatus and a depth image processing method using the same. A stereo camera apparatus includes a receiver configured to receive a first image and a second image of a subject captured through a first lens and a second lens that are provided in a vertical direction; a converter configured to convert the received first image and second image using a map projection scheme; and a processing configured to extract a depth of the subject by performing stereo matching on the first image and the second image converted using the map projection scheme, in a height direction.

Hyper camera with shared mirror

An imaging system can include a first and second camera configured to capture first and second sets of oblique images along first and second scan paths, respectively, on an object area. A drive is coupled to a scanning mirror structure, having at least one mirror surface, and configured to rotate the structure about a scan axis based on a scan angle. The first and second cameras each have an optical axis set at an oblique angle to the scan axis and include a respective lens to focus first and second imaging beams reflected from the mirror surface to an image sensor located in each of the cameras. The first and second imaging beams captured by their respective cameras can vary according to the scan angle. Each of the image sensors captures respective sets of oblique images by sampling the imaging beams at first and second values of the scan angle.

Server and method for displaying 3D tour comparison

The described technology is a technique related to a system and method for displaying 3D tour comparisons. The method for displaying a 3D tour comparison including setting each reference point for first and second tours that are different from each other, and setting coordinate values for a plurality of image photographing points included in the first and second tours, respectively, in the first tour, setting a first point that is one of the plurality of image photographing points included in the first tour, in the second tour, selecting a second point closest to the coordinate value of the first point out of the plurality of image photographing points included in the second tour, and displaying an image related to the first point on a part of a split-screen of a split-screen, and displaying an image related to the second point on at least a part of the rest of the split-screen of the split-screen.

Apparatus and methods for the optimal stitch zone calculation of a generated projection of a spherical image

Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

APPARATUS AND METHODS FOR NON-UNIFORM DOWNSAMPLING OF CAPTURED PANORAMIC IMAGES

Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

Capturing and processing of images including occlusions focused on an image sensor by a lens stack array

Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.

Electronic apparatus, method of controlling the same, and storage medium

An electronic apparatus includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic apparatus to perform control to display an image in a display unit based on a third image including a first image captured through a first optical system, and a second image having a parallax with respect to the first image, captured through a second optical system, receive an enlargement instruction for enlarging a part of the image displayed in the display unit, and perform control, upon reception of the enlargement instruction while the third image is displayed, to display in the display unit an enlarged image including an enlarged portion of either one of the first image and the second image.

MULTI APERTURE CAMERA AND METHOD FOR DRIVING THE SAME

Electronic apparatus for controlling display of image, control method of electronic apparatus and program

Camera device for generating an image of surroundings

A camera device having an enlarged or wide-angle field of view generates images of surroundings simultaneously using only one image capturing unit, such as an image sensor, for example. The camera device uses a diverting unit disposed upstream of the image capturing unit. The diverting unit includes so-called holographic optical elements which, based on their deflection structures, divert or deflect light so that the camera device can capture the wide-angle field of view, without generating imaging aberrations on the resulting image(s). The deflection structures are wavelength-selective and/or angle-selective. The total field of view is subdivided into individual angle-of-incidence regions by virtue of the properties of the deflection structures.

Image adjustment system, image adjustment device, and image adjustment method

In an image adjustment system, an image display device displays a captured image that is adjusted by an image adjustment device. The image adjustment device includes an image processor and an image generator. The image generator generates a spherical surface image. The image processor acquires the spherical surface image from the image generator to display the spherical surface image on the image display device on the basis of instruction information output from a controller. The image generator adjusts the captured image in accordance with a rotation of the spherical surface image, corrects camera shake in the captured image adjusted, and determines that a travel direction of a camera is changed when the captured image that is camera-shake corrected is changed by a predetermined angle or greater.

Pseudo lidar

A navigation system for a host vehicle may include a processor programmed to: receive from a center camera onboard the host vehicle a captured center image including a representation of at least a portion of an environment of the host vehicle, receive from a left surround camera onboard the host vehicle a captured left surround image including a representation of at least a portion of the environment of the host vehicle, and receive from a right surround camera onboard the host vehicle a captured right surround image including a representation of at least a portion of the environment of the host vehicle; provide the center image, the left surround image, and the right surround image to an analysis module configured to generate an output relative to the at least one captured center image; and cause a navigational action by the host vehicle based on the generated output.

Electronic control unit and vehicle control method thereof

An electronic control unit provided in a vehicle is provided. The electronic control unit comprises a communication unit for receiving information on vehicle electronic devices from one or more vehicle electronic devices provided in the vehicle, and a processor for selecting the information on vehicle electronic devices from any one of the vehicle electronic devices in response to occurrence of an event and controlling the communication unit to first transmit the selected information to a server.

Image data encoding/decoding method and apparatus

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Information processing system to obtain and manage images of a property

An information processing apparatus for processing an image includes circuitry unit and a communication interface. The circuitry acquires identification information to identify a set of one or more objects to be imaged by an imaging device according to a predetermined imaging sequence. The communication interface transmits at least one image of the set of one or more objects that is captured by the imaging device in association with the identification information, to a management device.

Method and apparatus for encapsulating images in a file

Encapsulating samples (images) in a file and parsing or reading samples (images) in a file, comprising: determining a grouping type based on a capture mode of the samples (images); generating a data structure describing the properties of the samples (images), the data structure comprising the grouping type; and embedding the data structure, the grouping type and samples (images) in the file. The data structure may ISO-BMFF and may be a second data structure (i.e. list of tie identifiers) ‘SampleGroupDescription’ box 402, within a first data structure (i.e. grouping information box) ‘SampleToGroup’ box 401. The grouping type may be defined for different image capture modes using four-character codes, such as: ‘auto exposure bracketing mode’ aebr; ‘white balance bracketing mode’ wbbr; ‘focus bracketing mode’ fobr; ‘flash exposure bracketing mode’ afbr; ‘depth or field bracketing mode’ dobr; ‘iso bracketing mode’ isbr; ‘time lapse mode’ tila; ‘panorama mode’ ‘pano’; ‘image burst mode’ imbu ...

Color and lighting adjustment for immersive content production system

An immersive content generation system receives a first input from a user indicating a lighting value. A second input indicates a region of an immersive stage set 200 to which the lighting value is to be applied. This lighting value is applied to the section of the immersive virtual environment. One or more modified images are then output by the system. Virtual lighting 108, 206 may be used. The lighting value may comprise intensity, colour, shape, size or softness.

CONTROL METHOD AND APPARATUS

A control method and apparatus are provided. The method is used to control an image shooting apparatus. The image shooting apparatus includes one camera or at least two cameras. The method includes: obtaining an instruction and/or cockpit information; generating control signaling according to the instruction and/or the obtained cockpit information; and when the image shooting apparatus includes one camera, controlling a space state of the camera of the image shooting apparatus by using the control signaling, or when the image shooting apparatus includes at least two cameras, controlling space states of some or all of the cameras by using the control signaling, so that at least one camera of the image shooting apparatus is flexibly controlled, and flexible changes of the space states of the cameras can meet requirements of a user for different multimedia scenarios. This improves user experience.

IMAGE DATA ENCODING/DECODING METHOD AND APPARATUS

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

ELECTRONIC DEVICE FOR IMAGE GENERATION, AND OPERATING METHOD OF ELECTRONIC DEVICE

An electronic device according to the present disclosure comprises: a camera having a first field of view; and at least one processor operatively connected to the camera, wherein the at least one processor can be configured to: acquire a first background image having a second field of view that is larger than the first field of view by allowing photography to be performed while changing the direction in which the camera faces, acquire, using the camera, a second background image corresponding to the first field of view and a subject positioned within the second background image, generate a composite image by combining a first part of the first background image and a second part of the second background image on the basis of the distance between a designated position of the second background image and the subject, and generate an image including the composite image and the subject.

DISPLAY TERMINAL, COMMUNICATION SYSTEM, DISPLAY METHOD, AND COMMUNICATION METHOD

A display terminal includes a reception unit (32, 301) to receive an operation for displaying a playback of a wide-angle view image related to a moving image recorded at a time of streaming of the moving image. The wide-angle view image has a wide viewing angle. The display terminal includes a display control unit (33, 301) to display, on a display (306), a display area representing a predetermined area of the wide-angle view image based on viewpoint information for specifying the predetermined area, in response to the operation received by the reception unit (33, 301). The predetermined area is displayed by a communication terminal (30) at the time of streaming of the moving image.

METHOD OF CONTROLLING PAN-TILT-ZOOM CAMERA BY USING FISHEYE CAMERA AND MONITORING SYSTEM

Configuring an immersive experience

An immersive experience is configured. The immersive experience comprises first and second scenes. First and second reference points are identified in the first scene. The first and second reference points are identified in the second scene. A relative bearing between the first and second scenes is determined using the identified first and second reference points in the first and second scenes.

METHOD FOR IMAGE COLLECTION, COMPUTER STORAGE MEDIUM, AND VEHICLE

A method for image collection, a computer storage medium, and a vehicle are provided. The method includes the following. An initial photographing direction of a mobile device associated with a vehicle is obtained, in response to determining that a predetermined condition is satisfied. An in-vehicle photography apparatus of the vehicle is adjusted to an initial orientation, to match a photographing direction at the initial orientation of the in-vehicle photography apparatus with the initial photographing direction of the mobile device. A drive signal configured to adjust the photographing direction of the in-vehicle photography apparatus is generated, based on a detecting signal of a sensor of the mobile device, such that the photographing direction of the in-vehicle photography apparatus synchronously varies with a pose of the mobile device. A surrounding image collected via the in-vehicle photography apparatus is transmitted to the mobile device, to display the surrounding image at the ...

Method and photographing device for acquiring side image for ocular proptosis degree analysis, and recording medium therefor

The present application relates to a method of acquiring a side image for analyzing the degree of ocular proptosis. According to an embodiment, an image acquisition method is provided which is including: acquiring a front image of the subject's face while guidance is given to satisfy a first photographing condition; generating panorama guidance on the basis of position information of a first point and a second point extracted from the front image; providing guidance on movement of a photographing device to acquire a preview image corresponding to the panorama guidance; and acquiring a side image of the subject's face while guidance is given to satisfy a second photographing condition. The first captured image shows iris areas of the subject, and the second captured image shows an outer canthus and a cornea of one of the subject's eyes.

IMAGE DATA ENCODING/DECODING METHOD AND APPARATUS

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Projecting multi-faceted image onto convex polyhedron based on wide-angle image

Systems and methods for projecting a multi-faceted image onto a convex polyhedron based on an input image are described. A system can include a controller configured to determine a mapping between pixels within a wide-angle image and a multi-faceted image, and generate the multi-faceted image based on the mapping.

Inspection system

Inspection system for visually inspecting objects, such as the surface of objects, during their transport along a transport path, the system including a free space allowing the objects to pass through the system and including an inspection area in which the objects are inspected visually, an illumination device for illuminating at least the peripheral surface of an object in the inspection area, and a plurality of camera/sensor devices, each being configured to take an image of a surface section of said peripheral surface in its respective field of view by receiving light running along a respective light path from the illuminated object to the camera/sensor device, the fields of view of the camera/sensor devices in combination providing for full peripheral coverage of azimuth angle 360° of the inspection area wherein the length of at least one of the light paths is longer than the spatial distance between its ends.

Multi-channel video recording method and device

A multi-channel video recording method comprises: starting, by an electronic device, a camera; acquiring images by using a first camera lens and a second camera lens in a plurality of camera lenses; displaying a preview interface, where the preview interface includes a first image and a second image; the first image is an image acquired by the first camera lens, the second image is from the second camera lens, and the second image corresponds to a central area of an image acquired by the second camera lens; and the first image is located in a first area in the preview interface, and the second image is located in a second area in the preview interface; starting video recording after detecting a video recording instruction operation of a user; and displaying a shooting screen, where the shooting screen includes the first area and the second area.

Image data encoding/decoding method and apparatus

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

TARGET OBJECT CAPTURING METHOD AND DEVICE, AND VIDEO MONITORING DEVICE

SYSTEM FOR PROVIDING MULTIPLE VIRTUAL REALITY VIEWS

ENDOSCOPIC CAMERA REGION OF INTEREST AUTOEXPOSURE

INSPECTION VEHICLE CONTROL DEVICE, CONTROL METHOD, AND COMPUTER PROGRAM

A vehicle control system includes at least one imaging device attached to a vehicle and that captures multiple images, and a control circuit that generates a composite image from the multiple images and displays the composite image on a display unit. The vehicle is operated according to a user operation on a portion of the display unit on which the composite image is being displayed.

WINGLESS AIRCRAFT

Downhole imaging

Designated view within a multi-view composited webcam signal

A system or method for imaging a panorama view may include a physical writing surface, a camera capturing the panorama view, and a sensor identifying a bearing of interest within the view. The system may maintain a coordinate map of the view, adjust an aspect ratio of the view, and generate a scaled panorama view based on the adjusted aspect ratio. The system may determine a coordinate of a designated view based on coordinate instructions and may generate a designated view signal based on the determined coordinate of the designated view comprising at least a portion of the physical writing surface. The system may composite a video signal including one or more of the scaled panorama view signal, a stage view signal, or the designated view signal, and may transmit the composite video signal.

Input apparatus, input method of input apparatus, and output apparatus

An input apparatus for inputting a diagnosis result of a diagnosis target detectable for a structure includes circuitry configured to display a spherical image captured for the structure on a screen, receive an input of a position of the diagnosis target in the spherical image, store position information indicating the received position of the diagnosis target in the spherical image in a memory, display, on the screen, the spherical image and a diagnosis information input field used for inputting diagnosis information of the diagnosis target, receive an input of the diagnosis information of the diagnosis target input via the diagnosis information input field, and store the diagnosis information and the position information indicating the received position of the diagnosis target in the spherical image, in the memory in association with each other.

Apparatus and method for generating panorama image

There are provided an apparatus and a method for generating a panorama image. The apparatus includes: a Region Of Interest (ROI) selecting block for receiving a plurality of images, and outputting ROI images by selecting an ROI of each of the plurality of images; a High Dynamic Range (HDR) processing block for performing HDR processing on the ROI images; and a panorama image generating block for generating a panorama image by stitching the plurality of images using a matching coordinate of the ROI images on which the HDR processing is performed. The HDR processing block performs the HDR processing on the panorama image.

IMAGING DEVICE AND METHOD, IMAGE PROCESSING DEVICE AND METHOD, AND IMAGING ELEMENT

Auto exposure metering for spherical panoramic content

Auto exposure metering is adapted for spherical panoramic content. Using input image data, a first metering map is generated for a selected image sensor and a second metering map is generated for an unselected image sensor. Auto exposure level values for the selected image sensor and for the unselected image sensor are respectively metered using the first metering map and the second metering map, such as by adjusting luminance weights in certain locations of the respective image sensor panoramic image capture band. Hemispherical images are processed using the auto exposure metered level values and stitched together in a panoramic format to produce a spherical panoramic image. The metering maps are generated to account for areas of greatest image data importance relative to a primary orientation direction of the spherical panoramic image. This allows for effective auto exposure metering of such areas within the resulting spherical panoramic image.

Visual display system and method in an aircraft

A system and method benefiting from cameras and digital hardware already installed on an aircraft in order to manage the images in the best possible manner according to the different flight phases. The visual display system in an aircraft includes a vision device to acquire a current image stream around the aircraft, and a processor to retrieve the current image stream from the vision device and to launch a current viewing application around the aircraft which is compatible with the current mobility phase of the aircraft.

IMAGE DISPLAY METHOD AND APPARATUS, AND ELECTRONIC DEVICE

An image display method and apparatus, and an electronic device are provided. The method includes: displaying, by an electronic device, a first input performed by a user in a case that a first three-dimensional model control is displayed on a photographing preview interface, where the first three-dimensional model control includes N display surfaces, and N is a positive integer; and displaying, by the electronic device on a first display surface in the N display surfaces in response to the first input, a first image photographed by a camera, where each display surface in the N display surfaces is used to display one image, and different display surfaces are used to display different images.

METHOD FOR STOCK KEEPING IN A STORE WITH FIXED CAMERAS

One variation of a method for stock keeping in a store includes: accessing an image captured by a fixed camera within the store; retrieving a field of view of the fixed camera; estimating a segment of an inventory structure in the store depicted in the image based on a projection of the field of view onto a planogram of the store; identifying a set of slots within the inventory structure segment; retrieving a product model representing a set of visual characteristics of a product type assigned to a slot, in the set of slots, by the planogram; extracting a constellation of features from the image; if the constellation of features approximates the set of visual characteristics in the product model, detecting presence of a product unit of the product type occupying the inventory structure segment; and representing presence of the product unit, occupying the inventory structure segment, in a realogram.

GENERATING PANORAMIC VIDEO FOR VIDEO MANAGEMENT SYSTEMS

Parallax-tolerant panoramic image generation

A method for generating a parallax-tolerant panoramic image includes obtaining a point cloud captured by a depth sensor, the point cloud representing a support structure bearing a set of objects; obtaining a set of images of the support structure and the set of objects, the set of images captured by an image sensor from a plurality of positions alongside a length of the support structure; generating a mesh structure using the point cloud, the mesh structure including a plurality of patches and representing a surface of the support structure and the set of objects; for each patch in the mesh structure, selecting an image from the set of images and projecting the selected image to the mesh patch; and generating an orthographic projection of the mesh structure onto a shelf plane of the support structure.

Object pre-encoding for 360-degree view for optimal quality and latency

Systems, apparatuses and methods may provide for technology to improve an appearance of objects that enter a viewable area of a 360-degree video. The technology may include a head mounted display (HMD), a viewport comprising a viewable area within the HMD, and a memory to store objects of interest not currently in the viewable area.

Electric shaver with imaging capability

System and method for improving the shaving experience by providing improved visibility of the skin shaving area. A digital camera is integrated with the electric shaver for close image capturing of shaving area, and displaying it on a display unit. The display unit can be integral part of the electric shaver casing, or housed in a separated device which receives the image via a communication channel. The communication channel can be wireless (using radio, audio or light) or wired, such as dedicated cabling or using powerline communication. A light source is used to better illuminate the shaving area. Video compression and digital image processing techniques are used for providing for improved shaving results. The wired communication medium can simultaneously be used also for carrying power from the electric shaver assembly to the display unit, or from the display unit to the electric shaver.

PHOTOGRAPHING APPARATUS FOR PHOTOGRAPHING PANORAMIC IMAGE AND METHOD THEREOF

MULTI-VIEW CAMERA AND LENS ADJUSTMENT DEVICE

AUTONOMOUS LAWN MOWER

Method and apparatus for encapsulating images in a file

SYSTEMS AND METHODS FOR IMAGE CAPTURE

Images subject to panoramic image stitching are analyzed for suitability in three dimensional construction. Effects of translation changes between cameras are mitigated. The dioptric relationship of subject content of the images to the camera set identifies camera translation changes, and eligible camera position inputs, permissible to avoid parallax errors. Images within permissible ranges of each other are stitched to create panoramic images of subject content that a camera cannot fully capture with a single image. Registration plane selection based on translation distances between cameras, and permissible translation changes based on detected subject content depth are disclosed.

Vehicle exterior imaging systems

This disclosure relates to vehicle exterior imaging systems that capture and display views of the exterior environment to vehicle operators. An exemplary vehicle exterior imaging system may include a glass panel including a combiner positioned between a first layer of glass and a second layer of glass, a first exterior side-view imager assembly configured to capture images of a vehicle exterior environment, and a projector assembly configured to project an output image onto the glass panel. The output image is based on the images captured by the first exterior side-view imager assembly. The glass panel may be part of either a windshield or a door window, and the projector assembly may be mounted either outside or inside of a housing of the first exterior side-view imager assembly.

Systems and methods for multispectral landscape mapping

Image acquisition and analysis systems for efficiently generating high resolution geo-referenced spectral imagery of a region of interest. In some examples, aerial spectral imaging systems for remote sensing of a geographic region, such as a vegetative landscape are disclosed for monitoring the development and health of the vegetative landscape. In some examples photogrammetry processes are applied to a first set of image frames captured with a first image sensor having a first field of view to generate external orientation data and surface elevation data and the generated external orientation data is translated into external orientation data for other image sensors co-located on the same apparatus for generating geo-referenced images of images captured by the one or more other image sensors.

Bowl-shaped photographic stage

A bowl-shaped photographic stage and photographic system is provided that produces consistent diffused lighting of an object or subject that is virtually shadow free for obtaining rotational views of the object in a time efficient manner. The bowl-shaped photographic stage may be used with a camera array, or a single camera may be moved around the circumference of the photographic stage to obtain a series of images needed to form a rotational view of an object or subject. Alternatively, the bowl-shaped photographic stage may be rotated to pass by a single fixed camera to obtain a series of images needed to form a rotational view of an object or subject.

DIGITAL IMAGE STITCHING SYSTEMS AND METHODS FOR GENERATING ONE OR MORE PANORAMIC IMAGE VIEWS

Digital image stitching systems and methods are disclosed herein for generating one or more panoramic image views. A plurality of digital images depicting a target feature within an application area are captured by a camera of a scanner device. Motion data is captured, by a sensor coupled to the scanner device, as the scanner device moves relative to the target feature, where relative position data, corresponding to the plurality of digital images, is determined based on the motion data. An angle or position is generated for a first image relative to a second image of the plurality of images, and, based on image matching of the angle or the position of the second image with respect to the first image, a panoramic image view is generated depicting the target feature in a wider field of view of the application area than either the first image or the second image.

THREE-DIMENSIONAL VIDEO PROCESSING

Image processing as a function of deformable electronic device geometry and corresponding devices and methods

A method comprises: detecting, with one or more sensors, geometry of a deformable electronic device having at least two imagers; capturing at least one image with at least one imager and at least one other image with at least one other imager; and processing the images as a function of deformable electronic device geometry. Also, a similar device in which respective imagers are disposed on first and second sides of a deformable portion of an electronic device; processor(s) combine images captured by the imagers to create a composite image as a function of geometry. Further, a method comprising: detecting, with one or more sensors, a bending operation deforming an electronic device at a bend, with at least one imager to one side of the bend and at least one other imager to another side of the bend; capturing at least one image with the imager and at least one other image with the other imager(s); and synthesizing the images as a function of a bend angle, creating a composite image. Device ...

Four-legged robot having ultra-wide viewing angle

A four-legged robot having an ultra-wide viewing angle. A four-legged robot is equipped with a wide-angle lens or a fisheye lens (2) having a viewing angle that covers a blind area (100) under the robot abdomen, and thus is capable of sensing the terrain under the robot abdomen and obstacles around the robot, achieving ultra-wide vision, and effectively reducing visual blind areas of the four-legged robot. Therefore, the solution can help the robot to select footholds for the feet to prevent the feet from slipping or stepping into pits or holes, or can be used for preventing the feet from hitting obstacles while swinging or for preventing the robot from hitting obstacles around the robot during movement. Thus, the solution prevents loss of control and damage of the four-legged robot, improves the motion sensing capability, and satisfies the requirements for autonomous movement and obstacle avoidance of four-legged robots.

Unconstrained image stabilisation

Image data encoding/decoding method and apparatus

A method for decoding a 360-degree image includes: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Here, generating the prediction image includes: checking, from the syntax information, prediction mode accuracy for a current block to be decoded; determining whether the checked prediction mode accuracy corresponds to most probable mode (MPM) information obtained from the syntax information; and when the checked prediction mode accuracy does not correspond to the MPM information, reconfiguring the MPM information according to the prediction mode accuracy for the current block.

Panoramic vision system with parallax mitigation

A panoramic image system with parallax mitigation includes a controller that can generate on a display an IFOV that includes image data from both a first image sensor having a first FOV and a second image sensor having a second FOV which are overlapping FOVs. The IFOV includes a portion of the non-overlapping section of a first FOV, the overlapping sections of both the first and second FOVs, and a portion of the non-overlapping section of the second FOV. The overlapping section of the first FOV is blended with the overlapping section of the second FOV, wherein the first FOV and the second FOV both have a level of contribution to the blended overlapping section. The level of contribution to the blending from the first FOV increases as the viewer's head moves in a first angular direction and decreases as the viewer's head moves in a second angular direction.

Calibrating system for colorizing point-clouds

A system includes a three-dimensional (3D) scanner that captures a 3D point cloud corresponding to one or more objects in a surrounding environment. The system further includes a camera that captures a control image by capturing a plurality of images of the surrounding environment, and an auxiliary camera configured to capture an ultrawide-angle image of the surrounding environment. One or more processors of the system colorize the 3D point cloud using the ultrawide-angle image by mapping the ultrawide-angle image to the 3D point cloud. The system performs a limited system calibration before colorizing each 3D point cloud, and a periodic full system calibration before/after a plurality of 3D point clouds are colorized.

Multi-panel, multi-communication video wall and system and method for seamlessly isolating one or more panels for individual use interaction

Electronic device, method for controlling electronic device, and program

An electronic device (200) sequentially displays a plurality of frame images of a moving content, such as VR content, on a screen (205) and displays a time line area (302) corresponding to a reproduction period of the plurality of frame images on the screen (205). The electronic device (200) calculates a position on a track (see fig 6) connecting reference positions of a first frame image and a second frame image, sets the calculated position as the reference position of the third frame image, and sets a plurality of fourth frame images existing in a specified period specified by an user to maintain one reference position specified by the user. The electronic device (200) displays the specified period and other periods separately in the time line area (302), and displays regions corresponding to the reference positions set for each of the plurality of frame images in sequence on the screen.

Method and apparatus for generating image

Disclosed is a method and apparatus for generating an image. The apparatus includes at least one processor and a memory. The processor is configured to obtain a wide image of an entire region, obtain one or more teleimages of one or more regions of interest (ROIs) of the entire region using a telecamera according to a capturing order of the telecamera determined for the one or more ROIs based on the wide image, match the wide image and the one or more teleimages, warp the one or more teleimages to the wide image based on a result of the matching, and stitch the one or more warped teleimages based on the wide image.

GENERATION OF ENHANCED PANORAMIC VISUAL CONTENT

An image capture device may capture two hemispherical views of a scene. The two hemispherical view of the scene may be stitched along a stitch line. The image capture device may be rotated to align the stitch line with a mid-line of a panoramic field of view of the scene. Separate exposure settings may be used to capture the two hemispherical views of the scene, with the exposure settings increasing the dynamic range of the scene depicted within the panoramic field of view of the scene. The panoramic field of view of the scene may be punched out as panoramic visual content.

Imaging device and imaging optical system

An imaging device includes: a plurality of optical systems each forming an image of a subject; a plurality of imaging sensors corresponding to the respective plurality of optical systems; and a housing part that houses the plurality of optical systems and the plurality of imaging sensors, the housing part having a peripheral surface along a circumferential direction about a reference axis, wherein: at least two of the plurality of optical systems each have: a peripheral lens arranged along the peripheral surface and located closest to an object; and a first optical path, the first optical paths of the at least two optical systems intersecting each other; and each of the peripheral lenses has a longitudinal direction, the peripheral lens being arranged along the peripheral surface such that the longitudinal direction extends along the reference axis.

DISPLAY APPARATUS, METHOD OF CONTROLLING THE SAME, AND COMPUTER PROGRAM PRODUCT THEREOF

VISIBILITY MEASUREMENT DEVICE

A visibility measurement device (10) comprising a camera (12) and a computing device (14) communicatively coupled to the camera and configured to: receive a first image from the camera; select a measurement feature in the first image, the measurement feature corresponding to a location within the field of view of the camera; measure an optical characteristic of the measurement feature to obtain a measured optical characteristic value for the location; and determine an ambient fog intensity value based on: the measured optical characteristic value; a reference optical characteristic value for the location; and a distance between the camera and the location, such that the ambient fog intensity value can be used to calculate the visibility in a direction between the camera and the location.

Image data encoding/decoding method and apparatus

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

INFORMATION PROCESSING METHOD, NON-TRANSITORY COMPUTER-READABLE MEDIUM, AND INFORMATION PROCESSING APPARATUS

An information processing method is performed by an information processing apparatus including a communication interface and an imaging device. The method includes acquiring a wide-angle image from an external imaging device via the communication interface; invoking an imaging function implemented by the imaging device; acquiring a captured image imaged by the imaging device; and associating the acquired wide-angle image with the acquired captured image.

Controller for photographing apparatus and photographing system

A picture photographed by a camera portion is sent to a video capturing portion of a computer. The picture is displayed in an operation, area of a monitor. A panorama picture of which pictures in part or all moving range of a pan tiler are combined is displayed in a panorama operation area. A pan tilter portion sends positional information of pan and tilt to the computer through a mode controller. With a mouse, the operation area and the panorama operation area are operated so as to select an object. The computer obtains data for driving the pan tilter. Thus, the selected object is displayed at the center of the operation area.

Method and apparatus for photographing a panoramic image

A method and apparatus for photographing a panoramic image. The method includes checking a Motion Vector (MV) of an image captured through an imaging device, selecting an image to be included the panoramic image based on the MV, detecting regions to be included in the panoramic image from the selected image, and generating the panoramic image including the detected regions.

Apparatus and method for producing images for stereoscopic viewing

Disclosed are methods and apparatus for producing images for stereoscopic, three-dimensional viewing generated with existing mobile graphical devices, such as cameras, video recorders, PDAs, telephones, and other devices, such as the iPhone™. Two reflectors, which may be mirrors or prisms, are positioned to separate the field of view of a camera lens on the mobile graphical device into a direct field of view and an offset field of view and to record and display the separated fields in a two-paned format on the mobile graphical device. Eye lenses are used to separately view the split images. An integrated housing and cradle receive the mobile graphical device and are coupled to the reflectors and the eye lenses. An area of each pane may be provided to display control icons for three-dimensional viewing, and a control area may be provided out of view on a touch screen for user control.

Method and apparatus for correlating and navigating between a live image and a prerecorded panoramic image

An approach is provided for correlating and navigating between a live camera image and a prerecorded panoramic image. A mapping and augmented reality application correlates at least one live image with a prerecorded panoramic image, when a first location of a device used to capture the at least one live image substantially matches or falls within a predetermined proximity of a second location of a device used to capture the panoramic prerecorded image. The mapping and augmented reality application causes, at least in part, alternating of the at least one live image and the prerecorded panoramic image in a presentation on a screen of the device capturing the at least one live image.

Auxiliary device for full-circle panoramic video imaging

So that parallax-free images can be taken even if the camera is rotated during filming and the direction of the camera is changed to an arbitrary direction, the auxiliary device is provided with a camera body retaining part and, in an equidistant surface centered on the nodal point of the camera, a camera attachment part. Regardless of the angle the camera makes as a result of the way in which the camera attachment part is mounted to a camera support mechanism part, the nodal point of the camera remains at a fixed location.

Control device, camera system, and program

According to a control device of the present invention, there is provided a center server including a display processing unit that performs control so as to display a panorama image display area in which a panorama image captured with a camera terminal device is displayed and an enlarged image display area in which an enlarged image is displayed, the enlarged image being obtained by enlarging an area corresponding to a position specified on the panorama image, and a control unit that performs control so as to capture with the camera terminal device an image of the area corresponding to the position specified on the panorama image. The display processing unit displays on the enlarged image display area the image captured with the camera terminal device in accordance with control by the control unit, and the panorama image is a circular panorama image.

Image processing apparatus, method, and storage medium capable of generating wide angle image

A digital camera 1 includes an image composition unit 52 and a composite position determining unit 53. The image composition unit 52 acquires a plurality of images which have been captured continuously. The composite position determining unit 53 sets candidate areas for determining composite positions in adjacent images, from the plurality of images acquired by the composite position determining unit 52. Furthermore, the composite position determining unit 53 determines composite positions of the adjacent images based on a degree of similarity between the set candidate areas. The image composition unit 52 combines the adjacent images at the determined composite positions.

Interlaced focal plane array for wide-area surveillance

Systems and methods of acquiring large field of view, high-resolution image data are discussed herein. Techniques and devices relate operation and composition of systems for acquiring large field of view, high-resolution image data. Such systems may include a first sensor chip assembly (SCA) in an interlaced focal plane array (FPA), the first SCA having a length, a width, and a resolution; a second SCA in the FPA, the second SCA having the same length, width, and resolution; and a field of view (FOV) adjustment device that moves the FOV of the FPA so that it can observe different scenes. In some such systems, the first and second SCAs are arranged relative to each-other in a first spaced array extending along a first dimension of the FPA such that there is an intentional gap between the first and second FPAs along the first dimension.

Rotatable Article Display Device and Method

A rotatable article display device for displaying an article such as a piece of jewelry or the like includes a platen defining a display surface. The platen is configured to rotate about a first axis substantially perpendicular to the display surface. A camera mount is provided which is configured to secure a camera to the device such that the camera is rotatable about a second axis substantially parallel to the display surface. In a method for use, at least one article of jewelry is positioned on the display surface and viewed while the platen is rotated about the perpendicular axis and the camera is rotated about the parallel axis.

Monitoring camera apparatus and control method for monitoring camera apparatus

A monitoring camera apparatus including a processing unit configured to process a video image input by an imaging unit, an upload control unit configured to upload the video image processed by the processing unit to a server via a network, a setting unit configured to set a parameter for the imaging unit to perform imaging or a processing parameter for the processing unit, and a transmission control unit configured to stop uploading of the processed video image to the server when the setting unit is in use.

Scanning electron microscope device and pattern dimension measuring method using same

In a panoramic image construction technology of dividing a wide-range imaging area (EP) of semiconductor patterns into a plurality of imaging areas (SEP), and joining a group of images, which are obtained by imaging the SEPs using an SEM, through image processing, a fact that although a pattern serving as a key to joining is not contained in an overlap area between some of the SEPs, all the images can be joined in some cases is noted so that: although the number of patterns serving as keys to joining is small, SEPs whose images are all joined can be determined; or even if such SEPs cannot be determined, SEPs satisfying user's request items as many as possible can be determined. The cases are extracted by optimizing an SEP arrangement, whereby the number of cases in which SEPs whose images are all joined can be determined is increased.

Head bracket

A head bracket for providing multiple horizontal panoramic pictures simultaneously comprises a video camera, a longitudinally rotating motor, a transversally rotating motor, sliding rings, a connection interface, and a support. A supporting pipe is arranged at center of head bracket and provided with multiple coaxial heads. Sliding rings are arranged at center of coaxial heads and fixed on supporting pipe. The video camera is mounted on fixing bracket of outer case of sliding rings. A longitudinally rotating belt pulley on video camera is connected to longitudinally rotating motor through a belt, and a transversely rotating belt pulley on sliding ring is connected to the transversely rotating motor through a belt; wherein the transversely rotating motor is fixed on a bottom plate fixed on the supporting pipe. The supporting pipe is internally provided with cables and cable connectors. The connection interface is arranged at the tail end where cables gather.

Apparatus and methods for full-mouth intraoral image acquisition

Apparatus and methods for full-mouth intraoral image acquisition. An intraoral sensor configuration includes a multi-aperture digital camera and/or a conformal layered sensor structure, a bite piece, and an electronic cable for imaging inside surfaces of a mouth of a patient without having to re-position the digital camera and/or the conformal layered sensor structure within the mouth of the patient during an image acquisition session. Images may be acquired sequentially or simultaneously.

Portrait Image Synthesis from Multiple Images Captured on a Handheld Device

A hand-held digital image capture device (digital camera) has a user-selectable mode in which upon engaging the mode the device detects a face in the field of view of the device and generates a face delimiter on a camera display screen, the delimiter surrounding the initial position of the image of a the face on the screen. The device is arranged to indicate thereafter to the user if the device departs from movement along a predetermined concave path P with the optical axis of the device pointing towards the face, such indication being made by movement of the image of the face relative to the delimiter. The camera captures and stores a plurality of images at successive positions along the concave path.

Providing multiple video perspectives of activities through a data network to a remote multimedia server for selective display by remote viewing audiences

Multiple visual perspectives in video of private and public activities including those in public areas such as entertainment venues captured by cameras located near the activities can be transmitted over data networks to a server where video-related data is processed and recorded for selective display by authorized, remote video display devices (e.g., HDTV, set-top boxes, computers, handheld devices) in wired/wireless communication with the server. Users can be registered and authorized to access the server to provide/access video captured by cameras at activities. Wireless handheld devices can selectively retrieve video-related data captured at activities for server storage and subsequent display by video display devices. Captured video/pictures can be organized in a server based on at least one of: activity title, activity time, activity date, activity place, wireless handheld device location at time of video recording, distance from location of interest. Simultaneous display of multiple videos on a display can be synchronized.

Pattern projection and imaging using lens arrays

A method for projection includes generating a pattern of illumination, and positioning an array of lenses so as to project different, respective parts of the pattern onto a scene.

Omnidirectional imaging system

To enable an image with no blind spot area to be obtained while ensuring a wide field of view, an omnidirectional imaging system includes: a primary mirror ( 101 ) including a hyperbolic mirror; a plurality of secondary mirrors ( 102 ) arranged around the primary mirror and each including a hyperbolic mirror; and a camera ( 104 ) that captures an image reflected by the primary mirror and images reflected by the plurality of secondary mirrors. A hyperboloid of the primary mirror and hyperboloids of the plurality of secondary mirrors have a substantially coincident outer focal point, and the camera ( 104 ) is placed so that a viewpoint of the camera substantially coincides with the outer focal point of the hyperboloid of the primary mirror ( 101 ) and the hyperboloids of the plurality of secondary mirrors ( 102 ), the viewpoint of the camera being an entrance pupil position of a lens attached to the camera ( 104 ).

Techniques for atmospheric and solar correction of aerial images

Techniques for atmospheric and solar correction of aerial images are described. An apparatus may comprise an atmospheric and solar component arranged for execution by a logic device and operative to correct solar and atmosphere artifacts from an aerial image. The atmospheric and solar component may comprise an image information component operative to generate an image record for each aerial image of a group of aerial images, the image record comprising statistical information and image context information for each aerial image, a filter generation component operative to generate an atmospheric filter and a solar filter from the statistical information and the image context information stored in the image records, and an image correction component operative to correct atmospheric and solar artifacts from the aerial image using the respective atmospheric filter and solar filter. Other embodiments are described and claimed.

System And Method For Creating Composite Images By Utilizing An Imaging Device

A system and method for creating composite images by utilizing a camera comprises a cradle device that transports the camera across a target area during a scanning procedure that captures and stores image data. During the scanning procedure, a motion detector captures and provides scan motion data to a scanning manager from the camera. The scanning manager may then responsively utilize the scan motion data to accurately extract still frames corresponding to the target area from the captured image data at pre-determined time intervals. A stitching software program may then access and combine the still frames generated by the scanning manager to thereby create composite images.

Image processing apparatus and method, and program

The present invention relates to an image processing apparatus and method, and a program capable of displaying a stereoscopic image having a more appropriate parallax. An image capture apparatus 11 captures a plurality of photographic images P( 1 ) to P(N) in a state of being turned around a center of turn C 11 . In response to an instruction for displaying an image in which a specific region in an area to be captured is displayed, the image capture apparatus 11 selects two photographic images between which parallax having a predetermined magnitude occurs in a subject in the specific region from among photographic images in which the specific region is displayed, and crops regions in which the subject in the specific region is displayed from these photographic images to produce right-eye and left-eye sub-images. These sub-images have an appropriate parallax and therefore are displayed simultaneously using a lenticular method or the like. Thus, a stereoscopic image with depth can be displayed. The present invention can be applied to a camera.

Omni-directional camera and related viewing software

Creating spherical video and corresponding audio utilizing a plurality of cameras by acquiring images via the cameras, processing the images, and mathematically converting and/or transforming the images into a combined spherical image file. A camera device creates the spherical image file and transfers it to devices running a viewer application, whereby the transfer occurs by saving the file to a storage file, streaming it to the devices via wired/wireless communication, or both.

Portable electronic device

According to an aspect, a portable electronic device includes an imaging unit, a moving unit, and a control unit. The imaging unit images a subject in an imaging region. The moving unit changes orientation and/or a position of the portable electronic device. The control unit causes the moving unit to change the orientation and/or the position of the portable electronic device so as to move the imaging region of the imaging unit.

Positional Sensor-Assisted Image Registration for Panoramic Photography

This disclosure pertains to devices, methods, and computer readable media for performing positional sensor-assisted panoramic photography techniques in handheld personal electronic devices. Generalized steps that may be used to carry out the panoramic photography techniques described herein include, but are not necessarily limited to: 1.) acquiring image data from the electronic device's image sensor; 2.) performing “motion filtering” on the acquired image data, e.g., using information returned from positional sensors of the electronic device to inform the processing of the image data; 3.) performing image registration between adjacent captured images; 4.) performing geometric corrections on captured image data, e.g., due to perspective changes and/or camera rotation about a non-center of perspective (COP) camera point; and 5.) “stitching” the captured images together to create the panoramic scene, e.g., blending the image data in the overlap area between adjacent captured images. The resultant stitched panoramic image may be cropped before final storage.

Orientation-based generation of panoramic fields

A field sensor may be capable of generating a panoramic field, e.g., by instructing the user to capture a sequence of fields of the panorama, performing a field evaluation to identify one or more landmarks depicted in overlapping areas of two contiguous fields, performing a field registration therebetween, and stitching together the panoramic field. However, panoramic field stitching based on field evaluation may fail to register two fields accurately or at all. Rather, panoramic field stitching may be performed using a device having an orientation sensor that detects the orientation of the device while capturing each field with a field sensor. The detected orientation may be used to orient the fields within a projection, from which a panoramic field may be accurately stitched. Additional variations include stitching together projections of the panorama captured at different times and utilizing fields captured at a distance from the root location of the panorama.

Image Registration Using Sliding Registration Windows

This disclosure pertains to devices, methods, and computer readable media for performing image registration. A few generalized steps may be used to carry out the image registration techniques described herein: 1) acquiring image data from an image sensor; 2) selecting a pair of overlapping image portions from the acquired image data for registration; 3) determining an area of “maximum energy” in one of the image portions being registered; 4) placing an image registration window over both image portions at the determined location of maximum energy; 5) registering the overlapping image portions using only the image data falling within the image registration windows; and 6) determining, according to one or more metrics, whether the image registration window should be shifted from a current location before registering subsequently acquired image portions.

Surveillance method utilizing video compression for wireless transmission

A digital surveillance method in which the output signal of a camera is highly compressed, to the extent that the compressed signal can be sent over relatively low bandwidth wireless networks, such as cellular networks. The compressed signal is then uploaded to the wireless network from where it can be relayed to a server, such as an internet server, from where it can be accessed, viewed, manipulated and further used by authorized personnel. Such authorized personnel need not be proximate to the surveillance equipment at all. The digital surveillance system can include fixed cameras mounted in fixed orientations and the signals of the various fixed cameras can be integrated into a wide view, as well as used as individual narrow views. These views are wirelessly communicated to an internet server from where they can be accessed, viewed, manipulated and further used by authorized personnel. To power the cameras and the wireless communication device, one or more solar panels are mounted on or applied to the fixed camera mount. By providing a user with access over a computer network to the surveillance video, the user can monitor a location without owning, operating, or maintaining a surveillance server of its own.

System and method for capturing and displaying cinema quality panoramic images

A system and method for capturing and displaying seamless cinema-quality 360° panoramic photographic and video images is described. In one embodiment, the panoramic imaging system comprises an image capture unit, a computing unit, a cooling unit, and a panoramic image display unit. The image capture unit includes a panoramic camera assembly which comprises a plurality of cameras evenly distributed upon a base plate about a circle of radius Riens. Each camera has its lens pointed at and aligned with a reflecting mirror positioned at a predetermined angle with respect to the vertical. The reflecting mirrors are arranged about a cylindrical support and are affixed to a top plate. The panoramic camera assembly acquires a plurality of images which are wrapped to form a 360° panoramic image. A specially configured Social Animals Flash player allows a user to view, play, manipulate, and click on the processed 360° image file.

Image processing device, and control method and computer readable medium

One embodiment of an apparatus includes a reference position receiving unit configured to receive intermediate or end panorama reference position information input by a user, and a control unit configured to control an imaging device to begin generating a plurality of images to be used to generate a panoramic image based on the intermediate or end panorama reference position information input by the user after the reference position receiving unit receives the intermediate or end panorama reference position information.

In camera implementation of selecting and stitching frames for panoramic imagery

A system, method, and computer program product for selecting qualifying frames from an image sequence for use in subsequent stitching into a composite panoramic image are disclosed. Incoming frames from any source may be cropped and downscaled prior to evaluation against qualifying criteria relating to image overlap and local motion. Qualifying images are saved and/or output. The resulting panoramic image generally uses fewer qualifying images and appears smoother and has fewer artifacts than those of the prior art. The qualifying criterion for image overlap is a predetermined overlap margin or percentage between a current image and a previous image from the sequence. The qualifying criterion for image motion includes a maximum amount of local motion, often due to passing objects. The embodiments may process incoming images in real time or from stored sequences. Problems may trigger user warnings.

Apparatus and method for providing panoramic view during video telephony and video messaging

An apparatus and method for performing video telephony by a mobile terminal are provided. The method includes establishing a video telephony connection with another mobile terminal, capturing a first image with a first camera, capturing a second image with a second camera, transmitting image information of at least one of the first image and the second image to a server, determining if image data is received from the server, if the image data is received, creating a panoramic image with the image data and at least one of the first image and the second image, and transmitting the panoramic image to the other mobile terminal.

Super resolution binary imaging and tracking system

In one aspect, the invention provides an imaging system including an optical system adapted to receive light from a field of view and direct the received light to two image planes. A fixed image detector is optically coupled to one of the image planes to detect at least a portion of the received light and generate image data corresponding to at least a portion of the field of view. A movable (e.g., rotatable) image detector is optically coupled to the other image plane to sample the received light at different locations thereof to generate another set of image data at a higher resolution than the image data obtained by the fixed detector. The system can include a processor for receiving the two sets of image data to generate two images of the field of view.

Image-capturing device

If a zoom magnification ratio of the image is changed after shooting, it is impossible to match brightness, amount of noise, exposure time between angles of view due to difference in light gathering ability of a camera. The number of one or more image-capturing units ( 130 to 161 ) having a first angle of view, among the plurality of image-capturing units, is made larger than the number of one or more image-capturing units ( 101 to 105 ) having a wider angle of view than the first angle of view. In addition, the amount of light being received in total by one or more image-capturing units ( 130 to 161 ) having a first angle of view is made approximately equal to the amount of light being received in total by one or more image-capturing units ( 101 to 105 ) having a second angle of view.

Image processing device and method, image processing system, and image processing program

An image processing device includes: an entire image display control portion that performs control to display an entire image of a predetermined region in an entire image display window; and a cutout image display control portion that performs control to enlarge a plurality of tracking subjects included in the entire image and display the tracking subjects in a cutout image display window. The cutout image display control portion performs the control in such a manner that one cutout image including the tracking subjects is displayed in the cutout image display window in a case where relative distances among the tracking subjects are equal to or smaller than a predetermined value, and that two cutout images including the respective tracking subjects are displayed in the cutout image display window in a case where the relative distances among the tracking subjects are larger than the predetermined value.

Street view creating system and method thereof

An exemplary street view creating method includes obtaining images captured by at least three cameras in close proximity. The method then extracts the distance information from the obtained images. Next, the method determines images captured by cameras in different orientations and at different precise locations. The method further creates virtual 3D models based on the determined images and the extracted distance information. Then, the method determines any overlapping portion between any two original images. The method aligns any portions of synchronous images which are determined as common or overlapping.

Monitoring camera and method for monitoring

A monitoring camera is arranged to monitor a wide angle image view. The camera comprises an event detector arranged to signal that an event has occurred when an alert line/tripwire positioned in the wide angle image view has been crossed. The alert line is defined as a line enclosing a point of the wide angle image view. A method for monitoring an area using the monitoring camera comprises capturing images representing a wide angle view through a wide angle lens, detecting if an object in the images is crossing an alert line defined in the wide angle view as a line enclosing a point in the wide angle view, and in response to a detection of an object crossing the alert line, redirecting the camera from capturing images through the wide angle lens to a position capturing an image view including the area in which the alert line was crossed.

Rotary image generator

A rotary system and method for capturing images and displaying moving images of the surroundings by rotating a camera in high speed and capturing a plurality of still images per second. The still images are then processed in real time and displayed in one or more display units. Each display unit can display a moving images view of a region in the surroundings and/or still images. Any still or moving image can be zoomed in.

Methods and apparatus for panoramic afocal image capture

The present invention includes a panoramic imaging system for projecting a 360 degree cylindrical field of view onto a two-dimensional annular format using a panoramic imaging block with a concentric axis 5 of symmetry, two refractive surfaces and two reflective surfaces, and an additional aspheric lens for mitigating aberrations inherent in refractive and reflective lenses.

360-Degree Automatic Tracking Hunting Camera And Operating Method Thereof

The invention discloses a camera comprises a central processing unit (the processor), at least three infrared sensors connected to respective input port of the processor, and a camera head connected to the processor and is controllable by the processor, a rotation mechanism for mounting the camera head and for pivoting clockwise or counterclockwise under control of the processor, and a power supply for providing power to the above mentioned processor, camera head, infrared sensors and the rotation mechanism. All the infrared sensors are arranged circumferentially on the device and a vision scope of one infrared sensor partially overlaps with a vision scope of an adjacent infrared sensor such that the total vision scope covers 360 degrees. Each infrared sensor defines a shooting orientation, and the partially overlapping area of the vision scopes of adjacent infrared sensors also defines a shooting orientation such that the total shooting orientation is doubled. The invention is advantageous in that a target object within the 360 degree range can be captured by the device, and the arrangement of valid shooting orientations may greatly simplify the control process and therefore extend the battery life.

Method and system for creating, receiving and playing multiview images, and related mobile communication device

A method and a system for creating, receiving and playing multi-view images are provided, and a related mobile communication device is also provided. A service server in the system receives images collected by the devices and encodes the received images based at least partly on redundancy of the images. The service server converts the received images into the multi-view images and sends them to a client terminal.

Image processing apparatus and method

Provided is an apparatus and method for generating a three-dimensional (3D) panoramic image using a single camera. The image processing apparatus may generate a two-dimensional (2D) reference panoramic image using a central area of each of a plurality of input image frames, and may extract a left-eye strip and a right-eye strip of when a similarity calculated in the plurality of input image frames based on the 2D reference panoramic image has a maximum value.

Image capture device and image synthesis method thereof

This invention discloses an image capture device and an image synthesis method thereof. The image capture device comprises an image pickup module and a processing module. The image pickup module scans a plurality of visual angles of a scene in advance to obtain a plurality of temporary images. Each of the temporary images has a scanning focal length value. The processing module analyzes the plurality of temporary image of each of the visual angles to obtain a temporary focal length value. The processing module obtains a weighting focal length value by each temporary focal length value by using a function to control the image pickup module in order to perform a panorama image capturing process according to the weighting focal length value.

Method of capture, display and sharing of orientation-based image sets

Captured images are associated with orientation. An imaginary rotational control can be used to play back the captured images associated with orientation.

Method and system of spacial visualisation of objects and a platform control system included in the system, in particular for a virtual fitting room

The disclosure relates to a method and a system for virtual visualization of objects and a platform control system included in the system, in particular for a virtual fitting room. Users can combine garments and accessories and watch the presented objects in a virtual environment in different perspectives. The system includes a rotatable platform with a control system thereof, wherein on the platform there is situated a spatial pattern. The rotatable platform is connected to an image or video capture device, which in turn is connected to a processing device. The processing device includes a processing module. The processing module comprises an input module, which cooperates with a comparator module. The comparator module cooperates with or without a coherence module, which in turn cooperates with a combination creating module for matching objects on the spatial pattern through a segmentation module.

Displaying arrays of image data

A method for displaying arrays of digital image data on a display monitor as a continuous image includes determining nonlinear corrections for each of the arrays of digital image data. Each nonlinear correction may be based in part on a location of the imaging device used to capture the array of digital image data relative to a location of the perspective center from which the array of digital image data will be displayed on the display monitor. The method also includes transforming each array of digital image data using the corresponding nonlinear correction. The method also includes displaying the arrays of corrected image data on the display monitor to produce a continuous display of the scene captured by the imaging device, where relative sizes and positions of objects in the scene are substantially reproduced in the display of the scene.

System and method for discreetly collecting 3d immersive/panoramic imagery

According to an embodiment of the disclosure, a system for discretely capturing data comprises a concealing structure and two or more cameras hidden within the concealing structure. The two or more cameras each having one or more sensors configured to collect imagery data. The imagery data includes data configured to construct one or more images. According to particular embodiments, the concealing structure is part of a vehicle, Additionally, according to particular embodiments, the two or more cameras are laterally offset from one another. Yet additionally, according to further embodiments, multiple sets of a plurality of laterally offset cameras are provided.

Electronic system with augmented reality mechanism and method of operation thereof

A method of operation of an electronic system includes: scanning an image for detecting a subject; detecting a potential adjustment for moving the subject within the image; and selecting an augmentation for recommending the potential adjustment and for displaying the augmentation on a device.

System and method of interactively controlling a virtual camera

A multiple-view virtual camera system comprising one or more image source units, an image processing unit, a parameter setting unit in signal communication with the image processing unit, and a display in signal communication with the image processing unit. The display is configured to display images generated by the image processing unit to a user of the virtual camera system, where the displayed images are configured according to image-related parameters input by a user of the multiple-view camera system through the parameter setting unit. The parameter setting unit may include a user interface, such as a single-touch or multi-touch touchscreen display, configured to accept input from the user that adjusts the parameters that are transmitted to the image processing unit and utilized by the image processing unit. A method of interactively controlling the virtual camera system by a user of a motor vehicle is also disclosed.

Digital detector

An extra-oral dental imaging apparatus for obtaining an image from a patient has a radiation source and a digital imaging sensor that provides, for each of a number of image pixels, at least a first digital value according to a count of received photons that exceed at least a first energy threshold. A mount supports the radiation source and the digital imaging sensor on opposite sides of the patient's head. There can be a computer in signal communication with the digital imaging sensor for acquiring one or more two-dimensional images.

Video camera positioning system and control method thereof

A method for controlling a video camera positioning system includes the steps of controlling a motor for driving a video camera to capture a panoramic frame, dividing the panoramic frame into a plurality of frames, controlling the motor for driving the camera lens to turn to the frame corresponding to an encoded command signal when the microcontroller receiving the encoded command signal, and zooming in the frame by the video camera. Furthermore, a video camera positioning system is also disclosed herein.

Method of and Apparatus for Image Enhancement

Image enhancement by separating the image signals, either Y or RGB, into a series of bands and performing noise reduction on bands below a given frequency but not on bands above that frequency. The bands are summed to develop the image enhanced signals. This results in improved sharpness and masking of image processing pipeline artifacts. Chroma signals are not separated into bands but have noise reduction applied to the full bandwidth signals. The higher frequency band is attenuated or amplified based on light level. The noise reduction has thresholds based on measured parameters, such as signal frequency, gain and light level, provided in a lookup table. The window size used for the noise reduction varies with the light level as well, smaller windows sizes being used in bright light and increasing window sizes as light levels decrease. Panoramic images are handled in a similar fashion.

Continuous video capture during switch between video capture devices

A method provides capturing video information in an electronic device. Capturing video information comprises capturing video, using a first video capture device of the electronic device, switching video capture between the first video capture device and a second video capture device of the electronic device, and continuing video capture while switching between the first video capture device and the second video capture device.

Virtual perspective image synthesizing system and its synthesizing method

The present disclosure provides a virtual perspective image synthesizing system for synthesizing multiple planar images into a virtual perspective image. The planar images are of the same object, as photographed by various panoramic camera devices, for example, fisheye lens and multi-lens camera devices. The virtual perspective image synthesizing system includes a computing device and a plurality of panoramic camera devices. The panoramic camera devices are arranged throughout the space to be monitored. The computing device is electrically connected to the panoramic camera devices. The computing device selects at least two of the panoramic camera devices based on the viewing position the viewer wishes to view from and distance of each panoramic camera device to the viewing target. The computing device synthesizes according to the synthesizing angle the panoramic images selected, to generate the virtual perspective image.

Imaging apparatus, method of controlling the same, and computer program

An imaging apparatus includes: an imaging unit that respectively generates, with imaging devices different from one another, a first captured image with a specific direction of a subject set in a longitudinal direction, a second captured image with an orthogonal direction orthogonal to the specific direction set in a longitudinal direction and including a subject adjacent to one side of the orthogonal direction of the subject included in the first captured image, and a third captured image with the orthogonal direction set in a longitudinal direction and including a subject adjacent to the other side of the orthogonal direction of the subject included in the first captured image; a detecting unit that detects a state of the imaging apparatus; and a control unit that determines, based on the detected state, a range of a target image as a target of display or recording among the first to third captured images.

Method and system for improving surveillance of ptz cameras

The subject matter discloses a method, comprising obtaining a scene from a video camera and defining at least one point of the scene; creating a first scene terrain model of the scene, said first scene terrain model comprises a typical human object size in pixels in said at least one point of the scene; creating a second scene model of the scene, said second model defines a false positive determination that said at least one point comprises a human object; wherein said second scene model is created when the scene does not contain a human object; obtaining an image of the scene, said image is captured by a video camera; determining whether the human object is detected at the at least one point of said captured image by applying said first scene terrain model and said second scene model on the least one point.

Automated external defibrillator with panoramic video camera device

An automated external defibrillator (AED) with a panoramic video camera device comprises a case, an AED accommodated by the case, a microprocessor built in the AED, an image capture device electrically connected with the microprocessor, a memory electrically connected with the microprocessor and storing the images captured by the image capture device, and a panoramic lens arranged above the image capture device. During usage, the present invention takes motion pictures panoramically to provide more detailed information for the medical personnel after the patient has been transported to the hospital and ascertain the truth for a medical dispute.

Video processing systems and methods

A smart camera system is disclosed. The camera can work with cloud data storage systems and compute cloud. A call center can access the cloud to provide security monitoring services.

Aerial vehicle image capturing systems

A method, system, apparatus, and/or device for capturing an image from an aerial vehicle. The method, system, apparatus, and/or device may include a boom, a motor, a propeller, a controller, a top plate, a bottom plate, and an image capturing device. The boom may be an arm that extends outwardly. The motor may be connected to an end of the boom. The propeller may be connected to the motor. The motor may be configured to rotate the propeller to lift the system, the apparatus, and/or the device into flight when the motor is engaged. The controller may be configured to control the motor. The top plate may be connected to a first end of the boom. The bottom plate may be connected to a second end of the boom. The image capturing device may be mounted to the top plate or the bottom plate.

High resolution 3d point clouds generation from downsampled low resolution lidar 3d point clouds and camera images

In one embodiment, a method or system generates a high resolution 3-D point cloud to operate an autonomous driving vehicle (ADV) from a low resolution 3-D point cloud and camera-captured image(s). The system receives a first image captured by a camera for a driving environment. The system receives a second image representing a first depth map of a first point cloud corresponding to the driving environment. The system downsamples the second image by a predetermined scale factor until a resolution of the second image reaches a predetermined threshold. The system generates a second depth map by applying a convolutional neural network (CNN) model to the first image and the downsampled second image, the second depth map having a higher resolution than the first depth map such that the second depth map represents a second point cloud perceiving the driving environment surrounding the ADV.

High resolution 3d point clouds generation based on cnn and crf models

In one embodiment, a method or system generates a high resolution 3-D point cloud to operate an autonomous driving vehicle (ADV) from a low resolution 3-D point cloud and camera-captured image(s). The system receives a first image captured by a camera for a driving environment. The system receives a second image representing a first depth map of a first point cloud corresponding to the driving environment. The system determines a second depth map by applying a convolutional neural network model to the first image. The system generates a third depth map by applying a conditional random fields model to the first image, the second image and the second depth map, the third depth map having a higher resolution than the first depth map such that the third depth map represents a second point cloud perceiving the driving environment surrounding the ADV.

Image stitching in a multi-camera array

Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Image stitching in a multi-camera array

Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

Method and apparatus for providing virtural processing effects for wide-angle video images

A system and method for capturing and presenting immersive video presentations is described. A variety of different implementations are disclosed including multiple stream pay-per-view, sporting event coverage and 3D image modeling from the immersive video presentations.

Immersive video system and method based on gaze vector information

A system and method for providing immersive video based on gaze vector information. A gaze vector is obtained from a client device operating to display a 360° immersive video asset to a user, wherein each video frame comprises an array of tiles projected on a 3-dimensional (3D) display environment viewed by the user in which the user is immersed, the gaze vector defining a gaze direction in the 3D display environment where the user is viewing (i.e., a viewport) at any particular time. Angular separations between the viewport and remaining portions of the video frame are used in selecting different video qualities of the 360° immersive video asset such that the viewport comprises a higher video quality than the remaining portions when displayed by the client device.

Systems and methods for generating depth maps using a camera arrays incorporating monochrome and color cameras

A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.

Compact panoramic camera: optical system, apparatus, image forming method

An optical system, apparatus, and method for sensing 360-degree horizontal and wide vertical field of view are shown. Powerful optics creates high resolution decompressed images on an image sensor. The compact panoramic camera includes two major optical components: (i) an axially symmetric convex aspheric reflector incorporated into a catadioptric optical element capable of providing a virtual curved image of a 360-degree panoramic scene with a specific image compression and (ii) a decompression lens with hardware aperture. The decompression lens is comprised of three single lens elements and accepts the virtual curved and compressed image and projects it onto the image sensor with high optical resolution and desirable image decompression to achieve a high digital resolution at the same time. Another version of decompression lens is comprised only of a single lens element and projects high resolution decompressed images onto an image sensor.

Method and apparatus for performing object detection according to bounding box distribution that is determined by considering lens configuration

An object detection apparatus includes a boundary box decision circuit and a processing circuit. The boundary box decision circuit receives lens configuration information of a lens, and refers to the lens configuration information to determine a bounding box distribution of bounding boxes that are assigned to different detection distances with respect to the lens for detection of a target object. The processing circuit receives a captured image that is derived from an output of an image capture device using the lens, and performs object detection upon the captured image according to the bounding box distribution of the bounding boxes.

Vehicular multi-camera surround view system with video display

A vehicular multi-camera surround view system includes a front camera, a driver-side camera, a passenger-side camera and a rear backup camera. Image data captured by the cameras is conveyed to an electronic control unit. The electronic control unit is operable to combine image data conveyed from the front camera, the driver-side camera, the passenger-side camera and the rear backup camera to form composite video images, which are output for display at a display device. Rear backup video images are displayed no later than two seconds after the driver of the vehicle first changes propulsion of the vehicle during a new ignition cycle to reverse mode. Upon changing propulsion of the vehicle during the new ignition cycle to reverse mode to commence a backup event subsequent to the first backup event, the video display screen displays video images derived, at least in part, from image data captured by the rear backup camera.

Method and system for three-dimensional imaging

A method for three-dimensional imaging is provided, storing a first two-dimensional image of field of view of a scanning device at a first position where a first three-dimensional view of the object is captured with said handheld scanning device; estimating location metric of a second two-dimensional image of field of view of said scanning device at a second position relative to said first image while said scanning device is being moved from said first position to said second position; and generating instructions on providing feedback to the user based on said location metric; wherein said feedback is provided to indicate if said second position is adequate for capturing a second three-dimensional view. A system for three-dimensional imaging is provided as well.

Mobile electronic device and mobile phone

The present disclosure relates to a mobile electronic device, which includes a body, a display screen disposed to an obverse surface of the body, an input-output module, and a drive assembly coupled to the input-output module. The display screen is able to display a start tag and a mode tag. The input-output module includes a base and a camera disposed to the base, and the input-output module is able to be at least partially accommodated in the body. The drive assembly is configured to drive the input-output module to be exposed from an end portion of the body in accordance with a user input signal for the start tag, and is configured to drive the input-output module to rotate in accordance with a user input for the mode tag. A mobile phone is also provided.

Method and system for integrated optical systems

A method of operating optical systems includes forming a stitched image of a field of regard using a first optical device. The stitched image of the field of regard comprises a plurality of sub-images associated with a first field of view. The method also includes receiving an image of a second field of view from a second optical device and determining a location of the image of the second field of view in the stitched image. The method further includes communicating an indicator to the second optical device. The indicator is to the location of the image of the second field of view in the stitched image.

Control device, imaging device, mobile object, control method and program

A control device includes a processor and a storage medium storing instructions that cause the processor to control an imaging device to capture a plurality of images while an imaging direction of the imaging device is changing, determine a target imaging direction of the imaging device that satisfies a predetermined condition based on the plurality of images, and control the imaging device to perform additional image capturing while further changing the imaging direction, including performing image capturing at a first image capture angle rate while the imaging direction is in a first angle range not including the target imaging direction and performing image capturing at a second image capture angle rate while the imaging direction is in a second angle range including the target imaging direction. The second image capture angle rate correspond to more images captured per unit angle than the first image capture angle rate.

Earphone and earphone system

An earphone and an earphone system are provided. The earphone includes two earpiece main bodies, two MIPI cameras, an MIPI driver and a processor. The two MIPI cameras are respectively disposed on the two earpiece main bodies and located on the sides facing away from a wearer. The processor is connected to MIPI interfaces of the two MIPI cameras through the MIPI driver, and acquires images photographed by the two MIPI cameras. The earphone system includes the earphone described above, and further includes a back-end processing platform and a USB communication device. The back-end processing platform is connected to the processor through the USB communication device, and acquires the images photographed by the two MIPI cameras transmitted by the processor.

Co-boresighted monocentric multiscale (mms) camera exhibiting galilean multiscale design

Disclosed are systems, methods, and structures for monocentric multiscale gigapixel imaging systems and cameras employing a Galilean architecture wherein adjacent subimages do not overlap while advantageously producing a reduced system volume, improved relative illumination and image quality as compared with prior art systems.

High Resolution Wide Field of View Digital Night Vision System

A wide field of view night vision system is described. The system comprises a head attachment apparatus configured to attach to a user's head and a night vision subsystem. The night vision subsystem comprises one or more night vision image sensors attached to the head attachment apparatus. Each sensor receives input light and produces a digital image of the input light. A processor processes the digital image(s) to produce a wide-field image. The wide-field image spans at least 60 degrees of a user's horizontal field of view. A display and eyepiece attached to the head attachment apparatus receives and displays the wide-field image. The eyepiece is positionable between the display and the user's eye to image the wide-field image into the user's eye.

Multiple View and Multiple Object Processing in Wide-Angle Video Camera

Methods and systems of transmitting a plurality of views from a video camera are disclosed. A multi object processing camera captures a wide-angle field of view in high resolution and a processing circuit executes a plurality of software tasks on a plurality of regions extracted from the wide-angle view. Multiple objects can be processed by the camera to detect various events, and the results of the processing transmitted to a base station. The camera removes the need for mechanical pan, tilt, and zoom apparatus by correcting distortions in the electronic image introduced by the wide-angle optical system and image sensor to electronically emulate the pan, tilt, and zoom movement.

Projection apparatus and projection method

A projection apparatus and a projection method are provided. The projection apparatus includes a projection device, a capturing image device, and a processing device. The capturing image device is configured to obtain an environmental image. The processing device is coupled to the projection device and the capturing image device. The processing device is configured to analyze the environmental image to provide at least one effective projection region. The processing device selects one of the at least one effective projection regions as a target projection region. The projection device is configured to project a projection image to the target projection region.

View-Driven Consumption of Frameless Media

This document describes techniques and apparatuses enabling view-driven consumption of frameless media. These techniques and apparatuses provide frameless media and enable a user to engage with the frameless media by orienting a viewing device within the world created by that frameless media. This orienting by the user drives what the user sees in this world and when the user sees it.

Method and apparatus for displaying images in portable terminal

A method of displaying an image in a portable terminal is provided. The method includescontinuously generating continuously at least one image of a subject,calculating a central point of the at least one image, anddisplaying a spatial image providing a spatial sense of the subject by using the central point.

Construction machine and method of controlling construction machine

A construction machine includes an image capturing device configured to capture an image of the surroundings, an image display part mounted in an operator's cab and configured to display a menu screen showing an operating condition and various settings, or the captured image captured with the image capturing device, an operation part including a menu switch to cause the menu screen to be displayed on the image display part, and a detector configured to detect whether a work element is enabled or disabled. The image display part is configured to display a warning in response to the menu switch being operated while the work element is enabled.

Imaging apparatus and non-transitory storage medium

An imaging apparatus that generates a wide-angle image on the basis of images from a plurality of imaging units and is capable of decreasing a likelihood of a subject becoming a double image. The imaging apparatus includes a determination unit configured to determine an imaging range of at least one of a first imaging unit and a second imaging unit on the basis of information relating to a subject designated by a user in a case in which a switching instruction from a non-composition mode to a composition mode and information relating to a subject designated by the user are received from an external device.

Digital content processing and generation for a virtual environment

An artificial reality system and method provides immersive digital content to a user via a device with limited capabilities. A digital content processor generates a video stream of a real-world environment in a first video resolution regime. The digital content processor identifies static regions across frames of the video stream. The digital content processor applies one or more of a stitching operation, a blending operation, and a layering operation to replace static regions of the video stream with still image pixels. The digital content processor transmits the modified video stream to a display unit of a virtual reality (VR) device at a second video resolution regime of lower resolution than the first video resolution regime.

Image Processing Device, and related Depth Estimation System and Depth Estimation Method

An image processing device is applied to an image processing device and a related depth estimation system. The image processing device includes a receiving unit and a processing unit. The receiving unit is adapted to receive a capturing image. The processing unit is electrically connected with the receiving unit to determine a first sub-image and a second sub-image on the capturing image, to compute relationship between a feature of the first sub-image and a corresponding feature of the second sub-image, and to compute a depth map about the capturing image via disparity of the foresaid relationship. The feature of the first sub-image is correlated with the corresponding feature of the second sub-image, and a scene of the first sub-image is at least partly overlapped with a scene of the second sub-image.

Rear cross traffic - quick looks

System and method of performing various transformations between an omnidirectional image model and a rectilinear image model for use in vehicle imaging systems. In particular, a panel transform system and method for transforming an omnidirectional image from an omnidirectional camera positioned on a vehicle to a rectilinear image. The rectilinear image is then displayed to the driver for use while performing vehicle maneuvers. The panel transform system and method also provide a rectilinear image model based on the omnidirectional camera for use with existing rectilinear imaging processing systems. The rectilinear image model is determined based on a variable set of input parameters that are defined by both automatic and manual system inputs such as a steering wheel angle sensor and a user interface.

Apparatus for video output and associated methods

An apparatus comprising a processor and memory including computer program code, the memory and computer program code configured to, with the processor, enable the apparatus at least to: use received current-field-of-view indication data together with future-event-direction data, in respect of recorded panoramic video output provided by panoramic video content data, to provide a sensory cue for a viewer of the recorded panoramic video output to indicate the direction of a future event in the recorded panoramic video output which is outside a current field of view, wherein the recorded panoramic video output is configured to provide video content to the viewer which extends outside the field of view of the viewer in at least in one direction, and the future-event-direction data is supplemental to the panoramic video content data which provides the video content itself.

Super Resolution Binary Imaging And Tracking System

In one aspect, the invention provides an imaging system including an optical system adapted to receive light from a field of view and direct the received light to two image planes. A fixed image detector is optically coupled to one of the image planes to detect at least a portion of the received light and generate image data corresponding to at least a portion of the field of view. A movable (e.g., rotatable) image detector is optically coupled to the other image plane to sample the received light at different locations thereof to generate another set of image data at a higher resolution than the image data obtained by the fixed detector. The system can include a processor for receiving the two sets of image data to generate two images of the field of view. In some implementations, the processor can employ one of the images (typically the image having a lower resolution) to detect one or more objects of interest (e.g., one or more objects moving within the field of view) and to effect the acquisition of image data corresponding to one or more of those moving objects at a higher resolution (e.g., by controlling the movement of the movable image detector).

Image processing device and associated methodology for generating panoramic images

One embodiment of an apparatus includes a reference position receiving unit configured to receive intermediate or end panorama reference position information input by a user, and a control unit configured to control an imaging device to begin generating a plurality of images to be used to generate a panoramic image based on the intermediate or end panorama reference position information input by the user after the reference position receiving unit receives the intermediate or end panorama reference position information.

Semiconductor device, method of manufacturing the same, and electronic device including the device

A semiconductor device including a first source/drain region at a lower portion thereof, a second source/drain region at an upper portion thereof, a channel region between the first source/drain region and the second source/drain region and close to peripheral surfaces thereof, and a body region inside the channel region. The semiconductor device may further include a gate stack formed around a periphery of the channel region.

Compression method and apparatus for panoramic stereo video system

A method of compressing a stereoscopic video including a left view frame and a right view frame is provided, the method including: determining a texture saliency value for a first block in the left view frame by intra prediction (1101); determining a motion saliency value for the first block by motion estimation (1102); determining a disparity saliency value between the first block and a corresponding second block in the right view frame (1103); determining a quantization parameter based on the disparity saliency value, the texture saliency value, and the motion saliency value (1104); and performing quantization of the first block in accordance with the quantization parameter (1105).

Method and apparatus for 2d to 3d conversion using panorama image

An apparatus for 2D to 3D conversion using a panorama image includes an image receiving unit for receiving and storing an input image, a user interface for receiving an input of a user who performs a 3D conversion work, a panorama image generating unit for extracting feature points of a plurality of images, a depth setting unit for recording scribbles including depth information in at least one of a plurality of pixels of the panorama image in response to the input of the user received through the user interface, a depth information propagating unit for calculating depth values of other pixels, a depth information remapping unit for mapping a depth value with respect to each of the plurality of images, and a stereo image generating unit for generating a stereo image pair for each of the plurality of images.

Systems and methods and apparatuses for capturing concurrent multiple perspectives of a target by mobile devices

Systems, methods and apparatuses utilize multiple, independent sensing devices to collaboratively gather sensing data. A server or one of the sensing devices receives information which is used to select a target, and the device commences gathering sensing data of a target. The server or the device then solicits other devices to provide additional perspectives of the target. The other devices can solicit still other devices, in a cascading or other fashion. The concurrent, multiple perspectives thus gathered are provided to a collector, and can be mosaicked or otherwise stitched together.

Block-based lensless compressive image acquisition

The present disclosure generally discloses block-based lensless compressive image acquisition capabilities. The block-based lensless compressive image acquisition capabilities may include a block-based lensless camera. The block-based lensless camera may include a set of two or more image acquisition block configured to capture respective sets of image data (e.g., detector outputs or compressive measurements produced from detector outputs) for respective image portions of an image to be captured by the block-based lensless camera. The blocks of a block-based lensless camera may each include an aperture including a set of aperture elements, a sensor, and an isolation chamber disposed between the aperture and the sensor for directing light from the aperture to the sensor while preventing comingling of light of the block and light of other blocks.

Vehicular multi-camera vision system

A vision system for a vehicle includes a plurality of cameras with one camera functioning as a master camera and other cameras functioning as slave cameras. During a forward driving maneuver of the vehicle, a forward viewing camera functions as the master camera and at least a driver-side sideward viewing camera and a passenger-side sideward viewing camera function as slave cameras. During a reversing maneuver of the vehicle, a rearward viewing camera functions as the master camera and at least the driver-side sideward viewing camera and the passenger-side sideward viewing camera function as slave cameras. The vision system is operable to synthesize a composite image derived from image data captured by at least the master camera and the driver-side sideward viewing camera and the passenger-side sideward viewing camera. Operating parameters of the master camera are used at least by the driver-side sideward viewing camera and the passenger-side sideward viewing camera.

Data Reduction in a Bar Code Reading Robot Shelf Monitoring System

A method for greatly reducing data storage requirements of autonomous robots capable of product inventory is described. Instead using high resolution images for label identification and position tracking, a lower resolution map can be searched. Human or machines can identify position of labels, and via a reverse mapping, the corresponding position of a label on the high resolution image can be identified. Except for those portions of the high resolution image showing a label, most of the high resolution image can be discarded. Further processing on the limited image subset can be used to read the labels.

Image data encoding/decoding method and apparatus

A method of decoding an image, includes obtaining at least one offset for a picture, deriving a variable for scaling for the picture based on the at least one offset, and performing inter prediction based on the variable for scaling for the picture. The at least one offset is defined with a direction of scaling.

Compound Eye Optical System And Imaging Device

Provided is a compound optical system that can obtain high-resolution images by solving the problem of aberration in a field-of-view separation-type optical system, and that enables a super thin image pickup device to be achieved. Also provided is an image pickup device using the compound optical system. With respect to the image pickup range of a central individual-eye lens, by narrowing the image pickup range of a peripheral individual-eye lens, the field curvature amount at the image pickup region can be reduced, and therefore, the eccentricity amount of the lens surface (or the lens group) can be reduced. As a result, an individual-eye lens with little defocus and good image forming characteristics can be obtained, and a compound optical system with favorable image forming characteristics can be configured.

Playback initialization tool for panoramic videos

A method for initializing a panoramic video by a graphical user interface (GUI) includes receiving a panoramic video, creating a three-dimensional mesh, and displaying a preview rendered from the three-dimensional mesh. The GUI displays a time selection interface and selects a frame time in the panoramic video with the time selection interface. The GUI displays a view selection interface and selects view parameters that define a camera orientation at the frame time of the panoramic video with the view selection interface. The GUI determines a selected frame of the panoramic video defined by the frame time and the view parameter, renders the thumbnail from the three-dimensional mesh based on the selected frame, and stores orientation data including the frame time and the view parameters.

Image-processing system, image-processing method and program

An image-processing system includes a receiver which receives an input value defining an output range, a generator which generates a three-dimensional model having a target image attached to a three-dimensional conformation, a decision part which decides a position of a viewing point and a viewing angle in accordance with the input value, and a projector which projects the three-dimensional model from the viewing point, wherein the decision part changes a range of a target image inside a viewing field by changing the viewing angle preferentially when the input value is in a first range, and changes the range of the target image inside the viewing field by changing the viewing point preferentially when the input value is in a second range which is a wider-angle side than that of the first range.

Apparatus and methods for selective coding of images

Apparatus and methods for resolution based, selective retrieval, of various portions of video content for e.g., accelerated rendering. Embodiments described herein select different portions of content to retrieve at different resolutions; content of interest can be rendered at high resolution, boundary content can be retrieved and/or rendered at low resolution. By selectively retrieving and rendering the video content, a greater portion of rendering resources can be allocated to content of interest and/or rendering resources can be reduced for boundary content. Rendering resources may include (but are not limited to) processing power, device battery life, network bandwidth, device storage or latency of switching content of interest. In this manner, even platforms with limited rendering resources can provide an equivalent (if not better) user experience than much more capable prior art platforms.

Network camera that connects a plurality of extensible imagers

A network camera that connects a plurality of extensible imagers includes at least one imaging module and a camera body. The at least one imaging module includes a lens, an image sensor, an image digital signal processor with a video encoder and a USB connecting line. The camera body includes a plurality of USB ports for the USB signal line of the at least one imaging module to insert therein, a CPU and at least one signal output interface. The image sensor captures a digital image via the lens. The digital image is processed by the image digital signal processor and the video encoder and transmitted to the camera body via the USB connecting line. The digital image is further processed by computations of the CPU to form required signals outputted via the signal output interface.

Optical apparatus

An optical apparatus includes a camera casing, a first optical module and a second optical module. The first optical module and the second optical module are installed on the camera casing. The first optical module receives an ambient light to capture a first image. The second optical module receives the ambient light to capture a second image, or the second optical module senses the ambient light. At least one of the first optical module and the second optical module has a non-linear optical axis in order to replace the front camera module and the rear camera module of the conventional panoramic camera. The optical apparatus is additionally installed on a periphery region of a portable electronic device or an extension position extended from the periphery region. Consequently, the optical apparatus provides a sufficient space to accommodate the first optical module and the second optical module.