ВЫЯВЛЕНИЕ РАСПОЛОЖЕНИЯ И МЕСТОПОЛОЖЕНИЯ ОБЪЕКТОВ

Заявленное изобретение относится к способу для выявления расположения и местоположения объектов, в частности объектов, не являющихся управляемыми по местоположению. Заявленный способ для выявления расположения и местоположения объектов, в частности объектов, не являющихся управляемыми по местоположению, характеризуется тем, что трехкоординатный датчик отправляет данные о целевом объекте, которые сравнивают с данными о целевом объекте, хранящимися в базе данных моделей, и используют для исходной оценки расположения и местоположения и последующей более точной оценки расположения и местоположения целевого объекта. Причем различные виды с различных направлений наблюдения объекта в форме упомянутого эталонного изображения сохраняются в базе данных моделей с определенным угловым разрешением, а текущий вид, полученный из принимаемых трехкоординатных данных датчика, сравнивается со всеми видами базы данных моделей. При этом трехкоординатный датчик отправляет данные, относящиеся к системе координат ...

АВТОМАТИЗИРОВАННОЕ ОКОНТУРИВАНИЕ АНАТОМИИ ДЛЯ ПЛАНИРОВАНИЯ ТЕРАПИИ С УПРАВЛЕНИЕМ ПО ИЗОБРАЖЕНИЯМ

Изобретение относится к компьютерным системам диагностической визуализации. Техническим результатом является повышение точности распознания анатомических особенностей на изображении за счет автоматизированного оконтуривания этих особенностей. Предложена система оконтуривания анатомических особенностей на изображениях, используемых для планирования терапии с управлением по изображениям. Система включает в себя процессор, который принимает исходное изображение анатомической структуры пациента из устройства формирования изображений. Упомянутый процессор также обнаруживает анатомические опознавательные точки в исходном изображении и сравнивает позиции обнаруженных анатомических опознавательных точек с опорными опознавательными точками в опорном контуре, соответствующем анатомической структуре. А также процессор осуществляет сопоставление обнаруженных анатомических опознавательных точек с опорными опознавательными точками. 5 н. и 15 з.п. ф-лы, 5 ил.

РАСПОЗНАВАНИЕ АНАТОМИЧЕСКИХ ХАРАКТЕРИСТИК И РАЗМЕРНЫЙ АНАЛИЗ ОБЪЕМА ГРУДИ ДЛЯ ОБЕСПЕЧЕНИЯ ХИРУРГИИ ГРУДИ

Группа изобретений относится к медицинской технике, а именно к средствам диагностики и формирования трехмерного изображения верхней части туловища. Система содержит устройство формирования трехмерного изображения, связанное с ним устройство компьютерного анализа, включающее один или более вычислительных модулей, предназначенных для определения незамкнутой непрерывной кривой, для определения параметров трехмерного изображения грудной стенки по данным трехмерного изображения, для определения части грудной стенки по данным указанной незамкнутой кривой и для определения исходного объема груди, и устройство отображения или формирования отчетов, связанное с устройством компьютерного анализа. Во втором варианте выполнения системы устройство компьютерного анализа дополнительно содержит один или более вычислительных модулей, предназначенных для определения грудной стенки по данным незамкнутых кривых, для определения исходного объема одной груди. Использование изобретений позволяет снизить накопление ...

УСТРОЙСТВО ОБРАБОТКИ ИНФОРМАЦИИ, СПОСОБ ОБНОВЛЕНИЯ КАРТЫ, ПРОГРАММА И СИСТЕМА ОБРАБОТКИ ИНФОРМАЦИИ

Изобретение относится к средствам обновления карты. Технический результат заключается в уменьшении времени обмена между пользователями информацией об изменении положения физического объекта в реальном пространстве. Получают по меньшей мере часть глобальной карты. Генерируют локальную карту, представляющую положение близлежащих объектов, обнаруживаемых устройством обработки информации. Вычисляют относительное положение локальной карты относительно глобальной карты на основе данных о положении объектов, включенных в глобальную карту, и данных о положении объектов, включенных в локальную карту. Преобразуют координаты из данных о положении объектов, включенных в локальную карту, в данные системы координат глобальной карты в соответствии с относительным положением локальной карты и обновляют глобальную карту на основе данных о положении объектов, включенных в локальную карту, после преобразования координат. 4 н. и 9 з.п. ф-лы, 22 ил.

ВИЗУАЛИЗАЦИЯ РЕКОНСТРУИРОВАННЫХ ДАННЫХ ИЗОБРАЖЕНИЯ

Группа изобретений относится к медицинской технике, а именно к средствам визуализации реконструированных данных изображения применительно к компьютерной томографии. Способ содержит этапы, на которых обрабатывают проекционные данные с помощью первого алгоритма реконструкции и реконструируют первые реконструированные данные объемного изображения, при этом первые реконструированные данные объемного изображения обладают первой 3D шумовой функцией, обрабатывают те же проекционные данные с помощью второго, отличающегося алгоритма реконструкции и реконструируют вторые реконструированные данные объемного изображения, при этом вторые реконструированные данные объемного изображения обладают второй 3D шумовой функцией, отличающейся от первой 3D шумовой функции, выполняют визуальное представление первых или вторых реконструированных данных объемного изображения в главном демонстрационном окне и выполняют визуальное представление подучастка других из первых и вторых реконструированных данных объемного ...

УСТРОЙСТВО, СИСТЕМА ВИЗУАЛИЗАЦИИ И СПОСОБ КОРРЕКЦИИ МЕДИЦИНСКОГО ИЗОБРАЖЕНИЯ МОЛОЧНОЙ ЖЕЛЕЗЫ

Группа изобретений относится к устройству и способу для коррекции медицинского изображения молочной железы, а также к системе визуализации. Устройство для коррекции медицинского изображения молочной железы содержит блок ввода медицинского изображения, потенциально демонстрирующего искусственные деформации молочной железы, блок ввода отсканированного изображения, изображающего молочную железу в заданном положении субъекта и содержащего информацию о поверхности молочной железы, блок моделирования для формирования смоделированного медицинского изображения молочной железы, при этом смоделированное медицинское изображение изображает молочную железу в том же заданном положении субъекта, что и отсканированное изображение, и представляет поверхность молочной железы поверхностной сеткой, а блок моделирования выполнен с возможностью формирования смоделированного медицинского изображения молочной железы на основе волюметрической биомеханической модели, материальные параметры которой изменяемы для ...

КОМПЛЕКСНАЯ СИСТЕМА И СПОСОБ ДЛЯ ДИСТАНЦИОННОГО ВЫБОРА ОДЕЖДЫ

МОДЕЛИРОВАНИЕ СЦЕНЫ В РЕАЛЬНОМ ВРЕМЕНИ, ОБЪЕДИНЯЮЩЕЕ ФОРМИРОВАНИЕ ТРЕХМЕРНОГО УЛЬТРАЗВУКОВОГО И ДВУМЕРНОГО РЕНТГЕНОВСКОГО ИЗОБРАЖЕНИЙ

РАСПОЗНАВАНИЕ АНАТОМИЧЕСКИХ ХАРАКТЕРИСТИК И РАЗМЕРНЫЙ АНАЛИЗ ОБЪЕМА ГРУДИ ДЛЯ ОБЕСПЕЧЕНИЯ ХИРУРГИИ ГРУДИ

... 1. Система автоматического определения объема груди на основе данных трехмерного контурного изображения верхней части туловища, содержащая:(a) устройство формирования трехмерного изображения, предназначенное для формирования указанного трехмерного контурного изображения указанной поверхности указанной верхней части туловища;(b) устройство компьютерного анализа, связанное с указанным устройством формирования трехмерного изображения и включающее в себя один или большее число вычислительных модулей, предназначенных для определения скорости изменения контуров указанного трехмерного изображения указанной верхней части туловища;(c) причем указанное устройство компьютерного анализа дополнительно содержит один или большее число вычислительных модулей, предназначенных для определения незамкнутой непрерывной кривой, представляющей субмаммарную складку трехмерного изображения груди, по данным указанного трехмерного изображения посредством анализа указанной скорости изменения указанных контуров указанного ...

СПОСОБ И УСТРОЙСТВО ДЛЯ ОПРЕДЕЛЕНИЯ ЖИЗНЕННО ВАЖНЫХ ПОКАЗАТЕЛЕЙ

ИНИЦИАЛИЗАЦИЯ МОДЕЛИ НА ОСНОВЕ КЛАССИФИКАЦИИ ВИДОВ

System zum patientenspezifischen Modellieren von Blutfluss

System zum Bestimmen von kardiovaskulären Informationen für einen Patienten, wobei das System Folgendes umfasst: wenigstens ein Computersystem, das konfiguriert ist, um: patientenspezifische Daten bezüglich einer Geometrie einer anatomischen Struktur des Patienten zu empfangen, wobei die anatomische Struktur wenigstens einen Abschnitt einer Mehrzahl an Koronararterien, die von einer Aorta ausgehen, beinhaltet; basierend auf den patientenspezifischen Daten ein dreidimensionales Modell zu erzeugen, das einen ersten Abschnitt der anatomischen Struktur repräsentiert, wobei der erste Abschnitt der anatomischen Struktur wenigstens den Abschnitt der Mehrzahl an Koronararterien beinhaltet; wenigstens teilweise basierend auf einer Masse oder einem Volumen des Myokardgewebes ein physikbasiertes Modell bezüglich einer Blutflusseigenschaft im ersten Abschnitt der anatomischen Struktur zu erzeugen; und wenigstens teilweise basierend auf dem dreidimensionalen Modell und dem physikbasierten Modell eine ...

Ein Robotersystem mit automatisiertem Paketregistrierungsmechanismus und Erkennung geeigneter Mindestbereiche

Die vorliegende Offenbarung betrifft Verfahren und Systeme zum Erzeugen eines verifizierten geeigneten Mindestbereichs (MVR) eines Objektes. Eine exponierte Außenecke und exponierte Kanten eines Objektes können durch Verarbeiten von Bilddaten erkannt werden. Ein anfänglicher MVR kann durch Erkennen gegenüberliegender paralleler Kanten erzeugt werden, die den exponierten Kanten gegenüberliegen. Der anfängliche MVR kann angepasst werden und das angepasste Ergebnis kann getestet werden, um einen verifizierten MVR zu erzeugen.

Verfahren zur Planung, Vorbereitung, Begleitung, Überwachung und/oder abschließenden Kontrolle eines operativen Eingriffs in den menschlichen oder tierischen Körper, Vorrichtung zum Ausführen eines solchen Eingriffs und Verwendung der Vorrichtung

Verfahren zur Planung, Begleitung, Überwachung und/oder abschließenden Kontrolle eines operativen Eingriffs in den menschlichen oder tierischen Körper (1), insbesondere zum Einsatz wenigstens eines Implantats (2), bei dem mit Hilfe einer Bildassistenzeinrichtung (3) mindestens zwei jeweils mehrdimensionale Darstellungen (4, 12, 13) zumindest eines Abschnitts (5) des Körpers (1) gezeigt werden, von denen sich wenigstens zwei Darstellungen (4) in Bezug auf die Anzahl der Dimensionen der Darstellung (4) unterscheiden, wobei die mehrdimensionalen Darstellungen (12, 13) vor, während oder nach ihrer Darstellung mit Hilfe der Bildassistenzeinrichtung (3) erkannt und bearbeitet werden und wobei der Bildassistenzeinrichtung Informationen und/oder Daten zu Implantaten (2, 46) und/oder 2D- und/oder 3D-Darstellungen (12, 13) von Implantaten zugänglich gemacht werden und wobei wenigstens ein Patientenbild (12, 13) vor, während oder nach seiner Darstellung mit Hilfe einer Bildassistenzeinrichtung (3) ...

Vorrichtung zur vierdimensionalen Darstellung einer Sturkturveränderung, insbesondere eines Krankheitsverlaufes

Vorrichtung zur Darstellung des zeitlichen Verlaufs einer Strukturveränderung, insbesondere eines Krankheitsverlaufes anhand von 2-D- oder 3-D-Datensätzen, gekennzeichnet durch eine Segmentiereinrichtung, mittels derer die Datensätze im Bereich der Strukturveränderungen unterschiedlich eingefärbt und anschließend anhand anatomischer Landmarken gematcht werden.

Verfahren zur Segmentierung eines Organs in Volumendatensätzen der Magnetresonanztomographie

Die vorliegende Erfindung betrifft ein Verfahren zur Segmentierung eines Organs, insbesondere der Leber, in n-kanaligen Volumendatensätzen der Magnetresonanztomographie. Bei dem Verfahren werden auf Basis von Segmentierungsergebnissen aus n-kanaligen Trainingsdatensätzen Wahrscheinlichkeitsverteilungen generiert, die Wahrscheinlichkeiten angeben, mit denen Positionen von Voxeln und mit Hilfe einer Diskriminanzreduktion aus n Dimensionen auf eine Dimension projizierte Intensitätswerte von Voxeln der Trainingsdatensätze zu dem Organ gehören. Aus den n-kanaligen Volumendatensätzen wird dann auf Basis der Wahrscheinlichkeitsverteilungen wenigstens ein 3-D-Wahrscheinlichkeitsdatensatz generiert, in dem jedem Voxel eine Wahrscheinlichkeit zugeordnet ist, zu dem Organ zu gehören. Ein Maximum des 3-D-Wahrscheinlichkeitsdatensatzes wird als Startpunkt für die Segmentierung gesetzt und die Segmentierung des Organs anschließend auf Basis des 3-D-Wahrscheinlichkeitsdatensatzes mit einer Region-Growing-Technik ...

Computerimplementiertes Verfahren zur Segmentation von Lungenknoten

Es wird ein Algorithmus zur lokalen Oberflächenglättung in einem definierten Volumen of Interest ("VOI") vorgestellt, der aus dreidimensionalen ("3-D") Volumendaten, wie z. B. Lungen-Computertomographie("CT")-Daten, erhalten wird. Da das VOI allgemein eine glatte und stückweise geradlinige Oberfläche ist, kann das Erscheinen von einer oder mehreren Erhebungen eine Abnormalität andeuten. In Lungen-CT-Daten z. B. können solche Erhebungen Knötchen sein, die aus der Brustwand wachsen. Die Knötchen können Lungenkrebs andeuten. Durch die Oberflächenglättung werden potentielle Pathologien von den umgebenden anatomischen Strukturen separiert. Beispielsweise können die Knötchen von der Brustwand segmentiert werden. Die separierten Pathologien können als Diagnosebeleg untersucht werden.

Anordnungsevaluierungsvorrichtung zur Evaluierung einer Anordungsposition eines Bereichssensors

Anordnungsevaluierungsvorrichtung (100) eines Bereichssensors (40), der ein Paar Kameras (41) und einen Projektor (42) zum Projizieren eines Streifenmusterlichts aufweist, wobei die Anordnungsevaluierungsvorrichtung (100) ausgebildet ist, um mithilfe von Simulation eine Anordnungsposition eines Bereichssensors (40) zu evaluieren, umfassend:eine Artikelanordnungseinheit (11), um ein Artikelmodell (2) anzuordnen, das einer Mehrzahl von gestapelten Artikeln (20) in einem vorgegebenen Gebiet in einem dreidimensionalen virtuellen Raum entspricht;eine Sensoranordnungseinheit (12), um ein dem Bereichssensor (40) entsprechenden Sensormodell (4), welches ein dem Paar Kameras (41) entsprechendes Paar Kameramodelle (5) sowie ein dem Projektor (42) entsprechendes Projektormodell (6) aufweist, derart in dem virtuellen Raum anzuordnen, dass das vorgegebene Gebiet in einem Messbereich enthalten ist;eine erste Ebenengruppen-Erzeugungseinheit (14), um eine Mehrzahl von ersten Ebenen (31) zu erzeugen, zu ...

Objektverfolgung

Verfahren und Systeme werden zum Verfolgen eines Objekts bereitgestellt. Das System beinhaltet ein Datenempfangsmodul, das dazu konfiguriert ist, dreidimensionale Bildgebungsdaten und zweidimensionale Bildgebungsdaten zu empfangen. Ein dreidimensionales Objektidentifikationsmodul ist konfiguriert, ein dreidimensionales Objekt abzugrenzen und dreidimensionale Objektdaten auszugeben. Ein Einstellmodul ist dazu konfiguriert, die dreidimensionalen Objektdaten basierend auf den zweidimensionalen Objektdaten einzustellen und eingestellte dreidimensionale Objektdaten auszugeben. Ein Verfolgungsmodul ist dazu konfiguriert, mindestens ein Objekt unter Verwendung der eingestellten dreidimensionalen Objektdaten zu verfolgen.

Verfahren zur Reduzierung von Bildartefakten, insbesondere von Metallartefakten, in CT-Bilddaten

Die vorliegende Erfindung betrifft ein Verfahren zur Reduzierung von Bildartefakten, insbesondere Metallartefakten, bei der Generierung von Computertomographie(CT)-Bilddaten eines Objekts. Bei dem Verfahren werden zwei CT-Bilddatensätze bei unterschiedlichen mittleren Röntgenenergien erzeugt. Durch eine gewichtete Kombination der beiden CT-Bilddatensätze wird ein neuer Bilddatensatz berechnet. Der bei der gewichteten Kombination eingesetzte Gewichtungsfaktor wird dabei so gewählt, dass die Bildartefakte in dem neuen CT-Bilddatensatz gegenüber den Bildartefakten in den beiden ursprünglichen CT-Bilddatensätzen deutlich reduziert sind. Auf diese Weise lassen sich vor allem Metallartefakte in CT-Bildern auf einfache Weise deutlich reduzieren.

Multimedia content delivery system

Graphics processing

Three-dimensional motion capture

A Method of Facilitating Comparison of Medical Image Data

Method of facilitating comparison of image data captured using different imaging systems, wherein each system comprises a scanner and a reconstruction protocol, the method steps of: Obtaining first reference image data from use of a reference object also known as a phantom using a first medical imaging system; Obtaining second reference image data from use of the phantom using a second medical imaging system; Comparing the first and second reference image data to determine a modifier useable to reduce differences between the first and second image data; and using the modifier to reduce differences between image data taken of a subject (patient) using the first and second imaging systems so that the modifier aligns the image quality of images produced by the two systems. The modifier may comprise a smoothing filter, a deconvolution filter, a widow level or look-up table (LUT) or an iterative optimising of a post-processing method to align the image quality.

3D printing system

A 3D printing method comprising: printing a portion of a 3D object 400; capturing infra-red (IR) images 410 of the 3D object using and array of IR cameras; analysing the images 420 to detect the state of the 3D object. 3D printing errors or completion of the print may be identified. The images may be stereoscopic. The images may be compared to printing instructions for the 3D item or to a model of the 3D item. The model may be of a partially completed 3D article. The printing process may be corrected or restarted 440 if an error occurs. Operating parameters of the 3D printer (eg. active cooling; fan speed; atmospheric conditions, temperature, humidity of the build chamber; heat of printing plastic; print speed; layer height, thickness, strength; substrate temperature; light source intensity) may be adjusted in response to the image analysis, ie. the printing process is controlled based on the determined condition (eg. shape) of the 3D object. An alarm may be raised. The object may be stuck ...

Combining computer generated objects with real video

A method of mixing or compositing in real-time, computer generated 3D objects and a video feed from a film camera in which the body of the film camera can be moved in 3D and sensors in or attached to the camera provide real-time positioning data defining the 3D position and 3D orientation of the camera, or, enabling the 3D position to be calculated. The sensors may include gyroscopes, magnetometers, accelerometers and 3D depth/range sensors. The aim of the application is to provide a real-time framing tool of virtual characters and environments for movie directors allowing display in real time photo-realistic results of the virtual objects merged with the real video, to provide an accurate camera tracking for both on set and post production and to provide an approximation of the 3D geometrical modelling of the real scene including handling occlusion between real and virtual objects. It is based on the implementation of a sensor fusion algorithm for merging natural (not added) markers in ...

Electronic display stabilization using pixel velocities

A target surface

Radiation dosage monitoring system

A radiation dosage monitoring system for determining internal radiation dosages received by a patient 20 undergoing radiation treatment. The system comprises a module to generate a three dimensional (3-D) model of a surface of a portion of the patient undergoing treatment and an image detector 10 that can detected Cherenkov radiation and any secondary radiation scattering due to initial Cherenkov radiation emitted from a surface of the irradiated patient. The system further comprises a processing module to estimate radiation dosages received by internal portions of the patient by estimating the radiation applied to the patient surface from images obtained from the image detector 10 and the generated 3-D model; and then using the estimated radiation applied to the patient surface together with: data indicating the orientation of a radiation beam inducing the Cherenkov emissions; and a model of radiation absorption by tissue in a portion of the patient being irradiated. Also a radiation dosage ...

Computer implemented methods and systems for generating virtual body models for garment fit visualisation

Computer implemented methods and systems for generating virtual body models for garment fit visualisation

3D scene rendering

Modelling a three-dimensional space

Computer implemented methods and systems for generating virtual body models for garment fit visualisation

Tiling a primitive in a graphics processing system

Tiling a primitive 904 in a graphics processing system to determine which of a plurality of tiles 902 of a rendering space the primitive (e.g. a triangle or polygon) intersects or overlaps with. The tiling involves testing tiles in a subset of tiles to determine whether they overlap, cover or intersect the primitive. Tiles in regions bounded by tested tiles are determined to overlap with primitive based on the test results of the tested tiles. Preferably the test may involve using an edge equation to determine whether certain points of the tile are inside or outside the primitive. A bounding box around the primitive may also be determined such that tiling tests are only conducted for tiles intersecting the bounding box. Preferably the subset of tiles to be tested comprises tiles spaced at regular intervals (more preferably one tested tile in each 2-by-2 block of tiles) and may contain the four corner tiles of the bounding box. The tests may be performed on a sparse subset, and then optionally ...

Apparatus and method for establishing patient registration using 3D scanner and tracking system

Methods and apparatuses for performing patient registration. 3D scan data from a 3D scanner (fig.5), preoperative image data, first tracking data from a first tracking system, and second tracking data from a second tracking system are mapped to a common coordinate space. The 3D scan data and the first tracking data are mapped to each other using a transformation that is determined based on a calibration relating the 3D scan coordinate space and the tracking coordinate space. The 3D scan data and the preoperative image data are mapped to each other using a surface matching algorithm. The first tracking data and the second tracking data are mapped to each other based on tracking of the patient reference device. The Patient reference device 600, 700 (fig.6 and 7) includes a plurality of markers (604,704).

Image processing system and method

Medical Image Analysis Using Neural Networks

Methods of generating personalized 3d head models or 3d body models

Image processing

Facemask

A method of selecting a facemask base 4 and an intermediate element 5 extending between the mask and the user’s face comprising: obtaining facial geometry, deriving parameters describing the facial geometry, comparing the parameters to parameters of a facemask bask, selecting a base according to the comparison, and determining a required geometry of the element based on the face and mask parameters. The base may be selected by determining that the face and base parameters are within a predetermined range. The facial geometry may comprise information regarding the user’s eyes, chin and nose and may be grouped into profiles which are used to select a base. Predetermined elements may be selected, or new elements created depending on the facial parameters. The element and mask may be manufactured and coupled together. The method may also comprise a test-fitting process whereby the fit of the mask is verified and the mask altered to improve the fit as needed.

BREATHE-LED THERAPY EVALUATION WITH ULTRASONIC CONTRAST MEANS

IMPLEMENTATION OF AN ADVANCED IMAGE FORMATION PROCESS AS A NETWORK LAYER AND ITS APPLICATIONS

A system for generating modified digital images from input digital images, using a neural network with a rendering layer trained to generate synthesized digital images from input digital images portraying diffuse materials and input digital images portraying specular materials. The neural network predicts at least two of a material property set, a surface orientation map, or an illumination environment map based on the input digital image and replace at least one of the material property set, the surface orientation map, or the illumination environment map with a target material property set, a target surface orientation map, or a target illumination map. The rendering layer of the neural network then generates a modified digital image from the input image based on at least one of the target material property set, the target surface orientation map, or the target illumination map. CL, >5 rU (001 I -o L - 5 - -- - - - - - - - - Cu ...

A contained area network and a processor

Disclosed herein is a contained area network (10). The network comprises a processor (12). The processor (12) comprises a contained area network interface (18) and processor readable tangible media (16) including program instructions which when executed by the processor (12) causes the processor (12) to generate processed geospatial information by processing geospatial information and send the processed geospatial information via the contained area network interface (18). The network (10) comprises a plurality of personal computing devices (20, 22, 24). The plurality of personal computing devices (20, 22, 24) comprises a plurality of contained area network interfaces (28, 30, 32) configured to receive from the processor (12) the processed geospatial information.

Systems and methods for detecting the presence of anomalous material within tissue

In one embodiment, the presence of anomalous material within tissue is detected by scanning a patient using magnetic resonance imaging (MRI) to obtain MRI data, identifying individual voxels of the MRI data, identifying multiple parameters of each voxel, and determining as to each voxel based upon the identified parameters the likelihood of tissue represented by the voxel containing anomalous material.

System and method for leadwire location

A system and method for leadwire location may provide for recognition of the leadwire via analysis of a series of two-dimensional images that include representations of the leadwire, and/or determining an orientation of the leadwire with reference to a marker on the leadwire.

System and method for image registration

A system and method for providing processable data associated with anatomical images may provide a user interface including a pivot and stem tool via which to align multiple images, a flashlight bar for viewing portions of an overlaid image, and/or user- movable markers for establishing a location of one or more anatomical landmarks with regions of one or more images.

Systems and methods for detecting the presence of anomalous material within tissue

In one embodiment, the presence of anomalous material within tissue is detected by scanning a patient using magnetic resonance imaging (MRI) to obtain MRI data, identifying individual voxels of the MRI data, identifying multiple parameters of each voxel, and determining as to each voxel based upon the identified parameters the likelihood of tissue represented by the voxel containing anomalous material.

Tracking geologic object and detecting geologic anomalies in exploration seismic data volume

A method and system are described for identifying a geologic object through cross sections of a geologic data volume. The method includes obtaining a geologic data volume having a set of cross sections. Then, two or more cross sections are selected and a transformation vector is estimated between the cross sections. Based on the transformation vector, a geologic object is identified within the geologic data volume.

A METHOD AND APPARATUS FOR GENERATING AN IMPROVED IMAGE OF NATURAL TISSUE IN RECONSTRUCTING BODY IMAGES FROM 3D-MEASUREMENTS

Gesture recognition devices and gesture recognition methods

According to various embodiments, a gesture recognition device may be provided. The gesture recognition device may include: a sensor configured to determine information (for example position information, forearm placement information and individual finger placement information) of a user of the gesture recognition device; a progress determination circuit configured to determine whether at least a pre-determined portion of a gesture was performed by the user based on the position information; and a gesture determination circuit configured to determine a gesture based on the at least pre-determined portion of the gesture.

System and method for atlas registration

A system and method for associating anatomically significant regions with regions of one or more images may include automatically modifying images of different modalities according to different correction algorithms, providing a user interface for identifying a plane within three-dimensional data, scaling atlas structures to fit an anatomical image according to identified landmarks, registering an atlas to such an image via a combination of registration algorithms, and/or registering an atlas to such an image using a feature extraction algorithm.

A system for mixing or compositing in real-time, computer generated 3D objects and a video feed from a film camera

A method of mixing or compositing in real-time, computer generated 3D objects and a video feed from a film camera in which the body of the film camera can be moved in 3D and sensors in or attached to the camera provide real-time positioning data defining the 3D position and 3D orientation of the camera, or enabling the 3D position to be calculated.

Vehicle positioning or navigation utilizing associated feature pairs

According to the embodiments described herein, a method for vehicle positioning or navigation utilizing associated feature pairs may include creating a plurality of associated feature pairs by retrieving an initial set of camera data from the camera comprising two-dimensional UV space information, forming pairs from the UV space information, and associating each pair from the UV space information with pairs from each of the plurality of three-dimensional global feature points of the industrial facility map, calculating a best estimate poses from calculated vehicle poses of the associated feature pairs, using an accumulated odometry to update the best estimate pose to a current localized position and setting a seed position as the current localized position. The navigation of the materials handling vehicle is tracked and/or navigated along the inventory transit surface navigate in at least a partially automated manner utilizing the current localized position.

Method and system for patient-specific modeling of blood flow

C:\Users\kll\AppData\Local\Temp12713 IDAOBAFC.DOCX-22 12/2015 Embodiments include a system for determining cardiovascular information for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of the patient's heart, and create a three dimensional model representing at least a portion of the patient's heart based on the patient-specific data. The at least one computer system may be further configured to create a physics-based model relating to a blood flow characteristic of the patient's heart and determine a fractional flow reserve within the patient's heart based on the three-dimensional model and the physics-based model.

Method and system for patient-specific modeling of blood flow

Abstract A system for determining cardiovascular information for a patient, the system comprising: at least one computer system configured to: receive patient specific data regarding a geometry of an anatomical structure of the patient; create a three-dimensional model representing at least a portion of the anatomical structure of the patient based on the patient-specific data, the three-dimensional model representing at least one fluid flow inlet and at least one fluid flow outlet; create at least one boundary condition model representing fluid flow through at least one of the at least one inlet or the at least one outlet, based at least in part on modeling a condition of hyperemia; and determine first information regarding a blood flow characteristic within the anatomical structure of the patient based on the three dimensional model and the at least one boundary condition model. cCD Co co VC C C) C) f I co C, Loij 0~ u~ EtIt C3oI ...

SYSTEMS AND METHODS FOR NAVIGATING A THREE-DIMENSIONAL MEDIA GUIDANCE APPLICATION

Systems and methods for navigating a three- dimensional (3D) media guidance application are provided. A first selectable media guidance object may be displayed on a screen that when viewed through the stereoscopic optical device may appear in a first plane. A second selectable media guidance object may be displayed on the screen that when viewed through the stereoscopic optical device may appear in a second plane. The first and second planes may be perceived to intersect an axis normal to the display in different locations. A user selection of at least one of the first and second selectable media guidance objects may be received. An action of moving a cursor in 3D space or selecting one of the selectable media guidance objects displayed in the 3D space may be performed based on the user selection. The user selection may be performed with an input device having an accelerometer.

METHOD, SYSTEM AND COMPUTER PROGRAM FOR DETERMINING POSITION AND/OR ORIENTATION PARAMETERS OF AN ANATOMICAL STRUCTURE

Disclosed is a computer-implemented method of determining one or more position and/or orientation parameters of an anatomical structure of a body portion. The anatomical structure has a longitudinal shape defining a longitudinal axis. The method includes generating and/or reading, by a data processing system, volumetric data of at least a portion of a subject. The method further includes generating and/or reading, by the data processing system, a deformable template which provides an estimate for a location of the longitudinal axis in the portion of the subject. The method further includes matching, by the data processing system, the deformable template to the volumetric data, thereby obtaining a matched template. The matching comprises using one or more internal energy functions and one or more external energy functions for optimizing an objective function. The method further includes determining, by the data processing system, the at least one position and/or orientation parameter based ...

APPARATUS, SYSTEM, AND PROCESS FOR DETERMINING CHARACTERISTICS OF A SURFACE OF A PAPERMAKING FABRIC

A METHOD AND A DEVICE FOR ESTIMATING WEIGHT OF FOOD OBJECTS

This disclosure relates to a method of estimating weight of food objects, comprising training an artificial neural network software module, and using the trained artificial neural network software module to provide a weight correlated data estimate for said food object based on a three dimensional (3D) image of the food object.

SEISMIC RANDOM NOISE ATTENUATION

Seismic image processing including filtering a three-dimensional (3D) seismic image for random noise attenuation via multiple processors. The filtering includes receiving a 3D image cube of seismic image data, decomposing the 3D image cube into 3D sub-cubes for parallel computation on the multiple processors, designing and applying a two-dimensional (2D) adaptive filter for image points on 2D image slices of the 3D sub-cubes via the multiple processors to give filtered 3D sub-cubes, and summing the filtered 3D sub-cubes to give a filtered 3D image cube.

STORAGE MEDIUM, RENDERING METHOD AND DATA STRUCTURE

For a state for which a rendering object presentation request was made, attribute spaces for which to perform an interpolation calculation for state information are decided based on an attribute table and a state table, state information of a state for which the presentation request was made is derived by, for each of the decided attribute spaces, performing the interpolation calculation, and the rendering object is then presented. In the derivation, for each of the decided attribute spaces, an interpolation calculation is performed using difference information managed by that attribute space, and by adding a sum total of the interpolation calculation results to state information of a reference state, the state information of the state for which the presentation request was made is derived.

APPARATUS, METHOD, AND SYSTEM FOR ALIGNMENT OF 3D DATASETS

The present invention lies in the field of 3D surveying, mapping, and imaging. In particular, the present invention relates to the rotational alignment of 3D datasets. Embodiments include an apparatus method and program for rotations! and optionally also transnational alignment of 3D datasets. The 3D datasets being stored as point clouds, transformed into vector sets, and the vector sets being represented as a unit sphere or Gaussian sphere and compared for best alignment. The found best alignment is used to rotate the two 3D datasets into rotational and translational alignment with one another.

METHOD FOR SCRIPTING INTER-SCENE TRANSITIONS

A method for authoring and displaying a virtual tour of a three-dimensional space which employs transitional effects simulating motion. An authoring tool is provided for interactively defining a series of locations in the space for which two-dimensional images, e.g., panoramas, photographs, etc., are available. A user identifies one or more view directions for a first-person perspective viewer for each location. For pairs of locations in the series, transitional effects are identified to simulate smooth motion between the pair of locations. The authoring tool stores data corresponding to the locations, view directions and transitional effects for playback on a display. When the stored data is accessed, a virtual tour of the space is created that includes transitional effects simulating motion between locations. The virtual tour created can allow a viewer to experience the three-dimensional space in a realistic manner.

METHOD, DEVICE AND COMPUTER PROGRAMME FOR EVALUATING IMAGES OF A CAVITY

The invention relates to a device, a method and a computer programme for evaluating images of the heart that have been captured by means of a medical imaging method. According to said method, at least two data records containing functional values, which describe the ventricular wall activity, are produced in a random format, are converted into a uniform format and the data records in the uniform format are compared with one another or calculated.

METHOD FOR GENERATING A PANORAMIC IMAGE

A method for generating a panoramic image comprising the steps of: providing a 3D point model of an area surrounding a virtual viewpoint, acquiring multiple images of the area surrounding the virtual viewpoint, projecting the acquired images onto the 3D point model, and generating the panoramic image using the thus obtained 3D point model of the area surrounding the virtual viewpoint.

SYSTEMS, METHODS, AND APPARATUSES FOR MEASURING DEFORMATION OF A SURFACE

The present invention regards a method for measuring displacement of a surface at a region of interest when the region of interest is exposed to a load. The method includes the steps of (1) evenly illuminating the surface; (2) by means of a camera capturing a first set of images comprising a first image of the surface, applying a load to the surface at the region of interest, and capturing a second image of the surface; and (3) transmitting the first and second image to a processing module of a computer, wherein the processing module: (a) includes data relating to the image capture, such as the spatial position and field of view of the camera relative to the surface when the images were captured; (b) generates a global perspective transform from selected regions out of the displacement area (c) performs a global image registration between the two images using perspective transform to align the images; (d) computes vertical pixel shift and horizontal pixel shift between the first image and ...

DIMENSIONAL ACQUISITION OF PACKAGES

The present disclosure relates to methods and systems for calculating dimensions of objects on loaded or partially loaded pallets for purposes of billing in shipping and transportation applications using depth-sensing imaging devices. A plurality of depth maps of an object are retrieved from one or more imaging devices. The depth maps are filtered and transformed into a world co-ordinate system based on calibration of the imaging devices. A point cloud is generated and a minimum volume bounding box is determined. The edge lengths and height of the object are calculated, and a volume may be determined to associate a volume with the object.

LOCALLY APPLIED TRANSPARENCY FOR A CT IMAGE

A method, including, receiving three-dimensional tomographic data with respect to a body of a living subject, and using the data to generate a representation of an external surface of the body and displaying the representation on a screen. The method further includes inserting an invasive instrument into a region of the body and identifying a position of the instrument in the body. The method also includes rendering an area of the external surface surrounding the identified position of the instrument locally transparent in the displayed representation, so as to make visible on the screen an internal structure of the body in a vicinity of the identified position.

METHODS AND SYSTEMS FOR AUTOMATED SEGMENTATION OF DENSE CELL POPULATIONS

Systems and methods for segmenting images comprising cells, wherein the images comprise a plurality of pixels; one or more three dimensional (3D) clusters of cells are identified in the images, and the 3D clusters of cells are automatically segmented into individual cells using one or more models.

SYSTEM AND METHOD OF INDICATING TRANSITION BETWEEN STREET LEVEL IMAGES

A system and method of displaying transitions between street level images is provided. In one aspect, the system and method creates a plurality of polygons (1120) that are both textured with images from a 2D street level (1110) image and associated with 3D positions, where the 3D positions correspond with the 3D positions of the objects (320, 322) contained m the image. These polygons (1120), in turn, are rendered from different perspectives to convey the appearance of moving among the objects contained in the original image ...

SPATIAL PREDICTIVE APPROXIMATION AND RADIAL CONVOLUTION

The present invention provides a method for approximating the location of a point of interest relative to a three dimensional coordinate system, the method including the steps of: orientating a camera toward the point of interest such that the point of interest can be seen within a camera view; retrieving camera data including a location relative to the three dimensional coordinate system, and a camera position including a camera heading and a camera tilt; querying an associated topographic map database to identify one or more coordinates located on the topographic map along the camera heading to form a first dataset; computing one or more coordinates located on a radial plane between the camera and the point of interest based on the camera heading and camera tilt to form a second dataset; and comparing the first dataset with the second dataset to identify a pair of matching coordinates; wherein the matching coordinates represent the three dimensional coordinate location of the point of ...

3-D SCANNING AND POSITIONING INTERFACE

A system and a method for providing an indication about positioning unreliability are described. The system comprises a scanner for scanning a surface geometry of an object and accumulating 3D points for each frame using shape-based positioning; a pose estimator for estimating an estimated pose for the scanner using the 3D points; an unreliable pose detector for determining if the estimated pose has an under constrained positioning and an indication generator for generating an indication that the unreliable pose estimation is detected. In one embodiment, a degree of freedom identifier identifies a problematic degree of freedom in the estimated pose. In one embodiment, a feature point detector detects a reobservable feature point and the pose estimator uses the feature point with the 3D points to estimate the estimated pose and the unreliable pose detector uses the feature point to identify the estimated pose as an unreliable pose estimation.

A SYSTEM FOR MIXING OR COMPOSITING IN REAL-TIME, COMPUTER GENERATED 3D OBJECTS AND A VIDEO FEED FROM A FILM CAMERA

A method of mixing or compositing in real-time, computer generated 3D objects and a video feed from a film camera in which the body of the film camera can be moved in 3D and sensors in or attached to the camera provide real-time positioning data defining the 3D position and 3D orientation of the camera, or enabling the 3D position to be calculated.

INTRAOPERATION RECORDING OF IMAGES BY MEANS OF SUPPORTING MARKERS

Texture processing method and unit

Three-dimensional coordinate scanner and method of operation

Virtual organ unfolding for visualization

A method and apparatus for generating position information of a target object

For the automatic determination of the detection in the Image positioning line method and system

Device and method for determining physiological parameters based on 3D (three-dimensional) medical images

The invention disclosed a device for determining physiological parameters based on 3D (three-dimensional) medical images. The device comprises a boundary determining unit and a volume determining unit. The boundary determining unit is used for determining boundaries of a target region. The volume determining unit is used for determining voxel sum of the target region according to the determined boundaries and calculating volume or capacity of the target region according to a preset relational expression. The device and a method have explicit physical significance and simple and efficient algorithm in calculation and processing and are suitable for processing special circumstances of various clinical lesion hearts, and objectivity and accuracy of image data processing are improved.

METHOD AND SYSTEM FOR REGISTERING DATA

Device and method for processing a stream of video data

Independent of the visual field 3 D scene veining background

Image analysis apparatus and procedures

METHOD FOR SUPPORTING THE MAINTENANCE OF AN AIRCRAFT BY AUGMENTED REALITY.

L'invention concerne un procédé d'aide à la maintenance d'un aéronef, mis en œuvre dans un système (100) comprenant : - des moyens de sélection d'affichage (130) ; et - un appareil portatif (120) avec une caméra (121) et des moyens d'affichage en réalité augmentée (122). Le procédé comprend les étapes suivantes : la caméra (121) acquiert des images (Im) d'un équipement de l'aéronef, et les envoie aux moyens de sélection d'affichage (130) ; les moyens de sélection d'affichage (130) identifient l'équipement présent sur ces images, et déterminent son identifiant (Id), dit identifiant utile ; à partir de l'identifiant utile (Id), les moyens de sélection d'affichage (130) envoient aux moyens d'affichage en réalité augmentée (122) des données d'aide à la maintenance ; - en réponse, les moyens d'affichage en réalité augmentée (122) affichent, en réalité augmentée, des images (Do) correspondant auxdites données. L'invention concerne également un dispositif pour mettre en œuvre un tel procédé.

PROCESS OF DIGITALIZATION OF BOOKS IN THREE DIMENSIONS BY WAVES TERAHERTZ.

METHOD FOR PRODUCING COMPUTER-ASSISTED MEDICAL IMAGES

Procédé de production d'une information médicale à partir de données numériques de scanographie ou d'IRM, caractérisé en ce que au moyen d'un ordinateur: - on définit au moyen d'itérations successives une suite croissante d'ensembles Ei de voxels, et on définit, pour chaque valeur de i, un ensemble appelé coque Ki (16, 18, 20, 22, 24) correspondant à l'ensemble des voxels appartenant à Ei et n'appartenant pas à E(i -1); - on détermine une grandeur Gi corrélée à une épaisseur de la coque Ki; - on détermine une segmentation cible Ec, en liaison avec la constatation d'une évolution prédéterminée de la valeur de Gi; - optionnellement on détermine une information médicale relative à la segmentation cible. L'invention concerne également un procédé et un ensemble de scanographie ou d'IRM, et un programme d'ordinateur pour leur mise en œuvre.

METHOD FOR CORRECTING A THREE-DIMENSIONAL PICTURE OF AN ELECTRONIC CIRCUIT

L'invention concerne un procédé de correction d'une image tridimensionnelle initiale d'un objet déformé comprenant la fourniture d'un modèle de l'objet non déformé comprenant des premières zones, la détermination dans l'image tridimensionnelle initiale de deuxièmes zones correspondant aux premières zones, la détermination d'une première transformation géométrique qui fait correspondre les deuxièmes zones aux premières zones et la détermination d'une image tridimensionnelle corrigée à partir de la première transformation géométrique et de l'image tridimensionnelle initiale.

METHOD OF THREE-DIMENSIONAL REPRESENTATION OF A SCENE

PROCEDE DE DETECTION DE CONTOURS EN IMAGERIE, ET D'ESTIMATION LOCALE DE LEURS PARAMETRES, DANS UN ESPACE A AU MOINS TROIS DIMENSIONS, ET DISPOSITIF POUR LA MISE EN OEUVRE DE CE PROCEDE

CE PROCEDE CONCERNE LES TRAITEMENTS D'IMAGE. TOUT HYPERCONTOUR EST MODELISE LOCALEMENT PAR UNE PORTION D'HYPERSURFACE, PAR EXEMPLE UN PLAN DONT LES PARAMETRES R PEUVENT PRENDRE S JEUX DE VALEURS PREDETERMINEES. POUR CHAQUE POINT DE L'IMAGE, LE PROCEDE CONSISTE A : -CALCULER DES PRODUITS DE CONVOLUTION LG ET LG, POUR I1 A S, OU L ET L SONT DES MATRICES CARREES FORMEES RESPECTIVEMENT PAR DES VALEURS DE LUMINANCE DE L'IMAGE COURANTE ET DE L'IMAGE SUIVANTE; OU G ET G SONT DES MATRICES PERMETTANT DE DETECTER UN HYPERCONTOUR MODELISABLE PAR UNE HYPERSURFACE PASSANT PAR LE POINT COURANT ET AYANT R POUR VALEURS DE PARAMETRES; -CALCULER LES VALEURS VR D'UN RAPPORT DE VRAISEMBLANCE GENERALISEE : VRLGLGPOUR I1 A S; -DETERMINER PARMI LES VALEURS VR LA VALEUR VRS QUI EST MAXIMALE ET LA COMPARER PAR RAPPORT A UNE VALEUR FIXEE L; -CONCLURE QU'IL Y A PAS D'HYPERCONTOUR PASSANT PAR LE POINT COURANT SI VRS L, OU CONCLURE QU'IL Y A UN HYPERCONTOUR, MODELISABLE PAR UNE PORTION D'HYPERSURFACE AYANT DES VALEURS ...

METHOD FOR GRAPHICALLY REPRESENTING THE RELATIVE POSITION OF THE SKY AND THE SOIL IN AN IMAGING SYSTEM FOR EDGE FOR AIRCRAFT

Le domaine général de l'invention est celui des procédés de représentation graphique de la position relative du ciel et de la terre dans un système de visualisation de bord pour aéronef, ladite représentation graphique (1, 2, 4, 5) étant affichée sur un écran de visualisation comportant les informations de pilotage et de navigation superposées à une représentation synthétique tridimensionnelle du paysage extérieur. Ladite représentation graphique n'est affichée que lorsque l'attitude de l'aéronef est inusuelle, une attitude inusuelle correspondant à une valeur de roulis ou à une valeur de tangage située en dehors d'une première plage de valeurs nominales. Elle comporte deux segments de disque de forme identique, opaques et de couleur différente, situés symétriquement sur un cercle concentrique à celui portant l'échelle de roulis, les segments droits des deux segments de disque étant parallèles à la ligne représentant l'indicateur d'assiette longitudinal nulle, la rotation des deux segments ...

자기 공명 영상 처리 장치 및 그에 따른 자기 공명 영상 처리 방법

... 개시된 실시예에 따른 자기 공명 영상 처리 장치는 움직이는 대상체를 연속되는 시간 구간 동안 자기 공명(Magnetic Resonance) 영상 촬영하여 복수개의 MR 영상을 획득하는 영상 획득부; 상기 MR 영상 시퀀스 중 인접한 두 MR 영상을 순차적으로 비교하여, 움직임이 발생한 구간을 검출하는 제어부; 상기 움직임이 검출된 구간에 대응되는 적어도 하나의 MR 영상을 움직임 보정하기 위한 변환 매트릭스(transform matrix)를 계산하고, 상기 변환 매트릭스를 상기 적어도 하나의 MR 영상에 적용하여 보정된 MR 영상을 획득하는 영상 처리부; 및 상기 보정된 MR 영상을 디스플레이하는 출력부를 포함한다.

METHOD AND SYSTEM TO THREE-DIMENSIONALLY MODEL CONTAINER PORT TERMINAL

The present invention provides a method and a system to three-dimensionally model a container port terminal, capable of resizing a three-dimensional model and changing its type in a more similar way to reality, and enabling easy posttreatment. The present invention stores a variety of equipment forming a terminal, and generates and operates a terminal model in a consistent way so that the equipment pieces are properly placed and used for their designated purposes. To achieve this, the method includes: steps (S11, S12) (a) in which an event manager (10) generates an equipment generation command; a step (S21) (b) in which a model manager (20) generates a standard equipment object (31); a step (S23) (d) in which the standard equipment object (31) sets a resizable spot or area to form a size-specified equipment object (32) for the standard equipment object (31); a step (24) (e) in which the necessity of attaching an easily detachable component to the size-specified equipment object (32) is ...

SPACE DIVIDING METHOD OF A 3D POINT CLOUD CAPABLE OF DIVIDING A 3D POINT CLOUD INTO A FLOOR AND OTHERS IN REAL TIME

PURPOSE: A space dividing method of a 3D point cloud is provided to easily divide buildings, trees, or vehicles from points of an object automatically divided into a floor and other objects. CONSTITUTION: A space dividing unit divides a space of a 3D point cloud into a plurality of grid cells(S10). The space dividing unit sets a base surface as a floor on the space(S20). An accumulator accumulates a point of all gird cells on the base surface in a grid cell of the base surface(S30). A grouping unit divides the grid cell into a floor and objects according to the number of accumulated points(S70). COPYRIGHT KIPO 2013 [Reference numerals] (AA) Start; (BB) End; (S10) Equally dividing into a plurality of grid cells; (S20) Setting a base surface; (S30) Accumulating a point of a grid cell vertical to the base surface; (S40) Setting a group; (S50) Setting a boundary bounding box; (S60) Determining an object group bounding box; (S70) Determining a floor and objects; ...

method and apparatus for converting two-dimensional video content for insertion into three-dimensional video content

método para formação de imagem de campo escuro e sistema de formação de imagem

Vision System for Facilitating the Automated Application of Disinfectant to the Teats of Dairy Livestock

In certain embodiments, a system includes a controller operable to access an image signal generated by a camera. The accessed image signal corresponds to one or more features of the rear of a dairy livestock. The controller is further operable to determine positions of each of the hind legs of the dairy livestock based on the accessed image signal. The controller is further operable to determine a position of an udder of the dairy livestock based on the accessed image signal and the determined positions of the hind legs of the dairy livestock. The controller is further operable to determine, based on the image signal and the determined position of the udder of the dairy livestock, a spray position from which a spray tool may apply disinfectant to the teats of the dairy livestock.

Method and System For Patient-Specific Modeling of Blood Flow

Embodiments include a system for planning treatment for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of an anatomical structure of the patient, create a three-dimensional model representing at least a portion of the anatomical structure of the patient based on the patient-specific data, and determine a first fractional flow reserve within the anatomical structure of the patient based on the three-dimensional model and information regarding a physiological condition of the patient. The at least one computer system may be further configured to receive input from a user regarding a plan of treatment, modify the physiological condition of the patient based on the received input, and determine a second fractional flow reserve within the anatomical structure of the patient based on the modified physiological condition of the patient.

Recording a Command Stream with a Rich Encoding Format for Capture and Playback of Graphics Content

Analyzing an application executing on a target device. An application may be executed on a target device. Low cost measurement may be gathered regarding the application executing on the target device. In response to a trigger, high cost measurement data may be gathered regarding the application executing on the target device. The high cost measurement data may include graphics commands provided by the application. The graphics commands and related information may be stored and provided to a host. The host may modify the graphics commands to perform experiments to determine performance issues of the application executing on the target device. The host may determine whether the performance is limited by the CPU or the GPU and may determine specific operations that are causing performance issues. The host may provide suggestions for overcoming the performance issues.

Single-Action Three-Dimensional Model Printing Methods

Methods and techniques of using 3D printers to create physical models from image data are discussed. Geometric representations of different physical models are described and complex data conversion processes that convert input image data into geometric representations compatible with third party 3D printers are disclosed. Printing templates are used to encapsulate complex geometric representations and complicated data conversion processes from users for fast and simple 3D physical model printing applications.

Method for estimating light scattering

The invention relates to a method for estimating the quantity of light scattered by a heterogeneous participating media. In order to optimise the display while minimising the required calculation time, the method comprises steps for selecting at least one level of spatial subdivision of said media from among a plurality of hierarchic levels of spatial subdivision according to at least one item of error information representative of an attenuation difference in said media according to at least one direction between two consecutive hierarchic levels, and estimating the quantity of light scattered by sampling of said media along at least one scattering direction, the sampling being a function of at least one selected spatial subdivision level.

Crowd-Sourced Video Rendering System

In one embodiment, a method includes distributing rendering tasks to connected client nodes having capable graphics processing units by transmitting viewport state data objects and a unique spatial location to each of the clients, performing path tracing at each of the clients from the starting point of their unique spatial locations, and transmitting their rendered output back to the server. The server generates a composite rendered output from the individual rendered outputs received by the participating clients, and then transmits the composite to all connected clients for display. Thus, as the number of client nodes increases, the scene is rendered more rapidly and at higher quality. In particular embodiments, the rendered output is a lightmap representing the diffuse lighting for the scene, and each client may render the scene's specular highlights from its own viewport.

Method and system for patient-specific modeling of blood flow

Embodiments include a system for determining cardiovascular information for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of the patient's heart, and create a three-dimensional model representing at least a portion of the patient's heart based on the patient-specific data. The at least one computer system may be further configured to create a physics-based model relating to a blood flow characteristic of the patient's heart and determine a fractional flow reserve within the patient's heart based on the three-dimensional model and the physics-based model.

Method and system for patient-specific modeling of blood flow

Embodiments include a system for determining cardiovascular information for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of the patient's heart, and create a three-dimensional model representing at least a portion of the patient's heart based on the patient-specific data. The at least one computer system may be further configured to create a physics-based model relating to a blood flow characteristic of the patient's heart and determine a fractional flow reserve within the patient's heart based on the three-dimensional model and the physics-based model.

2d/3d image registration method

A method ( 100 ) that registers a 3D heart volume ( 112, 114 ) obtained from either a pre-operative MR image or CT image ( 102 ) to an intra-operative fluoroscopic image using a mesh of the heart structure ( 106 ) as the basis for the registration.

Automated building detecting

In one aspect, a computerized method to automatically detect buildings includes determining if each point of a set of filtered points is on a line by processing the set of filtered points in one pass including a) locating a first point of the set of filter points nearest to a second point of the set of filtered points, b) determining if the distance between the first point and the second point is greater than a distance threshold; c) determining if the first point and the second point have collinearity greater than a collinearity threshold; and d) designating the first point as an endpoint of a line that includes the second point if the distance between the first point and the second point is greater than the distance threshold and if the first point and the second point have collinearity greater than the collinearity threshold.

Device and method for recognizing three-dimensional position and orientation of article

A recognition device and method capable of recognizing 3D position and orientation of an article at low calculation cost. A 2D image of a region, where articles are randomly located, is obtained by a camera, and 3D information of generally the same region is obtained by a range sensor. A space, where an article to be taken out is considered to exist, is roughly limited. Based on the limited space, a search condition for searching the article by 2D image processing is set, and 2D positional information on the image of the article is obtained. Then, 3D point data used to recognize the 3D position and orientation of the article is selected, and a view line in the 3D space, extending from the camera to the article, is calculated, whereby the 3D position and orientation of the article is calculated.

Method for registering function mri data

A method for registering functional MRI data, comprising: computing the functional connectivity pattern for every voxel in its given spatial neighborhood for every fMRI image; extracting features invariant to spatial location of the neighboring voxels based on the functional connectivity patterns; constructing similarity metric between voxels of different images based on the extracted features, and using fluid-like demons registration model to spatial normalize the fMRI data. The present invention tries to exploit the multi-range functional connectivity information of the fMRI data, and to register functional MR images based on the extracted spatial-location-invariant features. The present invention is robust against local spatial perturbations and does not depend on the assumption that functional signals of different subjects are synchronic, hence can be applied to resting-state fMRI data, and can achieve a statistically significant improvement in functional consistency across subjects.

Routing virtual area based communications

In association with a virtual area, a first network connection is established with a first network node present in the virtual area and a second network connection is established with a second network node present in the virtual area. Based on stream routing instructions, a stream router is created between the first network node and the second network node. The stream router includes a directed graph of processing elements operable to receive network data, process the received network data, and output the processed network data. On the first network connection, an input data stream derived from output data generated by the first network node is received in association with the virtual area. The input data stream is processed through the stream router to produce an output data stream. On the second network connection, the output data stream is sent to the second network node.

Methods for quantitative assessment of volumetric image from a subject and uses therof

Methods and systems are disclosed for assessing a quantitative image volume from an individual subject comprising comparing the image from the subject to images from a control group of subjects using voxel-wise comparison. The methods allow detection of pathologies or lesions in the individual subject being assessed.

Image data determination method, image processing workstation, target object determination device, imaging device, and computer program product

A second form of image data is determined from a first form of image data of an examination object in a radiological imaging system. A set of a defined plurality of input pixels in the image data of the first form is determined. In addition, a set of target form parameters of a target form model with a defined plurality of target form parameters is prognostically determined by way of a data-driven regression method from the plurality of input pixels. The number of target form parameters is smaller than the number of input pixels. The second form of image data is determined from the set of target form parameters. There is also described a method in radiological imaging for determining the geometric position of a number of target objects in a second form of image data and an image processing workstation for determining a second form of image data from a first form of image data as well as an imaging device.

Interactive 3-d examination of root fractures

A method for 3-D interactive examination of a subject tooth, executed at least in part by a computer, obtains volume image data containing at least the subject tooth and background content adjacent to the subject tooth and displays a first image from the volume data that shows at least the subject tooth and the background content. A portion of the background content in the first image is identified according to a first operator instruction. Tooth content for at least the subject tooth in the first image is identified according to a second operator instruction. At least the subject tooth is segmented from within the volume data according to the first and second operator instructions. The segmented subject tooth is then displayed.

Nonlinear Self-Calibration for Structure From Motion (SFM) Techniques

A nonlinear self-calibration technique that may, for example, be used to convert a projective reconstruction to metric (Euclidian) reconstruction. The self-calibration technique may use a nonlinear least squares optimization technique to infer the parameters. N input images and a projective reconstruction for each image may be obtained. At least two sets of initial values may be determined for an equation to be optimized according to the nonlinear optimization technique to generate a metric reconstruction for the set of N images. The equation may then be optimized using each set of initial values according to the nonlinear optimization technique. The result with a smaller cost may be selected. The metric reconstruction is output. The output may include, but is not limited to, focal length, rotation, and translation values for the N images.

Keyframe Selection for Robust Video-Based Structure from Motion

An adaptive technique is described for iteratively selecting and reconstructing keyframes to fully cover an image sequence that may, for example, be used in an adaptive reconstruction algorithm implemented by a structure from motion (SFM) technique. A next keyframe to process may be determined according to an adaptive keyframe selection technique. The determined keyframe may be reconstructed and added to the current reconstruction. A global optimization may be performed on the current reconstruction. One or more outlier points may be determined and removed from the reconstruction. One or more inlier points may be determined and recovered. If the number of inlier points that were added exceeds a threshold, then global optimization may again be performed. If the current reconstruction is a projective construction, self-calibration may be performed to upgrade the projective reconstruction to a Euclidean reconstruction.

Single-Action Three-Dimensional Model Printing Methods

Methods and techniques of using 3D printers to create physical models from image data are discussed. Geometric representations of different physical models are described and complex data conversion processes that convert input image data into geometric representations compatible with third party 3D printers are disclosed. Printing templates are used to encapsulate complex geometric representations and complicated data conversion processes from users for fast and simple 3D physical model printing applications.

IMAGE ORIENTATION SETTING APPARATUS, IMAGE ORIENTATION SETTING METHOD, AND IMAGE ORIENTATION SETTING PROGRAM

A core-line extraction unit extracts a core line of the blood vessel from a three-dimensional image of a subject including the blood vessel. A local-route extraction unit extracts a local route of the core line within a predetermined range based on a reference point on the core line. In a case where a plurality of points on the local route are projected, a plane setting unit sets a plane having an orientation in which a distribution of a plurality of the projected points has a reference value based on a maximum value of the distribution, as a display plane of the three-dimensional image. 1. An image orientation setting apparatus comprising: extract a core line of a blood vessel from a three-dimensional image of a subject including the blood vessel,', 'extract a local route of the core line within a predetermined range based on a reference point on the core line, and', 'set, in a case where a plurality of points on the local route are projected, a plane having an orientation in which a distribution of a plurality of the projected points has a reference value based on a maximum value of the distribution, as a display plane of the three-dimensional image., 'a processor that is configured to'}2. The image orientation setting apparatus according to claim 1 ,wherein the processor is configured to display a projected image in which the three-dimensional image is projected onto the display plane, on a display.3. The image orientation setting apparatus according to claim 1 , extract the local route within the predetermined range based on the moved reference point, and', 'set a second display plane on the basis of the local route extracted within the predetermined range based on the moved reference point., 'wherein in a case where the reference point is moved, the processor is configured to'}4. The image orientation setting apparatus according to claim 3 ,wherein the processor is configured to display a first projected image and a second projected image on a display, the ...

METHOD AND SYSTEM FOR IMAGE PROCESSING TO DETERMINE BLOOD FLOW

Embodiments include a system for determining cardiovascular information for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of the patient's heart, and create a three-dimensional model representing at least a portion of the patient's heart based on the patient-specific data. The at least one computer system may be further configured to create a physics-based model relating to a blood flow characteristic of the patient's heart and determine a fractional flow reserve within the patient's heart based on the three-dimensional model and the physics-based model. 1184-. (canceled)185. A method for processing images to determine cardiovascular information , comprising the steps of:receiving image data including a plurality of coronary arteries originating from an aorta;processing the image data to generate three-dimensional shape models of the coronary arteries;simulating a blood flow for the generated three-dimensional shape models of the coronary arteries; anddetermining a fractional flow reserve (FFR) of the coronary arteries based on a blood flow simulation result, wherein in the step of simulating the blood flow, a computational fluid dynamics model is applied to the three-dimensional shape models of the coronary arteries, a lumped parameter model is combined with the computational fluid dynamics model, and a simplified coronary artery circulation model including coronary arteries, capillaries of the coronary arteries and coronary veins is used as the lumped parameter model.186. The method of claim 185 , wherein claim 185 , when simulating the blood flow claim 185 , when applying the computational fluid dynamics model to the three-dimensional shape models of the coronary arteries claim 185 , using an aorta blood pressure pattern as an inlet boundary condition.187. The method of claim 185 , wherein simulating the blood flow comprises determining lengths of centerlines of the three- ...

ENVIRONMENT PERCEPTION USING A SURROUNDING MONITORING SYSTEM

An apparatus for environment perception using a monitoring system is described herein. The apparatus includes a plurality of sensors, wherein the plurality of sensors is to collect data. The apparatus also includes a controller to estimate motion based on the data and data from a plurality of cameras, wherein the data from the plurality of cameras is processed simultaneously. Additionally, the apparatus includes a matching unit to perform feature matching using the motion estimation and a perception unit to determine a 3D position of points in the environment. 1. An apparatus for environment perception using a monitoring system , comprising:a plurality of sensors, wherein the plurality of sensors is to collect data;a controller to estimate motion based on the data and data from a plurality of cameras, wherein the data from the plurality of cameras is processed simultaneously;a matching unit to perform feature matching using the motion estimation; anda perception unit to determine a 3D position of points in the environment based on the feature matching.2. The apparatus of claim 1 , wherein the points are used to render a 3D structure estimation.3. The apparatus of claim 1 , wherein the plurality of sensors includes velocity claim 1 , steering wheel change rate or yaw rate sensors.4. The apparatus of claim 1 , wherein sensor data is fused to determine a rough motion claim 1 , and the rough motion is refined using a CSBA.5. The apparatus of claim 1 , wherein the estimated motion is converted to all camera motions and is used during feature matching.6. The apparatus of claim 1 , the controller is to estimate motion using a Kalman filter.7. The apparatus of claim 1 , wherein the 3D position of points in the environment is provided to the matching unit in a feedback loop.8. The apparatus of claim 1 , wherein feature matching includes filtering outliers from a plurality of points.9. The apparatus of claim 1 , wherein the plurality of cameras form a rigid system.10. The ...

THREE-DIMENISIONAL OBJECT DETECTION DEVICE

A three-dimensional object detection device includes an image capturing unit, a detection area setting unit, an image conversion unit, a three-dimensional object detection unit, a reference image area setting unit, a contour information extraction unit, a reference sharpness calculation unit and a subject sharpness calculation unit. The image conversion unit converts a viewpoint of an image obtained by the image capturing unit to create a bird's-eye view image. The reference image area unit sets a reference image area for extracting contour information by the contour information extraction unit. The reference sharpness calculation unit calculates a reference sharpness using contour information of the reference image area. The subject sharpness calculation unit calculates a subject sharpness using contour information of the detection area. The three-dimensional object detection unit calculates a final sharpness based on the reference sharpness and the subject sharpness, and sets a difference threshold value based on the final sharpness. 1. A three-dimensional object detection device comprising:an image capturing unit arranged to capture images rearward of a host vehicle equipped with the three-dimensional object detection device;a detection area setting unit programmed to set a detection area for detecting a three-dimensional object rearward of the host vehicle;an image conversion unit programmed to convert a viewpoint of the images obtained by the image capturing unit to create bird's-eye view images;a three-dimensional object detection unit programmed to detect a presence of a three-dimensional object within the detection area in which the bird's-eye view images obtained at different times by the image conversion unit are aligned, and difference waveform information is generated by counting and creating a frequency distribution of a number of pixels that indicate a predetermined difference having a difference threshold value or greater in a difference image of the ...

R-SNAP FOR PRODUCTION OF AUGMENTED REALITIES

Images and/or videos have associated therewith information like location and orientation information for the camera used to captured the images/videos. The associated location and orientation (or pose) information facilitates subsequent processing for producing accurate and convincing augmented reality (AR) outputs. In addition, some embodiments associate user-specific information with images or videos for producing customized AR content on a user-to-user basis. 1. A method for augmented reality (AR) , comprisingassociating, by one or more processors, perspective information with an image or video as metadata that moves, copies, and transfers with the image or video, wherein the perspective information describes a camera at a first time the camera captured the image or video which contains real world content from a real world;associating, by the one or more processors, user-specific metadata with the image or video on a per user basis, wherein the user-specific metadata moves, copies, and transfers with the image or video;moving, copying, or transferring the image or video from a first storage medium to a second storage medium different from the first storage medium;producing at a second time, by the one or more processors, user-specific AR content comprising virtual augmentations added to the image or video based on the perspective information and the user-specific metadata, wherein the second time is after the first time,wherein for the producing step, the perspective information is used for selection of one or more virtual objects sourced from a virtual world, wherein the virtual world is modeled after the real world and includes at least one virtual location corresponding with at least one real world location that appears in the real world content of the image or video, wherein the virtual world includes virtual representations of at least some of the real world content of the image or video,wherein the perspective information is different from the user-specific ...

Probability mapping for visualisation and analysis of biomedical images

The invention provides a method of image transformation of a biomedical image, said method comprising: for each voxel of said biomedical image, calculating a transform value indicative of the likelihood of that voxel representing a first tissue type (such as scar tissue); wherein calculating said transform value includes: applying at least one feature function to calculate at least one feature value from the original image voxel value for said voxel and/or from the original image voxel values of one or more voxels proximate to said voxel, said feature function or functions being capable of discriminating between said first tissue and a second tissue type (e.g. healthy tissue); and deriving said transform value from said one or more feature values. The method allows more detail to be extracted from images about the locations of scar and healthy tissue and thus facilitates diagnosis. The transformed image can also be segmented to identify particular areas of interest such as the border zone between scar and healthy tissue where the two tissue types are interwoven. The segmentation technique better identifies clinically relevant information within the image. This information can then be processed to provide an indicator of clinical significance.

SELF-NAVIGATION IN THREE-DIMENSIONAL MAGNETIC RESONANCE IMAGING

The invention provides for a medical imaging system () comprising: a memory () for storing machine executable instructions () and a processor () for controlling the medical imaging system. Execution of the machine executable instructions causes the processor to: receive () magnetic resonance imaging data () descriptive of a subject (), wherein the magnetic resonance imaging data is segmented into sequential data portions (), wherein the magnetic resonance imaging data was acquired according to a three-dimensional magnetic resonance imaging protocol, wherein the magnetic resonance data within each of the sequential data portions is sampled in-plane using a rotating k-space sampling profile, wherein the magnetic resonance data within each of the sequential data portions is sampled using a segmented phase encoding in a thru-plane direction; and reconstruct () a navigator image () for each of the sequential data portions according to the three-dimensional magnetic resonance imaging protocol. 1. A medical imaging system comprising:a memory for storing machine executable instructions; receive magnetic resonance imaging data descriptive of a subject, wherein the magnetic resonance imaging data is segmented into sequential data portions, wherein the magnetic resonance imaging data was acquired according to a three-dimensional magnetic resonance imaging protocol, wherein the magnetic resonance data within each of the sequential data portions is sampled in-plane using a rotating k-space sampling profile, wherein the magnetic resonance data within each of the sequential data portions is sampled using a segmented phase encoding in a thru-plane direction, wherein the sequential data portions are quasi random sampled by the segmented phase encoding;', 'reconstruct a navigator image for each of the sequential data portions according to the three-dimensional magnetic resonance imaging protocol., 'a processor for controlling the medical imaging system, wherein execution of the ...

NON-INTRUSIVE MEASUREMENT OF THE VOLUME DENSITY OF A PHASE IN A PART

Method and system for non-intrusive measurement of volume density of a specific phase in a part, comprising: processor producing a volume image of the part, the image being formed by a three-dimensional grid of voxels, the values of which indicate the disposition of the specific phase in the part, processor associating a binary coefficient with each voxel of the volume image, thus constructing an initial three-dimensional matrix representation of binary coefficients representing a presence or absence of the specific phase in zones of the part corresponding to the voxels, processor convoluting the initial matrix representation with a convolution matrix kernel corresponding to a predetermined reference volume, the convolution performed by effecting a composition of three (successive) monodimensional convolutions in three independent directions, thus forming a resultant matrix representation, each resultant coefficient of which represents a volume ratio (the density) of the specific phase in the reference volume. 110-. (canceled)11. Method for the non-intrusive measurement of the volume density of a specific phase in a part , characterised in that it comprises the following steps:producing a volume (tomographic) image of said part, said image being formed by a three-dimensional grid of voxels, the values of which indicate the disposition of said specific phase in (corresponding zones of) said part,associating a binary coefficient with each voxel of said volume (tomographic) image, thus constructing an initial three-dimensional matrix representation of binary coefficients, said binary coefficients representing a presence or absence of said specific phase in zones of said part corresponding to the voxels,convoluting said initial matrix representation with a convolution matrix kernel corresponding to a predetermined reference volume, said convolution being performed by effecting a composition of three (successive) monodimensional convolutions in three independent ...

Shape recognition device, shape recognition program, and shape recognition method

Provided are a shape recognition device, a shape recognition program, and a shape recognition method capable of obtaining more accurate information for recognizing an outer shape of a target object. A shape recognition device according to the present invention includes: an outer shape detection unit that detects an outer shape of a hand; a reference point extraction unit that extracts a central point of a maximum inscribed circle of the detected outer shape as a reference point; a distance measurement unit that measures a distance between the reference point and each of a plurality of outer shape points on the outer shape; and a feature recognition unit that determines a feature part of the outer shape from the plurality of outer shape points on the basis of the distance.

IMAGE PROCESSOR WITH EVALUATION LAYER IMPLEMENTING SOFTWARE AND HARDWARE ALGORITHMS OF DIFFERENT PRECISION

An image processor comprises image processing circuitry implementing a plurality of processing layers including at least an evaluation layer and a recognition layer. The evaluation layer comprises a software-implemented portion and a hardware-implemented portion, with the software-implemented portion of the evaluation layer being configured to generate first object data of a first precision level using a software algorithm, and the hardware-implemented portion of the evaluation layer being configured to eV generate second object data of a second precision level lower than the first precision level using a hardware algorithm. The evaluation layer further comprises a signal combiner configured to combine the first and second object data to generate output object data for delivery to the recognition layer. By way of example only, the evaluation layer may be implemented in the form of an evaluation subsystem of a gesture recognition system of the image processor. 1. An image processor comprising:image processing circuitry implementing a plurality of processing layers including at least an evaluation layer and a recognition layer;the evaluation layer comprising a software-implemented portion and a hardware-implemented portion;the software-implemented portion of the evaluation layer being configured to generate first object data of a first precision level using a software algorithm;the hardware-implemented portion of the evaluation layer being configured to generate second object data of a second precision level lower than the first precision level using a-hardware algorithm;wherein the evaluation layer further comprises a signal combiner configured to combine the first and second object data to generate output object data for delivery to the recognition layer.2. The image processor of wherein the evaluation layer comprises an evaluation subsystem of a gesture recognition system.3. The image processor of wherein the plurality of processing layers further comprises a ...

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM

An apparatus includes an image acquisition unit configured to acquire a captured image of a real space, a position and orientation acquisition unit configured to acquire a position and orientation of each of a plurality of virtual objects, an interference determination unit configured to determine whether interference is present between the virtual objects based on the position and orientation of each of the plurality of virtual objects and model data of the plurality of virtual objects, an interference information recording unit configured to record an outline of an interference part where the virtual objects interfere with each other as interference information, based on a result of the interference determination unit, a generation unit configured to generate a composite image including the captured image, an image of the plurality of virtual objects, and an image representing the outline of the interference part. 1. An information processing apparatus comprising:a storage unit configured to store model data of a plurality of virtual objects;a position and orientation acquisition unit configured to acquire a position and orientation of each of the plurality of virtual objects;an interference determination unit configured to determine whether interference is present between the virtual objects based on the position and orientation of each of the plurality of virtual objects and the model data of the plurality of virtual objects;an interference information recording unit configured to record an outline of an interference part where the virtual objects interfere with each other as interference information, based on a result of the interference determination unit;a generation unit configured to generate a composite image including a captured image, an image of the plurality of virtual objects, and an image representing the outline of the interference part; andan output unit configured to output the generated composite image.2. The information processing apparatus ...

FLUOROSCOPIC POSE ESTIMATION

Methods and systems for registering three-dimensional (3D) CT image data with two-dimensional (2D) fluoroscopic image data using a plurality of markers are disclosed. In the methods and systems, a lateral angle and a cranial angle are searched for and a roll angle is computed. 3D translation coordinates are also computed. The calculated roll angle and 3D translation coordinates are computed for a predetermined number of times successively. After performing the calculations, the 3D CT image data is overlaid on the 2D fluoroscopic image data based on the lateral angle, the cranial angle, the roll angle, and the 3D translation coordinates. 1. A method for registering three-dimensional (3D) CT image data with two-dimensional (2D) fluoroscopic image data using a plurality of markers , the method comprising:searching for a lateral angle and a cranial angle;moving a 3D mass center of a marker to a half segment between a source and a 2D mass center of the marker;computing a roll angle;computing a 3D translation coordinates;computing the roll angle and the 3D translation coordinates for a predetermined number of times successively; andoverlaying the 3D CT image data on the 2D fluoroscopic image data based on the lateral angle, the cranial angle, the roll angle, and the 3D translation coordinates.2. The method of claim 1 , wherein searching for the lateral angle and the cranial angle includes:trying sample values in a 2D grid;finding a minima based on the sample values; andtrying sample values using a steepest descent method from the minima.3. The method of claim 1 , wherein computing the roll angle includes:computing a 2D vector joining the 2D mass center of the marker to 2D markers in the 2D fluoroscopic image data;computing a projected vector for projected 3D markers; anddetermining the roll angle which the angle between the 2D vector and the projected vector.4. The method of claim 1 , further comprising determining a performance of a solution based on the lateral angle ...

Service provision program

A non-transitory recording medium storing a program that causes a computer to execute a process, the process including: generating a modified image by executing modification processing on an image of a mark affixed to a product; and providing the generated modified image as a determination-use image employable in determination as to whether or not the product affixed with the mark is included in a captured image.

DETERMINATION OF MYOCARDIAL SCAR USING VELOCITY SPECTRAL MAP

A system and method for determining regions of a heart affected by a scar. An imaging dataset is acquired of a portion of a subject including the heart and the imaging dataset is processed to identify a motion parameter of the heart. The motion parameter of the heart is mapped on a spectral scale based on the motion parameter over time to identify low velocity regions of the heart. A report is generated indicating the low velocity regions of the heart affected by scar. 1. A system for determining regions of a heart affected by a scar , the system comprising:a memory having stored thereon an imaging dataset acquired from a portion of a subject including the heart;a processor having access to the memory and the imaging dataset stored thereon and configured to process the imaging dataset to identify a motion parameter and map a spectral scale based on the motion parameter over time to identify low velocity regions of the heart; anda display coupled to the processor and configured to display the low velocity regions of the heart relative to a series of images.2. The system as recited in wherein the processor is further configured to determine a wall thickness of the heart within the series of images at each low velocity region of the heart.3. The system as recited in wherein the processor is further configured to determine the low velocity regions of the heart within the series of images having the wall thicknesses below a pre-determined threshold.4. The system as recited in wherein the wall thickness is defined with respect to boundaries of a endocardium and a epicardium.5. The system as recited in wherein the processor is further configured to analyze the boundaries of the endocardium and the epicardium throughout a cardiac cycle of the low velocity regions of the heart.6. The system as recited in wherein the motion parameter includes velocity and the processor is configured to determine the velocity using a non-rigid registration based algorithm to track a voxel-to- ...

SYSTEM AND METHOD FOR SEGMENTATION OF LUNG

Disclosed are systems, devices, and methods for determining pleura boundaries of a lung, an exemplary method comprising acquiring image data from an imaging device, generating a set of two-dimensional (2D) slice images based on the acquired image data, determining, by a processor, a seed voxel in a first slice image from the set of 2D slice images, applying, by the processor, a region growing process to the first slice image from the set of 2D slice images starting with the seed voxel using a threshold value, generating, by the processor, a set of binarized 2D slice images based on the region grown from the seed voxel, filtering out, by the processor, connected components of the lung in each slice image of the set of binarized 2D slice images, and identifying, by the processor, the pleural boundaries of the lung based on the set of binarized 2D slice images. 1. A segmentation method for determining pleura boundaries of a lung , comprising:acquiring image data from an imaging device;generating a set of two-dimensional (2D) slice images based on the acquired image data;determining, by a processor, a seed voxel in a first slice image from the set of 2D slice images;applying, by the processor, a region growing process to the first slice image from the set of 2D slice images starting with the seed voxel using a threshold value;generating, by the processor, a set of binarized 2D slice images based on the region grown from the seed voxel;filtering out, by the processor, connected components of the lung in each slice image of the set of binarized 2D slice images; andidentifying, by the processor, the pleural boundaries of the lung based on the set of binarized 2D slice images.2. The segmentation method according to claim 1 , wherein the seed voxel is in a portion of the first slice image from the set of binarized 2D slice images corresponding to a trachea of the lung.3. The segmentation method according to claim 1 , wherein the threshold value is greater than or equal to an ...

METHOD OF AND APPARATUS FOR PROCESSING GRAPHICS

A scene to be rendered is divided into plural individual sub-regions or tiles. The individual sub-regions are also grouped into differing groups of sets of plural sub-regions. There is a top level layer comprising a set of 8×8 sub-regions which encompasses the entire scene area. There is then a group of four 4×4 sets of sub-regions, then a group of sixteen 2×2 sets of sub-regions, and finally a layer comprising the 64 single sub-regions. A primitive list building processor takes each primitive in turn, determines a location for that primitive, compares the primitive's location with the locations of the sub-regions and the locations of the sets of sub-regions, and allocates the primitive to respective primitive lists for the sub-regions and sets of sub-regions accordingly. 1. An apparatus for sorting graphics primitives for rendering in a graphics processing system in which a scene to be rendered is divided into a plurality of sub-regions for rendering , each sub-region including a respective area of the scene to be rendered , the apparatus comprising:at least one processor configured to prepare a set of plural first lists of primitives, each first list of primitives in the set of first lists of primitives being exclusive to a respective single sub-region of the scene and listing primitives for rendering for that single sub-region of the scene;wherein the at least one processor is further configured to prepare a set of plural second lists of primitives, the set of plural second lists of primitives being in addition to the set of plural first lists of primitives, and each second list of primitives in the set of second lists of primitives being a list of primitives to be used for a respective set of at least two sub-regions of the scene in common and listing primitives for rendering for that set of at least two sub-regions of the scene; andwherein:the at least one processor prepares the set of first primitive lists and the set of second primitive lists by, for each ...

DYNAMIC 3D LUNG MAP VIEW FOR TOOL NAVIGATION INSIDE THE LUNG

A method for implementing a dynamic three-dimensional lung map view for navigating a probe inside a patient's lungs includes loading a navigation plan into a navigation system, the navigation plan including a planned pathway shown in a 3D model generated from a plurality of CT images, inserting the probe into a patient's airways, registering a sensed location of the probe with the planned pathway, selecting a target in the navigation plan, presenting a view of the 3D model showing the planned pathway and indicating the sensed location of the probe, navigating the probe through the airways of the patient's lungs toward the target, iteratively adjusting the presented view of the 3D model showing the planned pathway based on the sensed location of the probe, and updating the presented view by removing at least a part of an object forming part of the 3D model. 1. A method for implementing a dynamic three-dimensional (3D) lung map view for navigating a prove inside a patient's lungs , the method comprising:loading a navigation plan into a navigation system, the navigation plan including a planned pathway shown in a 3D model generated from a plurality of CT images;inserting the probe into a patient's airways, the probe including a location sensor in operative communication with the navigation system;registering a sensed location of the probe with the planned pathway;selecting a target in the navigation plan;presenting a view of the 3D model showing the planned pathway and indicating the sensed location of the probe;navigating the probe through the airways of the patient's lungs toward the target;iteratively adjusting the presented view of the 3D model showing the planned pathway based on the sensed location of the probe; andupdating the presented view by removing at least a part of an object forming part of the 3D model.2. The method according to claim 1 , wherein iteratively adjusting the presented view of the 3D model includes zooming in when the probe approaches the ...

Photometric optimization with t-splines

One example method is disclosed that includes the steps of capturing a plurality of images of a scene, wherein each of the plurality of images of the scene captures a different perspective of a portion of an object; establishing a three-dimensional (“3D”) model of the object using at least some of the plurality of images of the scene; initializing a T-spline based at least in part on the 3D model; determining a first photometric error associated with the 3D model and the T-spline; and optimizing the T-spline based on the first photometric error to create an optimized T-spline.

CLASSIFYING CONTIGUOUS OBJECTS FROM POLYGONAL MESHES WITH SPATIALLY GRID-LIKE TOPOLOGY

Methods and systems in computer enabled imaging for the classification of connected sets of polygons in polygonal models/objects with spatially grid-like topology are provided. In one example, for the classification of connected sets of polygons in polygonal models/objects with spatially grid-like topology such as those generated by threshold-based extraction routines from volumetric data by means of exploiting the nature of the source data to efficiently determine an optimal neighborhood of possibly connected polygon. 1. A computer enabled method of classifying connected sets in a polygon object , comprising the acts of:providing a polygonal model with spatially grid-like topology;sorting polygons in the model into a three dimensional grid; anddetermining a neighborhood of potentially connected polygons based on a topological consistency of the polygonal model; andsorting each polygon into one of a plurality of connected sets.2. The method of claim 1 , further comprising rendering the polygonal model based on less than all of the plurality of connected sets.3. The method of claim 1 , wherein a user provides a polygonal model where each polygon has a consistent maximal width claim 1 , height claim 1 , and depth.4. The method of claim 1 , wherein the bounds of the polygonal model are determined by examining the XYZ components of each vertex in the model and storing the minimum and maximum bounds for each component.5. The method of claim 1 , wherein each polygon in the model is sorted into a list containing the polygons in the specified sub-grid of the polygonal model topology.6. The method of claim 1 , wherein the sorted polygons are iterated through claim 1 , using information about potential neighbors to any given polygon claim 1 , determining polygons that are connected spatially claim 1 , defined as two XYZ points in one polygon having the same correspondent XYZ values.7. The method of claim 6 , wherein in response to determining polygons are connected spatially ...

METHODS FOR GENERATING A DATASET OF CORRESPONDING IMAGES FOR MACHINE VISION LEARNING

Machine learning vision systems rely on very large numbers of training images to learn to recognize particular shapes and configurations of shapes. Traditionally, such datasets of training images needed to be selected and tagged (or labelled) manually. To recognize a particular object, such as a dog or vehicle, under realistic settings with an acceptable degree of reliability, may require data sets of thousands of images per object class. 1. A computer-implemented method for generating a dataset having a multiplicity of corresponding images for machine vision learning , the method comprising:loading a seed model into a 3D rendering engine;selecting a first lighting arrangement;selecting a first view of the seed model;rendering the first view of the seed model with the first lighting arrangement;storing a 2D image of the first view of the seed model with the first lighting arrangement;repeating the rendering and storing using a plurality of further views and a plurality of further lighting arrangements to generate a multiplicity of 2D images of the seed model; andgenerating a dataset comprising the corresponding multiplicity of 2D images of the seed model.2. The computer-implemented method according to claim 1 , the method further comprising:selecting one or more camera artefacts;rendering the seed model with the one or more camera artefacts;storing a 2D image of the seed model with the one or more camera artefacts; andrepeating the rendering and storing with the one or more camera artefacts to generate a dataset comprising the corresponding multiplicity of 2D images of the seed model.3. The computer-implemented method according to claim 2 , wherein the camera artefact is selected from the group comprising:blur, lighting flare, defocusing, translation, rotation, scaling, image size, obscuration, noise, motion, pixelization, edge clarity, aliasing, image compression, resolution, color banding, grain, quantization, macro blocking, mosaicing, ringing, posterizing, and ...

VISUALIZATION OF SPENDING DATA IN AN ALTERED REALITY

Systems, methods, and non-transitory computer readable media for visualizing user spending data in an altered reality are provided. Spending data includes items purchased, budgets for specific rooms or categories, prices paid, dates of purchase, and amounts spent. The user may interact within the altered reality to manage spending and move budgets between rooms or categories. 1. A system , comprising:a non-transitory memory; and acquiring spending data of a user corresponding to an item purchased;', 'determining a category of the item;', 'accessing an altered reality of a location associated with the user;', 'determining a sub-location within the location that corresponds to the category of the item;', 'generating a visualization of the spending data in the altered reality; and, 'one or more hardware processors coupled to the non-transitory memory and configured to read instructions from the non-transitory memory to cause the system to perform operations comprisingdisplaying the altered reality via a user interface.2. The system of claim 1 , wherein:the location is a building having a plurality of rooms, each room being a sub-location representing a spending category; andthe visualization of the spending data in each room represents items found in each room.3. The system of claim 2 , wherein the operations further comprise:moving items or funds from one room to another room via the user interface; andadjusting the spending data in each room accordingly.4. The system of claim 1 , wherein the altered reality is at least one of a virtual reality or an augmented reality.5. The system of claim 1 , wherein the visualization of the spending data comprises: a symbol claim 1 , picture claim 1 , or number representing an amount the user has spent on items contained in the altered reality;a time period corresponding to the spending data;a merchant name corresponding to the spending data;a payment type used that corresponds to the spending data; oruser identification data.6. ...

INFORMATION PROCESSING DEVICE, MAP UPDATE METHOD, PROGRAM, AND INFORMATION PROCESSING SYSTEM

There is provided an information processing device including: a global map acquiring unit that acquires at least a part of a global map representing positions of objects in a real space where a plurality of users are in activity; a local map generating unit that generates a local map representing positions of nearby objects detectable by a device of one user among the plurality of users; and an updating unit that updates the global map based on position data of objects included in the local map 1. An information processing device comprising:a global map acquiring unit that acquires at least a part of a global map representing positions of objects in a real space where a plurality of users are in activity;a local map generating unit that generates a local map representing positions of nearby objects detectable by a device of one user among the plurality of users; andan updating unit that updates the global map based on position data of objects included in the local map.2. The information processing device according to claim 1 , further comprising:a calculating unit that calculates a relative position of the local map to the global map based on position data of objects included in the global map and position data of objects included in the local map; anda converting unit that performs coordinate conversion from the position data of objects included in the local map to data of a coordinate system of the global map according to the relative position of the local map,wherein the updating unit updates the global map by using the position data of objects included in the local map after the coordinate conversion by the converting unit.3. The information processing device according to claim 1 , whereinthe information processing device is a terminal device possessed by the one user.4. The information processing device according to claim 3 , whereinthe global map acquiring unit acquires at least a part of the global map from a server device storing the global map, andthe ...

METHOD AND DEVICE FOR THREE-DIMENSIONAL RECONSTRUCTION

The disclosure provides a method and device for three-dimensional reconstruction, applied to the field of image processing. The method includes: obtaining a first depth map, which is photographed by a first photographic device, and obtaining a second depth map, which is photographed by a second photographic device; merging the first depth map with a first three-dimensional model according to a position of the first photographic device to obtain a second three-dimensional model; and merging the second depth map with the second three-dimensional model according to a position of the second photographic device to obtain a third three-dimensional model. 1. A method for measurement , comprising:obtaining a three-dimensional model of a measured object;fitting a pre-stored measured three-dimensional model to the three-dimensional model of the measured object; andmeasuring the three-dimensional model of the measured object according to the pre-stored measured three-dimensional model and the fitting.2. The method according to claim 1 , wherein:the pre-stored measured three-dimensional model comprises feature measurement markers; andmeasuring the three-dimensional model of the measured object according to the pre-stored measured three-dimensional model and the fitting process comprises measuring the three-dimensional model of the measured object according to the feature measurement markers and the fitting.3. The method according to claim 2 , wherein:the measured object is a human body;the feature measurement markers are marking points of the pre-stored measured three-dimensional model;one or more feature measurement markers are located on a body circumference of the pre-stored measured three-dimensional model; and calculating fitted heights of the one or more feature measurement markers after the fitting according to heights of the feature measurement markers on the pre-stored measured three-dimensional model and the fitting;', 'obtaining an envelope curve located on the ...

Automated bone segmentation in images

A method for automated segmentation of a bone in an image dataset of a region of a human body, wherein said region comprises at least two adjacent bones, and wherein one of the bones comprises a shaft region and a head region, the method comprising identifying in the image dataset voxels belonging to a contiguous volume comprising both bones based on a density threshold; extracting a subset comprising the head region of the first bone, based on a boundary image slice; and applying a trained machine learning classifier to said subset, to generate a classification of each of voxel as belonging to one of the bones or a none-bone tissue.

METHOD OF PROCESSING OPTICAL COHERENCE TOMOGRAPHY (OCT) DATA, METHOD OF OCT IMAGING, AND OCT DATA PROCESSING APPARATUS

An OCT apparatus of an exemplary aspect includes an OCT scanner, image data generating unit, registration unit, and image data composing unit. The OCT scanner is configured to acquire three dimensional data sets by applying an OCT scan to mutually different three dimensional regions of a sample. The image data generating unit is configured to generate a plurality of pieces of image data from the three dimensional data sets. The registration unit is configured to perform a first registration between the plurality of pieces of image data by applying an image correlation calculation to each of overlap regions in the plurality of pieces of image data. The image data composing unit is configured to compose the plurality of pieces of image data based on a result of the first registration. 1: A method of processing data acquired by an optical coherence tomography (OCT) scan , the method comprising:preparing a plurality of three dimensional data sets acquired from a plurality of three dimensional regions of a sample different from each other;generating a plurality of pieces of image data from the plurality of three dimensional data sets;performing a first registration between the plurality of pieces of image data by applying an image correlation calculation to each of a plurality of overlap regions in the plurality of pieces of image data; andcomposing the plurality of pieces of image data based on a result of the first registration.2: The OCT data processing method of claim 1 , wherein for a first image data and a second image data that include mutual overlap regions claim 1 , the image correlation calculation calculates at least one of a translation amount and a rotation amount between the overlap region in the first image data and the overlap region in the second image data.3: The OCT data processing method of claim 2 , wherein the image correlation calculation includes a phase only correlation calculation.4: The OCT data processing method of claim 1 , further comprising ...

VEHICLE POSE DETERMINATION

A computer, including a processor and a memory, the memory including instructions to be executed by the processor to determine a vehicle six degree of freedom (DoF) pose based on an image where the six DoF pose includes x, y, and z location and roll, pitch, and yaw orientation and transform the vehicle six DoF pose into global coordinates based on a camera six DoF pose. The instructions can include further instructions to communicate to the vehicle the six DoF pose in global coordinates. 1. A computer , comprising a processor; anda memory, the memory including instructions to be executed by the processor to:determine a vehicle six DoF pose based on an image where the vehicle six DoF pose includes x, y, and z location and roll, pitch, and yaw orientation;transform the vehicle six DoF pose into global coordinates based on a camera six DoF pose; andcommunicate to a vehicle the vehicle six DoF pose in the global coordinates.2. The computer of claim 1 , the instructions further including instructions to determine the vehicle six DoF pose by determining features and dimensions based on computer-aided design (CAD) data claim 1 , physical measurements and machine vision techniques.3. The computer of claim 2 , the instructions further including instructions to determine corresponding vehicle features based on an image using machine vision techniques and transforming the vehicle features into the nominal features using a perspective-n-points algorithm to determine the six DoF pose.4. The computer of claim 3 , wherein the perspective-n-points algorithm determines a six DoF pose for a camera with respect to the vehicle features by iteratively fitting n vehicle features to a three-dimensional (3D) vehicle model claim 3 , and then determines the vehicle six DoF pose based on a determined real-world camera six DoF pose.5. The computer of claim 1 , the instructions further including instructions to determine the vehicle six DoF pose by inputting a video image to a trained ...

Systems and Methods for Generating 2D Projection from Previously Generated 3D Dataset

A method includes receiving a first set of 2D images of an object, wherein the first set of 2D images is derived from a three-dimensional (3D) image of the object placed at a first pose. The method further includes generating a set of bound 2D images by binding multiple 2D images of the first set, wherein the multiple 2D images correspond to adjacent sub-volumes of the 3D image. The method further includes projecting the set of bound 2D images from the first pose to a second pose different from the first pose, thereby obtaining re-projected 2D images. The method further includes combining the re-projected 2D images. 1. A system , comprising:a first non-transitory memory;one or more first hardware processors coupled to the first non-transitory memory, the one or more first hardware processors to execute instructions to perform first operations comprising:receiving a first set of 2D images of an object, wherein the first set of 2D images is derived from a three-dimensional (3D) image of the object placed at a first pose;generating a set of bound 2D images by binding multiple 2D images of the first set, wherein the multiple 2D images correspond to adjacent sub-volumes of the 3D image;projecting the set of bound 2D images from the first pose to a second pose different from the first pose, thereby obtaining re-projected 2D images; andcombining the re-projected 2D images.2. The system of claim 1 , the first operations further comprising:receiving multiple sets of 2D images of the object, wherein the multiple sets are derived from the 3D image of the object placed at respective multiple poses different from the second pose;selecting one set of 2D images from the multiple sets; andproviding the one set of 2D images as the first set of 2D images and a pose corresponding to the one set of 2D images as the first pose.3. The system of claim 2 , wherein the one set of 2D images is selected such that a pose corresponding to the one set of 2D images results in the smallest ...

SYSTEM AND METHOD FOR PLACING A CHARACTER ANIMATION AT A LOCATION IN A GAME ENVIRONMENT

A method for execution by a processor of a computer system for computer gaming. The method comprises maintaining a game environment; receiving a request to execute an animation routine during gameplay; attempting to identify a location in the game environment having a surrounding area that is free to host the requested animation routine; and in case the attempting is successful, carrying out the animation routine at the identified location in the game environment. 1. A method for execution by a processor of a computer system , comprising:maintaining a game environment;receiving a request to execute an animation routine during gameplay;attempting to identify a location in the game environment having a surrounding area that is free to host the requested animation routine; andin case the attempting is successful, carrying out the animation routine at the identified location in the game environment.3. The method defined in claim 2 , further comprising repeating steps c) and d).4. The method defined in claim 3 , wherein the attempting is considered unsuccessful when neither step a) nor step c) determines a location that is free to host the requested animation routine claim 3 , after a predetermined number of iterations of step c).5. The method defined in claim 2 , wherein the area surrounding a particular location is considered not to be free to host the requested animation routine when an obstacle is detected to be present within a predetermined distance from the particular location.6. The method defined in claim 5 , wherein selecting the next location comprises selecting a location that is oriented relative to the initial location in a direction away from the obstacle.7. The method defined in claim 2 , further comprising determining a slope of terrain in a vicinity of the initial location and restricting the next location to one having a corresponding slope of terrain.8. The method defined in claim 2 , further comprising determining a slope of terrain in a vicinity of ...

Three-dimensional object scanning feedback

Examples of providing feedback regarding a scan of a three-dimensional object are described. In one example, a method of computer modeling a three-dimensional object includes computer-tracking a three-dimensional pose of a scanning device relative to the three-dimensional object as the three-dimensional pose of the scanning devices changes to measure different contours of the three-dimensional object from different vantage points, and assessing a sufficiency of contour measurements from one or more of the different vantage points based on measurements received from the scanning device. The example method further includes providing haptic feedback, via a haptic output device, indicating the sufficiency of contour measurements corresponding to a current three-dimensional pose of the scanning device.

Pick to Augmented Reality

The embodiments provide an augmented reality device for increasing human efficiency in navigating a distribution site and retrieving different customer order items from distinct locations within the distribution site. The augmented reality device uses at least one camera to scan reference points distributed across the distribution site. From the scanning, the device determines its position relative to a destination within the distribution site. The device layers over a real-world view, navigational information directing movement of a device user along a most efficient path to the destination. The camera further scans items falling within its field of view. The device performs feature matching in order to identify a particular item of interest within the field of view. The device layers over the real-world view, visual makers distinguishing the particular item from other items as well instructions or other identifying information relating to the particular item.

AUGMENTED REALITY CONTENT RENDERING VIA ALBEDO MODELS, SYSTEMS AND METHODS

Methods for rendering augmented reality (AR) content are presented. An a priori defined 3D albedo model of an object is leveraged to adjust AR content so that is appears as a natural part of a scene. Disclosed devices recognize a known object having a corresponding albedo model. The devices compare the observed object to the known albedo model to determine a content transformation referred to as an estimated shading (environmental shading) model. The transformation is then applied to the AR content to generate adjusted content, which is then rendered and presented for consumption by a user. 135-. (canceled)36. A method of rendering augmented reality content , comprising:obtaining, by a rendering device, an albedo model related to a patient in a medical environment, the albedo model comprising portions corresponding to portions of the patient, wherein each portion of the albedo model includes lighting rules selected based on a reflective nature of a corresponding portion of the patient;obtaining, by the rendering device, augmented reality (AR) content related to the patient;deriving, by the rendering device, a pose of the patient or of one or more portions of the patient from a digital representation of the patient;aligning, by the rendering device, the albedo model with the pose;deriving, by the rendering device, observed shading data from the digital representation and the albedo model;deriving an estimated object shading model using the albedo model and the observed shading data;generating, by the rendering device, environmentally adjusted AR content by applying the estimated object shading model to the AR content; andrendering, by the rendering device, the environmentally adjusted AR content.37. The method of claim 36 , wherein the portions of the patient comprise at least one of skin claim 36 , a face claim 36 , lips claim 36 , eyes claim 36 , and a tissue.38. The method of claim 36 , wherein the AR content comprises at least one of a medical image claim 36 , ...

Measuring Method and Apparatus for Damaged Part of Vehicle

Provided are a measuring method and apparatus for a damaged part of a vehicle includes: acquiring an image to be processed of a vehicle; acquiring the damaged part of the vehicle in the image to be processed according to the image to be processed; acquiring first position information of key points in the image to be processed according to the image to be processed; determining a transformation relation between the image to be processed and a first fitting plane according to the key points included in the image to be processed and the first position information, where the first fitting plane is a fitting plane determined according to the key points included in the image to be processed on the D model; acquiring a projection area of the damaged part in the first fitting plane according to the transformation relation; and measuring the projection area to acquire a measuring result. 1. A measuring method for a damaged part of a vehicle , comprising:acquiring an image to be processed of a vehicle;acquiring the damaged part of the vehicle in the image to be processed according to the image to be processed;acquiring first position information of key points comprised in the image to be processed according to the image to be processed, wherein the key points are points provided at preset positions of a 3D model of the vehicle;determining a transformation relation between the image to be processed and a first fitting plane according to the key points comprised in the image to be processed and the first position information, wherein the first fitting plane is a fitting plane determined according to the key points comprised in the image to be processed on the 3D model;acquiring a projection area of the damaged part in the first fitting plane according to the transformation relation; andmeasuring the projection area to acquire a measuring result.2. The method according to claim 1 , wherein the determining a transformation relation between the image to be processed and a first ...

Systems and Methods for Authenticating a User According to a Hand of the User Moving in a Three-Dimensional (3D) Space

Methods and systems for capturing motion and/or determining the shapes and positions of one or more objects in 3D space utilize cross-sections thereof. In various embodiments, images of the cross-sections are captured using a camera based on edge points thereof. 1. A system for authenticating a user according to a hand of the user moving in a three-dimensional (3D) space , the system comprising: analyzing a sequence of images including the hand of the user moving in the 3D space, as captured by a camera from a particular vantage point, to (i) computationally determine a shape of the hand of the user according to one or more mathematically represented 3D surfaces of the hand and (ii) computationally determine a jitter pattern of the hand; and', 'in response to a received authentication determination obtained by performing a comparison of the shape of the hand and the jitter pattern of the hand to a database of hand shapes and jitter patterns, authenticating the user and granting access to the user when the authentication determination indicates that the user is authorized and denying access to the user when the authentication determination indicates that the user is not authorized., 'one or more processors coupled to a memory storing instructions that, when executed by the one or more processors, implement actions including2. The system of claim 1 , further including: at least one source that casts an output onto a portion of the hand of the user.3. The system of claim 1 , further including transmitting to at least one further process claim 1 , a signal that includes at least one selected from (i) trajectory information determined from a reconstructed position of a portion of the hand of the user that the at least one further process interprets claim 1 , and (ii) gesture information interpreted from trajectory information for the portion of the hand of the user.4. The system of claim 1 , further comprising a time-of-flight camera claim 1 , and wherein a plurality of ...

METHOD AND DEVICE FOR GENERATING THREE-DIMENSIONAL GRAPHIC FILE AND PRESENTING THREE-DIMENSIONAL GRAPHIC ON CLIENT

A method for generating a three-dimensional graphic file including extracting, from data of a group of three-dimensional graph description objects including identical attribute features, data portions of the identical attribute features to form a shared description file shared by the group of three-dimensional graph description objects; extracting a data portion of a unique attribute feature of each three-dimensional graph description object in the group of three-dimensional graph description objects respectively to form a separate description file corresponding to each three-dimensional graph description object; and combining the shared description file with any of the separate description files according to requirements for displaying a three-dimensional graph to form a complete three-dimensional graph description file. The above method solves the problems in the conventional techniques that online shopping experience is affected as a three-dimensional graph presentation of different SKUs selected from the same kind of commodities cannot achieve an expected effect. 1. A method comprising:downloading a shared description file of a group of three-dimensional graph description objects including identical attribute features;downloading at least one separate description file of the group of three-dimensional graph description objects;combining the shared description file with a separate description file from the at least one separate description file to form a three-dimensional graph description file; andautomatically presenting the three-dimensional graph by using the combined three-dimensional graph description file.2. The method of claim 1 , further comprising repeating the following steps until exiting the presenting the three-dimensional graph presentation:combining the shared description file with another separate description file from the at least one separate description file to form another three-dimensional graph description file.3. The method of claim 1 , ...

INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM

An information processing apparatus acquires first physical makeup information representing a physical makeup of a first object. The first physical makeup information is information generated based on images obtained by imaging the first object with a plurality of imaging apparatuses in a plurality of directions. The information processing apparatus acquires second physical makeup information representing a physical makeup of a second object and motion information representing motion of a plurality of parts of the second object. The information processing apparatus generates motion information associated with the first physical makeup information based on the second physical makeup information and the motion information relating to the second object. 1. An information processing apparatus , comprising:a first acquisition unit configured to acquire first physical makeup information representing a physical makeup of a person as a first object, the first physical makeup information generated based on images obtained by imaging the first object with a plurality of imaging apparatuses in a plurality of directions;a second acquisition unit configured to acquire second physical makeup information representing a physical makeup of a person as a second object and motion information representing motion of a plurality of parts of the second object; anda generation unit configured to generate motion information associated with the acquired first physical makeup information based on the acquired second physical makeup information and the acquired motion information representing the motion of the plurality of parts of the second object.2. The information processing apparatus according to claim 1 , further comprising a display control unit configured to display claim 1 , on a display unit claim 1 , a first image representing motion of the first object based on the imaging of the first object and a second image based on the generated motion information associated with the acquired ...

METHOD AND SYSTEM FOR DETERMINING A VOLUME OF INTEREST

A system includes a storage device storing a set of instructions and a processor in communication with the storage device. When executing the set of instructions, the processor is configured to cause the system to obtain a 3D image including a plurality of 2D images, the 3D image relating to a lesion of an object and determine a preliminary VOI in the 3D image. The processor is also configured to cause the system to determine a preliminary shape based on an intersection of the preliminary VOI and a 2D target image of the plurality of 2D images and determine a transformation matrix corresponding to an operation to transform the preliminary shape to a target shape relating to the 3D ROI. The processor is further also configured to cause the system to determine a transformed VOI based on the preliminary VOI and the transformation matrix. 1. A system , comprising:at least one storage device including a set of instructions for determining a volume of interest (VOI); and obtain a three-dimensional (3D) image including a plurality of two-dimensional (2D) images, the 3D image relating to a 3D region of interest (ROI) corresponding to a lesion of an object;', 'determine a preliminary VOI in the 3D image, the preliminary VOI corresponding to the 3D ROI;', 'determine a preliminary shape based on an intersection of the preliminary VOI and a 2D target image of the plurality of 2D images;', 'determine a transformation matrix corresponding to an operation to transform the preliminary shape to a target shape relating to the 3D ROI; and', 'determine a transformed VOI based on the preliminary VOI and the transformation matrix., 'at least one processor configured to communicate with the at least one storage device, wherein when executing the set of instructions, the at least one processor is configured to cause the system to2. The system of claim 1 , wherein to determine the preliminary VOI in the 3D image claim 1 , the at least one processor is further configured to cause the system ...

Method and System for Registering a Patient with a 3D Image Using a Robot

A method of operating a medical registration system, the medical registration system comprising a robot which carries a surface point sampling device and comprising a computer connected to the robot, to obtain a registration of a 3D image of a patient with the patient (P) by: a) acquiring the 3D image of the patient; b) acquiring an initial registration of the 3D image with the patient as the registration; c) instructing the robot to sample the spatial locations of N different points on the surface of the patient using the surface point sampling device, wherein N is a positive integer; d) updating the registration based on the spatial locations of the N sampled points; and e) repeating steps c) and d) until a predetermined exit condition is fulfilled. 115.-. (canceled)16. A method of operating a medical registration system , the medical registration system comprising a robot which carries a surface point sampling device and including a computer connected to the robot , to obtain a registration of a 3D image of a patient with the patient by:acquiring the 3D image of the patient;acquiring an initial registration of the 3D image with the patient as the registration;sampling by the robot the spatial locations of N different points on the surface of the patient using the surface point sampling device, wherein N is a positive integer;updating the registration based on the spatial locations of the N sampled points; andrepeating the sampling and the updating steps until a predetermined exit condition is fulfilled.17. The method of claim 16 , wherein the predetermined exit condition is at least one of a time lapse claim 16 , the total number of sampled surface points claim 16 , the accuracy of the registration or the registration confidence.18. The method of claim 16 , wherein the sampling by the robot includes for each of the N different points claim 16 , instructing the robot to move the surface point sampling device into a sampling position and instructing the surface ...

Systems and Methods for Generating 2D Projection from Previously Generated 3D Dataset

A method includes providing a set of 2D images of an object, wherein the set of 2D images is obtained from a three-dimensional (3D) image of the object placed at a first pose. The method further includes projecting the set of 2D images from the first pose to a second pose different from the first pose, thereby obtaining a set of re-projected 2D images; and combining the set of re-projected 2D images into a single 2D image. 1. A method , comprising:providing a set of 2D images of an object, wherein the set of 2D images is obtained from a three-dimensional (3D) image of the object placed at a first pose;projecting the set of 2D images from the first pose to a second pose different from the first pose, thereby obtaining a set of re-projected 2D images; andcombining the set of re-projected 2D images into a single 2D image.2. The method of claim 1 , wherein the projecting of the set of 2D images includes sampling the set of re-projected 2D images to a grid corresponding to the second pose.3. The method of claim 1 , before the combining of the set of re-projected 2D images claim 1 , further comprising:deforming at least one of the set of re-projected 2D images.4. The method of claim 1 , before the projecting of the set of 2D images claim 1 , further comprising:binding multiple 2D images of the set of 2D images into a bound 2D image, wherein the multiple 2D images correspond to adjacent sub-volumes of the 3D image, wherein the projecting of the set of 2D images includes projecting the bound 2D image from the first pose to the second pose.5. The method of claim 1 , further comprising:binding multiple images of the set of re-projected 2D images, thereby obtaining another 2D image; andprojecting the another 2D image from the second pose to a third pose different from the second pose.6. The method of claim 1 , further comprising:projecting the set of re-projected 2D images from the second pose to a third pose different from the second pose, thereby obtaining another set of re- ...

MEASUREMENT OF THICKNESS OF THERMAL BARRIER COATINGS USING 3D IMAGING AND SURFACE SUBTRACTION METHODS FOR OBJECTS WITH COMPLEX GEOMETRIES

Embodiments described herein relate to a non-destructive measurement device measurement device and a non-destructive measurement method for determining coating thickness of a three-dimensional (3D) object. In one embodiment, at least one first 3D image of an uncoated surface of the object and at least one second 3D image of a coated surface of the object are collected and analyzed to the determine the coating thickness of the object. 1. A method of determining a thickness of an object coating , comprising:positioning a surface of an object in a field view of the at least one image sensor system in a non-destructive measurement device, the object having one or more surfaces;reading a Quick Response (QR) code corresponding to at least one part coordinate or an alignment position of the surface in the non-destructive measurement device, the QR code disposed on the object:collecting a 3D image of the surface without chemically or physically changing the one or more surfaces of the object corresponding to the at least one part coordinate or the aligned surface of the object at the alignment position; andanalyzing the 3D.2. The method of claim 1 , wherein the surface includes an uncoated portion and a coated portion claim 1 , and the 3D image corresponds to a first surface profile of the uncoated portion and a second surface profile of the coated portion claim 1 , the analyzing the second 3D image and the first 3D image comprises:removing outliers of the first surface profile and the second surface profile;filtering the first surface profile and the second surface profile;overlapping the first surface profile and the second surface profile; andsubtracting the second surface profile from the first surface profile to obtain a thickness of a coating of the object.3. The method of claim 2 , wherein the analyzing the first 3D image and the second 3D image further comprises:mirroring the first 3D image and the second 3D image; andselecting a first area of the first 3D image and ...

METHOD AND SYSTEM FOR PATIENT-SPECIFIC MODELING OF BLOOD FLOW

Embodiments include a system for determining cardiovascular information for a patient. The system may include at least one computer system configured to receive patient-specific data regarding a geometry of the patient's heart, and create a three-dimensional model representing at least a portion of the patient's heart based on the patient-specific data. The at least one computer system may be further configured to create a physics-based model relating to a blood flow characteristic of the patient's heart and determine a fractional flow reserve within the patient's heart based on the three-dimensional model and the physics-based model. 1184-. (canceled)185. A method for vascular assessment comprising:receiving a plurality of 2D angiographic images of a portion of a vasculature of a subject, and processing said images to produce a stenotic model over the vasculature, said stenotic model having measurements of the vasculature at one or more locations along vessels of the vasculature;obtaining a flow characteristic of the stenotic model; andcalculating an index indicative of vascular function, based, at least in part, on the flow characteristic in the stenotic model.186. The method according to claim 185 , wherein said measurements of the vasculature are at one or more locations along a centerline of at least one branch of the vasculature.187. The method according to claim 185 , wherein said flow characteristic of said stenotic model comprises resistance to fluid flow.188. The method according to claim 187 , further comprising identifying in said first stenotic model a stenosed vessel and a downstream portion of said stenosed vessel claim 187 , and calculating said resistance to fluid flow in said downstream portion;wherein said index is calculated based on a volume of said downstream portion, and on a contribution of said stenosed vessel to said resistance to fluid flow.189. The method according to claim 185 , wherein said flow characteristic of said stenotic model ...

Three Dimensional User Interface Effects On A Display

The techniques disclosed herein may use various sensors to infer a frame of reference for a hand-held device. In fact, with various inertial clues from accelerometer, gyrometer, and other instruments that report their states in real time, it is possible to track a Frenet frame of the device in real time to provide an instantaneous (or continuous) 3D frame-of-reference. In addition to—or in place of—calculating this instantaneous (or continuous) frame of reference, the position of a user's head may either be inferred or calculated directly by using one or more of a device's optical sensors, e.g., an optical camera, infrared camera, laser, etc. With knowledge of the 3D frame-of-reference for the display and/or knowledge of the position of the user's head, more realistic virtual 3D depictions of the graphical objects on the device's display may be created—and interacted with—by the user.

Surgery assistance apparatus and method, and non-transitory recording medium having stored therein surgery assistance program

A surgery assistance apparatus includes an organ region extraction unit that extracts a tubular-organ region from a three-dimensional image obtained by imaging a tubular-organ and a blood vessel dominating the tubular-organ, a blood vessel region extraction unit that extracts a blood vessel region dominating the tubular-organ from the three-dimensional image, a branching structure extraction unit that extracts a branching structure of the blood vessel from the extracted blood vessel region, and a dominated region identification unit that identifies, with respect to an arbitrary partial blood vessel corresponding to an upper edge branching at least once to reach an edge including a terminal-end of the extracted branching structure, a dominated region in the tubular-organ region that is dominated by the arbitrary partial blood vessel by using positional relationships between a plurality of terminal end points present after the edge of the arbitrary partial blood vessel branches last and the tubular-organ region.

REAL-TIME MOBILE CAPTURE AND APPLICATION OF PHOTOGRAPHIC IMAGES AS TEXTURES IN THREE-DIMENSIONAL MODELS

A computer-implemented method for obtaining texture data for a three-dimensional model is disclosed. The method is performed at a portable electronic device including a camera, one or more processors, and memory storing one or more programs. The method includes obtaining an image of one or more objects with the camera. The method also includes concurrently displaying at least a portion of the image with one or more objects in the three-dimensional model. The one or more objects in the three-dimensional model at least partially overlay the one or more objects in the image. The method furthermore includes storing at least one or more portions of the image as texture data for one or more of the one or more objects in the image. 1. A method for obtaining texture data for a three-dimensional model , comprising: obtaining an image of one or more objects with the camera;', 'concurrently displaying at least a portion of the image with a representation of one or more objects in the three-dimensional model, wherein the representation of the one or more objects in the three-dimensional model at least partially overlay the one or more objects in the image; and', 'storing at least one or more portions of the image as texture data for one or more of the one or more objects in the image., 'at a portable electronic device including a camera, one or more processors, and memory storing one or more programs, the one or more processors executing the one or more programs to perform the operations of2. The method of claim 1 , wherein the one or more objects in the three-dimensional model correspond to the one or more objects in the image.3. The method of claim 1 , further comprising:aligning the representation of the one or more objects in the three-dimensional model with the at least a portion of the image.4. The method of claim 3 , wherein the device includes a touch-sensitive display and the method includes:receiving one or more touch gestures on the touch-sensitive display; ...

Method and system for image processing in video conferencing

A method for image processing in video conferencing, for correcting the gaze of an interlocutor in an image or a sequence of images captured by at least one real camera, comprises the steps of the at least one real camera acquiring an original image of the interlocutor; synthesizing a corrected view of the interlocutor's face as seen by a virtual camera, the virtual camera being located on the interlocutor's line of sight and oriented towards the interlocutor; transferring the corrected view of the interlocutor's face from the synthesized view into the original image, thereby generating a final image; at least one of displaying the final image and transmitting the final image.

TERMINAL DEVICE, IMAGE SHOOTING SYSTEM AND IMAGE SHOOTING METHOD

A terminal device used for stereo imaging includes: an image shooting unit; a communication unit that receives a first image of a first angular field from an external terminal device; and a determination unit that determines the image shooting range relationship between the first image received by the communication unit and a second image of a second angular field shot by the image shooting unit, the second angular field being wider than the first angular field. 1. A terminal device comprising:an image shooting unit;a communication unit that receives a first image of a first angular field from an external terminal device; anda determination unit that determines an image shooting range relationship between the first image received by the communication unit and a second image of a second angular field shot by the image shooting unit, wherein the second angular field is wider than the first angular field.2. The terminal device according to claim 1 , wherein the determination unit detects an area corresponding to the first image from the second image claim 1 , and based on the position of the detected area on the second image claim 1 , determines the image shooting range relationship between the first and second images.3. The terminal device according to claim 2 , further comprising a display unit claim 2 , wherein the determination unit causes the display unit to superpose and display an image that indicates the range of the detected area and the second image.4. The terminal device according to claim 2 , wherein the determination unit causes the communication unit to transmit a notice indicating the determination result of the image shooting range relationship between the first and second images to the external terminal device.5. The terminal device according to claim 2 , further comprising a clipping unit that clips the detected area from the second image claim 2 ,wherein the determination unit causes the communication unit to transmit the image clipped by the ...

METHOD AND APPARATUS FOR MEASURING THE THREE DIMENSIONAL STRUCTURE OF A SURFACE

A method includes imaging a surface with at least one imaging sensor, wherein the surface and the imaging sensor are in relative translational motion. The imaging sensor includes a lens having a focal plane aligned at a non-zero angle with respect to an x-y plane of a surface coordinate system. A sequence of images of the surface is registered and stacked along a z direction of a camera coordinate system to form a volume. A sharpness of focus value is determined for each (x,y) location in the volume, wherein the (x,y) locations lie in a plane normal to the z direction of the camera coordinate system. Using the sharpness of focus values, a depth of maximum focus zalong the z direction in the camera coordinate system is determined for each (x,y) location in the volume, and based on the depths of maximum focus z, a three dimensional location of each point on the surface may be determined. 115-. (canceled)16. An apparatus , comprising:an imaging sensor comprising a telecentric lens, wherein the lens has a focal plane aligned at a non-zero viewing angle with respect to an x-y plane in a surface coordinate system, wherein the surface and the imaging sensor are in relative translational motion, and wherein the sensor images the surface to form a sequence of images thereof;a processor that:aligns in each image in the sequence a reference point on the surface to form a registered sequence of images;stacks the registered sequence of images along a z direction in a camera coordinate system to form a volume, wherein each image in the registered sequence of images comprises a layer in the volume;computes a sharpness of focus value for each pixel within the volume, wherein the pixels lie in a plane normal to the z direction in the camera coordinate system;{'sub': 'm', 'computes, based on the sharpness of focus values, a depth of maximum focus value zfor each pixel within the volume;'}{'sub': 'm', 'determines, based on the depths of maximum focus z, a three dimensional location of ...

CALIBRATION APPARATUS, CALIBRATION METHOD, OPTICAL APPARATUS, IMAGE CAPTURING APPARATUS, AND PROJECTION APPARATUS

A calibration apparatus is configured to acquire calibration data indicating a correspondence between two-dimensional pixel coordinates of the image-conversion device and three-dimensional world coordinates of the world coordinate space and calculate parameters by fitting, to the acquired data, a camera model in which two coordinate values of the two-dimensional pixel coordinates are expressed as a function of three coordinate values of the three-dimensional world coordinates. When a projection relationship between an angle of view and an image height of the optical system is roughly expressed by a predetermined expression by using a projection focal distance, the apparatus is configured to convert three-dimensional world coordinates of the acquired data to two-dimensional coordinates and, subsequently, by fitting a camera model in which the two coordinate values of the two-dimensional pixel coordinates are expressed as a function of two coordinate values of the two-dimensional coordinates, calculate the parameters of the camera model. 1. A calibration apparatus for an optical apparatus provided with a two-dimensional image-conversion device having a plurality of pixels and an optical system that forms an imaging relationship between the image-conversion device and a three-dimensional world coordinate space , wherein the calibration apparatus is configured to:acquire calibration data indicating a correspondence between two-dimensional pixel coordinates of the image-conversion device and three-dimensional world coordinates of the world coordinate space; andcalculate parameters of a camera model in which two coordinate values of the two-dimensional pixel coordinates are expressed as a function of three coordinate values of the three-dimensional world coordinates by fitting the camera model to the acquired calibration data,wherein, when a projection relationship between an angle of view θ and an image height y of the optical system is roughly expressed by a projection ...

INVISIBLE BIFURCATION DETECTION WITHIN VESSEL TREE IMAGES

An image registration system an endoscope () and an endoscope controller (). In operation, the endoscope () generates an intra-operative endoscopic image () of a vessel tree within an anatomical region including a plurality of branches of the vessel tree visible within the intra-operative endoscopic image () as an indication of a furcation of the vessel tree invisible within the intra-operative endoscopic image (). The endoscope controller () image registers the intra-operative operative endoscopic image () of the vessel tree to a pre-operative three-dimensional image () of the vessel tree. The image registration includes an image matching of a graphical representation of the furcation of the vessel tree as indicated by the branches of the vessel tree visible within the intra-operative endoscopic image () of the vessel tree to a graphical representation of the furcation of the vessel tree visible within the pre-operative three- dimensional image () of the vessel tree. 1. An image registration system , comprising:{'b': 12', '14, 'claim-text': {'b': 14', '14', '14, 'wherein the intra-operative endoscopic image () of the vessel tree includes a plurality of branches of the vessel tree visible within the intra-operative endoscopic image () as an indication of a furcation of the vessel tree invisible within the intra-operative endoscopic image (); and'}, 'an endoscope () operable for generating an intra-operative endoscopic image () of a vessel tree within an anatomical region,'}{'b': 22', '14', '44, 'claim-text': {'b': 14', '44, 'wherein the image registration includes an image matching of a graphical representation of the furcation of the vessel tree as indicated by the visible branches of the vessel tree within the intra-operative endoscopic image () of the vessel tree to a graphical representation of the furcation of the vessel tree within the pre-operative three-dimensional image () of the vessel tree.'}, 'an endoscope controller () operable for image registering the ...

System and method for fabricating a custom face mask

A system and method for fabricating a custom face mask. The system includes a factory client, wherein the factory client includes a computing device configured to receive, at a factory server and at least a user device, an image datum comprising a plurality of data of a face of a user. The computing device is further configured to map, as a function of a first machine-learning model, at least a facial landmark to a three-dimensional (3D) mesh of the image datum, map, as a function of a second machine-learning mode, a path to the 3D mesh including a boundary of a custom face mask configured for use on a user's face, generate a model file of a mold, instruct a manufacturing tool, and instruct a manufacturing device to thermoform the plastic component of the mold.

Real-Time 3D Virtual or Physical Model Generating Apparatus for HoloPortal and HoloCloud System

A novel electronic system provides fast three-dimensional model generation, social content sharing of dynamic three-dimensional models, and monetization of the dynamic three-dimensional models created by casual consumers. In one embodiment, a casual consumer utilizes a dedicated real-time D model reconstruction studio with multiple camera angles, and then rapidly create dynamic D models with novel computational methods performed in scalable graphics processing units. In another embodiment, uncalibrated multiple sources of video recording of a targeted object are provided by a plurality of commonly-available consumer video recording devices (e.g. a smart phone, a camcorder, a digital camera, etc.) located at different angles, after which the uncalibrated multiple sources of video recording are transmitted to a novel cloud computing system for real-time temporal, spatial, and photometrical calibration and D model reconstruction. The dynamic D models can be uploaded, listed, and shared among content creators and viewers in an electronic sharing platform. 1. A real-time 3D virtual and physical body double-generating apparatus comprising:a HoloPortal electronic system that incorporates a dedicated physical studio space, which is configured to capture, calibrate, calculate, reconstruct, and generate graphical transformation of a target object to create an electronic 3D body double model;a HoloCloud electronic system comprising consumer-level portable video recording devices positioned circularly around the target object and generate a plurality of multiple-angle video data streams, a scalable number of graphics processing units (GPU's) that execute a pre-processing module and a 3D reconstruction module for calibrating, calculating, reconstructing, and generating graphical transformations to create the electronic 3D body double model that resembles the target object, and a wireless transceiver that transmits the plurality of multiple-angle video data streams from the ...

PREDICTING RESPONSE TO IMMUNOTHERAPY TREATMENT USING DEEP LEARNING ANALYSIS OF IMAGING AND CLINICAL DATA

A method comprises providing a pre-treatment image of a target subject to at least one deep learning model uniquely trained to predict immunotherapy treatment responses. The method further comprises generating, by a processing device, a predicted treatment response score to a treatment based on the single pre-treatment image and the at least one deep learning model. The method further comprises providing, based on the predicted treatment response score, a recommended treatment plan. 1. A method , comprising:providing a pre-treatment image of a target subject to at least one deep learning model uniquely trained to predict immunotherapy treatment responses;generating, by a processing device, a predicted treatment response score to a treatment based on the single pre-treatment image and the at least one deep learning model; andproviding, based on the predicted treatment response score, a recommended treatment plan.2. The method of claim 1 , further comprising:receiving an intra-treatment follow-up image;providing the intra-treatment follow-up image to the at least one deep learning model;generating an updated predicted treatment response score; andproviding, based on the updated predicted treatment response score, an updated recommended treatment plan.3. The method of claim 1 , wherein the pre-treatment image comprises a plurality of imaging features.4. The method of claim 1 , wherein the at least one deep learning model comprises a convolutional neural network.5. The method of claim 1 , wherein the treatment is a PD-[L]1 immune checkpoint inhibitor treatment.6. The method of claim 1 , wherein the treatment is a PD-[L]1 or CTLA-4-immune checkpoint inhibitor treatment.7. The method of claim 1 , wherein the treatment is a PD-[L]1-based treatment or CTLA-4-based treatment combined with chemotherapy treatment.8. The method of claim 1 , wherein the treatment is a PD-[L]1-based treatment or CTLA-4-based treatment combined with radiotherapy treatment.9. The method of claim 1 ...

PRODUCT VISUALIZATION SYSTEM

A method and apparatus for displaying a product. The three-dimensional model includes objects and a spatial relationship of the objects to each other. A group of the objects in the three-dimensional model is identified based on a policy applied to a user input selecting a portion of the product and assigns a value to a group of attributes associated with the group of the objects. The value assigned to the group of the attributes indicates that the group of the objects is to be displayed on the display system. Other objects in the objects having the attributes without the value are not displayed. The attributes associated with the objects are outputted in which the group of the objects is displayed in three dimensions on the display system using the attributes associated with the objects, enabling a desired level of performance in visualizing the three-dimensional model of the product. 1. A method for displaying a product , the method comprising:accessing a three-dimensional model of the product in a computer system, wherein the three-dimensional model includes objects and a spatial relationship of the objects to each other;identifying a group of the objects in the three-dimensional model to be displayed on a display system in the computer system based on a policy applied to a user input selecting a portion of the product;assigning a value to a group of attributes associated with the group of the objects, wherein the value assigned to the group of the attributes indicates that the group of the objects is to be displayed on the display system, and wherein the other objects in the objects having the attributes without the value are not displayed; andoutputting the attributes associated with the objects in which the group of the objects is displayed in three dimensions on a display system using the attributes associated with the objects, enabling a desired level of performance in visualizing the three-dimensional model of the product on the display system.2. The method ...

Three-dimensional cavitation quantitative imaging method for microsecond-resolution cavitation spatial-temporal distribution

A three-dimensional cavitation quantitative imaging method for a microsecond-resolution cavitation spatial-temporal distribution includes steps of: after each wide beam detection, moving an array transducer by one unit; waiting until the cavitation nuclei distribution backs to an initial state, then detecting the cavitation by the wide beam detection with same cavitation energy incitation, so as to obtain a spatial series of two-dimensional cavitation raw radio frequency data corresponding to different placing positions of the array transducer; then changing the cavitation energy source duration, time delays between energy source incitation and the wide beam transmitted by the array transducer, and time delays between the pulsating pump and energy source incitation, so as to obtain a temporal series of two-dimensional cavitation raw radio frequency data; and then obtaining a microsecond-resolution three-dimensional cavitation spatial-temporal distribution image and a cavitation micro bubble concentration quantitative Nakagami parametric image. 1. A three-dimensional cavitation quantitative imaging method for a microsecond-resolution cavitation spatial-temporal distribution , comprising steps of: using a wide beam to detect cavitation activity for two-dimensional cavitation raw radio frequency data obtained; after cavitation detection by each wide beam , moving an array transducer for the wide beam detection by one unit perpendicular to a placing direction of the array transducer; waiting until a cavitation nuclei distribution returns to an original state thereof , then detecting the cavitation by the wide beam detection with same cavitation energy incitation , so as to obtain a spatial series of two-dimensional cavitation raw radio frequency data with the array transducer placed at different unit positions; and then obtaining a three-dimensional cavitation image and a cavitation micro bubble concentration quantitative three-dimensional image by combining wide beam ...

AUTOMATIC IMAGE SEGMENTATION METHODS AND ANALYSIS

The invention provides methods and apparatus for image processing that perform image segmentation on data sets in two- and/or three-dimensions so as to resolve structures that have the same or similar grey values (and that would otherwise render with the same or similar intensity values) and that, thereby, facilitate visualization and processing of those data sets. 1. A method comprising:(a) selecting a two-dimensional (2D) image slice from a plurality of 2D image slices using a digital data processing system configured for image processing;(b) computing with the digital data processing system a histogram for the 2D image slice;(c) receiving a plurality of identified histograms generated from a plurality of 2D image slices where the component connections are identified in the plurality of 2D image slices and the components are known in the plurality of 2D image slices;(d) computing with the digital data processing system a correlation between the histogram of step (b) and one or more of the plurality of identified histograms of step (c);(e) identifying an anatomical structure in the 2D image slice based on the correlation in step (d);(f) using the digital data processing system to assign a region of the 2D image slice corresponding to the anatomical structure identified in step (e) to one or more volumetric regions of a 3D volume;(g) performing a threshold segmentation on the 2D image slice;(h) identifying one or more connected components of the anatomical structure identified in step (e) based on the results of the threshold segmentation of step (g); and(i) displaying the 2D image slice with one of the one or more connected components removed based on the one or more connected components identified in step (h).2. The method of claim 1 , where the one or more connected components include bone structures and vessel structures.3. The method of claim 2 , where the bone structures are removed from the displayed 2D image.4. The method of claim 3 , where the vessel ...

Method, apparatus, and computer readable medium for removing unwanted objects from a tomogram

A method, apparatus, and computer readable medium for removing an unwanted object from an image volume are provided. Volumetric data of an object of study is generated in a radiographic scan. Volumetric data of the unwanted object is obtained. The two sets of volumetric data are registered in a common coordinate system. The unwanted object is removed from the volumetric data of the object of study to create modified volumetric data of the object of study. Data from voxels surrounding the removed unwanted object may be used to populate voxels corresponding to the unwanted object with interpolated data. A plurality of forward projections are performed on the modified volumetric data of the object of study, and a tomogram with the unwanted object removed is constructed.

APPARATUS FOR PERFORMING TESSELLATION OPERATION AND METHODS UTILIZING THE SAME

A rendering method executed by a graphics processing unit includes: loading a vertex shading command from a first command queue to a shader module; executing the vertex shading command for computing the varying of the vertices to perform a vertex shading operation by taking the vertices as first input data; storing first tessellation stage commands into a second command queue; loading the first tessellation stage commands to the shader module; and executing the first tessellation commands for computing first tessellation stage outputs to perform a first tessellation stage of the one or more tessellation stages by taking the varying of the vertices as second input data. The vertex shading command is stored into the first command queue by a first processing unit. The varying of the vertices and the first tessellation stage outputs are stored in a cache of the graphics processing unit. 1. A rendering method executed by a graphics processing unit (GPU) comprising a shader module , a non-shader module and a cache for performing one or more tessellation stages , the method comprising the steps of: loading a vertex shading command from a first command queue to the shader module, wherein the vertex shading command is stored into the first command queue by a first processing unit; and', 'executing the vertex shading command for computing varying of the plurality of vertices; and, 'performing a vertex shading operation by taking a plurality of vertices as first input data, comprising storing first tessellation stage commands into a second command queue;', 'loading the first tessellation stage commands from the second command queue to the shader module; and', 'executing the first tessellation commands for computing first tessellation stage outputs,, 'performing a first tessellation stage of the one or more tessellation stages by taking the varying of the plurality of vertices as second input data, comprisingwherein the varying of the plurality of vertices and the first ...

SYSTEM FOR TRACKING A HANDHELD DEVICE IN VIRTUAL REALITY

A system for tracking a first electronic device, such as a handheld smartphone, in a virtual reality environment generated by a second electronic device, such as a head mounted display may include detection, by a camera included in one of the first electronic device or the second electronic device, of at least one visual marker included on the other of the first electronic device or the second electronic device. Features detected within the field of view corresponding to known features of the visual markers may be used to locate and track movement of the first electronic device relative to the second electronic device, so that movement of the second electronic device may be translated into an interaction in a virtual experience generated by the second electronic device. 1. A method , comprising:operably coupling a first electronic device with a second electronic device so that the first electronic device and the second electronic device are in communication with each other while operating in an ambient environment, the second device being configured to generate and display a virtual environment while operating in the ambient environment;detecting at least one visual marker on one of the first electronic device or the second electronic device by a sensor of the other of the first electronic device or the second electronic device;detecting and tracking movement of the first electronic device in the ambient environment based on features detected in the at least one visual marker; andtranslating the detected and tracked movement of the first electronic device in the ambient environment into a corresponding action in the virtual environment.2. The method of claim 1 , wherein the detecting at least one visual marker and the detecting and tracking movement of the first electronic device in the ambient environment includes:collecting optical data using an optical sensor of the first electronic device, the optical data including images of the second electronic device; ...

HEAD-MOUNTED DISPLAY DEVICE AND COMPUTER PROGRAM

A head-mounted display device includes an image display section configured to display an image, an imaging section, a memory section configured to store data of a marker image, an image setting section configured to cause the image display section to display an image based at least on the data, and a parameter setting section. The parameter setting section derives at least one of camera parameters of the imaging section and a spatial relationship, the spatial relationship being between the imaging section and the image display section, based at least on an image that is captured by the imaging section in the case where the imaging section acquires a captured image of a real marker. 1. A head-mounted display device comprising:an image display section configured to transmit light from an outside scene and to display an image;an imaging section;a memory section configured to store data of a marker image;an image setting section configured to cause the image display section to display an image based at least on the data; anda parameter setting section,wherein the parameter setting section derives at least one of a camera parameter of the imaging section and a spatial relationship, the spatial relationship being between the imaging section and the image display section, based at least on an image that is captured by the imaging section in a condition that allows a user to visually perceive that the marker image displayed by the image display section and a real marker corresponding to the marker image substantially align at least partially with each other.2. A head-mounted display device according to claim 1 ,wherein the image setting section causes the image display section to display an AR image so as to allow the user to visually perceive a condition that a position and pose of the AR image and those of the real marker correspond to each other, after the parameter setting section derives at least one of the camera parameters and the spatial relationship.3. A head- ...

INTELLIGENT BIONIC HUMAN BODY PART MODEL DETECTION DEVICE AND METHOD FOR MANUFACTURING SAME

Disclosed are an intelligent bionic human body part model detection device and a method for manufacturing same. The device comprises: a bionic human body part model (); and multiple optical fiber grating sensing units () which are integrated on an optical fibre and arranged at multiple pre-determined positions of the bionic human body part model (). The device can improve the accuracy of the detection of pressure applied to the intelligent bionic human body part model. 1. A detection device of intelligent bionic human body part model , comprising:a bionic human body part model; anda plurality of fiber grating sensing units integrated on an optical fiber and a plurality of predetermined positions set on the bionic human body part model.2. The detection device according to claim 1 , wherein each of the plurality of fiber grating sensing units comprises:a substrate;a groove on the substrate; anda Bragg grating, suspended on a surface of the groove, wherein an air chamber is formed at the groove after packaging.3. The detection device according to claim 1 , wherein a plurality of optical fiber sensing channels are set on the bionic human body part model claim 1 , the plurality of optical fiber grating sensing units are dispersed in each of the optical fiber sensing channels claim 1 , at least one fiber grating sensing unit is dispersed in one fiber optic sensing channel claim 1 , and the at least one fiber grating sensing unit has different center wavelengths.4. The detection device according to claim 1 , wherein material of the bionic human body part model is an elastomer with a Young's modulus below 1 MPa.5. The detection device according to claim 4 , wherein the elastomer with a Young's modulus below 1 MPa is one or more of following:silicone, polyurethane, polyester, and polyacrylic acid.6. The detection device according to claim 1 , further comprising:a base set at a bottom of the bionic human body part model;a protective layer integrally connected to an upper ...

LASER SPECKLE SYSTEM AND METHOD FOR AN AIRCRAFT

A system for registering multiple point clouds captured by an aircraft is disclosed. The system includes a speckle generator, at least one three-dimensional (3D) scanner, and a processor coupled thereto. In operation, the speckle generator projects a laser speckle pattern onto a surface (e.g., a featureless surface). The at least one 3D scanner scans the surface to generate a plurality of point clouds of the surface and to image at least a portion of the laser speckle pattern. The processor, which is communicatively coupled with the at least one 3D scanner, registers the plurality of point clouds to generate a complete 3D model of the surface based at least in part on the laser speckle pattern. 1. A system for registering multiple point clouds , the system comprising:a speckle generator to project a first laser speckle pattern onto a surface;at least one three-dimensional (3D) scanner to scan the surface, wherein the at least one 3D scanner is configured to generate a plurality of point clouds of the surface and to image at least a portion of the first laser speckle pattern; anda processor communicatively coupled with the at least one 3D scanner to register the plurality of point clouds to generate a 3D model of the surface based at least in part on the first laser speckle pattern.2. The system of claim 1 , wherein the speckle generator includes a laser source to generate a laser beam and an optical element to diffract the laser beam into a plurality of laser beams of multiple orders claim 1 , wherein the plurality of laser beams defines the first laser speckle pattern.3. The system of claim 1 , wherein the at least one three-dimensional (3D) scanner is coupled to an aircraft having a diffuser and a downward facing camera communicatively coupled with the processor claim 1 , the downward facing camera being configured to image a first surface of the diffuser.4. The system of claim 3 , wherein the speckle generator is configured to project a second laser speckle ...

Image analysis for making animal measurements including 3-d image analysis

A computer-implemented image analysis process including accessing image data and range data representing an image of an animal, measuring an object volume from the range data and estimating the animal's weight using the dimensions representing the animal's size. A database containing relative volume and weight information can then be used to accurately predict the animal's weight from calculating its volume.

THREE-DIMENSIONAL PRINTING APPARATUS AND THREE-DIMENSIONAL PRINTING METHOD

A 3D printing method adapted to a 3D printing apparatus is provided. The 3D printing apparatus is configured to edit a plurality of sliced images, and execute a 3D printing operation according to the edited sliced images. The 3D printing method includes: analyzing a plurality of sliced objects of the sliced images, so as to draw a plurality of sliced object casings according to individual contours of the sliced objects, where the sliced object casings respectively include a part of the sliced objects; and respectively deleting the other parts of the sliced objects outside the sliced object casings, and integrating the sliced object casings of the sliced images to obtain a 3D model casing. Moreover, the 3D printing apparatus applying the 3D printing method is also provided. 1. A three-dimensional printing method , adapted to a three-dimensional printing apparatus , wherein the three-dimensional printing apparatus is configured to horizontally slice a three-dimensional model to obtain a plurality of sliced images , and edit the sliced images to execute a three-dimensional printing operation according to the edited sliced images , the three-dimensional printing method comprising:analyzing a plurality of sliced objects of the sliced images, so as to draw a plurality of sliced object casings according to individual contours of the sliced objects, wherein the sliced object casings respectively comprise a part of the sliced objects; andrespectively deleting the other parts of the sliced objects outside the sliced object casings, and integrating the sliced object casings of the sliced images to obtain a three-dimensional model casing.2. The three-dimensional printing method as claimed in claim 1 , wherein the sliced object casings respectively have a same predetermined thickness.3. The three-dimensional printing method as claimed in claim 1 , further comprising:analyzing an outer three-dimensional contour of the three-dimensional model casing to obtain a plurality of ...

Image Processing Apparatus, Image Processing Method, and Image Communication System

Methods and apparatus provide for: capturing an image of an object, which includes a face of a person wearing an optical display apparatus by which to observe a stereoscopic image that contains a first parallax image and a second parallax image obtained when the object in a three-dimensional (3D) space is viewed from different viewpoints; identifying the optical display apparatus included in the image of the object; and generating an image of the face of the person that does not include the optical display apparatus by excluding the identified optical display apparatus, and instead by adding features of the face of the person to a region in which the identified optical display apparatus is excluded. 1. An image processing apparatus comprising at least one processor operating under control of executable computer code stored in a non-tangible , computer readable recording medium , such that the image processing apparatus operates to:obtain an image of an object, which includes a face of a person wearing an optical display apparatus by which to observe a stereoscopic image that contains a first parallax image and a second parallax image obtained when the object in a three-dimensional (3D) space is viewed from different viewpoints;identify the optical display apparatus included in the image of the object; andgenerate an image of the face of the person that does not include the optical display apparatus by excluding the identified optical display apparatus, and instead by adding features of the face of the person to a region in which the identified optical display apparatus is excluded.2. The image processing apparatus according to claim 1 , wherein the image of the object is obtained via a stereoscopic camera including a first camera and a second camera that take images of the first parallax image and the second parallax image claim 1 , respectively claim 1 , when the object in the three-dimensional space is viewed from different viewpoints.3. The image processing ...

Near Touch Interaction

A near-touch interface is provided that utilizes stereo cameras and a series of targeted structured light tessellations, emanating from the screen as a light source and incident on objects in the field-of-view. After radial distortion from a series of wide-angle lenses is mitigated, a surface-based spatio-temporal stereo algorithm is utilized to estimate initial depth values. Once these values are calculated, a subsequent refinement step may be applied in which light source tessellations are used to flash a structure onto targeted components of the scene, where initial near-interaction disparity values have been calculated. The combination of a spherical stereo algorithm, and smoothing with structured light source tessellations, provides for a very reliable and fast near-field depth engine, and resolves issues that are associated with depth estimates for embedded solutions of this approach. 1. A system for determining near touch interaction , comprising:a display for displaying one or more elements thereon;a plurality of stereo cameras positioned adjacent to the display, at least one of the plurality of cameras being active in a visible light portion of the spectrum, and at least one of the plurality of cameras being active in a portion of the spectrum other than the visible light spectrum; anda processor for causing the display to flash one or more structured light sequences on a user pointer placed adjacent to the display, determining a depth map in accordance with information acquired by the stereo camera pair, and if desired, employing the one or more structured light sequences to possibly refine the depth map, and determining a location corresponding to one or more of the one or more elements displayed on the display to be selected in accordance with the determined depth map;wherein the at least one of the plurality of cameras that is active in the visible light portion of the spectrum operating when ambient light is determined to be sufficient for visible ...

COMPOSITE IMAGE GENERATION TO REMOVE OBSCURING OBJECTS

Technologies are generally described for methods and systems effective to generate a composite image. The methods may include receiving first image data that includes object data corresponding to an object and receiving second image data that includes obscuring data. The obscuring data, if displayed on a display, may obscure at least a portion of the. The methods may also include identifying a first region that may include the object data, in the first image data. The methods may also include identifying a second region, that may include the obscuring data, in the second image data. The methods may also include replacing at least part of the second region with at least part of the first region to generate the composite image data that may include at least some of the object data. The methods may also include displaying the composite image on a display. 1. A method to generate a composite image , the method comprising , by a first device:receiving, from a second device, first image data that includes object data, wherein the object data corresponds to an object;receiving second image data that includes obscuring data, wherein the obscuring data corresponds to at least a part of the second device, the obscuring data, if displayed on a display, would obscure at least a portion of the object;identifying a first region in the first image data, wherein the first region includes the object data;identifying a second region in the second image data, wherein the second region includes the obscuring data;replacing at least part of the second region in the second image data with at least part of the first region, to generate the composite image data, where the composite image data includes at least some of the object data; anddisplaying the composite image on a display.2. The method of claim 1 , wherein the first device includes a vehicle and the display is inside the vehicle.3. The method of claim 1 , wherein the first device includes a first vehicle claim 1 , and the second ...

Medical image measurement device and method, and non-transitory computer-readable recording medium

The medical image measurement device includes a medical image acquisition unit which acquires a first medical image and a second medical image obtained by photographing the same object of interest of the same patient at different time points, a measurement parameter acquisition unit which acquires a first measurement parameter set for measuring the features of the shape of the object of interest in the first medical image and a second measurement parameter set for measuring the features of the shape of the object of interest in the second medical image, an evaluation value acquisition unit which acquires an evaluation value indicating a change between the first measurement parameter and the second measurement parameter, and a determination unit which determines whether or not the change is equal to or greater than a preset amount of change based on the evaluation value.

METHOD AND APPARATUS FOR DISPLAYING PATHOLOGICAL CHANGES IN AN EXAMINATION OBJECT BASED ON 3D DATA RECORDS

A method and an apparatus are disclosed for analyzing pathological changes to anatomic areas in examination objects. In such cases, the method includes the segmentation of 3D data of the anatomic area, its standardization, comparison with a reference model and assignment of a deviation value and intensity value from an intensity scale to the anatomic area. The intensity value of the diagrammatic display of the standardized anatomic area allows the person skilled in the art to determine pathological changes to the anatomic area in a quick and cost-effective manner. 1. A method for analyzing a 3D data record of an examination object , comprising:segmenting the 3D data record of the examination object to determine different anatomic areas in the 3D data record;determining standardized anatomic areas by standardizing sizes of the different anatomic areas;comparing the sizes of the different standardized anatomic areas with a reference model including reference variables of the different anatomic areas; and determining a deviation value, indicating how the size of the respective standardized anatomic area deviates from the associated reference variable,', 'assigning, to all pixels of a respective anatomic area, a deviation value, so that all pixels of an anatomic area have the same deviation value, and', 'assigning, to all pixels of the respective anatomic area, an intensity value for diagrammatic display which corresponds to the deviation value., 'for each of the standardized anatomic areas,'}2. The method of claim 1 , wherein claim 1 ,all of the different anatomic areas, contained in the 3D data record of the examination object, are divided into a plurality of pixels, andthe standardization of a respective one of the different anatomic areas takes place such that the ratio of the volume of all pixels of the respective one of the different anatomic areas with an overall volume of all pixels of the examination object is determined.3. The method of claim 1 , wherein claim ...

Systems and Methods for Ultrasound Imaging

Techniques for processing ultrasound data. The techniques include using at least one computer hardware processor to perform obtaining ultrasound data generated based, at least in part, on one or more ultrasound signals from an imaged region of a subject; calculating shadow intensity data corresponding to the ultrasound data; generating, based at least in part on the shadow intensity data and at least one bone separation parameter, an indication of bone presence in the imaged region, generating, based at least in part on the shadow intensity data and at least one tissue separation parameter different from the at least one bone separation parameter, an indication of tissue presence in the imaged region; and generating an ultrasound image of the subject at least in part by combining the indication of bone presence and the indication of tissue presence.

Methods, systems, and computer readable media for real-time 2d/3d deformable registration using metric learning

Methods, systems, and computer readable media for real-time 2D/3D deformable registration using metric learning are disclosed. According to one aspect, a method for real-time 2D/3D deformable registration using metric learning includes creating a catalogue of simulated 2D projection images based on a reference 3D image and a shape space of 3D deformations, where each entry in the catalogue is created by: applying to the reference 3D image a set of deformation parameters from the shape space of deformations; simulating a 2D projection of the result; associating the simulated 2D projection image with the deformation parameters used to create the simulated 2D projection image; and storing the simulated 2D projection image and associated deformation parameters in the catalogue. The method also includes receiving a 2D image, and, in response to receiving the 2D image: calculating a value of distance between the received 2D image and a simulated 2D projection image for each of the simulated 2D projection images in the catalogue; using the calculated distances to calculate weighting factors to be applied to the deformation parameters of each of the simulated 2D projection images in the catalogue; and calculating deformation parameters for the received 2D image based on the weighted deformation parameters in the catalogue. The calculated deformation parameters are then used to deform a 3D volume of interest to produce a 3D volume that represents the 3D layout of the tissue at the time that the received 2D image was acquired.

VIEW CLASSIFICATION-BASED MODEL INITIALIZATION

An image processing apparatus and related method. The apparatus (PP) comprises an input port (IN), a classifier (CLS) and an output port (OUT). The input port is capable of receiving an image of an object acquired at a field of view (FoV) by an imager (USP). The image records a pose of the object corresponding to the imager's field of view (FoV). The classifier (CLA) is configured to use a geometric model of the object to determine, from a collection of pre-defined candidate poses, the pose of the object as recorded in the image. The output port (OUT) is configured to output pose parameters descriptive of the determined pose. 1. An image processing apparatus , comprising:an input port (IN) for receiving an image (3DV) of an object (HT) acquired at a field of view (FoV) by an imager (USP), the image recording a pose of the object corresponding to the imager's field of view (FoV);a classifier configured to use a geometric model (MOD) of the object (HT) to determine, from a collection of pre-defined poses, the pose of the object as recorded in the image;an output port (OUT) configured to output a pose parameter descriptive of the determined pose,characterized in that the classifier uses a generalized Hough transform, GHT, to determine the object's pose, each of the pre-defined poses associated with a point in the Hough parameter space of the GHT.2. An image processing apparatus of claim 1 , further comprising:a segmenter configured to use the pose parameters as initialization information to segment the image for the object at the estimated pose.3. (canceled)4. An image processing apparatus of claim 1 , wherein the GHT is based on a plurality of separate Hough accumulators claim 1 , each dedicated to a different one of the pre-defined poses.5. An image processing apparatus of claim 1 , comprising an identifier (ID) configured to identify at least one landmark in the image (3DV) claim 1 , each pre-defined pose associated with a transformation claim 1 , the classifier ( ...

INFORMATION PROCESSING APPARATUS RECOGNIZING CERTAIN OBJECT IN CAPTURED IMAGE, AND METHOD FOR CONTROLLING THE SAME

An information processing apparatus includes an image obtaining unit configured to obtain an input image, an extraction unit configured to extract from the input image one or more regions corresponding to one or more objects included in a foreground of the operation surface in accordance with the reflected positional information and positional information of the operation surface in the space, a region specifying unit configured to specify an isolation region, which is not in contact with a boundary line which defines a predetermined closed region in the input image, from among the one or more regions extracted by the extraction unit, and a recognition unit configured to recognize an adjacency state of a predetermined instruction object relative to the operation surface in accordance with the positional information reflected from the portion corresponding to the isolation region as specified by the region specifying unit. 1. An information processing apparatus comprising:an image obtaining unit configured to obtain an input image on which positional information in a space including an operation surface as a portion of a background is reflected;an extraction unit configured to extract one or more regions corresponding to one or more objects included in a foreground of the operation surface from the input image in accordance with the positional information reflected on the input image obtained by the image obtaining unit and positional information of the operation surface in the space;a region specifying unit configured to specify an isolation region which is not in contact with a boundary line which defines a predetermined closed region in the input image from among the one or more regions extracted by the extraction unit; anda recognition unit configured to recognizes an adjacency state of a predetermined instruction object relative to the operation surface in accordance with the positional information reflected on the isolation region in the input image in a ...

AUTOMATIC BACKGROUND REGION SELECTION FOR LESION DELINEATION IN MEDICAL IMAGES

In a method and apparatus for automatic background region selection for lesion segmentation in medical images, a patient medical image dataset is loaded into a computer and an image region is delineated to obtain a segmentation containing a lesion. A background region is created from the segmentation representing the patient organ. 1. A method for automatic background region selection for lesion segmentation in medical image data , comprising:loading a medical image data set of a patient into a computer;in said computer, automatically identifying and delineating an image region that contains a lesion, within said medical image data set;in said computer, automatically identifying a background region within said image region;in said computer, automatically calculating a segmentation of said lesion by comparison of said lesion with said background region; andfrom said computer, causing the segmented lesion to be visually displayed at a display screen in communication with said computer.2. A method as claimed in comprising identifying said background region by:automatically identifying regions of said lesion in said image region, and identifying potential non-background regions; andautomatically identifying said background region by subtracting, from said image region, said regions identified as said lesion and as potential non-background regions.3. A method as claimed in comprising providing said computer with co-registered functional and anatomical data sets claim 1 , respectively obtained with multiple imaging modalities claim 1 , as said medical image data set.4. A method as claimed in comprising delineating said image region by executing said algorithm on said anatomical data set claim 3 , and transferring a segmentation of said lesion from said anatomical data set to said functional data set claim 3 , and performing the identification of said background region using said functional data set.5. A method as claimed in wherein said medical image data set is a ...

SURGERY ASSISTANCE APPARATUS AND METHOD, AND NON-TRANSITORY RECORDING MEDIUM HAVING STORED THEREIN SURGERY ASSISTANCE PROGRAM

A surgery assistance apparatus includes an organ region extraction unit that extracts a tubular organ region from a three-dimensional image obtained by imaging a tubular organ and a blood vessel dominating the tubular organ, a region-of-interest setting unit that sets a region of interest in the tubular organ region, a blood vessel region extraction unit that extracts a blood vessel region dominating the tubular organ from the three-dimensional image, a branching structure extraction unit that extracts a branching structure of the blood vessel from the blood vessel region, and a dominating blood vessel identification unit that identifies a dominating blood vessel region in the blood vessel region that dominates the region of interest by using a positional relationship between a terminal end point of the extracted branching structure and the set region of interest. 1. A surgery assistance apparatus comprising:an organ region extraction unit that extracts a tubular organ region from a three-dimensional image obtained by imaging a tubular organ and a blood vessel dominating the tubular organ;a blood vessel region extraction unit that extracts a blood vessel region dominating the tubular organ from the three-dimensional image;a region-of-interest setting unit that sets a region of interest in the extracted tubular organ region;a branching structure extraction unit that extracts a branching structure of the blood vessel from the extracted blood vessel region; anda dominating blood vessel identification unit that identifies a dominating blood vessel region in the blood vessel region that dominates the region of interest by using a positional relationship between a terminal end point of the extracted branching structure and the set region of interest,wherein the dominating blood vessel identification unit identifies a part of the blood vessel region corresponding to a segment from an edge including a terminal end of the branching structure, and the terminal end being ...

MULTIMODE X-RAY APPARATUS AND METHOD FOR THE OPERATION

In a method for producing 2-D recordings and 3-D recordings of a breast of a patient using an x-ray device that is operable in two recording modes and that has an x-ray radiation source and an x-ray radiation detector, the breast is placed between the x-ray radiation source and the x-ray radiation detector, and the 2-D recordings and the 3-D recordings are generated with the same breast placement. In order to keep the radiation exposure as low as possible in such a multi-mode x-ray device, all recordings are produced without the use of an anti-scatter grid, and a retroactive scattered radiation correction is implemented. 1. A mammography method comprising:operating an x-ray source to irradiate a breast with x-rays that produce scattered radiation, and detecting x-rays attenuated by the breast, with no anti-scatter grid between the x-ray source and the radiation detector, in a first mode to acquire at least one of a 2-D x-ray data set and in a second mode to acquire a 3-D x-ray data set, with a position of the breast being unchanged in said first mode and said second mode; andin a computer, reconstructing an image of the breast from each of said 2-D x-ray data set and said 3-D x-ray data set by executing an image reconstruction algorithm with retrospective scattered radiation correction, and making the images available at an output of the computer in electronic form as a data file.2. A method as claimed in comprising generating multiple 3-D images of the breast claim 1 , and generating a synthetic 2-D image of the breast from said 3-D images.3. A method as claimed in comprising executing said retroactive scattered radiation correction when generating said synthetic 2-D image.4. A method as claimed in comprising generating said retroactive scattered radiation correction using an image processing algorithm in said reconstruction algorithm.5. A method as claimed in comprising generating multiple 3-D images of the breast claim 4 , and generating a synthetic 2-D image of ...

THREE-DIMENSIONAL MAP DISPLAY SYSTEM

A map database stores three-dimensional polygons of features, as well as water system polygons such as sea and lake and ground surface polygons. The map database stores map data in multiple levels having different levels of details, such as levels LVa to LVc. A procedure of displaying a three-dimensional map offsets the water systems relative to the ground surfaces, draws a map of a distant view area distant away from the viewpoint using map data at a low level of details, subsequently clears a depth buffer and newly draws a map of a close view area close to the viewpoint using map data at a high level of details. The offset is set to increase in the distant view area and decrease in the close view area. Increasing the offset in the distant view area avoids the occurrence of Z-fighting in the distant area from the viewpoint. 1. A three-dimensional map display system that displays a three-dimensional map , comprising:a map database that stores three-dimensional polygon data representing geography and a three-dimensional shape of each feature;an offset setting section that performs an offset process in an overlapping area of a first polygon and a second polygon representing substantially horizontal planes to shift the first polygon and the second polygon relative to each other in a height direction, so as to make a height difference between the first polygon and the second polygon; anda drawing controller that uses the three-dimensional polygon data and polygons processed by the offset setting section to draw the three-dimensional map by perspective projection viewed from a specified viewpoint position and in a specified gaze direction, whereinthe offset setting section shifts the first polygon and the second polygon to increase the height difference at a distant point from the viewpoint in the perspective projection than a close point to the viewpoint.2. The three-dimensional map display system according to claim 1 , whereinthe map database stores the three- ...

THREE-DIMENSIONAL MAP DISPLAY SYSTEM

A map database stores map data in multiple levels having different levels of details. In displaying a three-dimensional map, the map data having a higher level of details is used for a close view area near the viewpoint to a predetermined distance, and the map data having a lower level of details is used for a distant view area farther from the predetermined distance. The distant view area is first drawn by a perspective projection, and then, after clearing a depth buffer that stores depth information, the close view area is drawn, such that an undesirable hidden line removal process based on the depth information is not performed between the projected image in the distant view area and that in the close view area, thereby avoiding an unnatural phenomenon in which part of the close view image is hidden by the distant view image. 1. A three-dimensional map display system that displays a three-dimensional map , comprising:a map database that stores map data for displaying a three-dimensional map, at each of multiple levels having different levels of map details; and the display controller concurrently uses map data in a plurality of different levels to draw a map, such that map data at a rougher level having a lower level of map details is used for a distant view area more distant away from the viewpoint position and map data at a finer level having a higher level of map details is used for a close view area closer to the viewpoint position,', 'the display controller sequentially draws the map from the distant view area toward the close view area, and', 'the display controller draws the close view area over a previously drawn map, irrespective of depth at each point on the previously drawn map., 'a display controller that refers to the map database and displays a three-dimensional map viewed from a specified viewpoint position and in a specified gaze direction, wherein'}2. The three-dimensional map display system according to claim 1 , whereinthe display controller ...

THREE-DIMENSIONAL MAP DISPLAY SYSTEM

A three-dimensional map is displayed in a bird's eye view with a stereoscopic effect of feature polygons by providing shading in an appropriate direction according to the gaze direction in a simulative manner. Shading wall polygons are set in addition to feature polygons in three-dimensional map data. The shading wall polygon is a virtual plate-like polygon provided vertically, for example, along a boundary of a feature polygon. When provided around the water system, the shading wall polygon is specified to be opaque on one surface viewed from the water system side and to be transparent on the opposite surface. The shading wall polygons are drawn along with the feature polygons in the process of displaying a map. The shading wall polygon is drawn in black, gray or the like only at a location where the surface specified to be opaque faces a gaze direction. 1. A three-dimensional map display system that displays a three-dimensional map , comprising:a drawing map database that is used to draw the three-dimensional map; anda display controller that refers to the drawing map database and displays the three-dimensional map as a bird's eye view from a viewpoint position looking down from a height and in a gaze direction, whereinthe drawing map database stores: feature polygon data used to draw feature polygons representing shapes of features to be drawn in the three-dimensional map; and shading wall polygon data used to display a shading wall polygon, which is a virtual plate-like polygon to express shading in the three-dimensional map, is set perpendicular to or inclined to a feature polygon for which the plate-like polygon is to be set, and is specified to be visible only from one surface of front and rear surfaces and to be transparent from the other surface, andthe display controller displays only the surface specified to be visible with respect to the shading wall polygon.2. The three-dimensional map display system according to claim 1 , whereinthe shading wall ...

Determining a Three-dimensional Model Dataset of a Blood Vessel System with at least One Vessel Segment

A three-dimensional model dataset of a blood vessel system of a patient including at least one the vessel system is determined from a number of projection images, which have been recorded from different recording angles, of the blood vessel system The projection images are divided up into image areas each containing at least one pixel. A feature vector is determined for each of the image areas. Classification information, which describes how the respective image area belongs or does not belong to a vessel segment of the blood vessel system defined in accordance with anatomical specification data, is defined for each of the image areas by applying a classification function to the feature vector assigned to the image area. The classification function has been trained by training data records annotated with classification information obtained from at least one person other than the patient. The blood vessel system in the projection images is segmented by grouping image areas with the same classification information. The three-dimensional model dataset is calculated as a function of the segmented projection images and the classification information. 1. A method for determining a three-dimensional model dataset of a blood vessel system of a patient including at least one vessel segment from a number of projection images of the blood vessel system , which have been recorded from different recording angles , the method comprising:dividing the projection images up into image areas each containing at least one pixel,determining a feature vector comprising at least image data of at least the image area and/or computation data computed as a function of the image data, for each of the image areas,defining classification information that describes how the respective image area belongs to a vessel segment of the blood vessel system defined in accordance with anatomical specification data or describes how the respective image area does not belong to the blood vessel system, for ...

METHOD FOR CO-SEGMENTATING THREE-DIMENSIONAL MODELS REPRESENTED BY SPARSE AND LOW-RANK FEATURE

Presently disclosed is a method for co-segmenting three-dimensional models represented by sparse and low-rank feature, comprising: pre-segmenting each three-dimensional model of a three-dimensional model class to obtain three-dimensional model patches for the each three-dimensional model; constructing a histogram for the three-dimensional model patches of the each three-dimensional model to obtain a patch feature vector for the each three-dimensional model; performing a sparse and low-rank representation to the patch feature vector for the each three-dimensional model to obtain a representation coefficient and a representation error of the each three-dimensional model; determining a confident representation coefficient for the each three-dimensional model according to the representation coefficient and the representation error of the each three-dimensional model; and clustering the confident representation coefficient of the each three-dimensional model to co-segment the each three-dimensional model respectively. 1. A method for co-segmenting three-dimensional models represented by sparse and low-rank feature , comprising:pre-segmenting each three-dimensional model of a three-dimensional model class to obtain three-dimensional model patches for the each three-dimensional model;constructing a histogram for the three-dimensional model patches of the each three-dimensional model to obtain a patch feature vector for the each three-dimensional model;performing a sparse and low-rank representation to the patch feature vector for the each three-dimensional model to obtain a representation coefficient and a representation error of the each three-dimensional model;determining a confident representation coefficient for the each three-dimensional model according to the representation coefficient and the representation error of the each three-dimensional model; andclustering the confident representation coefficient of the each three-dimensional model to co-segment the each ...

COMPUTER-READABLE RECORDING MEDIUM, VOXELIZATION METHOD, AND INFORMATION PROCESSING DEVICE

A non-transitory computer-readable recording medium stores a voxelization program that causes a computer to execute a process. The process includes voxelizing a three-dimensional shape to generate a first voxel structure corresponding to the three-dimensional shape, specifying, in a case where lines perpendicular to respective faces of a cube or a cuboid containing the generated first voxel structure are extended from the respective faces toward inside the cube or the cuboid until the lines hit the first voxel structure, a region outside an outer periphery of the first voxel structure according to whether at least lines extended from three faces orthogonal to each other intersect, and setting the specified outside region as a second voxel structure, and performing inversion to invert a region of the voxel structures and a region not set as a voxel in the cube or the cuboid. 1. A non-transitory computer-readable recording medium storing a voxelization program that causes a computer to execute a process , the process comprising:voxelizing a three-dimensional shape to generate a first voxel structure corresponding to the three-dimensional shape;specifying, in a case where lines perpendicular to respective faces of a cube or a cuboid containing the generated first voxel structure are extended from the respective faces toward inside the cube or the cuboid until the lines hit the first voxel structure, a region outside an outer periphery of the first voxel structure according to whether at least lines extended from three faces orthogonal to each other intersect;setting the specified outside region as a second voxel structure; andperforming inversion to invert a region of the voxel structures and a region not set as a voxel in the cube or the cuboid.2. The non-transitory computer-readable recording medium according to claim 1 , wherein the process further includesspecifying a region through which a sphere or cube of a specific size is allowed to continuously pass in a ...

METHODS AND SYSTEMS OF PERFORMING EYE RECONSTRUCTION USING A PARAMETRIC MODEL

Systems and techniques for reconstructing one or more eyes using a parametric eye model are provided. The systems and techniques may include obtaining one or more input images that include at least one eye. The systems and techniques may further include obtaining a parametric eye model including an eyeball model and an iris model. The systems and techniques may further include determining parameters of the parametric eye model from the one or more input images. The parameters can be determined to fit the parametric eye model to the at least one eye in the one or more input images. The parameters include a control map used by the iris model to synthesize an iris of the at least one eye. The systems and techniques may further include reconstructing the at least one eye using the parametric eye model with the determined parameters. 1. A computer-implemented method of reconstructing one or more eyes , comprising:obtaining one or more input images, the one or more input images including at least one eye;obtaining a parametric eye model, the parametric eye model including an eyeball model and an iris model;determining parameters of the parametric eye model from the one or more input images, the parameters being determined to fit the parametric eye model to the at least one eye in the one or more input images, wherein the parameters include a control map used by the iris model to synthesize an iris of the at least one eye; andreconstructing the at least one eye using the parametric eye model with the determined parameters.2. The method of claim 1 , wherein the one or more input images include a three-dimensional face scan of at least a portion of a face including the at least one eye claim 1 , the three-dimensional face scan being from a multi-view scanner.3. The method of claim 2 , wherein the parameters include a shape parameter corresponding to a shape of an eyeball of the at least one eye claim 2 , and wherein determining the shape parameter includes fitting the ...