20-01-2022 дата публикации
Номер: US20220019837A1
Принадлежит:
In an approach for guiding a visually impaired user to position a mobile device appropriately in relation to a screen so that dynamic information on the screen can be reliably extracted and conveyed to the visually impaired user, a processor receives an image captured by a camera of a mobile device. A processor performs object recognition on the image to identify a digital screen and a location of the digital screen in the image. A processor retrieves a template of the digital screen. A processor performs angle-sensitive optical character recognition (OCR) on the location of the digital screen in the image. Responsive to a processor determining text on the digital screen can be extracted, a processor conveys the text to a user. Responsive to a processor determining text on the digital screen cannot be extracted, a processor guides the user to re-orient the mobile device to capture a better image. 1. A computer-implemented method comprising:receiving, by one or more processors, an image captured by a camera of a user mobile device;performing, by the one or more processors, object recognition on the image to identify a digital screen and a location of the digital screen in the image, wherein the digital screen is identified to be of a known type, brand, or model of digital screen;retrieving, by the one or more processors, a template of the digital screen based on the known type, brand, or model of digital screen;performing, by the one or more processors, angle-sensitive optical character recognition (OCR) on the location of the digital screen in the image; anddetermining, by the one or more processors, whether, within the image, text on the digital screen can be extracted.2. The computer-implemented method of claim 1 , further comprising:responsive to determining the text can be extracted, audibly conveying, by the one or more processors, the text to a user of the user mobile device using text-to-speech.3. The computer-implemented method of claim 1 ,responsive to ...
Подробнее
