• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    Procedure and system for meter reading. A method and meter data reading system (10) using a digital camera provided in a mobile user terminal (1), with which: - an image (3) of the digital camera is framed within a template (2, 2 ') superimposed on the image (3) by a reading data capture application running on the mobile user terminal (1), the template (2, 2 ') defined according to a model of the counter (10) recognized by the application by means of a classifier of counters previously trained with images of different counter models; - a picture of the framed image (3) comprising a reading is taken by means of the digital camera and sent by the application of reading data acquisition through a wireless network from the mobile user terminal (1) to a server that performs a recognition of the reading through an OCR algorithm. (Machine-translation by Google Translate, not legally binding)
    公开号:ES2669555A1
    申请号:ES201631515
    申请日:2016-11-25
    公开日:2018-05-28
    发明作者:Jose Maria BOIXEDA DE MIGUEL
    申请人:Gas Natural Redes Distribucion Gas SDG SA；
    IPC主号:
    专利说明:

    image 1 DESCRIPTION
    Procedure and system for meter reading OBJECT OF THE INVENTION
    The present invention falls within the technical sector of the technologies of automatic collection of consumption, diagnosis and status data of meters, water or energy (gas, electricity), and transfer of said data to a central database for Billing, problem solving and analysis.
    More particularly, the present invention relates to a system and method for reading meter data using a mobile user terminal (smartphone, tablet, etc.). BACKGROUND OF THE INVENTION
    The problem of reading meters and water and energy measurement equipment is known. An erroneous reading brings with it an erroneous billing, or a claim from the user, or a momentary loss of income by the companies involved in the processes, both the distribution company and the marketers.
    The distribution companies have staff that travel to homes and other places where the meters are installed to proceed to the manual reading of each meter one by one. To solve the problem, centralized systems were developed that have a single unit, with the capacity to connect to them a series of meters that incorporate a pulse emitting system, collected in the central. Likewise, individual systems have been developed, in which for each meter to be read, there is an electronic unit to which the meter is connected. In both cases, for the reading of the unit, central or individual, a processor is required, by centralization or by each individual subscriber, which implies an increase in the price of the product and therefore the reading and billing. A solution to this is that described in ES-2029406, which refers to an autonomous pulse recording system via radio or by a laptop, for centralized meter reading. However, not all meters have this pulse emitting system, which makes the meter more expensive.
    image2
    On the other hand, from the point of view of the consumer, provide the readings of the
    5 counters to the distribution company, by phone, mail or other means that are used today (until recently it was not yet possible to read or online), or allowing company personnel to enter the home to obtain them, it is always a bit annoying task.
    10 The objective technical problem that arises is thus to provide a meter reading method and system that is comfortable for the user and does not entail an extra cost, taking advantage of the new technologies developed for the mobile user terminals with which it has more and more part of the population
    fifteen DESCRIPTION OF THE INVENTION
    The present invention serves to solve the problem mentioned above, solving the problems presented by the solutions mentioned in the state of the art, allowing the user to read the meter from his mobile terminal through an application (aap) that runs in the same. The application can run on iOS and Android systems, and can be used from a mobile phone or tablet. To use the application, the user registers a Universal Supply Point Code (CUPS) number and takes a picture of the measuring equipment or counter with his mobile terminal. The app
    25 notifies the user of whether the photo is correct and sends it to the computer systems of the distribution company, of water or energy, so that the data extracted from the photo is processed automatically. The mobile application allows the meter to be read with the camera provided in the user's mobile terminal and sent to the server, where the reading is processed without human intervention.
    30 Of course, there may be a percentage of readings that need human validation, for example, by a dirty or fogged counter, poor lighting, an image angle that does not allow numbers to be recognized ..., in addition there are numerous counter models and, with them, the different typefaces and size of the numbers.
    35 Therefore, the mobile application has a powerful Optical Character Recognition (OCR) algorithm and a control platform, through which the operators of the servers or computer systems ('backoffice', in English) of the Counter distributors can analyze blurry images and have access to automatically validated ones, for monitoring and supervision purposes. The integration of this platform with the internal management systems of the distribution company allows accounting of the readings and invoicing.
    image3
    One aspect of the invention relates to a method of reading measuring equipment or counters comprising the following steps:
    -Frame an image seen through a digital camera provided in a mobile user terminal within one or more templates shown (s) overprinted (s) in the image by a reading data capture application that runs in the terminal mobile user (phone, tablet, etc.); - take, by means of the digital camera, a photo of the framed image that comprises a reading and send it by means of the application of capture of data of reading through a wireless network from the mobile user terminal to a server that makes a recognition of the reading through an OCR algorithm.
    Another aspect of the invention relates to a system that implements the meter reading procedure described above. The system comprises a mobile user terminal and a server that communicate with each other through a wireless network, comprising:
    -a mobile user terminal provided with a digital camera and where there is a reading data capture application configured to display at least one template superimposed on an image received by the digital camera, which takes a photo of the image with a framed reading within the template; -a server with a receiver to receive the photo with the reading, which sends the application of reading data capture from the mobile user terminal through a wireless network, and that executes an OCR algorithm to perform a reading recognition received
    The advantages of the present invention with respect to prior art solutions are fundamentally:
    image4
    -Faster, more convenient and easier reading of the counters thanks to the simple use of a camera of the user's terminal, with the help of the mechanism of framing of the digits provided by the counter, also frames that, to facilitate the process of capturing A valid reading is adapted to each type of meter.
    5 - "- Availability of the meter's photograph as objective evidence of the reading provided. The photographic support of the reading is a key element to be considered" real "reading (comparable to the reading taken by the operator when accessing the client's home) and pick up the meter reading) "
    -It is a “real” reading provided directly by the client, which
    10 supposes a drastic elimination of disagreements with the billing if the billing has been carried out according to that “real” reading through a photograph taken by the customer and sent to the distributor. BRIEF DESCRIPTION OF THE FIGURES
    A series of drawings that help to better understand the invention and that expressly relate to an embodiment of said invention which is presented as a non-limiting example thereof is described very briefly below.
    FIGURE 1.- Shows a schematic representation of a scenario for using a meter reading system that uses a mobile for capturing the reading, according to a preferred embodiment of the invention.
    FIGURE 2.- Shows an image of the reading captured through the mobile in the proposed system 25, according to a possible embodiment of the invention.
    FIGURE 3.- Shows a flow of states that follows a reading in the meter reading system until it is accepted or discarded by the proposed system, according to a possible embodiment of the invention.
    30
    35
    image5 PREFERRED EMBODIMENT OF THE INVENTION
    In a preferred embodiment of the invention, a gas meter reading system (10) is proposed which comprises an application to capture the reading data installed in a user mobile terminal (1), for example, a smartphone as shown in Figure 1, or a tablet, which has a digital camera.
    The Application to capture the reading data previously requests the user to enter a CUPS number or Unique Supply Point Code, which uniquely identifies a supply point, in this case, gas.
    Once the Unique CUPS Code has been introduced, the camera's own application with the mobile terminal is opened. Alternatively, the user can put the camera in manual or automatic mode to force shooting. In this way you can choose that, although the Application to capture the reading data may not consider that the received image has sufficient quality, as described below, the camera is also shot to take the picture with any quality.
    To take the photo, the user approaches the camera to the gas meter (10) and the Application to capture the reading data instructs the user to frame the digits in a template (2, 2 '), such as the one shown in the Figures 1 and 2, which appears superimposed on the video or image signal (3) received by the camera. The user frames according to that template (2, 2 ’), focuses with the camera and, once the digits within the template (2, 2’) are focused and framed, the camera fires, manually or automatically.
    Before shooting, the Application to capture reading data can determine if the camera is receiving good image quality. If the automatic analysis of the image performed by the Capture Application determines that the image (3) the camera is receiving does not have sufficient quality, the Application notifies the user. For example, in a possible embodiment, the part external to the template (2, 2 ’), that is, the area around the area within which the user has to frame the reading, turns red. Despite this, the user is able to see the whole image (3) that comes from the camera because this red is translucent. In case the framing is correct, the area of all areas of the image
    (3) external to the template (2, 2 ') momentarily turns green to indicate that the image (3) has sufficient quality and can be shot, automatically if the trigger is activated, to capture an image with framed digits of the counter .
    image6
    In a possible embodiment, operating in automatic shooting mode the camera, the Application to capture reading data analyzes three levels of quality:
    1) If the image (3) that you are receiving is stable and has no shaking 2) If the image (3) that you are receiving in the template frame (2, 2 ') has something similar to what the reading of a counter (10) 3) If it is able to recognize any digit of the image (3)
    Operating in manual shooting mode, the Application only analyzes the first two steps to determine if sufficient quality is achieved - and indicate the user with the green color surrounding the template (2, 2 ’) that can be triggered -:
    1) If the image (3) you are receiving is stable and has no shaking 2) If the image (3) you are receiving in the frame has something similar to what a meter reading looks like (10)
    After taking the picture, the Application shows a screen that shows the user the picture taken and a text indicating if the photo is of sufficient quality.
    After the user has been able to send the first photo, the system is able to recognize the counter model (10).
    To recognize the counter model (10), the system comprises a meter classifier trained to learn to distinguish the images of the different models by their visual appearance. To carry out this learning, many images of each of the counter models have been taken. From these images, the classifier is able to learn what visual characteristics of the image are similar in all images of the same model and what characteristics allow them to be distinguished from the images of other models. In this way, when a new image is received, the classifier is able to identify which counter model corresponds to a certain level of confidence.
    Once the counter model has been identified, a homography process is applied to locate the areas corresponding to the reading and the serial number within the image.
    image7
    The homogenization process consists in matching the image (3) that is received and wants to be recognized with a reference image that has been used to define a template (2, 2 ’) of the profile assigned to the counter (10). In this process, the most visually relevant points are sought both in the image (3) to be recognized and in the template image (2, 2 ’) of the assigned profile. The points in both images are mapped and in this way you can obtain a geometric transformation that allows you to align the new image with the template image, achieving two objectives:
    • Locate precisely within the new image the areas that correspond to the reading and the serial number.
    • Correct possible geometric distortions of the image, basically orientation, size and perspective
    The model identifier is sent to the application so that it can apply certain templates (2, 2 ’). These templates (2, 2 ’) are maintained for each meter profile registered in the mobile terminal (1). In a possible embodiment, a first serial number template (2) is first presented, as shown in Figure 1, so that the photo sent to the server of the distribution company allows the counter (10) to be identified through said number serial. After that, the application for capturing read data presents a second framing template of reading digits (2 '), as shown in Figure 2. The templates (2, 2') are shown on the screen, superimposed on the image (3), for example, showing a green rectangle where the user has to fit the image
    (3) in both templates (2, 2 ') to proceed to the reading of its counter, an orange rectangle where the user has to fit the serial number in the first template (2) of Figure 1 and some orange lines to fit the measurement digits in the second template (2 ') of Figure 2. The templates (2, 2') have frames to focus on the serial number and the reading of measurement digits respectively, frames that are placed in function of the profile assigned to the counter. Thus, for each profile or type of counter a template is defined that determines the relative position of where the template boxes (2, 2 ’) appear within the image (3).
    To recognize both the serial number in the first template (2) and the measurement reading in the second template (2 ’), an OCR process described below is applied. If the model contains a barcode, an attempt is also made to recognize the barcode as an alternative method to identify the serial number.
    image8
    In the procedure of aid to the framing with the templates (2, 2 ’) the three verifications are detailed that follow and, if the three give a positive result, the image is considered to be well framed:
    one. A classifier analyzes the visual appearance of the area of the image that is within the focus frame and checks whether it visually resembles a reading or not.
    2. A process is also executed that verifies that the image does not change significantly from one frame of the video signal (‘frame’ in English) to the next, to ensure that the image is stable.
    3. Finally, an OCR algorithm is applied to the focus frame image to verify that a minimum number of digits can be recognized with sufficient confidence.
    If it is the first photo that the user has taken, the system tries to recognize at least all the digits collected in the image minus two, that is, it is allowed to have up to two digits that cannot be recognized. If you do not exceed this threshold, the user is notified and the Application invites you to take a new capture. In the second capture it is controlled that in at least one of the two photos you have taken you have been able to recognize at least one digit. If so, it allows you to send the picture to the distributor's server for consideration.
    All these processes are typical of the Data Capture Application that runs on the mobile terminal (1) that are specifically developed, in a possible implementation, using tools from a public library of computer vision algorithms, the openCV library.
    The OCR algorithm that allows the reading digits to be recognized basically consists of two processes:
    one. Digit location and segmentation: In this process the image corresponding to the region defined by the focus frame is taken and the location of each digit of the reading is searched within this image. The objective is to obtain a set of sub-images that correspond to each of the digits.
    2. Digit recognition: Each of the sub-images of the digits found in the previous process is taken and a classifier is used to decide which digit corresponds to each image. This classifier is trained using thousands of
    5
    10
    fifteen
    twenty
    25
    30


    Counter digit images. Apart from the recognized digit, a confidence measure that is used to decide whether or not the reading is accepted is returned.
    Once the photo is taken, it is sent to some servers of the gas distribution company, where the photo is treated. The photo is sent through a wireless network, the mobile phone network or a Wi-Fi network, depending on the user's availability at that time. , through an HTTPS call, secured end to end.
    If it is the first time that the client performs this action, the meter model, the serial number of the meter and the reading it shows are recognized from the photo; on the following occasions, it is only necessary to recognize the meter reading from the photo. The meter reading becomes a numerical measurement data, in this example, gas consumption, and is incorporated as actual meter reading information.
    If operating in this way, in automatic mode, the system is not able to identify the numerical data of the photograph with sufficient confidence, it is possible to transfer the photo to the computer systems of the operators of the distributor ('backoffice') that They are responsible for making a manual recognition.
    An example of the combination of the two modes of operation, automatic and manual, is shown in Figure 3. Once the photograph sent by the user through the network is delivered to the servers of the distributor, the photo remains in the “ OCR PENDING ”. All photographs of this state are processed by the OCR server that analyzes whether it is able to recognize the reading with sufficient confidence. Once the automatic treatment has been carried out, if it exceeds the established trust criteria, the photo is considered to have been “AUTOMATICALLY RECOGNIZED”. Otherwise, it is “PENDING MANUAL REVIEW”. Once the manual review has been completed, if it has been accepted by a ‘backoffice’ operator, it goes to the “MANUALLY RECOGNIZED” state. ”. If it is not accepted by the operator, it goes directly to the “DISCARDED READING” state and the user of the mobile application is notified that the reading has not been accepted and that a new capture is sent. In case it is not a re-linked reading or, if it is re-encoded but its transcription of the reading has been modified, the photo is pending to be sent to an image recognition platform, just like a photo that is already “AUTOMATICALLY RECOGNIZED " Whether it has been recognized automatically or manually, you try to send to that platform


    of recognition of errors, which in case you accept the reading, is confirmed in the "READ ACCEPTED" state. On the contrary if it is rejected by the recognition platform, the reading goes back through the backoffice for another manual review in which they verify or not the transcription of the reading, until the transcription does not change or
    5 reject directly by a ‘backoffice’ operator.
    As an additional feature, the Read Data Capture Application asks the user if they want to be informed of the reading period, in order to facilitate the photo in a manner consistent with the readings made by the gas distribution company, of
    10 so that when said supply re-enters the reading period, the client receives a notification notification inviting him to facilitate said reading with the Application. This notification is made through PUSH notifications via Apple and Android directly. Although the user does not have the application open at that time, he receives the notification equally. This notification is sent to the user at the time he has indicated
    15 from the configuration part of the application. When the application has received notification that a new reading is pending, a number is displayed on a red ball at the top left of the application icon, as required by the user. If the user opens the application, the counter identifier is shown in orange, on which it is necessary to send a new reading photo.
    20 Once each of the photos has been sent, the user looks like he has already completed the shipment. In case the photo must be rejected for some reason, the user receives in the application as the photo has been rejected and if he can send a photo again. The Application optionally allows you to store a history of all the readings sent.
    25
    权利要求:
    Claims (12)
    [1]
    image 1
    1. A method for reading meter data (10) using a digital camera provided in a mobile user terminal (1), characterized in that it comprises the
    5 next steps: - frame an image (3) received by the digital camera into at least one template (2, 2 ') shown superimposed on the image (3) by a reading data capture application that runs on the terminal mobile user (1); - take, by means of the digital camera, a photo of the image (3) framed that
    10 comprises reading and sending it by means of the application of reading data capture through a wireless network from the mobile user terminal (1) to a server that recognizes the reading through an OCR algorithm.
    [2]
    2. The method according to claim 1, characterized in that the
    15 digital camera takes the picture of the image (3) only if the application of reading data capture determines that the image (3) is framed with a given quality threshold.
    [3]
    3. The method according to claim 2, characterized in that the
    20 reading data capture application determines that the image (3) is framed with the given quality threshold: - visually analyzing an area of the image (3) within the template (2, 2 ') and comparing the area with a pattern of reading images using a classifier,
    25 - determining that the image (3) remains stable.
    [4]
    4. The method according to claim 3, characterized in that determining that the image (3) is framed with the quality threshold given additionally comprises
    30 -recognize a minimum number of digits in the image area (3) within the template (2, 2 ') using an OCR algorithm that runs on the mobile user terminal (1) and accessed by the capture application of reading data.
    [5]
    5. The method according to any of the preceding claims, characterized in that if the photo of the image (3) is the first one taken by the camera
    12

    digital, the reading included in the photo corresponds to a serial number of the counter (10) framed within a first template (2); in another case, the reading included in the photo corresponds to some consumption measurement digits of the counter (10) framed within a second template (2 ’).
    5
    [6]
    6. The method according to any of the preceding claims, characterized in that the template (2, 2 ’) is defined according to a counter model (10) recognized by the application for reading data capture.
    The method according to claim 6, characterized in that the reading data capture application recognizes the meter model (10) by means of a meter counter previously trained with images of different meter models to distinguish them by visual appearance .
    The method according to any of the preceding claims, characterized in that it additionally comprises sending a notification to the mobile user terminal (1) from the server that performs the reading recognition.
    [9]
    9. The method according to claim 8, characterized in that the
    20 notification is selected from Accepted Reading, Rejected Reading and Pending Reading.
    [10]
    10. The method according to claim 9, characterized in that if the
    Notification is Read Accepted, additionally it comprises storing the reading 25 by the application for capturing reading data in mobile user terminal (1).
    [11]
    11. The method according to claim 9, characterized in that if the notification is Rejected Reading or Pending Reading additionally comprises requiring an additional photo by the application of reading data capture.
    30
    [12]
    12. The method according to any of the preceding claims, characterized in that it additionally comprises sending a unique supply point code that uniquely identifies a supply point to a user associated with a counter (10).
    35
    13
    image2
    [13]
    13. The method according to claim 12, characterized in that it additionally comprises assigning readings received on the server to the unique supply point code.
    The method according to any of the preceding claims, characterized in that the reading data capture application sends the photo of the image (3) through a mobile telephone network or through a WiFi network.
    [15]
    15. A system for reading meter data (10), characterized in that it comprises:
    10 -a mobile user terminal (1) provided with a digital camera and where there is a reading data capture application configured to display at least one template (2, 2 ') superimposed on an image (3) received by the camera digital, to take a picture of the image (3) comprising a reading framed within the template (2, 2 ');
    15 -a server with a receiver to receive the photo with the reading, which sends the application of reading data capture from the mobile user terminal (1) through a wireless network, and which executes an OCR algorithm to perform a recognition of the reading received.
    14
    类似技术:
    公开号 | 公开日 | 专利标题
    JP6557222B2|2019-08-07|Iris biometric recognition module and access control assembly
    TWI622011B|2018-04-21|Surface state photographic display system and surface state photographic display method
    CN106062783B|2019-11-26|Pointers track for eye simple scan device and display
    ES2854979T3|2021-09-23|Smartphone-assisted maintenance of a self-service terminal
    CN105303632A|2016-02-03|Mobile signing monitoring system and working method
    CN104173027A|2014-12-03|Self-service body temperature measuring method and system thereof
    JP2020507836A|2020-03-12|Tracking surgical items that predicted duplicate imaging
    CN106355367A|2017-01-25|Warehouse monitoring management device
    US10565735B2|2020-02-18|Image calibration patient identification
    CN108010008B|2021-06-22|Target tracking method and device and electronic equipment
    CN110418627A|2019-11-05|Medicament identification device, medicament recognition methods and medicament recognizer
    ES2669555A1|2018-05-28|Procedure and system for meter reading |
    CN102782718A|2012-11-14|Authentication device, authentication program, and authentication method
    CN204192587U|2015-03-11|Self-service body temperature measuring instrument
    CN211928594U|2020-11-13|Self-service temperature measurement system and device thereof
    CN207267409U|2018-04-24|Internet of Things intelligence seal system
    KR20190059148A|2019-05-30|Method for identification of companion animals using muzzle patternrecognition from an identity verification agency
    CN109101917A|2018-12-28|Mask method, training method, the apparatus and system identified again for pedestrian
    CN108985675A|2018-12-11|A kind of auto inventory method and system of RFID tag
    WO2021139494A1|2021-07-15|Animal body online claim settlement method and apparatus based on monocular camera, and storage medium
    CN108446664A|2018-08-24|A kind of indentity identifying method and device based on recognition of face
    US10339174B2|2019-07-02|Automated location visit verification for officer monitoring systems
    CN108986137A|2018-12-11|Human body tracing method, device and equipment
    CN208969738U|2019-06-11|Hand-held tour terminal for safety monitoring
    US10943366B2|2021-03-09|Wound characterization of a patient
    同族专利:
    公开号 | 公开日
    ES2669555B1|2019-05-07|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    WO2002031442A1|2000-10-07|2002-04-18|Lattice Intellectual Property Ltd|Method and apparatus for obtaining information from a utility meter|
    EP1584898A1|2004-04-08|2005-10-12|Accenture Global Services GmbH|Method and system for remotely monitoring meters|
    ES2270727A1|2005-09-27|2007-04-01|Grup Iviron, S.A.|Remote reading system for consumption metering equipment|
    US20160086034A1|2011-08-31|2016-03-24|Next Future, LLC|Analog utility meter reading|
    US20150003665A1|2013-06-27|2015-01-01|Verizon Patent And Licensing Inc.|Metering information collection|FR3097390A1|2019-06-17|2020-12-18|Total Direct Energie|Control method for the implementation of a communication system for an electricity meter, computer program and associated electronic device|
    WO2021113531A1|2019-12-05|2021-06-10|Saudi Arabian Oil Company|Method and system for obtaining information from analog instruments using a digital retrofit|
    法律状态:
    2019-05-07| FG2A| Definitive protection|Ref document number: 2669555 Country of ref document: ES Kind code of ref document: B1 Effective date: 20190507 |
    优先权:
    申请号 | 申请日 | 专利标题
    ES201631515A|ES2669555B1|2016-11-25|2016-11-25|Procedure and system for meter reading|ES201631515A| ES2669555B1|2016-11-25|2016-11-25|Procedure and system for meter reading|
    [返回顶部]