• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    SYSTEM AND METHOD FOR VOICE ACTIVATED CONFIGURATION OF A CONTROL DEVICE. It is a speech recognition mechanism to which voice data indicative of at least the brand of a target equipment is provided. The speech recognition engine uses the speech data indicative of at least the target equipment brand to identify within a code set library at least one code set which is compared to the target equipment brand. At least one set of codes thus identified is then provided to the control device for use in directing the functional operations of the target equipment.
    公开号:BR112014010748B1
    申请号:R112014010748-3
    申请日:2012-10-23
    公开日:2021-05-11
    发明作者:Jonathan Lim
    申请人:Universal Electronics Inc；
    IPC主号:
    专利说明:

    Field of Invention
    [0001] The present invention relates generally to remote control systems and, more particularly, to a system and method for configuring a control device such as a universal remote control to command the functions of one or more types of remotely controllable equipment from one or more manufacturers. Exemplary types of equipment include, but are not limited to, televisions, AV receivers, cable or satellite Internet connection devices (STBs), DVD players, digital video recorders (DVRs), thermostats, game consoles , etc. Fundamentals of the Invention
    [0002] Manufacturers typically supply a remote control with one device and as such different types of equipment from different manufacturers are often commanded with different remote controls. To minimize the number of individual remote controls a user needs, universal remote controls have been developed. Consequently, universal remote controls and/or application software to universal remote control to command the various functions of various types of equipment from various manufacturers have become very frequent. By way of example, universal remote controls are described in US Patents. US. 4,959,810, 5,255,313 and 5,552,917.
    [0003] In a common method of configuring a universal remote control, codes to command the functions of a device are learned from a remote control supplied by the manufacturers with that equipment. The learned codes, which are stored within the universal remote control, are then available for subsequent transmission to the equipment. Alternatively, codes to command the functions of equipment of various types and manufacturers can be pre-programmed into the universal remote control. The user can then interact with the universal remote control to identify on the universal remote control which equipment(s) the user wants to control, that is, the user manually enters an equipment code or brand code, usually obtained from a table in a printed user manual or similar, on the universal remote control and it uses this identification information provided by the user to access those pre-programmed codes that are appropriate to command the identified equipment(s). In this regard, examples of known methods for performing an initial setup of a universal remote control can be found, for example, in the US Patent. Mentioned above No. 4,959,810, as well as in US Patent. No. 5,614,906 entitled “Method for Selecting a Remote Control Command Set”, or US Patent. No. 4,703,359 entitled "Universal Remote Control Unit with Model Identification Capability", each of which is incorporated herein by reference.
    [0004] As an alternative to printed tables and the like, several methods have been proposed based on the use of a personal computer to access equipment identification data listings and/or command codes. Examples of such methods can be found in US Patent. No. 7,612,685 entitled “Online remote control configuration system” or in the US Patent Application. Co-pending 12/490,978 entitled "System and Method to Facilitate Configuration of a Universal Controlling Device", both of which are incorporated herein by reference.
    [0005] Furthermore, in certain cases, the user of a control device, whether universal or not, can be provided with the ability to customize the functionality of the control device, for example, rearranging which functions are assigned to which keys, adding functions to lesser used keys that were not part of the standard command set provided in the control device, etc. Again, such operations can be performed by entering data obtained from a table into a printed user manual, as described in the US Patent. No. 5,515,052 entitled "Universal Remote Control with Function Synthesis", or using a personal computer and/or Internet service as described, for example, in the US Patent. No. 7,093,003 entitled "System and Method for Upgrading the Remote Control Functionality of a Device", both commonly owned patents and incorporated herein by reference.
    [0006] While such known methods work for their intended purpose, it has been seen that the process of setting up a control device, such as a universal remote control, can remain demanding and often frustrating for many users. For example, user manuals or other documents containing setup codes and entry instructions may be lost or may be in inappropriate places, or may be replaced as brand and/or model names evolve or controllable functions are added; a personal computer and/or internet access may not be available at the location of the equipment to be controlled, etc. Consequently, there is a need for a more simplified and user-friendly system and method for the user to conveniently configure a control device. Invention Summary
    [0007] The present description generally refers to control devices, such as universal remote controls, and more specifically to improved methods for configuring such devices, that is, the identification and selection of appropriate sets of command data to be associated with the specific equipment to be controlled. To this end, a control device may be provided with a device to receive voice input from a user, eg a microphone, so that when placed in a configuration mode, the control device can request information description of spoken equipment, for example, brand and model number, to be processed by a voice recognition system in order to identify the equipment to be controlled and the command data to which it responds. As will be clear, the speech recognition and command data identification process can be carried out in the control device itself; on a locally located device, such as a personal computer or a device connecting to the Internet via TV; remotely on a network server; or a combination of these when appropriate for a particular modality. Additionally, in certain modalities, speech recognition capability can be extended to allow the user to further refine the control device configuration, for example, assigning extended functionality to certain keys, verbally accessing less frequently used functions, defining activities, etc.
    [0008] A better understanding of the objectives, advantages, characteristics, properties and relationships of the invention claimed later will be obtained from the following detailed description and attached drawings which present illustrative embodiments and which are indicative of the various ways in which the principles of invention can be employed. Brief Description of Drawings
    [0009] For a better understanding of the various aspects of the claimed invention, reference may be made to the preferred embodiments shown in the attached drawings in which:
    [0010] Figures 1a and 1b illustrate exemplified systems in which the control devices according to the present invention can be used.
    [0011] Figure 2 illustrates a block diagram of exemplified components of the control device of Figure 1a.
    [0012] Figure 3 illustrates a block diagram of exemplified components of the control device of Figure 1b.
    [0013] Figure 4 illustrates an exemplified method for configuring a control device to find a device to be controlled using speech input.
    [0014] Figures 5a and 5b further illustrate exemplified systems in which control devices can be configured according to the method of Figure 4.
    [0015] Figure 6 illustrates an exemplified method to access extended functions of a configured equipment using speech input.
    [0016] Figures 7a and 7b illustrate the structure of a database of brand names, model numbers, and command codes for use in conjunction with the methods of Figures 4 and 6. Detailed Description of the Invention
    [0017] Turning now to Figure 1a, an exemplified system is illustrated in which a control device 100 is configured to control various controllable equipment, such as a television 102, an Internet connection device via TV ("STB" ) 104, a DVD player 106 and an AV receiver 108. As is known in the art, the control device 100 may be capable of transmitting commands to the equipment using any IR, RF, Point-to-Point, or proto-protocol. -120 network neck, to make the equipment perform operational functions. While illustrated in the context of a television 102, STB 104, DVD player 106 and AV receiver 108, it is understood that controllable equipment may include, but need not be limited to, televisions, VCRs, DVRs, DVD players, video devices. Internet connection via TV (“STBs”), amplifiers, CD players, game consoles, home lighting, curtains, fans, HVAC systems, thermostats, personal computers, etc.
    [0018] Figure 1b illustrates a second exemplified system that is similar to that of Figure 1a, but where the control device functionality can be incorporated into a user-installed application software module (generally known in the art as “application”) residing on a smart device 110, a device that can comprise a smartphone, a tablet computer, a portable e-mail device, an e-book, portable game and/or game controller, a portable media device , etc. As is clear, in that case, the physical ability to transmit command signals from equipment 120 can be provided by an external adapter, for example, as described in the US Patent. No. 6,931,231 entitled "Infrared Generator From Audio Signal Source", by a transmission device, for example, as described in the US Patent Application. Copen- dent 13/071,661 entitled "System and Method for Facilitating Appliance Control Via a Smart Device", or may be embedded in the smart device, for example, as described in the US Patent Application. copending 04/133,915 entitled "System and Method for Provision of Infrared Signaling in Smart Phones", all of which are incorporated herein by reference.
    [0019] Referring to Figure 2, a first exemplified modality of a control device 100 for use in commanding the functional operations of one or more equipment may include, when necessary for a particular application, a processor 200 coupled to a ROM memory 204, a RAM memory 205, an array of keys 216 (e.g. fixed keys, function keys such as a touch-sensitive surface superimposed on a liquid crystal display (LCD), and/or an electroluminescent display (EL)), transmission circuit(s) and/or transceiver circuit(s) 210 (eg IR and/or RF), a non-volatile read/write memory 206, a device 202 for providing feedback to the user ( for example, one or more LEDs, illuminable keys, display, audible alert, voice synthesizer with associated speaker, and/or the like), an input/output port 218 such as a serial interface, USB port, modem , Zigbee, WiFi, or Bluetooth transceiver, etc., a 220 power supply such c such as a battery, a clock and timer logic 212 with associated crystal or resonator 214 and speech input devices comprising a microphone 224 and associated circuit 222, e.g. an analog-to-digital converter, speech digitizer, etc. ., as known in the art.
    [0020] As will be understood by those skilled in the art, some or all of the memories 204, 205, 206 may include executable instructions (collectively, the control device program memory) that are intended to be executed by the processor 200 to control the operation of the control device 100, as well as data that are to define the necessary control protocols and command values for use in transmitting the command signals to the controllable equipment (collectively, the command data). In this way, the processor 200 can be programmed to control the various electronic components within the control device 100, e.g., to monitor the key array 216, to cause the transmission of signals, etc. Non-volatile read/write memory 206, e.g., an EEPROM, battery powered RAM, FLASH, Smart Card, memory card, or the like, can additionally be provided to store configuration data and parameters when required. While memory 204 is illustrated and described as a ROM memory, memory 204 may also be comprised of any type of readable medium, such as ROM, FLASH, EEPROM, or the like. Preferably, memories 204 and 206 are non-volatile or battery powered so that data is not required to be reloaded after battery changes. In addition, memories 204, 205 and 206 may be in the form of a chip, a hard disk, a magnetic disk, an optical disk and/or the like. Furthermore, it is appreciated that some or all of the illustrated memory devices can be physically combined (for example, a single FLASH memory can be logically partitioned into different parts to support the functionality of memories 204 and 206, respectively), and/or can be physically incorporated within the same IC chip as the microprocessor 200 (a so-called “microcontroller”) and as such they are shown separately in Figure 2 for clarity only.
    [0021] To make the control device 100 perform an action, the control device 100 is adapted to respond to events, such as a user interaction captured with the key array 216, sound input captured, etc. In response to an event, appropriate instructions within program memory (hereinafter the “control device operation program”) can be executed. For example, when a command function key is activated in control device 100, it can retrieve from the command data stored in memory 204, 205, 206 a command value and command protocol corresponding to the command key. function activated and, when necessary, the current device mode, and transmit this command to an intended target equipment, eg STB 106, in a format recognizable by that equipment to thereby control one or more functional operations of that equipment. It is clear that the control device operating program can be used not only to cause the transmission of commands and/or data to the equipment, but also to perform local operations. While not limiting, the local operations that can be performed by control device 100 may include information/display data, favorite channel setting, macro key setting, function key relocation, etc. Examples of local operations can be found in US Patents. US. 5,481,256, 5,959,751 and 6,014,092.
    [0022] In some embodiments, the control device 100 may be of the universal type, that is, provided with a library comprising multiple command codes and protocols suitable for controlling various equipment - also called command data sets or code sets . In such cases, to select the command data sets associated with specific equipment to be controlled (hereinafter referred to as the setup procedure), the data can be supplied to the control device 100 which serves to identify each target equipment. intended by that brand, and/or model and/or type. In the presented modality, these data can be in the form of speech input, as described in more detail below. Such data allows the control device 100 to identify the appropriate command data set within the command data library that will be used to transmit recognizable commands in appropriate form for such identified equipment. The command data library can represent a plurality of controllable equipment of different types and manufacturers, a plurality of controllable equipment of the same type, but from different manufacturers, a plurality of equipment of the same manufacturer, but of type or model different, etc., or any combination of these when appropriate for a given modality.
    [0023] In an alternative embodiment, the functionality of the control device may take the form of a software application residing on a smart device 110. A representative smart device, illustrated in Figure 3, in the form of a smartphone, may include, when required, a particular application processing device 300 which may comprise either an application processing section 302 or an RF/DSP processing section 304; a 306 LCD screen; a numeric keypad 308 which may comprise physical keys, touch sensitive keys overlaying LCD 306, or a combination thereof; a subscriber identification module (SIM) card 310; a memory device 312 which may comprise ROM, RAM, FLASH, or any combination thereof; WiFi and/or Bluetooth 314 wireless interfaces; a 316 wireless telephony interface; power management circuit 318 with associated battery 320; USB 322 interface and 324 connector; an audio management system 326 with associated microphone 328, speaker 330, and headset 332; embedded or added to an IR communication device comprising a transmitter and/or receiver 336 with IR output diode(s) 334; and various optional 338 features such as digital camera, GPS, accelerometer, etc.
    [0024] It is known that offering an application for downloading or downloading and installing in memory 312 can serve to allow the use of the smartphone to transmit commands suitable for the operation of entertainment equipment and other equipment. Such an application can draw on a library of code sets suitable for commanding the functional operations of various types of equipment from multiple manufacturers and/or models, that is, a library of code sets for a so-called “universal” control as known in technique. As appropriate for a particular modality, this library can be resident on the smart device itself, or downloaded as part of or bundled with the application, or pre-installed in 312 memory or a separate stand-alone command transmitter; it can be located externally on a local PC or remote server device accessible to the smart device 110 for downloading only those code sets necessary for the operation of the configured equipment; or it may be located in a command transmission device as described in the US Patent Application. previously cited 13/043,915.
    [0025] In any of these exemplified modalities, during the configuration of the control device, a user can provide equipment identification via speech input as will now be described in conjunction with the flowchart of Figure 4. steps involved are similar for any modality, it is understood that in the following descriptions, unless otherwise indicated, the term "control device" is intended to cover, with the necessary changes, the exemplified control device 100, the exemplified control device 110, and all their equivalents.
    [0026] Initially, in step 400, a user can put the control device into a configuration mode, for example, activating a "configure" screen, selecting that item from a displayed menu of choices, by a command voice, or any other method appropriate for a particular modality. In this context, it is appreciated that, in certain embodiments where a control device, such as, for example, control device 100' of Figure 5a, may be enabled to communicate bidirectionally 504 with equipment such as, for example, the STB 104, the above mentioned menu screens and any other user notices, messages, etc. can be displayed on a connected equipment such as, for example, the TV 102.
    [0027] Once the configuration mode has been started, in step 402, the control device can prompt the user to speak the brand name of the equipment to be added to the configuration of the control device. This prompt and subsequent prompts for voice input may take the form of an illuminated LED and/or "speech" symbol, a displayed text or image, a synthesized speech message (for example, when the device returns to the user of the device controller 202 comprises speech synthesis device and a loudspeaker, or when an application of the smart device has access to loudspeaker 330), etc. The resulting spoken syllables can be digitized and presented in a speech recognition device for processing and comparison with a phonetic database of brand names that have been compared to appropriate code sets within the library of sets of codes. As appropriate for a particular modality, all or part of said speech recognition process can be performed programmatically in the control device itself; or, with reference to Figures 5a and 5b, it can be performed by programming in a local equipment such as an STB 104, which is in bidirectional communication 504 with the control device; or it can be run programmatically residing on a remote server 500 accessible via network 502 such as the Internet or PSTN. In the latter case, access to such a network may be via an intermediary equipment such as the STB 104, illustrated at 506, or it may be via a local network connection 508, such as WiFi or Bluetooth, through an access point device , such as a router (not illustrated). As is clear, in those modalities where the captured voice input data is forwarded to another device, in some modalities it can be subjected to initial pre-processing, compression, etc. by programming in the control device.
    [0028] In step 404, if the speech recognition device is unable to uniquely identify the desired brand, step 402 can be repeated in order to request additional identification information from the user. For example, a user may be presented with a short list of possible brand identities to select from; can be prompted to speak the first few characters of the brand name; may be asked to speak the name of a geographic region or a service provider, etc.; where appropriate to facilitate the identification process.
    [0029] Once the brand has been successfully identified, in step 406, the user can be prompted to provide spoken equipment type and/or model number information for processing and comparison with a phonetic database of model number data that is applicable to the identified brand if necessary, for example, to further narrow code set choices. As is clear, in many manufacturer model numbering systems, the equipment type can be inferred from an assigned model number, and consequently, in certain modalities, the equipment type may not be initially requested . However, in cases where the model number alone may be insufficient, or in modalities where the availability of one type of equipment may facilitate model number recognition processing by providing a context to limit the search length in the database, the equipment type may comprise part of the initial request. In step 408, the spoken syllables comprising the model identity can be processed and compared to a phonetic database of model numbers by the speech recognition device which have also been compared to code sets within a library of code sets. codes. If the model information initially provided is insufficient to uniquely identify the equipment, in step 410, additional user input may be requested. For example, a user may be asked to indicate a device type if it is not already provided, to provide the geographic region or service provider, to select from a series of displayed images of equipment and /or OEM remote controls, etc. As an alternative or in conjunction with the above, in some modalities, a group of test codes, each corresponding to a predetermined command function (eg, “turn on”) in one of several command data formats may be transferred to the control device, or otherwise indicated to the control device, to allow a user to determine by experimentation which of a group of possible command code sets is applicable to that equipment, for example, as described in US Patent. 5,614,906 previously cited entitled “Method for Selecting a Remote Control Command Set”.
    [0030] Once a suitable command code has been uniquely identified, in step 412, the desired configuration data can be communicated to the operating program of the control device or remote control application, when appropriate for the device being configured. Depending on the particular modality, communication of configuration data may comprise transferring a complete set of command code data to the control device from a database outside the platform of localized code sets, e.g. local application such as STB 104 or on a remote server 500; or it may comprise simply communicating a configuration number or other pointer to an entry in a database of command codes already preloaded into the memory of the control device. Then, in step 414, the user can be prompted to indicate if he wants to configure additional equipment. If so, the process can be repeated starting at step 402. If not, the current equipment setup session is completed and the controlling device exits setup mode.
    [0031] In a further aspect of the invention, once the equipment to be controlled has been identified to a control device as described above or by any other convenient method, a user may be enabled to further customize the functionality of individual keys via voice input. In this regard, as many OEM remote controls can include a large number of key functions, some of which may be used less frequently or of interest only to certain classes of users, the initial configuration of many universal control devices may include only a subset of the total functionality of a remote OEM of equipment, comprising the most commonly used functions. By way of example, Tables 1a and 1b below illustrate a specific set of remote control commands that may be supported by a particular model of DVD player. Table 1a lists those commonly used commands that might be included in the default key configuration of a typical universal control device, while Table 1b lists additional or “extended” functions that may be unique to that device. DVD and/or may perform rarely used operations.

    [0032] However, a user of a universal control device may from time to time wish to issue equipment commands corresponding to one or more of the extended functions supported by his particular equipment model. Several methods have been proposed to enable a user to customize universal control device key functionality by adding available extended functions not initially available as part of the standard configuration. By way of example, descriptions of such methods can be found in the US Patent. No. 5,515,052 entitled “Universal Remote Control with Function Synthesis” or US Patent. No. 7,093.003 entitled "System and Method for Upgrading the Remote Control Functionality of a Device", both commonly owned and incorporated herein by reference.
    [0033] Furthermore, as different equipment manufacturers may use different terminology for the same function, a generic function label used for a key on a universal control device may not always match the term used by the original equipment manufacturer for reference to that function. By way of example, Table 2 below lists some of the known synonyms for the command function that can be used to make a device such as a TV or STB tune from a channel currently selected for the channel. immediately preceding, a function that can simply be labeled with the generic term “Last” on the numeric keypad of a universal control device.

    [0034] Consequently, in addition to facilitating the initial setup of equipment to be controlled, in some embodiments, the speech recognition capabilities described here can be adapted to provide a fast and convenient method for a user of a device. control access specific functions of your configured equipment via voice commands. As will be clear, such extended function access may be for the purpose of issuing an immediate command transmission, or it may be for the purpose of assigning the identified command function to a command device key for future convenience of equipment operation.
    [0035] Turning now to the flowchart of Figure 6, an exemplified extended function access method can be initiated at steps 600 or 602. As before, initiation can take the form of a key activation, menu selection, speech input, etc., when appropriate for a particular modality. The initiation at step-pa 600 may be for the purpose of issuing an immediate equipment command, while the initiation at step 602 may be for the purpose of assigning an equipment command function to a key of the control device. Step 602 may thus include an indication of the particular control device that will be reconfigured. Regardless of the purpose, in step 604, the user can be prompted to speak the name of the desired function. As before, this notice may take the form of an illuminated LED and/or “talk” symbol, a displayed text or image, etc., where appropriate. The resulting spoken syllables can be digitized and presented to a speech recognition device for processing and comparison to a phonetic database of command function names that have been compared to the data within a code set that is applicable to the model. particular equipment currently configured, for example, as illustrated in Table 1b above. As with the previously described methods, all or part of said speech recognition process can be executed through programming in the control device itself; can be run programmatically on a local device that is in bidirectional communication with the control device; or it can be run by programming residing on a remote server accessible via a network such as the Internet or PSTN.
    [0036] In step 604, it can be determined whether the speech input was sufficient to uniquely identify the desired command function. If not at step 6087, additional information may be requested from the user to aid in identifying the desired command function. By way of example, a user may be asked to indicate a geographic region or approximate age of a device; can be presented with a display of a short list of function names to select from; may be asked to provide synonym(s) for the desired command function, etc. Once the desired function has been uniquely identified, in step 610, command code data can be provided to the control device. When appropriate for the particular implementation, such provision may comprise transferring the data itself, providing a pointer to an entry in a local database, etc. Then, in step 612, it can be determined whether the request was for an immediate command transmission (i.e., originated by step 600) or for assignment of the function to a key (i.e., originated by step 602). If for immediate transmission, in step 614, the data provided can be used to transmit the desired command to the target equipment. If assigning the function to a key, in step 616, the new function can be assigned to the indicated key, for example, using an entry in a key reassignment table, such as described in the US Patent. No. 6,195,033 entitled “Key Mover”, commonly owned and incorporated herein by reference.
    [0037] With respect to Figure 7a, the structure of a database of exemplified equipment command codes for use in conjunction with the methods of Figures 5 and 6 may comprise a series of trademark registrations 702, each of which points for a group of model 704 records specific to that brand, each model record, in turn, points to a code set register 706 containing command code data, function labels, etc., that are applicable to that brand. and specific model of equipment. It is clear that since multiple models of a manufacturer's equipment may share the same OEM remote control model and/or set of command codes, there may not be a one-to-one correspondence between the 704 model number records and the assembly records of codes 706.
    [0038] Each trademark registration 702 may comprise a trademark name entry comprising a text representation 710 of the trademark name along with a phonetic representation 712 of that trademark name comprising digitized phoneme models, cepstral coefficients or vectors, etc. ., when appropriate for the speech recognition algorithms of a particular modality. Trademark records may also include an entry 714 that can identify a geographic region, along with its phonetic representation 716. By way of example, region information may be requested from a user if a spoken trademark name is not. is immediately identified in step 404 of Figure 4, and used to filter the search results when multiple possible matches are initially identified. Alternatively, in some modalities where the database is used to support multiple territories, multiple entries can be created for a particular brand name to accommodate regional differences in accent or pronunciation, in which case the region information can be used to pre-select those entries that participate in a search. As is clear, in embodiments in which the Internet server-based region information can be derived from the IP address associated with the requesting device, and so in those cases, the region identification step can be performed automatically. Region information must also be automatically gathered using the GPS capabilities of a smart device, the network tower information of a network in which a smart device resides, etc. The final entry of a brand name record may take the form of a pointer 718 to a group of model number records comprising equipment models that correspond to the indicated brand.
    [0039] Each model number 704 record may comprise text entries for model number 720, equipment type 722 (eg DVD) and subtype 724 (eg Blu-ray), region 726, and provider of services (eg, MSO cable, satellite, etc.) along with corresponding phonetic representations 730 to 736. As before, the data contained in the device type, sub-type, region, and provider entries can be used to refine template selection, for example, as described in conjunction with step 410 of Figure 4. Additionally, template record 704 may also include a link 740 to an equipment image and/or a link 742 to a remote control image of the original equipment, again for possible use in refining the user identification of your exact model of equipment. As is clear, not all of the above fields can be filled in for every template record. Finally, each model number register 704 may contain a link 744 to a code set register.
    [0040] Referring to Figure 7b, each codeset register 706 may comprise a unique codeset identification number, a protocol and formatting information block 752 which may describe the physical protocol requirements for transmitting the command data elements that comprise that set of codes, including, for example, items such as carrier frequency, bit encoding, data frame size and structure, equipment address, parity or CRC requirements, etc. Following block 752 there may be a series of individual command function entries 754. Each entry may comprise a default function ID 756, which may be a standard label indicative of the function or operation invoked by that command (i.e., of so that within a universal remote control system, the same functionality can be mapped to a key independent of any variations in the equipment manufacturer's specific nomenclature, for example, as seen in Table 2 above); a function name 758 corresponding to the name by which this function is generally called by that equipment manufacturer along with this phonetic representation 760; and command data 762 which, when transmitted using block protocol specifications 752, will command the equipment to perform the indicated action. In some embodiments, multiple occurrences of function name 758 and associated phonetic representation 760 may be present to cater for synonyms and/or regional differences.
    [0041] As will be clear, in step 412 of Figure 4, all or part of the information contained in the identified code set record can be transferred to the control device being configured. Where appropriate for a particular modality, such a transfer may comprise only code set number 750 when it is determined that the required code set is already pre-loaded into the memory of the control device or local equipment, or may comprise a complete transfer of code set number 750, protocol and formatting information 752, and all or a part of the command data inputs 762. Furthermore, in order to identify the extended command functions requested by the user, the phonetic representations 758 corresponding to the command function inputs of the code set number corresponding to the currently configured equipment can be searched for by the speech recognition device, for example, as illustrated in steps 604 and 606 of Figure 6, and the corresponding command data returned to the requesting control device as illustrated 610 in Figure 6.
    [0042] While several concepts have been described in detail, it is clear to those skilled in the art that various modifications and alternatives to these concepts could be developed given the general teachings of the description.
    [0043] Furthermore, while described in the context of functional modules and illustrated using the block diagram format, it is understood that, unless otherwise stated, one or more of the described functions and/or features may be integrated on a single physical device and/or software module, or one or more functions and/or features may be implemented on separate physical devices or software modules. It is also clear that a detailed discussion of the actual implementation of each module is not necessary for an understanding of the invention. Preferably, the actual implementation of such modules would be well within an engineer's routine, given the description given here of the attributes, functionality, and interrelationship of the various functional modules in the system. Then, one skilled in the art will be able to practice the invention set out in the claims without undue experimentation. It is further clear that the particular concepts described are to be illustrative only and not limiting the scope of the invention given the full breadth of the appended claims and any equivalents thereof.
    [0044] All patents cited within this document are hereby incorporated by reference.
    权利要求:
    Claims (15)
    [0001]
    1. Method for configuring a control device (100, 110) to command functional operations of a target equipment (102, 104, 106, 108), characterized in that it comprises: making a set register code set (706) is provided to the control device for use in functional command operations of the target equipment (102, 104, 106, 108), the code set record provided (706) comprising formatting and protocol information ( 752) and a series of individual command function inputs (754), each of the series of individual command function inputs having common command data comprises a phonetic representation (760) of a single of a plurality of function name synonyms by which each of the series of individual command function entries (754) having common command data (762) is to be referenced; cause less than all individual command function inputs (762) from within the provided code set register (706) to each be paired with one of a plurality of command function keys of the device. control (100, 110), whereby a subsequent activation of one of the plurality of command function keys will cause the control device (100, 110) to transmit a command communication using the formatting and protocol information (752 ) and command data (762) of one of the plurality of individual command function inputs (754) from within the code set register (706) that has been mapped to the plurality of command function keys enabled; and causing the control device (100, 110) to transmit a command communication by using the format and protocol information (752) and the command data (762) of one of the plurality of individual command function inputs. (754) from within the provided codeset register (706) having a phonetic representation (760) of a function name synonym that corresponds to the voice data provided to the speech recognition engine.
    [0002]
    2. Method according to claim 1, characterized in that the control device (100, 110) comprises a microphone (224) for receiving voice input used in creating the voice data.
    [0003]
    3. Method according to claim 1, characterized in that it comprises receiving, in a speech recognition mechanism, data indicative of at least one brand of the target equipment, whereby the speech recognition mechanism uses the voice data indicative of the at least one brand of target equipment to identify, within a library of code set records, the code set record that is provided to the control device (110, 110).
    [0004]
    4. Method according to claim 1, characterized in that the control device (100, 110) comprises a processing device (200) and instructions to provide the speech recognition mechanism.
    [0005]
    5. Method according to claim 1, characterized in that the speech recognition mechanism is executed in a computing device (500) remote from the control device (100, 110).
    [0006]
    6. Method according to claim 3, characterized in that the library of code set records is stored remotely from the control device (100, 110) and the code set is provided to the control device at from the codeset registry library by downloading to it.
    [0007]
    7. Method according to claim 1, characterized in that the method comprises receiving, in the speech recognition engine, voice data to map each of the less than all individual command function inputs into set record of codes provided for one of the plurality of command function keys of the control device (100, 110).
    [0008]
    8. Method according to claim 1, characterized in that it comprises using at least location data to identify the at least one code set record that is provided to the control device.
    [0009]
    9. System for configuring a control device (100, 110) to command functional operations of a target equipment (102, 104, 106, 108), characterized in that it comprises: a processing device (200, 300) having associated instructions stored on a non-transient readable medium (204 - 206, 310) which instructions, when executed by the processing device, cause a code set register (706) to be provided to the control device for use in operations command functions of the target equipment, wherein the provided code set register (706) comprises formatting and protocol information (752) and a series of individual command function inputs (754) each comprising common command data ( 762) and the series of individual command function inputs (754) having common command data (762) comprise a phonetic representation (760) of a single of a plurality of function name synonyms by which each the one of the series of individual command function entries (754) must be referenced, causes unless all individual command codes within the provided code set register (706) to each be mapped to one of a plurality of command function keys of the control device (100, 110), whereby a subsequent activation of one of the plurality of command function keys will cause the control device (100, 110) to transmit a communication of command by using the format and protocol information (752) and command data (762) of a corresponding one of the plurality of individual command function inputs (754) from within the provided code set register (706) having a representation phonetics of a synonym for a function name that corresponds to the voice data supplied to the speech recognition engine.
    [0010]
    10. System according to claim 9, characterized in that the control device comprises one of a smartphone (100) and a tablet computing device (110).
    [0011]
    11. System according to claim 9, characterized in that the control device (100, 110) comprises a memory (312) having stored therein a library of code set records including the code set record. codes provided.
    [0012]
    12. System according to claim 9, characterized in that a library of code set records is stored remotely from the control device (100, 110) and the code set is provided to the control device from the library of codeset records by downloading into it.
    [0013]
    13. System according to claim 9, characterized in that the processing device (200) comprises one or more computing devices located remotely from the control device (100, 110).
    [0014]
    14. System according to claim 9, characterized in that the instructions use voice data received by the speech recognition engine to map each of the less than all command function entries from within the code set register to one of the plurality of control device command function keys (100, 110).
    [0015]
    15. System according to claim 9, characterized in that the instructions additionally use at least location data to identify the set of codes that is provided to the control device (100, 110).
    类似技术:
    公开号 | 公开日 | 专利标题
    BR112014010748B1|2021-05-11|system and method for voice activated configuration of a control device
    US10254937B2|2019-04-09|Graphical user interface and data transfer methods in a controlling device
    RU2698247C2|2019-08-23|System and method for configuring remote control functionality of portable device
    US9087100B2|2015-07-21|System and method for configuring the remote control functionality of a portable device
    CN108604179A|2018-09-28|The realization of voice assistant in equipment
    KR101922782B1|2018-11-27|Method and apparatus for assigning keyword model to voice operated function
    JP2005228293A|2005-08-25|Information processing device and program
    US11119725B2|2021-09-14|Customizable embedded vocal command sets for a lighting and/or other environmental controller
    KR102356889B1|2022-01-28|Method for performing voice recognition and electronic device using the same
    JP5370432B2|2013-12-18|Management device, karaoke system and management method
    US20190333523A1|2019-10-31|Method for operating content and electronic device for implementing same
    US20200259887A1|2020-08-13|Universal voice assistant
    US20160197780A1|2016-07-07|Method and apparatus for transmitting configuration information
    WO2014138685A2|2014-09-12|Method and system for voice recognition input on network-enabled devices
    CN108293095A|2018-07-17|Imaging sensor includes the electronic equipment and its operating method of the imaging sensor
    US20190172460A1|2019-06-06|Electronic apparatus and control method thereof
    KR102188685B1|2020-12-08|Apparatas and method for generating application packages
    KR102180955B1|2020-11-20|Method for transmitting and receiving phonetic data
    TWI709037B|2020-11-01|Bios setting method
    US11243740B2|2022-02-08|Electronic device and method for controlling same
    US20200204613A1|2020-06-25|Universal voice assistant
    US20210120301A1|2021-04-22|Universal voice assistant
    KR102371751B1|2022-03-07|Electronic device and control method thereof
    KR102374620B1|2022-03-16|Device and system for voice recognition
    JP2007043443A|2007-02-15|Electronic equipment system and program
    同族专利:
    公开号 | 公开日
    US20130132094A1|2013-05-23|
    EP2780908B1|2020-12-02|
    US9847083B2|2017-12-19|
    EP2780908A4|2015-04-01|
    US20180061414A1|2018-03-01|
    WO2013074253A1|2013-05-23|
    EP2780908A1|2014-09-24|
    BR112014010748A8|2017-05-16|
    CN103959374B|2017-04-26|
    CN103959374A|2014-07-30|
    US11264018B2|2022-03-01|
    BR112014010748A2|2017-04-25|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US4703359A|1985-05-30|1987-10-27|Nap Consumer Electronics Corp.|Universal remote control unit with model identification capability|
    US5255313A|1987-12-02|1993-10-19|Universal Electronics Inc.|Universal remote control system|
    US5515052A|1987-10-14|1996-05-07|Universal Electronics Inc.|Universal remote control with function synthesis|
    US4959810A|1987-10-14|1990-09-25|Universal Electronics, Inc.|Universal remote control device|
    US5247580A|1989-12-29|1993-09-21|Pioneer Electronic Corporation|Voice-operated remote control system|
    CH689410A5|1994-04-21|1999-03-31|Info Byte Ag|Method and apparatus for voice-activated remote control of electrical loads.|
    US5614906A|1996-04-23|1997-03-25|Universal Electronics Inc.|Method for selecting a remote control command set|
    US5991726A|1997-05-09|1999-11-23|Immarco; Peter|Speech recognition devices|
    US6748361B1|1999-12-14|2004-06-08|International Business Machines Corporation|Personal speech assistant supporting a dialog manager|
    US6650248B1|1999-12-22|2003-11-18|Thomson Licensing, S.A.|Programming a universal remote control device|
    DE10002321C2|2000-01-20|2002-11-14|Micronas Munich Gmbh|Voice-controlled device and system with such a voice-controlled device|
    US20010033243A1|2000-03-15|2001-10-25|Harris Glen Mclean|Online remote control configuration system|
    WO2001075837A2|2000-03-30|2001-10-11|Xircom, Inc.|Universal remote control device wirelessly linked to personal computer|
    US6629077B1|2000-11-22|2003-09-30|Universal Electronics Inc.|Universal remote control adapted to receive voice input|
    US7093003B2|2001-01-29|2006-08-15|Universal Electronics Inc.|System and method for upgrading the remote control functionality of a device|
    US6879351B1|2001-06-13|2005-04-12|Innotech Systems, Inc.|Method and apparatus for remote control|
    US7831930B2|2001-11-20|2010-11-09|Universal Electronics Inc.|System and method for displaying a user interface for a remote control application|
    US10235873B2|2001-12-20|2019-03-19|Universal Electronics Inc.|System and method to facilitate configuration of a controlling device|
    US7359858B2|2002-02-07|2008-04-15|Sap Aktiengesellschaft|User interface for data access and entry|
    US7181203B2|2003-07-21|2007-02-20|The Chamberlain Group, Inc.|Barrier movement operator human interface method and apparatus|
    US7502731B2|2003-08-11|2009-03-10|Sony Corporation|System and method for performing speech recognition by utilizing a multi-language dictionary|
    US20050043067A1|2003-08-21|2005-02-24|Odell Thomas W.|Voice recognition in a vehicle radio system|
    CA2537977A1|2003-09-05|2005-03-17|Stephen D. Grody|Methods and apparatus for providing services using speech recognition|
    US7739117B2|2004-09-20|2010-06-15|International Business Machines Corporation|Method and system for voice-enabled autofill|
    US20060235701A1|2005-04-13|2006-10-19|Cane David A|Activity-based control of a set of electronic devices|
    US20060235698A1|2005-04-13|2006-10-19|Cane David A|Apparatus for controlling a home theater system by speech commands|
    US20060235694A1|2005-04-14|2006-10-19|International Business Machines Corporation|Integrating conversational speech into Web browsers|
    US20070005370A1|2005-06-30|2007-01-04|Scott Elshout|Voice-activated control system|
    TW200720991A|2005-11-22|2007-06-01|Delta Electronics Inc|Voice control methods|
    US8213917B2|2006-05-05|2012-07-03|Waloomba Tech Ltd., L.L.C.|Reusable multimodal application|
    US7957972B2|2006-09-05|2011-06-07|Fortemedia, Inc.|Voice recognition system and method thereof|
    WO2009055819A1|2007-10-26|2009-04-30|Honda Motor Co., Ltd.|Improving free-speech command classification for car navigation system|
    US8219407B1|2007-12-27|2012-07-10|Great Northern Research, LLC|Method for processing the output of a speech recognizer|
    US8386260B2|2007-12-31|2013-02-26|Motorola Mobility Llc|Methods and apparatus for implementing distributed multi-modal applications|
    US8812629B2|2008-04-18|2014-08-19|Universal Electronics Inc.|System and method for configuring the remote control functionality of a portable device|
    US11012732B2|2009-06-25|2021-05-18|DISH Technologies L.L.C.|Voice enabled media presentation systems and methods|
    US20110264452A1|2010-04-27|2011-10-27|Ramya Venkataramu|Audio output of text data using speech control commands|
    US9368107B2|2011-04-20|2016-06-14|Nuance Communications, Inc.|Permitting automated speech command discovery via manual event to command mapping|
    US9847083B2|2011-11-17|2017-12-19|Universal Electronics Inc.|System and method for voice actuated configuration of a controlling device|US9847083B2|2011-11-17|2017-12-19|Universal Electronics Inc.|System and method for voice actuated configuration of a controlling device|
    KR101871714B1|2012-04-02|2018-06-27|엘지전자 주식회사|Mobile terminal and method for controlling thereof|
    US10395672B2|2012-05-31|2019-08-27|Elwha Llc|Methods and systems for managing adaptation data|
    US10431235B2|2012-05-31|2019-10-01|Elwha Llc|Methods and systems for speech adaptation data|
    US20140074472A1|2012-09-12|2014-03-13|Chih-Hung Lin|Voice control system with portable voice control device|
    HK1186912A2|2013-01-25|2014-03-21|Zhipei Wang|Remote control system and device|
    US9875494B2|2013-04-16|2018-01-23|Sri International|Using intents to analyze and personalize a user's dialog experience with a virtual personal assistant|
    CN103489303B|2013-09-02|2016-08-17|小米科技有限责任公司|A kind of remote control thereof and device|
    WO2015128684A2|2014-02-25|2015-09-03|Pasztor Lénard Zoltan|Process and schematic for operating electronic devices by remote control and for collecting, utilising, and transmitting the operating parameters of such devices for the purposes of analysis|
    US9641885B2|2014-05-07|2017-05-02|Vivint, Inc.|Voice control component installation|
    US9729929B2|2014-08-08|2017-08-08|Arris Enterprises Llc|Channel tuning with synthesized key codes|
    CN105334997A|2014-08-12|2016-02-17|扬智科技股份有限公司|Intelligent input apparatus as well as setting method and control method therefor|
    KR102298457B1|2014-11-12|2021-09-07|삼성전자주식회사|Image Displaying Apparatus, Driving Method of Image Displaying Apparatus, and Computer Readable Recording Medium|
    TW201636082A|2015-04-13|2016-10-16|Infinite Electronics Inc|Digital mahjong game machine|
    KR20170024480A|2015-08-25|2017-03-07|엘지전자 주식회사|Display device and universal remote controller setting method thereof|
    CN105355033B|2015-11-09|2019-09-27|常州市永伟电子有限公司|The method of general remote controller setting code|
    US10026401B1|2015-12-28|2018-07-17|Amazon Technologies, Inc.|Naming devices via voice commands|
    US10185544B1|2015-12-28|2019-01-22|Amazon Technologies, Inc.|Naming devices via voice commands|
    US10127906B1|2015-12-28|2018-11-13|Amazon Technologies, Inc.|Naming devices via voice commands|
    CN105488032A|2015-12-31|2016-04-13|杭州智蚁科技有限公司|Speech recognition input control method and system|
    CN108604179A|2016-05-10|2018-09-28|谷歌有限责任公司|The realization of voice assistant in equipment|
    CN112947683A|2016-05-13|2021-06-11|谷歌有限责任公司|Media delivery between media output devices|
    USD822716S1|2016-05-13|2018-07-10|Google Llc|Voice interface device|
    CN107545896A|2016-06-24|2018-01-05|中兴通讯股份有限公司|Control method, apparatus and system, the sending method of file and the device of equipment|
    CN107545892B|2016-06-24|2021-07-30|中兴通讯股份有限公司|Equipment control method, device and system|
    CN106328136A|2016-08-19|2017-01-11|黄广明|Voice-controllable intelligent device|
    US20180061222A1|2016-08-25|2018-03-01|Lénard Zoltan PASZTOR|Process and Schematic for Operating Electronic Devices By Remote Control and for Collecting, Utilising and Transmitting the Operating Parameters of Such Devices for the Purposes of Analysis|
    US20190020493A1|2017-07-12|2019-01-17|Universal Electronics Inc.|Apparatus, system and method for directing voice input in a controlling device|
    US10930276B2|2017-07-12|2021-02-23|Universal Electronics Inc.|Apparatus, system and method for directing voice input in a controlling device|
    CN109286832A|2017-07-20|2019-01-29|中兴通讯股份有限公司|The method, apparatus and set-top box and computer readable storage medium of realization speech control|
    US10032365B1|2017-10-16|2018-07-24|Universal Electronics Inc.|Apparatus, system and method for using a universal controlling device for displaying a graphical user element in a display device|
    KR102025566B1|2018-07-27|2019-09-26|엘지전자 주식회사|Home appliance and voice recognition server system using artificial intelligence and method for controlling thereof|
    US10867603B2|2018-10-24|2020-12-15|Sony Corporation|Audio-video reproduction device setup using interview-based voice control|
    US11158316B2|2018-11-16|2021-10-26|Alpine Electronics, Inc.|In-vehicle device and speech recognition method|
    KR102058386B1|2019-05-02|2019-12-23|주식회사 오성전자|Method of setting a code set of a control target device used remote control|
    CN110415700A|2019-08-30|2019-11-05|南宁学院|A kind of voice and press key control multiple household electrical appliances device systems and its method|
    CN111462471A|2020-04-20|2020-07-28|江苏群达智能科技有限公司|Universal air conditioner remote controller and remote control code matching method thereof|
    法律状态:
    2017-05-02| B11A| Dismissal acc. art.33 of ipl - examination not requested within 36 months of filing|
    2017-05-23| B11N| Dismissal: publication cancelled [chapter 11.14 patent gazette]|
    2018-12-04| B06F| Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]|
    2019-09-17| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|
    2021-03-09| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|
    2021-05-11| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 23/10/2012, OBSERVADAS AS CONDICOES LEGAIS. |
    优先权:
    申请号 | 申请日 | 专利标题
    US13/298,629|US9847083B2|2011-11-17|2011-11-17|System and method for voice actuated configuration of a controlling device|
    US13/298,629|2011-11-17|
    PCT/US2012/061475|WO2013074253A1|2011-11-17|2012-10-23|System and method for voice actuated configuration of a controlling device|
    [返回顶部]