Organization: Public

FIG. 1  illustrates a system 100 in which a server 104 and a client device 106 are connected to a network 102.

In various embodiments, the network 102 may include the Internet, a local area network (“LAN”), a wide area network (“WAN”), and/or other data network. In addition to traditional data-networking protocols, in some embodiments, data may be communicated according to protocols and/or standards including near field communication (“NFC”), Bluetooth, power-line communication (“PLC”), and the like. In some embodiments, the network 102 may also include a voice network that conveys not only voice communications, but also non-voice data such as Short Message Service (“SMS”) messages, as well as data communicated via various cellular data communication protocols, and the like.

In various embodiments, the client device 106 may include desktop PCs, mobile phones, laptops, tablets, wearable computers, or other computing devices that are capable of connecting to the network 102 and communicating with the server 104, such as described herein.

In various embodiments, additional infrastructure (e.g., short message service centers, cell sites, routers, gateways, firewalls, and the like), as well as additional devices may be present. Further, in some embodiments, the functions described as being provided by some or all of the server 104 and the client device 106 may be implemented via various combinations of physical and/or logical devices. However, it is not necessary to show such infrastructure and implementation details in FIG. 1 in order to describe an illustrative embodiment.

FIG. 2  is an example block diagram of a computing device 200  that may incorporate embodiments of the present invention. FIG. 2 is merely illustrative of a machine system to carry out aspects of the technical processes described herein, and does not limit the scope of the claims. One of ordinary skill in the art would recognize other variations, modifications, and alternatives. In one embodiment, the computing device 200 typically includes a monitor or graphical user interface 202, a data processing system 220, a communication network interface 212, input device(s) 208, output device(s) 206, and the like.

As depicted in FIG. 2, the data processing system 220 may include one or more processor(s) 204 that communicate with a number of peripheral devices via a bus subsystem 218. These peripheral devices may include input device(s) 208, output device(s) 206, communication network interface 212, and a storage subsystem, such as a volatile memory 210 and a nonvolatile memory 214.

The volatile memory 210 and/or the nonvolatile memory 214 may store computer-executable instructions and thus forming logic 222 that when applied to and executed by the processor(s) 204 implement embodiments of the processes disclosed herein.

The input device(s) 208 include devices and mechanisms for inputting information to the data processing system 220. These may include a keyboard, a keypad, a touch screen incorporated into the monitor or graphical user interface 202, audio input devices such as voice recognition systems, microphones, and other types of input devices. In various embodiments, the input device(s) 208 may be embodied as a computer mouse, a trackball, a track pad, a joystick, wireless remote, drawing tablet, voice command system, eye tracking system, and the like. The input device(s) 208 typically allow a user to select objects, icons, control areas, text and the like that appear on the monitor or graphical user interface 202 via a command such as a click of a button or the like.

The output device(s) 206 include devices and mechanisms for outputting information from the data processing system 220. These may include the monitor or graphical user interface 202, speakers, printers, infrared LEDs, and so on as well understood in the art.

The communication network interface 212 provides an interface to communication networks (e.g., communication network 216) and devices external to the data processing system 220. The communication network interface 212 may serve as an interface for receiving data from and transmitting data to other systems. Embodiments of the communication network interface 212 may include an Ethernet interface, a modem (telephone, satellite, cable, ISDN), (asynchronous) digital subscriber line (DSL), FireWire, USB, a wireless communication interface such as BlueTooth or WiFi, a near field communication wireless interface, a cellular interface, and the like.

The communication network interface 212 may be coupled to the communication network 216 via an antenna, a cable, or the like. In some embodiments, the communication network interface 212 may be physically integrated on a circuit board of the data processing system 220, or in some cases may be implemented in software or firmware, such as “soft modems”, or the like.

The computing device 200 may include logic that enables communications over a network using protocols such as HTTP, TCP/IP, RTP/RTSP, IPX, UDP and the like. 

The volatile memory 210 and the nonvolatile memory 214 are examples of tangible media configured to store computer readable data and instructions to implement various embodiments of the processes described herein. Other types of tangible media include removable memory (e.g., pluggable USB memory devices, mobile device SIM cards), optical storage media such as CD-ROMS, DVDs, semiconductor memories such as flash memories, non-transitory read-only-memories (ROMS), battery-backed volatile memories, networked storage devices, and the like. The volatile memory 210 and the nonvolatile memory 214 may be configured to store the basic programming and data constructs that provide the functionality of the disclosed processes and other embodiments thereof that fall within the scope of the present invention.

Logic 222 that implements embodiments of the present invention may be stored in the volatile memory 210 and/or the nonvolatile memory 214. Said logic 222 may be read from the volatile memory 210 and/or nonvolatile memory 214 and executed by the processor(s) 204. The volatile memory 210 and the nonvolatile memory 214 may also provide a repository for storing data used by the logic 222.

The volatile memory 210 and the nonvolatile memory 214 may include a number of memories including a main random access memory (RAM) for storage of instructions and data during program execution and a read only memory (ROM) in which read-only non-transitory instructions are stored. The volatile memory 210 and the nonvolatile memory 214 may include a file storage subsystem providing persistent (non-volatile) storage for program and data files. The volatile memory 210 and the nonvolatile memory 214 may include removable storage systems, such as removable flash memory.

The bus subsystem 218 provides a mechanism for enabling the various components and subsystems of data processing system 220 communicate with each other as intended. Although the communication network interface 212 is depicted schematically as a single bus, some embodiments of the bus subsystem 218 may utilize multiple distinct busses.

It will be readily apparent to one of ordinary skill in the art that the computing device 200 may be a device such as a smartphone, a desktop computer, a laptop computer, a rack-mounted computer system, a computer server, or a tablet computer device. As commonly known in the art, the computing device 200 may be implemented as a collection of multiple networked computing devices. Further, the computing device 200 will typically include operating system logic (not illustrated) the types and nature of which are well known in the art. 

Terms used herein should be accorded their ordinary meaning in the relevant arts, or the meaning indicated by their use in context, but if an express definition is provided, that meaning controls.

“Circuitry” in this context refers to electrical circuitry having at least one discrete electrical circuit, electrical circuitry having at least one integrated circuit, electrical circuitry having at least one application specific integrated circuit, circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program which at least partially carries out processes or devices described herein, or a microprocessor configured by a computer program which at least partially carries out processes or devices described herein), circuitry forming a memory device (e.g., forms of random access memory), or circuitry forming a communications device (e.g., a modem, communications switch, or optical-electrical equipment).

“Firmware” in this context refers to software logic embodied as processor-executable instructions stored in read-only memories or media.

“Hardware” in this context refers to logic embodied as analog or digital circuitry.

“Logic” in this context refers to machine memory circuits, non transitory machine readable media, and/or circuitry which by way of its material and/or material-energy configuration comprises control and/or procedural signals, and/or settings and values (such as resistance, impedance, capacitance, inductance, current/voltage ratings, etc.), that may be applied to influence the operation of a device. Magnetic media, electronic circuits, electrical and optical memory (both volatile and nonvolatile), and firmware are examples of logic. Logic specifically excludes pure signals or software per se (however does not exclude machine memories comprising software and thereby forming configurations of matter).

“Software” in this context refers to logic implemented as processor-executable instructions in a machine memory (e.g. read/write volatile or nonvolatile memory or media).

Herein, references to “one embodiment” or “an embodiment” do not necessarily refer to the same embodiment, although they may. Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to.” Words using the singular or plural number also include the plural or singular number respectively, unless expressly limited to a single one or multiple ones. Additionally, the words “herein,” “above,” “below” and words of similar import, when used in this application, refer to this application as a whole and not to any particular portions of this application. When the claims use the word “or” in reference to a list of two or more items, that word covers all of the following interpretations of the word: any of the items in the list, all of the items in the list and any combination of the items in the list, unless expressly limited to one or the other. Any terms not expressly defined herein have their conventional meaning as commonly understood by those having skill in the relevant art(s).

Various logic functional operations described herein may be implemented in logic that is referred to using a noun or noun phrase reflecting said operation or function. For example, an association operation may be carried out by an “associator” or “correlator”. Likewise, switching may be carried out by a “switch”, selection by a “selector”, and so on.

FIG. 3 illustrates several components of an exemplary system 300 in accordance with one embodiment. In various embodiments, system 300 may include a desktop PC, server, workstation, mobile phone, laptop, tablet, set-top box, appliance, or other computing device that is capable of performing operations such as those described herein. In some embodiments, system 300 may include many more components than those shown in FIG. 3. However, it is not necessary that all of these generally conventional components be shown in order to disclose an illustrative embodiment.  Collectively, the various tangible components or a subset of the tangible components may be referred to herein as “logic” configured or adapted in a particular way, for example as logic configured or adapted with particular software or firmware.

In various embodiments, system 300 may comprise one or more physical and/or logical devices that collectively provide the functionalities described herein. In some embodiments, system 300 may comprise one or more replicated and/or distributed physical or logical devices.

In some embodiments, system 300 may comprise one or more computing resources provisioned from a “cloud computing” provider, for example, Amazon Elastic Compute Cloud (“Amazon EC2”), provided by Amazon.com, Inc. of Seattle, Washington; Sun Cloud Compute Utility, provided by Sun Microsystems, Inc. of Santa Clara, California; Windows Azure, provided by Microsoft Corporation of Redmond, Washington, and the like. 

System 300 includes a bus 302 interconnecting several components including a network interface 308, a display 306, a central processing unit 310, and a memory 304.

Memory 304 generally comprises a random access memory (“RAM”) and permanent non-transitory mass storage device, such as a hard disk drive or solid-state drive. Memory 304 stores an operating system 312.

These and other software components may be loaded into memory 304 of system 300 using a drive mechanism (not shown) associated with a non-transitory computer-readable  medium 316, such as a DVD/CD-ROM drive, memory card, network download, or the like.

Memory 304 also includes database 314. In some embodiments, system 300 may communicate with database 314 via network interface 308, a storage area network (“SAN”), a high-speed serial bus, and/or via the other suitable communication technology.

In some embodiments, database 314 may comprise one or more storage resources provisioned from a “cloud storage” provider, for example, Amazon Simple Storage Service (“Amazon S3”), provided by Amazon.com, Inc. of Seattle, Washington, Google Cloud Storage, provided by Google, Inc. of Mountain View, California, and the like.

Terms used herein should be accorded their ordinary meaning in the relevant arts, or the meaning indicated by their use in context, but if an express definition is provided, that meaning controls.

“Circuitry” in this context refers to electrical circuitry having at least one discrete electrical circuit, electrical circuitry having at least one integrated circuit, electrical circuitry having at least one application specific integrated circuit, circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program which at least partially carries out processes or devices described herein, or a microprocessor configured by a computer program which at least partially carries out processes or devices described herein), circuitry forming a memory device (e.g., forms of random access memory), or circuitry forming a communications device (e.g., a modem, communications switch, or optical-electrical equipment).

“Firmware” in this context refers to software logic embodied as processor-executable instructions stored in read-only memories or media.

“Hardware” in this context refers to logic embodied as analog or digital circuitry.

“Logic” in this context refers to machine memory circuits, non transitory machine readable media, and/or circuitry which by way of its material and/or material-energy configuration comprises control and/or procedural signals, and/or settings and values (such as resistance, impedance, capacitance, inductance, current/voltage ratings, etc.), that may be applied to influence the operation of a device. Magnetic media, electronic circuits, electrical and optical memory (both volatile and nonvolatile), and firmware are examples of logic. Logic specifically excludes pure signals or software per se (however does not exclude machine memories comprising software and thereby forming configurations of matter).

“Software” in this context refers to logic implemented as processor-executable instructions in a machine memory (e.g. read/write volatile or nonvolatile memory or media).

Herein, references to “one embodiment” or “an embodiment” do not necessarily refer to the same embodiment, although they may. Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to.” Words using the singular or plural number also include the plural or singular number respectively, unless expressly limited to a single one or multiple ones. Additionally, the words “herein,” “above,” “below” and words of similar import, when used in this application, refer to this application as a whole and not to any particular portions of this application. When the claims use the word “or” in reference to a list of two or more items, that word covers all of the following interpretations of the word: any of the items in the list, all of the items in the list and any combination of the items in the list, unless expressly limited to one or the other. Any terms not expressly defined herein have their conventional meaning as commonly understood by those having skill in the relevant art(s).

Various logic functional operations described herein may be implemented in logic that is referred to using a noun or noun phrase reflecting said operation or function. For example, an association operation may be carried out by an “associator” or “correlator”. Likewise, switching may be carried out by a “switch”, selection by a “selector”, and so on.

FIG. 4 illustrates an embodiment of a digital apparatus 400 to implement components and process steps of the system described herein.

Input devices 404 comprise transducers that convert physical phenomenon into machine internal signals, typically electrical, optical or magnetic signals. Signals may also be wireless in the form of electromagnetic radiation in the radio frequency (RF) range but also potentially in the infrared or optical range. Examples of input devices 404 are keyboards which respond to touch or physical pressure from an object or proximity of an object to a surface, mice which respond to motion through space or across a plane, microphones which convert vibrations in the medium (typically air) into device signals, scanners which convert optical patterns on two or three dimensional objects into device signals. The signals from the input devices 404 are provided via various machine signal conductors (e.g., busses or network interfaces) and circuits to memory 406. 

The memory 406 is typically what is known as a first or second level memory device, providing for storage (via configuration of matter or states of matter) of signals received from the input devices 404, instructions and information for controlling operation of the CPU 402, and signals from storage devices 410. 

The memory 406 and/or the storage devices 410 may store computer-executable instructions and thus forming logic 414 that when applied to and executed by the CPU 402 implement embodiments of the processes disclosed herein.

Information stored in the memory 406 is typically directly accessible to the CPU 402 of the device. Signals input to the device cause the reconfiguration of the internal material/energy state of the memory 406, creating in essence a new machine configuration, influencing the behavior of the digital apparatus 400 by affecting the behavior of the CPU 402 with control signals (instructions) and data provided in conjunction with the control signals. 

Second or third level storage devices 410 may provide a slower but higher capacity machine memory capability. Examples of storage devices 410 are hard disks, optical disks, large capacity flash memories or other non-volatile memory technologies, and magnetic memories. 

The CPU 402 may cause the configuration of the memory 406 to be altered by signals in storage devices 410. In other words, the CPU 402 may cause data and instructions to be read from storage devices 410 in the memory 406 from which may then influence the operations of CPU 402 as instructions and data signals, and from which it may also be provided to the output devices 408. The CPU 402 may alter the content of the memory 406 by signaling to a machine interface of memory 406 to alter the internal configuration, and then converted signals to the storage devices 410 to alter its material internal configuration. In other words, data and instructions may be backed up from memory 406, which is often volatile, to storage devices 410, which are often non-volatile.

Output devices 408 are transducers which convert signals received from the memory 406 into physical phenomenon such as vibrations in the air, or patterns of light on a machine display, or vibrations (i.e., haptic devices) or patterns of ink or other materials (i.e., printers and 3-D printers).  

The network interface 412 receives signals from the memory 406 and converts them into electrical, optical, or wireless signals to other machines, typically via a machine network. The network interface 412 also receives signals from the machine network and converts them into electrical, optical, or wireless signals to the memory 406.

Terms used herein should be accorded their ordinary meaning in the relevant arts, or the meaning indicated by their use in context, but if an express definition is provided, that meaning controls.

“Circuitry” in this context refers to electrical circuitry having at least one discrete electrical circuit, electrical circuitry having at least one integrated circuit, electrical circuitry having at least one application specific integrated circuit, circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program which at least partially carries out processes or devices described herein, or a microprocessor configured by a computer program which at least partially carries out processes or devices described herein), circuitry forming a memory device (e.g., forms of random access memory), or circuitry forming a communications device (e.g., a modem, communications switch, or optical-electrical equipment).

“Firmware” in this context refers to software logic embodied as processor-executable instructions stored in read-only memories or media.

“Hardware” in this context refers to logic embodied as analog or digital circuitry.

“Logic” in this context refers to machine memory circuits, non transitory machine readable media, and/or circuitry which by way of its material and/or material-energy configuration comprises control and/or procedural signals, and/or settings and values (such as resistance, impedance, capacitance, inductance, current/voltage ratings, etc.), that may be applied to influence the operation of a device. Magnetic media, electronic circuits, electrical and optical memory (both volatile and nonvolatile), and firmware are examples of logic. Logic specifically excludes pure signals or software per se (however does not exclude machine memories comprising software and thereby forming configurations of matter).

“Software” in this context refers to logic implemented as processor-executable instructions in a machine memory (e.g. read/write volatile or nonvolatile memory or media).

Herein, references to “one embodiment” or “an embodiment” do not necessarily refer to the same embodiment, although they may. Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise,” “comprising,” and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to.” Words using the singular or plural number also include the plural or singular number respectively, unless expressly limited to a single one or multiple ones. Additionally, the words “herein,” “above,” “below” and words of similar import, when used in this application, refer to this application as a whole and not to any particular portions of this application. When the claims use the word “or” in reference to a list of two or more items, that word covers all of the following interpretations of the word: any of the items in the list, all of the items in the list and any combination of the items in the list, unless expressly limited to one or the other. Any terms not expressly defined herein have their conventional meaning as commonly understood by those having skill in the relevant art(s).

Various logic functional operations described herein may be implemented in logic that is referred to using a noun or noun phrase reflecting said operation or function. For example, an association operation may be carried out by an “associator” or “correlator”. Likewise, switching may be carried out by a “switch”, selection by a “selector”, and so on.

Referring to FIG. 5, a mobile device 500 comprises an antenna 502, control logic 504, wireless communication logic 506, a memory 508, a power manager 510, a battery 512, logic 516, and user interface logic 514.

The control logic 504 controls and coordinates the operation of other components as well as providing signal processing for the mobile device 500. For example control logic 504 may extract baseband signals from radio frequency signals received from the wireless communication logic 506 logic, and processes baseband signals up to radio frequency signals for communications transmitted to the wireless communication logic 506 logic. Control logic 504 may comprise a central processing unit, digital signal processor, and/or one or more controllers or combinations of these components. 

The wireless communication logic 506 may further comprise memory 508 which may be utilized by the control logic 504 to read and write instructions (commands) and data (operands for the instructions). The memory 508 may comprise logic 516 to carry out aspects of the processes disclosed herein, e.g., those aspects executed by a smart phone or other mobile device. 

A human user or operator of the mobile device 500 may utilize the user interface logic 514 to receive information from and input information to the mobile device 500. Images, video and other display information, for example, user interface optical patterns, may be output to the user interface logic 514, which may for example operate as a liquid crystal display or may utilize other optical output technology. The user interface logic 514 may also operate as a user input device, being touch sensitive where contact or close contact by a use’s finger or other device handled by the user may be detected by transducers. An area of contact or proximity to the user interface logic 514 may also be detected by transducers and this information may be supplied to the control logic 504 to affect the internal operation of the mobile device 500 and to influence control and operation of its various components. 

Audio signals may be provided to user interface logic 514 from which signals output to one and more speakers to create pressure waves in the external environment representing the audio. The mobile device 500 may convert audio phenomenon from the environment into internal electro or optical signals by operating a microphone and audio circuit (not illustrated). 

The mobile device 500 may operate on power received from a battery 512. The battery 512 capability and energy supply may be managed by a power manager 510. 

The mobile device 500 may transmit wireless signals of various types and range (e.g., cellular, GPS, WiFi, BlueTooth, and near field communication i.e. NFC). The mobile device 500 may also receive these types of wireless signals. Wireless signals are  transmitted and received using wireless communication logic 506 logic coupled to one or more antenna 502. Other forms of electromagnetic radiation may be used to interact with proximate devices, such as infrared (not illustrated).

FIG. 6 illustrates arrays 600.

FIG. 7 illustrates electrical, logical, mathmatical symbols 700.

Signal processing and system control 804 controls and coordinates the operation of other components as well as providing signal processing for the mobile device 800. For example signal processing and system control 804 may extract baseband signals from radio frequency signals received from the wireless communication 806 logic, and processes baseband signals up to radio frequency signals for communications transmitted to the wireless communication 806 logic. Signal processing and system control 804 may comprise a central processing unit, digital signal processor, and/or one or more controllers or combinations of these components. 

The wireless communication 806 may further comprise memory 808 which may be utilized by the signal processing and system control 804 to read and write instructions (commands) and data (operands for the instructions). 

A human user or operator of the mobile device 800 may utilize the user interface 814 to receive information from and input information to the mobile device 800. Images, video and other display information, for example, user interface optical patterns, may be output to the user interface 814, which may for example operate as a liquid crystal display or may utilize other optical output technology. The user interface 814 may also operate as a user input device, being touch sensitive where contact or close contact by a use’s finger or other device handled by the user may be detected by transducers. An area of contact or proximity to the user interface 814 may also be detected by transducers and this information may be supplied to the signal processing and system control 804 to affect the internal operation of the mobile device 800 and to influence control and operation of its various components. 

A camera 816 may interface to image processing 818 logic to record images and video from the environment. The image processing 818 may operate to provide image/video enhancement, compression, and other transformations, and from there to the signal processing and system control 804 for further processing and storage to memory 808. Images and video stored in the memory 808 may also be read by the signal processing and system control 804 and output to the user interface 814 for display to a user of the mobile device 800.

Audio signals may be provided to user interface 814 from which signals output to one and more speakers to create pressure waves in the external environment representing the audio. The mobile device 800 may convert audio phenomenon from the environment into internal electro or optical signals by operating a microphone and audio circuit (not illustrated). 

The mobile device 800 may operate on power received from a battery 812. The battery 812 capability and energy supply may be managed by a power manager 810. 

The mobile device 800 may transmit wireless signals of various types and range (e.g., cellular, WiFi, BlueTooth, and near field communication i.e. NFC). The mobile device 800 may also receive these types of wireless signals. Wireless signals are  transmitted and received using wireless communication 806 logic coupled to one or more antenna 802. Other forms of electromagnetic radiation may be used to interact with proximate devices, such as infrared (not illustrated).

Signal processing and system control 906 controls and coordinates the operation of other components as well as providing signal processing for the mobile device 900. For example signal processing and system control 906 may extract baseband signals from radio frequency signals received from the wireless communication 908 logic, and processes baseband signals up to radio frequency signals for communications transmitted to the wireless communication 908 logic. Signal processing and system control 906 may comprise a central processing unit, digital signal processor, and/or one or more controllers or combinations of these components. 

The wireless communication 908 may further comprise memory 916 which may be utilized by the signal processing and system control 906 to read and write instructions (commands) and data (operands for the instructions). 

A human user or operator of the mobile device 900 may utilize the user interface 922 to receive information from and input information to the mobile device 900. Images, video and other display information, for example, user interface optical patterns, may be output to the user interface 922, which may for example operate as a liquid crystal display or may utilize other optical output technology. The user interface 922 may also operate as a user input device, being touch sensitive where contact or close contact by a use’s finger or other device handled by the user may be detected by transducers. An area of contactor proximity to the user interface 922 may also be detected by transducers and this information may be supplied to the signal processing and system control 906 to affect the internal operation of the mobile device 900and to influence control and operation of its various components. 

A camera 924 may interface to image processing 926 logic to record images and video from the environment. The image processing 926 may operate to provide image/video enhancement, compression, and other transformations, and from there to the signal processing and system control 906 for further processing and storage to memory 916. Images and video stored in the memory 916 may also be read by the signal processing and system control 906 and output to the user interface 922 for display to a user of the mobile device 900.

Audio signals may be provided to user interface 922 from which signals output to one and more speakers to create pressure waves in the external environment representing the audio. The mobile device 900 may convert audio phenomenon from the environment into internal electro or optical signals by operating a microphone and audio circuit (not illustrated). 

The mobile device 900 may operate on power received from a battery 920. The battery 920 capability and energy supply may be managed by a power manager 918. 

The mobile device 900 may transmit wireless signals of various types and range (e.g., cellular, WiFi, BlueTooth, and near field communication i.e. NFC). The mobile device 900 may also receive these types of wireless signals. Cellular wireless signals are  transmitted and received using wireless communication 908 logic coupled to one or more antenna 902. Shorter-range wireless signals may be transmitted and received via antenna 904 and wireless communication logic 928. Other forms of electromagnetic radiation may be used to interact with proximate devices, such as infrared (not illustrated).

The device may utilize a haptic driver 932 which controls a vibration generator 914 to cause vibrations in response to events identified by signal processing and system control 906, such as the received text messages, emails, incoming calls or other events that require the user or the device’s attention.

A subscriber identity module ( SIM 910 ) may be present in some mobile devices, especially those operated on the Global System for Mobile Communication (GSM) network. The SIM 910 stores, in machine-readable memory, personal information of a mobile service subscriber, such as the subscriber’s cell phone number, address book, text messages, and other personal data. A user of the mobile device 900 can move the SIM 910to a different and maintain access to their personal information. A SIM 910 typically has a unique number which identifies the subscriber to the wireless network service provider.

The mobile device 900 may include an audio driver 930 including an audio encoder/decoder for encoding and decoding digital audio files or audio files stored by memory 916, SIM 910, or received in real time via  one of the antenna 902, antenna 904. The audio driver 930 is controlled by the signal processing and system control 906 and decoded audio is provided to one and more speaker 912 to create pressure waves in the external environment representing the audio.

Signal processing and system control 1006 controls and coordinates the operation of other components as well as providing signal processing for the mobile device . For example signal processing and system control 1006 may extract baseband signals from radio frequency signals received from the wireless communication logic 1026, and processes baseband signals up to radio frequency signals for communications transmitted to the wireless communication logic 1026 logic. Signal processing and system control 1006 may comprise a central processing unit, digital signal processor, and/or one or more controllers or combinations of these components. 

The wireless communication logic 1026 may further comprise memory 1016 which may be utilized by the signal processing and system control 1006 to read and write instructions (commands) and data (operands for the instructions). 

A camera 1022 may interface to image processing 1024 logic to record images and video from the environment. The image processing 1024 may operate to provide image/video enhancement, compression, and other transformations, and from there to the signal processing and system control 1006 for further processing and storage to memory 1016. Images and video stored in the memory 1016 may also be read by the signal processing and system control 1006 and output for display to a user of the mobile device 1000.

Audio signals may be provided to one or more speakers to create pressure waves in the external environment representing the audio. The mobile device 1000 may convert audio phenomenon from the environment into internal electro or optical signals by operating a microphone and audio circuit (not illustrated). 

The mobile device 1000 may operate on power received from a battery 1020. The battery 1020 capability and energy supply may be managed by a power manager 1018. 

The mobile device 1000 may transmit wireless signals of various types and range (e.g., cellular, WiFi, BlueTooth, and near field communication i.e. NFC). The mobile device 1000 may also receive these types of wireless signals. Cellular wireless signals are  transmitted and received using wireless communication logic 1026 logic coupled to one or more antennae (not shown). Other forms of electromagnetic radiation may be used to interact with proximate devices, such as infrared (not illustrated).

The device may utilize a GPU 1030 which controls a motor control 1014 to cause vibrations in response to events identified by signal processing and system control 1006, such as the received text messages, emails, incoming calls or other events that require the user or the device’s attention.

A subscriber identity module (navigation board 1028) may be present in some mobile devices, especially those operated on the Global System for Mobile Communication (GSM) network. The navigation board 1028 stores, in machine-readable memory, personal information of a mobile service subscriber, such as the subscriber’s cell phone number, address book, text messages, and other personal data. A user of the mobile device 1000 can move the navigation board 1028 to a different and maintain access to their personal information. A navigation board 1028 typically has a unique number which identifies the subscriber to the wireless network service provider.

The mobile device 1000 may include a navigation board 1028 including an audio encoder/decoder for encoding and decoding digital audio files or audio files stored by memory 1016, navigation board 1028, or received in real time via an antenna (not shown). The navigation board 1028 is controlled by the signal processing and system control 1006 and decoded audio is provided to one and more altimeter 1012 to create pressure waves in the external environment representing the audio.

Referring to FIG. 11, a network 1100 comprises a client device 1102, a client device 1104, a client device 1106, a server 1108, a server 1110, a router 1112, a network 1114, a network 1116, and a network 1118.

Referring to FIG. 12, a computing environment 1200 comprises a CPU 1202, a bus 1204, a ROM 1206, a RAM 1208, an I/O adapter 1210, a memory structure 1212, a communication adapter 1214, a communication 1216, an interface device 1218, a user interface adapter 1220, an interface device 1222, an interface device 1224, an interface device 1226, a display adapter 1228, and a display device 1230.

Referring to FIG. 13, The system 1300 comprises a host OE 1302, a VOE A 1304, a VOE B 1306, and a VOE C 1308.

Referring to FIG. 14 a system 1400 comprises a host OE 1402, an OE D 1404, a network 1406, an OE B 1408, and an OE C 1410.

Referring to FIG. 15, a system 1500 comprises a gateway 1502, an OE A 1504, a network 1506, an OE B 1508, an OE C 1510, and a cloud 1512.

Referring to FIG. 16, a computing environment 1600 comprises a device 1602. The device 1602 comprises a processor 1604, a persistent secondary storage 1608, an input device adapter 1610, an output device adapter 1612, a network interface adapter 1614, a bus 1616, a virtual processor memory 1618, an input device 1628, and an output device 1630. The virtual processor memory 1618 may comprise a physical processor memory 1606, an operating system 1620, an OCE 1622, applications 1624, and other libraries and subsystems 1626. Part of the persistent secondary storage 1608 and/or the bus 1616 may be comprised by the device 1602 and/or the virtual processor memory 1618.

Referring to FIG. 17, an operating environment 1700 comprises an application 1702, a web browser 1704, a subsystem 1712, a network stack 1714, an application protocol service 1716, a GUI subsystem 1730, a graphics subsystem 1732, and an input driver 1734. The application 1702 may further comprise an application logic 1706 and a presentation controller 1726. The presentation controller 1726 may comprise a UI element handler 1722. The web browser 1704 may further comprise an application logic 1708, a content manager 1718, and a presentation controller 1728. The application logic 1708 and the presentation controller 1728 may comprise a SAA 1710 and a content handler 1720 in full or in part. The presentation controller 1728 may comprise a UI element handler 1724.

Referring to FIG. 18, a computing environment 1800 comprises a service application 1802, a network stack 1804, a network application platform 1806, an application protocol service 1808, a controller 1810, a model database 1816, and a template database 1822. The service application 1802 may further comprise a model 1812 and a view 1826. The model 1812 may further comprise a request handler 1814 and a data access manager 1818. The view 1826 may further comprise a template engine 1820, a response handler 1828, and a data-out 1830. The template database 1822 may further comprise a template 1824.

FIG. 21 is a block diagram 2100 illustrating an architecture of software 102, which can be installed on any one or more of the devices described above. FIG. 21 is merely a non-limiting example of a software architecture, and it will be appreciated that many other architectures can be implemented to facilitate the functionality described herein. In various embodiments, the Software Architecture 2104 is implemented by hardware such as a machine 2102 of FIG. 2 that includes processors 2120, memory 2126, and I/O components 2138. In this example architecture, the software 102 can be conceptualized as a stack of layers where each layer may provide a particular functionality. For example, the software 102 includes layers such as an operating system 2112, libraries 2110, frameworks 2108, and applications 2106. Operationally, the applications 2106 invoke application programming interface (API) calls 112 through the software stack and receive messages 2152 in response to the API calls 2150, consistent with some embodiments.

In various implementations, the operating system 2112 manages hardware resources and provides common services. The operating system 2112 includes, for example, a kernel 2114, services 2116, and drivers 2122. The kernel 2114 acts as an abstraction layer between the hardware and the other software layers, consistent with some embodiments. For example, the kernel 2114 provides memory management, processor management (e.g., scheduling), component management, networking, and security settings, among other functionality. The services 2116 can provide other common services for the other software layers. The drivers 2122 are responsible for controlling or interfacing with the underlying hardware, according to some embodiments. For instance, the drivers 2122 can include display drivers, camera drivers, BLUETOOTH® or BLUETOOTH® Low Energy drivers, flash memory drivers, serial communication drivers (e.g., Universal Serial Bus (USB) drivers), WI-FI® drivers, audio drivers, power management drivers, and so forth.

In some embodiments, the libraries 2110 provide a low-level common infrastructure utilized by the applications 2106. The libraries 2110 can include system libraries 2118 (e.g., C standard library) that can provide functions such as memory allocation functions, string manipulation functions, mathematic functions, and the like. In addition, the libraries 2110 can include API libraries 2124 such as media libraries (e.g., libraries to support presentation and manipulation of various media formats such as Moving Picture Experts Group-4 (MPEG4), Advanced Video Coding (H.264 or AVC), Moving Picture Experts Group Layer-3 (MP3), Advanced Audio Coding (AAC), Adaptive Multi-Rate (AMR) audio codec, Joint Photographic Experts Group (JPEG or JPG), or Portable Network Graphics (PNG)), graphics libraries (e.g., an OpenGL framework used to render in two dimensions (2D) and three dimensions (3D) in a graphic content on a display), database libraries (e.g., SQLite to provide various relational database functions), web libraries (e.g., WebKit to provide web browsing functionality), and the like. The libraries 2110 can also include a wide variety of other libraries 2128 to provide many other APIs to the applications 2106.

The frameworks 2108 provide a high-level common infrastructure that can be utilized by the applications 2106, according to some embodiments. For example, the frameworks 2108 provide various graphic user interface (GUI) functions, high-level resource management, high-level location services, and so forth. The frameworks 2108 can provide a broad spectrum of other APIs that can be utilized by the applications 2106, some of which may be specific to a particular operating system or platform.

In an example embodiment, the applications 2106 include a home application 2136, a contacts application 2130, a browser application 2132, a book reader application 2134, a location application 2142, a media application 2144, a messaging application 2146, a game application 2148, and a broad assortment of other applications such as a third-party application 2140. According to some embodiments, the applications 2106 are programs that execute functions defined in the programs. Various programming languages can be employed to create one or more of the applications 2106, structured in a variety of manners, such as object-oriented programming languages (e.g., Objective-C, Java, or C++) or procedural programming languages (e.g., C or assembly language). In a specific example, the third-party application 2140 (e.g., an application developed using the ANDROID™ or IOS™ software development kit (SDK) by an entity other than the vendor of the particular platform) may be mobile software running on a mobile operating system such as IOS™, ANDROID™, WINDOWS® Phone, or another mobile operating system. In this example, the third-party application 2140 can invoke the API calls 2150 provided by the operating system 2112 to facilitate functionality described herein.

FIG. 22 illustrates a diagrammatic representation of a machine 2200 in the form of a computer system within which a set of instructions may be executed for causing the machine to perform any one or more of the methodologies discussed herein, according to an example embodiment. Specifically, FIG. 22 shows a diagrammatic representation of the machine 2200 in the example form of a computer system, within which instructions 2208 (e.g., software, a program, an application, an applet, an app, or other executable code) for causing the machine 2200 to perform any one or more of the methodologies discussed herein may be executed.  For example the instructions 2208 may cause the machine 2200 to execute the method XYZ of FIG. 2.  Additionally, or alternatively, the instructions 2208 may implement FIGs. X-X, and so forth.  The instructions 2208 transform the general, non-programmed machine 2200 into a particular machine 2200 programmed to carry out the described and illustrated functions in the manner described.  In alternative embodiments, the machine 2200 operates as a standalone device or may be coupled (e.g., networked) to other machines.  In a networked deployment, the machine 2200 may operate in the capacity of a server machine or a client machine in a server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment.  The machine 2200 may comprise, but not be limited to, a server computer, a client computer, a personal computer (PC), a tablet computer, a laptop computer, a netbook, a set-top box (STB), a PDA, an entertainment media system, a cellular telephone, a smart phone, a mobile device, a wearable device (e.g., a smart watch), a smart home device (e.g., a smart appliance), other smart devices, a web appliance, a network router, a network switch, a network bridge, or any machine capable of executing the instructions 2208, sequentially or otherwise, that specify actions to be taken by the machine 2200.  Further, while only a single machine 2200 is illustrated, the term “machine” shall also be taken to include a collection of machines 200 that individually or jointly execute the instructions 2208 to perform any one or more of the methodologies discussed herein.

The machine 2200 may include processors 2202, memory 2204, and I/O components 2242, which may be configured to communicate with each other such as via a bus 2244.  In an example embodiment, the processors 2202 (e.g., a Central Processing Unit (CPU), a Reduced Instruction Set Computing (RISC) processor, a Complex Instruction Set Computing (CISC) processor, a Graphics Processing Unit (GPU), a Digital Signal Processor (DSP), an ASIC, a Radio-Frequency Integrated Circuit (RFIC), another processor, or any suitable combination thereof) may include, for example, a processor 2206 and a processor 2210 that may execute the instructions 2208.  The term “processor” is intended to include multi-core processors that may comprise two or more independent processors (sometimes referred to as “cores”) that may execute instructions contemporaneously.  Although FIG. 22 shows multiple processors 2202, the machine 2200 may include a single processor with a single core, a single processor with multiple cores (e.g., a multi-core processor), multiple processors with a single core, multiple processors with multiples cores, or any combination thereof.

The memory 2204 may include a main memory 2212, a static memory 2214, and a storage unit 2216, both accessible to the processors 2202 such as via the bus 2244.  The main memory 2204, the static memory 2214, and storage unit 2216 store the instructions 2208 embodying any one or more of the methodologies or functions described herein.  The instructions 2208 may also reside, completely or partially, within the main memory 2212, within the static memory 2214, within machine-readable medium 2218 within the storage unit 2216, within at least one of the processors 2202 (e.g., within the processor’s cache memory), or any suitable combination thereof, during execution thereof by the machine 2200. 

The I/O components 2242 may include a wide variety of components to receive input, provide output, produce output, transmit information, exchange information, capture measurements, and so on.  The specific I/O components 2242 that are included in a particular machine will depend on the type of machine.  For example, portable machines such as mobile phones will likely include a touch input device or other such input mechanisms, while a headless server machine will likely not include such a touch input device.  It will be appreciated that the I/O components 2242 may include many other components that are not shown in FIG. 22.  The I/O components 2242 are grouped according to functionality merely for simplifying the following discussion and the grouping is in no way limiting.  In various example embodiments, the I/O components 2242 may include output components 2228 and input components 2230.  The output components 2228 may include visual components (e.g., a display such as a plasma display panel (PDP), a light emitting diode (LED) display, a liquid crystal display (LCD), a projector, or a cathode ray tube (CRT)), acoustic components (e.g., speakers), haptic components (e.g., a vibratory motor, resistance mechanisms), other signal generators, and so forth.  The input components 2230 may include alphanumeric input components (e.g., a keyboard, a touch screen configured to receive alphanumeric input, a photo-optical keyboard, or other alphanumeric input components), point-based input components (e.g., a mouse, a touchpad, a trackball, a joystick, a motion sensor, or another pointing instrument), tactile input components (e.g., a physical button, a touch screen that provides location and/or force of touches or touch gestures, or other tactile input components), audio input components (e.g., a microphone), and the like.

In further example embodiments, the I/O components 2242 may include biometric components 2232, motion components 2234, environmental components 2236, or position components 2238, among a wide array of other components.  For example, the biometric components 2232 may include components to detect expressions (e.g., hand expressions, facial expressions, vocal expressions, body gestures, or eye tracking), measure biosignals (e.g., blood pressure, heart rate, body temperature, perspiration, or brain waves), identify a person (e.g., voice identification, retinal identification, facial identification, fingerprint identification, or electroencephalogram-based identification), and the like.  The motion components 2234 may include acceleration sensor components (e.g., accelerometer), gravitation sensor components, rotation sensor components (e.g., gyroscope), and so forth.  The environmental components 2236 may include, for example, illumination sensor components (e.g., photometer), temperature sensor components (e.g., one or more thermometers that detect ambient temperature), humidity sensor components, pressure sensor components (e.g., barometer), acoustic sensor components (e.g., one or more microphones that detect background noise), proximity sensor components (e.g., infrared sensors that detect nearby objects), gas sensors (e.g., gas detection sensors to detection concentrations of hazardous gases for safety or to measure pollutants in the atmosphere), or other components that may provide indications, measurements, or signals corresponding to a surrounding physical environment.  The position components 2238 may include location sensor components (e.g., a GPS receiver component), altitude sensor components (e.g., altimeters or barometers that detect air pressure from which altitude may be derived), orientation sensor components (e.g., magnetometers), and the like.

Communication may be implemented using a wide variety of technologies.  The I/O components 2242 may include communication components 2240 operable to couple the machine 2200 to a network 2220 or devices 2222 via a coupling 2224 and a coupling 2226, respectively.  For example, the communication components 2240 may include a network interface component or another suitable device to interface with the network 2220.  In further examples, the communication components 2240 may include wired communication components, wireless communication components, cellular communication components, Near Field Communication (NFC) components, Bluetooth^® components (e.g., Bluetooth^® Low Energy), Wi-Fi^® components, and other communication components to provide communication via other modalities.  The devices 2222 may be another machine or any of a wide variety of peripheral devices (e.g., a peripheral device coupled via a USB).

Moreover, the communication components 2240 may detect identifiers or include components operable to detect identifiers.  For example, the communication components 2240 may include Radio Frequency Identification (RFID) tag reader components, NFC smart tag detection components, optical reader components (e.g., an optical sensor to detect one-dimensional bar codes such as Universal Product Code (UPC) bar code, multi-dimensional bar codes such as Quick Response (QR) code, Aztec code, Data Matrix, Dataglyph, MaxiCode, PDF417, Ultra Code, UCC RSS-2D bar code, and other optical codes), or acoustic detection components (e.g., microphones to identify tagged audio signals).  In addition, a variety of information may be derived via the communication components 2240, such as location via Internet Protocol (IP) geolocation, location via Wi-Fi® signal triangulation, location via detecting an NFC beacon signal that may indicate a particular location, and so forth.

EXECUTABLE INSTRUCTIONS AND MACHINE STORAGE MEDIUM

The various memories (i.e., memory 2204, main memory 2212, static memory 2214, and/or memory of the processors 2202) and/or storage unit 2216 may store one or more sets of instructions and data structures (e.g., software) embodying or utilized by any one or more of the methodologies or functions described herein.  These instructions (e.g., the instructions 2208), when executed by processors 2202, cause various operations to implement the disclosed embodiments.

As used herein, the terms “machine-storage medium,” “device-storage medium,” “computer-storage medium” mean the same thing and may be used interchangeably in this disclosure.  The terms refer to a single or multiple storage devices and/or media (e.g., a centralized or distributed database, and/or associated caches and servers) that store executable instructions and/or data. The terms shall accordingly be taken to include, but not be limited to, solid-state memories, and optical and magnetic media, including memory internal or external to processors.  Specific examples of machine-storage media, computer-storage media and/or device-storage media include non-volatile memory, including by way of example semiconductor memory devices, e.g., erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), FPGA, and flash memory devices; magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks.  The terms “machine-storage media,” “computer-storage media,” and “device-storage media” specifically exclude carrier waves, modulated data signals, and other such media, at least some of which are covered under the term “signal medium” discussed below.

TRANSMISSION MEDIUM

In various example embodiments, one or more portions of the network 2220 may be an ad hoc network, an intranet, an extranet, a VPN, a LAN, a WLAN, a WAN, a WWAN, a MAN, the Internet, a portion of the Internet, a portion of the PSTN, a plain old telephone service (POTS) network, a cellular telephone network, a wireless network, a Wi-Fi® network, another type of network, or a combination of two or more such networks.  For example, the network 2220 or a portion of the network 2220 may include a wireless or cellular network, and the coupling 2224 may be a Code Division Multiple Access (CDMA) connection, a Global System for Mobile communications (GSM) connection, or another type of cellular or wireless coupling.  In this example, the coupling 2224 may implement any of a variety of types of data transfer technology, such as Single Carrier Radio Transmission Technology (1xRTT), Evolution-Data Optimized (EVDO) technology, General Packet Radio Service (GPRS) technology, Enhanced Data rates for GSM Evolution (EDGE) technology, third Generation Partnership Project (3GPP) including 3G, fourth generation wireless (4G) networks, Universal Mobile Telecommunications System (UMTS), High Speed Packet Access (HSPA), Worldwide Interoperability for Microwave Access (WiMAX), Long Term Evolution (LTE) standard, others defined by various standard-setting organizations, other long range protocols, or other data transfer technology.

The instructions 2208 may be transmitted or received over the network 2220 using a transmission medium via a network interface device (e.g., a network interface component included in the communication components 2240) and utilizing any one of a number of well-known transfer protocols (e.g., hypertext transfer protocol (HTTP)).  Similarly, the instructions 2208 may be transmitted or received using a transmission medium via the coupling 2226 (e.g., a peer-to-peer coupling) to the devices 2222.  The terms “transmission medium” and “signal medium” mean the same thing and may be used interchangeably in this disclosure.  The terms “transmission medium” and “signal medium” shall be taken to include any intangible medium that is capable of storing, encoding, or carrying the instructions 2208 for execution by the machine 2200, and includes digital or analog communications signals or other intangible media to facilitate communication of such software. Hence, the terms “transmission medium” and “signal medium” shall be taken to include any form of modulated data signal, carrier wave, and so forth.  The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a matter as to encode information in the signal.

COMPUTER-READABLE MEDIUM

The terms “machine-readable medium,” “computer-readable medium” and “device-readable medium” mean the same thing and may be used interchangeably in this disclosure.  The terms are defined to include both machine-storage media and transmission media.  Thus, the terms include both storage devices/media and carrier waves/modulated data signals.