Efficient eye illumination using reflection of structured light pattern for eye tracking
Granted: February 1, 2022
Patent Number:
11237628
Disclosed herein are techniques for eye illumination for eye position tracking. An illumination system includes a light source configured to emit a light beam in a first wavelength range, a beam splitter configured to split the light beam emitted by the light source into a plurality of light beams, a substrate configured to be placed in front of an eye of a user, and a plurality of reflectors located within the substrate. Each of the plurality of reflectors is configured to intercept one…
Volumetric display including liquid crystal-based lenses
Granted: February 1, 2022
Patent Number:
11240488
A volumetric display may include a two-dimensional display; a varifocal optical system configured to receive image light from the two-dimensional display and focus the image light; and at least one processor configured to: control the two-dimensional display to cause a plurality of sub-frames associated with an image frame to be displayed by the display, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame;…
Curved pillar interconnects
Granted: February 1, 2022
Patent Number:
11239400
A light-emitting diode (LED) array is formed by bonding an LED chip or wafer to a backplane substrate via curved interconnects. The backplane substrate may include circuits for driving the LED's. One or more curved interconnects are formed on the backplane substrate. A curved interconnect may be electrically connected to a corresponding circuit of the backplane substrate, and may include at least a portion with curvature. The LED chip or wafer may include one or more LED devices. Each…
Architecture for hybrid TFT-based micro display projector
Granted: February 1, 2022
Patent Number:
11239399
For small, high-resolution, light-emitting diode (LED) displays, such as for a near-eye display in an artificial-reality headset, LEDs are spaced closely together. A backplane can be used to drive an array of LEDs in an LED display. A plurality of interconnects electrically couple the backplane with the array of LEDs. As spacing between LEDs becomes smaller than interconnect spacing, a thin-film circuit layer can be used to reduce a number or interconnects between the backplane and the…
Estimation of absolute depth from polarization measurements
Granted: February 1, 2022
Patent Number:
11238598
A head mounted display comprises an eye tracking system configured to enable eye tracking using polarization. The eye tracking system includes one or more illumination sources and an optical detector comprising polarization sensitive pixels. The one or more illumination sources are configured to illuminate a user's eye and generate reflections directed towards the optical detector. The eye tracking system determines, for each polarization sensitive pixel in a subset of the polarization…
Method and system for reconstructing obstructed face portions for virtual reality environment
Granted: February 1, 2022
Patent Number:
11238568
A method and a system for reconstructing obstructed face portions are provided herein. The method may include the following steps: obtaining off-line 3D data, being 3D data of a head of a person not wearing a face-obstructing object, being an object which obstructs a portion of the face of the person; obtaining in real time, real-time 3D data, being 3D data of said head, wherein said person wears said face-obstructing object; applying a 3D transformation to at least a portion of the…
Methods and systems for facilitating e-commerce payments
Granted: February 1, 2022
Patent Number:
11238461
Methods for facilitating financial transactions include facilitating or otherwise increasing the ease and speed of checkout processes. In particular, one or more implementations comprise an e-commerce payment facilitator that acts as an intermediary between a commerce application and a payment gateway. The e-commerce payment facilitator can provide stored payment information to a commerce application based on a few simple selections by a user. This allows a user to easily and securely…
Predictive eyetracking using recurrent neural networks
Granted: February 1, 2022
Patent Number:
11238340
A system predicts future positions or vergence depth of the user's eyes and generates gaze contingent content, such as for a head-mounted display (HMD), based on the predicted positions or vergence depth. The system includes an eye tracking controller that creates eye tracking information defining positions of a first eye and a second eye of a user over time. The eye tracking information is input to a neural network model that outputs the predicted positions or vergence depth. The…
In-call experience enhancement for assistant systems
Granted: February 1, 2022
Patent Number:
11238239
In one embodiment, a method includes establishing a video call between multiple client systems while persistently maintaining access to an assistant system during the video call. A request to be performed by the assistant system during the video call may then be received from a first client system; this request may reference one or more second users in the video call. An intent of the request and one or more user identifiers of these one or more second users referenced by the request may…
Artificial reality system with verified boot sequences
Granted: February 1, 2022
Patent Number:
11238159
In general, techniques are described for improving security of a boot sequence of an application processor. In some examples, a computing device includes a first processor coupled to a first storage device, the first processor and first storage device configured to obtain firmware from a storage device external to the first processor; run a verification routine on the firmware; and in response to validation of the firmware with the verification routine, communicate the firmware to a…
Multipass scanner for near-eye display
Granted: February 1, 2022
Patent Number:
11237402
A multipass scanner usable e.g. in a near-eye display is disclosed. The multipass scanner scans a light beam angularly, forming an image in angular domain. The multipass scanner includes a light source, a tiltable reflector, and a multipass coupler that couples light emitted by the light source to the tiltable reflector, receives the reflected light and couples it back to the tiltable reflector to double the scanning angle. Then, the multipass coupler couples the light reflected at least…
Multi-line scanning display for near-eye displays
Granted: February 1, 2022
Patent Number:
11237397
A scanning display includes a light source and a scanning assembly. The light source is configured to emit source light from a plurality of rows of emitters that are arranged parallel to a first dimension. The scanning assembly includes at least one optical element that conditions the source light. The scanning assembly is configured to scan the conditioned source light along a second dimension that is orthogonal to the first dimension. The scanning assembly configured to output the…
Wedge combiner for eye-tracking
Granted: February 1, 2022
Patent Number:
11237389
An optical system includes a first optical element having at least a first optical surface and a second optical surface, the first optical surface is not parallel to the second optical surface. The optical system includes a plurality of optical elements positioned adjacent to the second optical surface of the first optical element. The respective optical element of the plurality of optical elements is configured to receive light transmitted through the first optical surface at a first…
Depth sensing using a time of flight system including a scanning beam in combination with a single photon avalanche diode array
Granted: February 1, 2022
Patent Number:
11236993
A depth camera assembly (DCA) includes a light generator emitting a beam of light into a local area and a detector. The detector captures light from the beam reflected by objects in the local area to a portion of an array of pixels that each include a single photon avalanche diode (SPAD). The location of the portion of the array is based in part on the angle of the beam emitted from the projector. The DCA identifies a set of pixels of the array corresponding to the portion and…
Fluidic control: using exhaust as a control mechanism
Granted: February 1, 2022
Patent Number:
11236846
The disclosed apparatus may include a fluidic channel connecting an inlet port and an outlet port. The apparatus may further include a gate transmission element configured to limit fluid flow between the inlet port and the outlet port. Still further, the apparatus may include a primary gate terminal connected to a second fluidic inlet port, where pressure or force at the primary gate may at least partially control movement of the gate transmission element. The apparatus may also include…
Sequencer-based protocol adapter
Granted: January 25, 2022
Patent Number:
11231769
Methods, Apparatus, and Systems are discussed for a sequencer-based protocol adapter that executes a limited instruction set. The sequencer-based protocol adapter is implemented in electronic hardware and programmable registers in an integrated circuit and configured to transition a set of 1) one or more voltage sources, 2) one or more frequency sources, or 3) a combination of voltage sources and frequency sources, coupled with that sequencer-based protocol adapter. The sequencer-based…
Systems and methods for providing spatial awareness in virtual reality
Granted: January 25, 2022
Patent Number:
11232644
In one embodiment, a method includes rendering, for one or more displays of a VR device, a first output image of a VR environment based on a user's field of view. The VR environment has a virtual boundary corresponding to a real-world environment. The method further includes determining whether the user is approaching a threshold distance of the virtual boundary and determines the user's direction of movement and field of view, accessing one or more images of the real-world environment…
Training data quality for spam classification
Granted: January 25, 2022
Patent Number:
11232369
In one embodiment, a method includes accessing posts in a social-networking system. Each of the posts is unlabeled with respect to whether the post is known to be spam. The method also includes determining a posting user who submitted the post to the social-networking system and a recipient user to whom the post is addressed. The method further includes determining a first vector representation of the posting user and a second vector representation of the recipient user based on one or…
Personalized gesture recognition for user interaction with assistant systems
Granted: January 25, 2022
Patent Number:
11231946
In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and…
Handheld controllers for artificial reality and related methods
Granted: January 25, 2022
Patent Number:
11231791
The disclosed handheld controllers may include a multi-degree of freedom sensor module, a mouse module, and a switch. The mouse module may include a mouse sensor and a proximity sensor. The switch may be configured to activate the mouse sensor and deactivate the multi-degree of freedom sensor module when the proximity sensor indicates that the mouse sensor is proximate to a physical surface and to deactivate the mouse sensor and activate the multi-degree of freedom sensor when the…
