Learning-based camera pose estimation from images of an environment
Granted: March 30, 2021
Patent Number:
10964061
A deep neural network (DNN) system learns a map representation for estimating a camera position and orientation (pose). The DNN is trained to learn a map representation corresponding to the environment, defining positions and attributes of structures, trees, walls, vehicles, etc. The DNN system learns a map representation that is versatile and performs well for many different environments (indoor, outdoor, natural, synthetic, etc.). The DNN system receives images of an environment…
Vertical disparity detection in stereoscopic images from optical flow data
Granted: March 30, 2021
Patent Number:
10964034
Due to the factors such as lens distortion and camera misalignment, stereoscopic image pairs often contain vertical disparities. Introduced herein is a method and apparatus that determine and correct vertical disparities in stereoscopic image pairs using an optical flow map. Instead of discarding vertical motion vectors of the optical flow map, the introduced concept extracts and analyzes the vertical motion vectors from the optical flow map and vertically aligns the images using the…
Techniques for reducing noise in video
Granted: March 30, 2021
Patent Number:
10964000
Systems and techniques for noise reduction in video are described. Example implementations provide improved motion-adaptive temporal or spatio-temporal noise reduction that use an improved blending of the current frame with previous frames. The improved blending may be particularly effective for processing video captured in noisy environments such as low-light and/or mobile environments. In some example implementations, the improved blending is based on more accurately distinguishing…
Package level power gating
Granted: March 23, 2021
Patent Number:
10957651
A die package is disclosed through which power domains within the chip may be isolated by removing vias within the package substrate, rather than power gating. Multiple substrate options may be configured without specific vias. This eliminates the need to design power gating circuitry into the die, freeing up that die area for more functional logic. The solution allows the die package to retain the same pinout for use by PCB designers, regardless of which power domains are gated.
Enhanced anti-aliasing by varying sample patterns spatially and/or temporally
Granted: March 23, 2021
Patent Number:
10957078
A raster unit is configured to generate different sample patterns for adjacent pixels within a given frame. In addition, the raster unit may adjust the sample patterns between frames. The raster unit includes an index unit that selects a sample pattern table for use with a current frame. For a given pixel, the index unit extracts a sample pattern from the selected sample pattern table. The extracted sample pattern is used to generate coverage information for the pixel. The coverage…
Systems and methods for frame time smoothing based on modified animation advancement and use of post render queues
Granted: March 23, 2021
Patent Number:
10957020
Embodiments of the present invention provide end-to-end frame time synchronization designed to improve smoothness for displaying images of 3D applications, such as PC gaming applications. Traditionally, an application that renders 3D graphics functions based on the assumption that the average render time will be used as the animation time for a given frame. When this condition is not met, and the render time for a frame does not match the average render time of prior frames, the frames…
Retina space display stabilization and a foveated display for augmented reality
Granted: March 16, 2021
Patent Number:
10948985
Perceived clarity of an image presented by a display can be improved using an image stabilization technique to stabilize the image relative to a user's retina. During an illumination period, stabilization actuators are controlled to move a display panel or adjust optical components in the path of light associated with the image to shift the location of the image on the user's retina in response to head or eye movement detected by the system. In some embodiments, a display is configured…
Using playstyle patterns to generate virtual representations of game players
Granted: March 16, 2021
Patent Number:
10946281
In various embodiments of the present disclosure, playstyle patterns of players are learned and used to generate virtual representations (“bots”) of users. Systems and methods are disclosed that use game session data (e.g., metadata) from a plurality of game sessions of a game to learn playstyle patterns of users, based on user inputs of the user in view of variables presented within the game sessions. The game session data is applied to one or more machine learning models to learn…
Generating scenes containing shadows using pixel noise reduction techniques
Granted: March 9, 2021
Patent Number:
10943387
This disclosure presents a technique for utilizing ray tracing to produce a high quality visual scene that includes shadows while minimizing computing costs. Since the scene quality and computing cost is directly proportional to the number of rays used, this technique can lower the number of rays needed for shadow region rendering while maintaining a targeted visual quality for the scene. The process includes generating a complex pixel mask based on depth boundary testing, and generating…
IC package design and methodology to compensate for die-substrate CTE mismatch at reflow temperatures
Granted: March 9, 2021
Patent Number:
10943882
An IC package including an integrated circuit die having a major surface and one or more solder bumps located on the major surface in at least one corner region of the major surface and a substrate having a surface, the surface including bump pads thereon. The major surface of the integrated circuit die faces the substrate surface, the one or more solder bumps are bonded to individual ones of the bump pads to thereby form a bond joint, the major surface of the integrated circuit die has…
Hybrid virtual 3D rendering approach to stereovision
Granted: March 2, 2021
Patent Number:
10935788
A method for stereoscopically presenting visual content is disclosed. The method comprises identifying and distinguishing between a first type of content and a second type of content of a frame to be stereoscopically displayed. The method also comprises rendering the first type of content in a first left and a first right frame from a single perspective using a first stereoscopic rendering method. Further, the method comprises rendering the second type of content in a second left and a…
Low power flip-flop element with gated clock
Granted: February 23, 2021
Patent Number:
10931266
A flip-flop element is configured to gate the clock inversions within a master-slave flip-flop element. The flip-flop element reduces the number of circuit elements within the flip-flop element by collapsing elements with common functionality into a single circuit element. Further, by making the actions of judiciously selected circuit elements conditional upon the state of the input data, the flip-flop element circuit reduces the number of internal transitions. In this manner, by…
Motion adaptive rendering using variable rate shading
Granted: February 23, 2021
Patent Number:
10930022
Motion adaptive shading increases rendering performance for real-time animation in graphics systems while maintaining dynamic image quality. Each frame of an animation is statically displayed within a refresh interval, while a viewer's eyes move continuously relative to the image when actively tracking a moving object being displayed. As a result, a statically displayed frame is essentially smeared across the viewer's continuously moving retina over the lifetime of the frame, causing a…
Learning rigidity of dynamic scenes for three-dimensional scene flow estimation
Granted: February 23, 2021
Patent Number:
10929987
A neural network model receives color data for a sequence of images corresponding to a dynamic scene in three-dimensional (3D) space. Motion of objects in the image sequence results from a combination of a dynamic camera orientation and motion or a change in the shape of an object in the 3D space. The neural network model generates two components that are used to produce a 3D motion field representing the dynamic (non-rigid) part of the scene. The two components are information…
Three-dimensional (3D) pose estimation from a monocular camera
Granted: February 23, 2021
Patent Number:
10929654
Estimating a three-dimensional (3D) pose of an object, such as a hand or body (human, animal, robot, etc.), from a 2D image is necessary for human-computer interaction. A hand pose can be represented by a set of points in 3D space, called keypoints. Two coordinates (x,y) represent spatial displacement and a third coordinate represents a depth of every point with respect to the camera. A monocular camera is used to capture an image of the 3D pose, but does not capture depth information. A…
Techniques for pre-silicon testing integrated circuit designs that accommodate power-supply noise and adaptive-clock aware timing
Granted: February 23, 2021
Patent Number:
10929591
Various embodiments of the disclosure disclosed herein provide techniques for pre-silicon testing of a design for an integrated circuit. A pre-silicon testing system identifies one or more critical paths included in the integrated circuit. The pre-silicon testing system performs a based noise simulation to generate one or more voltage waveforms at each gate associated with the one or more critical paths. The pre-silicon testing system applies the one or more voltage waveforms to one or…
Saccadic redirection for virtual reality locomotion
Granted: February 16, 2021
Patent Number:
10922876
A method, computer readable medium, and system are disclosed for redirecting a user's movement through a physical space while the user views a virtual environment. A temporary visual suppression event is detected when a user's eyes move relative to the user's head while viewing a virtual scene displayed on a display device, an orientation of the virtual scene relative to the user is modified to direct the user to physically move along a planned path through a virtual environment…
Guided hallucination for missing image content using a neural network
Granted: February 16, 2021
Patent Number:
10922793
Missing image content is generated using a neural network. In an embodiment, a high resolution image and associated high resolution semantic label map are generated from a low resolution image and associated low resolution semantic label map. The input image/map pair (low resolution image and associated low resolution semantic label map) lacks detail and is therefore missing content. Rather than simply enhancing the input image/map pair, data missing in the input image/map pair is…
Fault injection architecture for resilient GPU computing
Granted: February 16, 2021
Patent Number:
10922203
Unavoidable physical phenomena, such as an alpha particle strikes, can cause soft errors in integrated circuits. Materials that emit alpha particles are ubiquitous, and higher energy cosmic particles penetrate the atmosphere and also cause soft errors. Some soft errors have no consequence, but others can cause an integrated circuit to malfunction. In some applications (e.g. driverless cars), proper operation of integrated circuits is critical to human life and safety. To minimize or…
Coherent caching of data for high bandwidth scaling
Granted: February 9, 2021
Patent Number:
10915445
A method, computer readable medium, and system are disclosed for a distributed cache that provides multiple processing units with fast access to a portion of data, which is stored in local memory. The distributed cache is composed of multiple smaller caches, and each of the smaller caches is associated with at least one processing unit. In addition to a shared crossbar network through which data is transferred between processing units and the smaller caches, a dedicated connection is…
