Three-dimensional (3D) pose estimation from a monocular camera
Granted: November 1, 2022
Patent Number:
11488418
Estimating a three-dimensional (3D) pose of an object, such as a hand or body (human, animal, robot, etc.), from a 2D image is necessary for human-computer interaction. A hand pose can be represented by a set of points in 3D space, called keypoints. Two coordinates (x,y) represent spatial displacement and a third coordinate represents a depth of every point with respect to the camera. A monocular camera is used to capture an image of the 3D pose, but does not capture depth information. A…
Neural network based facial analysis using facial landmarks and associated confidence values
Granted: November 1, 2022
Patent Number:
11487968
Systems and methods for more accurate and robust determination of subject characteristics from an image of the subject. One or more machine learning models receive as input an image of a subject, and output both facial landmarks and associated confidence values. Confidence values represent the degrees to which portions of the subject's face corresponding to those landmarks are occluded, i.e., the amount of uncertainty in the position of each landmark location. These landmark points and…
Simulating a cable driven system representative of a robot
Granted: November 1, 2022
Patent Number:
11487919
A cable driving a large system such as cable driven machines, cable cars or tendons in a human or robot is typically modeled as a large number of small segments that are connected via joints. The two main difficulties with this model are satisfying the inextensibility constraint and handling the typically large mass ratio between the segments and the objects they connect. This disclosure introduces an effective approach to solving these problems. The introduced approach simulates the…
Fault buffer for tracking page faults in unified virtual memory system
Granted: November 1, 2022
Patent Number:
11487673
A system for managing virtual memory. The system includes a first processing unit configured to execute a first operation that references a first virtual memory address. The system also includes a first memory management unit (MMU) associated with the first processing unit and configured to generate a first page fault upon determining that a first page table that is stored in a first memory unit associated with the first processing unit does not include a mapping corresponding to the…
Volume control for audio and video conferencing applications
Granted: November 1, 2022
Patent Number:
11487498
In various examples, when a local user initiates an instance of a video conference application, the user may be provided with a user interface (UI) that displays an icon corresponding to the user as well as several other icons corresponding to participants in the instance of the video conference application. As the users converse, the local user may find that a particular participant is speaking loudly compared to the other remote users. The local user may then select an icon…
Techniques for configuring a processor to execute instructions efficiently
Granted: November 1, 2022
Patent Number:
11487341
Systems and techniques for improving the performance of circuits while adapting to dynamic voltage drops caused by the execution of noisy instructions (e.g. high power consuming instructions) are provided. The performance is improved by slowing down the frequency of operation selectively for types of noisy instructions. An example technique controls a clock by detecting an instruction of a predetermined noisy type that is predicted to have a predefined noise characteristic (e.g. a high…
In-cabin hazard prevention and safety control system for autonomous machine applications
Granted: November 1, 2022
Patent Number:
11485308
In various examples, systems and methods are disclosed that accurately identify driver and passenger in-cabin activities that may indicate a biomechanical distraction that prevents a driver from being fully engaged in driving a vehicle. In particular, image data representative of an image of an occupant of a vehicle may be applied to one or more deep neural networks (DNNs). Using the DNNs, data indicative of key point locations corresponding to the occupant may be computed, a shape…
Directing board repositioning during sensor calibration for autonomous vehicles
Granted: October 25, 2022
Patent Number:
11482008
According to an aspect of an embodiment, operations may comprise determining a target position and orientation for a calibration board with respect to a camera of a vehicle, detecting a first position and orientation of the calibration board with respect to the camera of the vehicle, determining instructions for moving the calibration board from the first position and orientation to the target position and orientation, transmitting the instructions to a device, detecting a second…
Real-time hardware-assisted GPU tuning using machine learning
Granted: October 25, 2022
Patent Number:
11481950
Graphics processing unit (GPU) performance and power efficiency is improved using machine learning to tune operating parameters based on performance monitor values and application information. Performance monitor values are processed using machine learning techniques to generate model parameters, which are used by a control unit within the GPU to provide real-time updates to the operating parameters. In one embodiment, a neural network processes the performance monitor values to generate…
Clock data recovery convergence in modulated partial response systems
Granted: October 18, 2022
Patent Number:
11477004
A clock data recovery circuit detects illegal decisions for received data, accumulates a phase gradient for the data, determines a number of the illegal decisions in a configured window for receiving the data, and if the number of the illegal decisions exceeds a pre-defend number in the window, applies a sum of the accumulated phase gradient and a phase increment having a sign of the accumulated phase gradient to a clock circuit for the data receiver.
Glitch-free multiplexer
Granted: October 18, 2022
Patent Number:
11476852
When a signal glitches, logic receiving the signal may change in response, thereby charging and/or discharging nodes within the logic and dissipating power. Providing a glitch-free signal may reduce the number of times the nodes are charged and/or discharged, thereby reducing the power dissipation. A technique for eliminating glitches in a signal is to insert a storage element that samples the signal after it is done changing to produce a glitch-free output signal. The storage element is…
High dynamic range image generation from tone mapped standard dynamic range images
Granted: October 18, 2022
Patent Number:
11475549
High dynamic range (HDR) support is provided for legacy application programs, such as games that are configured to display standard dynamic range (SDR) frames. HDR frames may be generated without modifying the legacy application program. The buffer creation process of the legacy application program is intercepted and modified before creation of the SDR format buffer so that the buffer is configured to use an upgraded SDR format having an increased bit depth compared with a conventional…
Neural network system with temporal feedback for adaptive sampling and denoising of rendered sequences
Granted: October 18, 2022
Patent Number:
11475542
A neural network-based rendering technique increases temporal stability and image fidelity of low sample count path tracing by optimizing a distribution of samples for rendering each image in a sequence. A sample predictor neural network learns spatio-temporal sampling strategies such as placing more samples in dis-occluded regions and tracking specular highlights. Temporal feedback enables a denoiser neural network to boost the effective input sample count and increases temporal…
Techniques for storing data to enhance recovery and detection of data corruption errors
Granted: October 18, 2022
Patent Number:
11474897
Often there are errors when reading data from computer memory. To detect and correct these errors, there are multiple types of error correction codes. Disclosed is an error correction architecture that creates a codeword having a data portion and an error correction code portion. Swizzling rearranges the order of bits and distributes the bits among different codewords. Because the data is redistributed, a potential memory error of up to N contiguous bits, where N for example equals 2…
Application-specific memory scaling in multi-device systems
Granted: October 18, 2022
Patent Number:
11474710
One aspect of the current disclosure provides a method for utilizing a plurality of memories associated with a plurality of devices in a computer system. The method includes: receiving an application-specific data set for executing a ray tracing application employing the devices; determining whether the data set is fully replicable in each memory; when the data set is not fully replicable in any of the memories, determining a maximum amount of the data set that is replicable in each…
Systems and methods for computer-assisted shuttles, buses, robo-taxis, ride-sharing and on-demand vehicles with situational awareness
Granted: October 18, 2022
Patent Number:
11474519
A system and method for an on-demand shuttle, bus, or taxi service able to operate on private and public roads provides situational awareness and confidence displays. The shuttle may include ISO 26262 Level 4 or Level 5 functionality and can vary the route dynamically on-demand, and/or follow a predefined route or virtual rail. The shuttle is able to stop at any predetermined station along the route. The system allows passengers to request rides and interact with the system via a variety…
Leveraging multidimensional sensor data for computationally efficient object detection for autonomous machine applications
Granted: October 11, 2022
Patent Number:
11468582
In various examples, a two-dimensional (2D) and three-dimensional (3D) deep neural network (DNN) is implemented to fuse 2D and 3D object detection results for classifying objects. For example, regions of interest (ROIs) and/or bounding shapes corresponding thereto may be determined using one or more region proposal networks (RPNs)—such as an image-based RPN and/or a depth-based RPN. Each ROI may be extended into a frustum in 3D world-space, and a point cloud may be filtered to include…
Scalable light-weight protocols for wire-speed packet ordering
Granted: October 11, 2022
Patent Number:
11470394
A communication method between a source device and a target device utilizes speculative connection setup between the source device and the target device, target-device-side packet ordering, and fine-grained ordering to remove packet dependencies.
Automatic video montage generation
Granted: October 11, 2022
Patent Number:
11468915
In various examples, users may access a tool that automatically generates video montages from video clips of the user's gameplay according to parameterized recipes. As a result, a user may select—or allow the system to select—clips corresponding to gameplay of the user and customize one or more parameters (e.g., transitions, music, audio, graphics, etc.) of a recipe, and a video montage may be generated automatically according to a montage script output using the recipe. As such, a…
Rendering scenes using a combination of raytracing and rasterization
Granted: October 11, 2022
Patent Number:
11468630
The disclosure provides a cloud-based renderer and methods of rendering a scene on a computing system using a combination of raytracing and rasterization. In one example, a method of rendering a scene includes: (1) generating at least one raytracing acceleration structure from scene data of the scene, (2) selecting raytracing and rasterization algorithms for rendering the scene based on the scene data, and (3) rendering the scene utilizing a combination of the raytracing algorithms and…
