Nvidia Patent Grants

Application partitioning for locality in a stacked memory system

Granted: September 24, 2024
Patent Number: 12099453
Embodiments of the present disclosure relate to application partitioning for locality in a stacked memory system. In an embodiment, one or more memory dies are stacked on the processor die. The processor die includes multiple processing tiles and each memory die includes multiple memory tiles. Vertically aligned memory tiles are directly coupled to and comprise the local memory block for a corresponding processing tile. An application program that operates on dense multi-dimensional…

Performing load and store operations of 2D arrays in a single cycle in a system on a chip

Granted: September 24, 2024
Patent Number: 12099439
In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups,…

System and methods for hardware-software cooperative pipeline error detection

Granted: September 24, 2024
Patent Number: 12099407
An error reporting system utilizes a parity checker to receive data results from execution of an original instruction and a parity bit for the data. A decoder receives an error correcting code (ECC) for data resulting from execution of a shadow instruction of the original instruction, and data error correction is initiated on the original instruction result on condition of a mismatch between the parity bit and the original instruction result, and the decoder asserting a correctable error…

Holographic virtual reality display

Granted: September 17, 2024
Patent Number: 12092820
Virtual reality (VR) displays are computer displays that present images or video in a manner that simulates a real experience for the viewer. In many cases, VR displays are implemented as head-mounted displays (HMDs) which provide a display in the line of sight of the user. Because current HMDs are composed of a display panel and magnifying lens with a gap therebetween, proper functioning of the HMDs limits their design to a box-like form factor, thereby negatively impacting both comfort…

Genetic mutation detection using deep learning

Granted: September 17, 2024
Patent Number: 12094572
The present disclosure provides methods, systems, and computer program products that use deep learning models to classify candidate mutations detected in sequencing data, particularly suboptimal sequencing data. The methods, systems, and programs provide for increased efficiency, accuracy, and speed in identifying mutations from a wide range of sequencing data.

Distance to obstacle detection in autonomous machine applications

Granted: September 17, 2024
Patent Number: 12093824
In various examples, a deep neural network (DNN) is trained to accurately predict, in deployment, distances to objects and obstacles using image data alone. The DNN may be trained with ground truth data that is generated and encoded using sensor data from any number of depth predicting sensors, such as, without limitation, RADAR sensors, LIDAR sensors, and/or SONAR sensors. Camera adaptation algorithms may be used in various embodiments to adapt the DNN for use with image data generated…

Automatic population of boot volumes via provided URLs

Granted: September 17, 2024
Patent Number: 12093699
A storage system (400) includes a storage processor (420-1) such as a storage card resident in a host server (410-1) and coupled to the storage device (450-1). The storage processor (420-1) may be configured to create a virtual volume (428-1), store content derived from an image (492) downloaded from a URL storage corresponding to the virtual volume (428-1), and present the virtual volume (428-1) to the host server as a boot LUN. A management infrastructure (480) can be used to create a…

Using per memory bank load caches for reducing power use in a system on a chip

Granted: September 17, 2024
Patent Number: 12093539
In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups,…

Streaming batcher for collecting work packets as remote descriptors

Granted: September 17, 2024
Patent Number: 12093209
Technologies for batching remote descriptors of serialized objects in streaming pipelines are described. One method of a first computing device generates a streaming batch of remote descriptors. Each remote descriptor uniquely identifies a contiguous block of a serialized object. The first computing device sends at least one of the remote descriptors to a second computing device before the streaming batch is completed. At least some contents of a contiguous block are obtained for storage…

Remote descriptor to enable remote direct memory access (RDMA) transport of a serialized object

Granted: September 17, 2024
Patent Number: 12093208
Technologies for enabling remote direct memory access (RDMA) transport of serialized objects in streaming pipelines are described. One method of a first computing device that stores a serialized object in a first memory can generate a remote descriptor associated with the serialized object. The remote descriptor uniquely identifies the location of the serialized object and a reference count token. The first computing device sends the remote descriptor to a second computing device in the…

Encoding LiDAR scanned data for generating high definition maps for autonomous vehicles

Granted: September 17, 2024
Patent Number: 12092742
Embodiments relate to methods for efficiently encoding sensor data captured by an autonomous vehicle and building a high definition map using the encoded sensor data. The sensor data can be LiDAR data which is expressed as multiple image representations. Image representations that include important LiDAR data undergo a lossless compression while image representations that include LiDAR data that is more error-tolerant undergo a lossy compression. Therefore, the compressed sensor data can…

Integrated server flow-through fixture with state sensor for datacenter cooling systems

Granted: September 10, 2024
Patent Number: 12089378
Systems and methods for cooling a datacenter are disclosed. In at least one embodiment, a server tray or box includes a surface with a flow-through fixture or manifold that extends on both sides of the surface, that includes an inward coupling, an outward coupling, a flow controller, and a state sensor, the state sensor to monitor a flow-through fixture or manifold, where a flow controller of a flow-through fixture or manifold can change a flow of a coolant through a flow-through fixture…

Determining associations between objects and persons using machine learning models

Granted: September 10, 2024
Patent Number: 12087077
In various examples, sensor data—such as masked sensor data—may be used as input to a machine learning model to determine a confidence for object to person associations. The masked sensor data may focus the machine learning model on particular regions of the image that correspond to persons, objects, or some combination thereof. In some embodiments, coordinates corresponding to persons, objects, or combinations thereof, in addition to area ratios between various regions of the image…

Measuring the effects of augmentation artifacts on a machine learning network

Granted: September 10, 2024
Patent Number: 12086208
In various examples, sets of testing data may be selected and applied to an MLM such that differences in performance of the MLM in the testing between the sets indicates and may be used to determine whether and/or an extent by which the MLM is trained to rely on artifacts. Training data for the MLM may be generated using a first value of a parameter that defines a value of a characteristic of the training data. For testing, first testing data may be selected that corresponds to a second…

Remote promise and remote future for downstream components to update upstream states

Granted: September 10, 2024
Patent Number: 12086095
Technologies for enabling downstream components to update upstream states in streaming pipelines are described. One method of a first computing device receives a remote promise object assigned to a first serialized object from a second computing device in the data center over a network fabric. The remote promise object uniquely identifies a first contiguous block of the first serialized object stored in a memory associated with the second computing device. The method obtains contents of…

Efficient safety aware path selection and planning for autonomous machine applications

Granted: September 3, 2024
Patent Number: 12077190
In various examples, systems and methods are disclosed for weighting one or more optional paths based on obstacle avoidance or other safety considerations. In some embodiments, the obstacle avoidance considerations may be computed using a comparison of trajectories representative of safety procedures at present and future projected time steps of an ego-vehicle and other actors to ensure that each actor is capable of implementing their respective safety procedure while avoiding collisions…

Intelligent in-rack pump or compressor unit for datacenter cooling systems

Granted: September 3, 2024
Patent Number: 12082382
Systems and methods for cooling a datacenter are disclosed. In at least one embodiment, a control unit within a rack has a pump or compressor unit to cause two-phase fluid to circulate through a cold plate associated with a computing device and to circulate through a heat exchanger associated with a rear door of a rack, so as to dissipate heat from a computing device through a heat exchanger by a control unit within a rack.

Dynamically reducing stutter and latency in video streaming applications

Granted: September 3, 2024
Patent Number: 12081812
A performance metrics of a receiver is obtained using frames of an application hosted by a server that are received via a network. The one or more performance metrics include information indicative of a current occupancy of a frame buffer corresponding to the receiver and information indicative of a target occupancy of the frame buffer corresponding to the receiver. The frame buffer of the receiver is used to queue frames of the application for display. A frame rate associated with…

Fast clock detection

Granted: September 3, 2024
Patent Number: 12079028
Methods and structures are described for detecting clock anomalies, including anomalies in which the clock oscillates at a faster than expected rate or exhibits a shorter than expected clock phase instance. Example methods include starting a timer responsive to the start of a clock phase, wherein the timer duration is shorter than an expected duration of the clock phase. If the clock phase ends before the timer expires, a fast clock detection signal is asserted. Example structures…

In system test of chips in functional systems

Granted: September 3, 2024
Patent Number: 12078678
Manufacturers perform tests on chips before the chips are shipped to customers. However, defects can occur on a chip after the manufacturer testing and when the chips are used in a system or device. The defects can occur due to aging or the environment in which the chip is employed and can be critical; especially when the chips are used in systems such as autonomous vehicles. To verify the structural integrity of the IC during the lifetime of the product, an in-system test (IST) is…