Performance of ray-traced shadow creation within a scene
Granted: December 19, 2023
Patent Number:
11847733
A ray (e.g., a traced path of light, etc.) is generated from an originating pixel within a scene being rendered. Additionally, one or more shadow map lookups are performed for the originating pixel to estimate an intersection of the ray with alpha-tested geometry within the scene. A shadow map stores the distance of geometry as seen from the point of view of the light, and alpha-tested geometry includes objects within the scene being rendered that have a determined texture and opacity.…
Sparse convolutional neural network accelerator
Granted: December 19, 2023
Patent Number:
11847550
A method, computer program product, and system perform computations using a processor. A first instruction including a first index vector operand and a second index vector operand is received and the first index vector operand is decoded to produce first coordinate sets for a first array, each first coordinate set including at least a first coordinate and a second coordinate of a position of a non-zero element in the first array. The second index vector operand is decoded to produce…
Differential privacy dataset generation using generative models
Granted: December 19, 2023
Patent Number:
11847538
Apparatuses, systems, and techniques to train a generative model based at least in part on a private dataset. In at least one embodiment, the generative model is trained based at least in part on a differentially private Sinkhorn algorithm, for example, using backpropagation with gradient descent to determine a gradient of a set of parameters of the generative models and modifying the set of parameters based at least in part on the gradient.
Convergence among concurrently executing threads
Granted: December 19, 2023
Patent Number:
11847508
Convergence of threads executing common code sections is facilitated using instructions inserted at strategic locations in computer code sections. The inserted instructions enable the threads in a warp or other group to cooperate with a thread scheduler to promote thread convergence.
Occupancy map updates based on sensor data collected by autonomous vehicles
Granted: December 12, 2023
Patent Number:
11842528
An online system builds a high definition (HD) map for a geographical region based on sensor data captured by a plurality of autonomous vehicles driving through a geographical region. The autonomous vehicles detect map discrepancies based on differences in the surroundings observed using sensor data compared to the high definition map and send messages describing these map discrepancies to the online system. The online system updates existing occupancy maps to improve the accuracy of the…
Landmark location reconstruction in autonomous machine applications
Granted: December 12, 2023
Patent Number:
11842440
In various examples, locations of directional landmarks, such as vertical landmarks, may be identified using 3D reconstruction. A set of observations of directional landmarks (e.g., images captured from a moving vehicle) may be reduced to 1D lookups by rectifying the observations to align directional landmarks along a particular direction of the observations. Object detection may be applied, and corresponding 1D lookups may be generated to represent the presence of a detected vertical…
Loss-scaling for deep neural network training with reduced precision
Granted: December 12, 2023
Patent Number:
11842280
In training a deep neural network using reduced precision, gradient computation operates on larger values without affecting the rest of the training procedure. One technique trains the deep neural network to develop loss, scales the loss, computes gradients at a reduced precision, and reduces the magnitude of the computed gradients to compensate for scaling of the loss. In one example non-limiting arrangement, the training forward pass scales a loss value by some factor S and the weight…
Gaze determination using glare as input
Granted: December 12, 2023
Patent Number:
11841987
Machine learning systems and methods that learn glare, and thus determine gaze direction in a manner more resilient to the effects of glare on input images. The machine learning systems have an isolated representation of glare, e.g., information on the locations of glare points in an image, as an explicit input, in addition to the image itself. In this manner, the machine learning systems explicitly consider glare while making a determination of gaze direction, thus producing more…
Domain restriction of neural networks through synthetic data pre-training
Granted: December 12, 2023
Patent Number:
11841458
A neural network is trained to focus on a domain of interest. For example, in a pre-training phase, the neural network in trained using synthetic training data, which is configured to omit or limit content less relevant to the domain of interest, by updating parameters of the neural network to improve the accuracy of predictions. In a subsequent training phase, the pre-trained neural network is trained using real-world training data by updating only a first subset of the parameters…
Multi-view geometry-based hazard detection for autonomous systems and applications
Granted: December 12, 2023
Patent Number:
11840238
In various examples, systems and methods are disclosed that detect hazards on a roadway by identifying discontinuities between pixels on a depth map. For example, two synchronized stereo cameras mounted on an ego-machine may generate images that may be used extract depth or disparity information. Because a hazard's height may cause an occlusion of the driving surface behind the hazard from a perspective of a camera(s), a discontinuity in disparity values may indicate the presence of a…
Parallel selection of fifth generation (5G) new radio information
Granted: December 5, 2023
Patent Number:
11838126
Apparatuses, systems, and techniques to select fifth-generation (5G) new radio data. In at least one embodiment, a processor includes one or more circuits to select 5G new radio signal information in parallel.
Motion vector optimization for multiple refractive and reflective interfaces
Granted: December 5, 2023
Patent Number:
11836844
Systems and methods relate to the determination of accurate motion vectors, for rendering situations such as a noisy Monte Carlo integration where image object surfaces are at least partially translucent. To optimize the search for “real world” positions, this invention defines the background as first path vertices visible through multiple layers of refractive interfaces. To find matching world positions, the background is treated as a single layer morphing in a chaotic way,…
Generating augmented sensor data for testing operational capability in deployed environments
Granted: December 5, 2023
Patent Number:
11836645
In various examples, performance capabilities of a consumer—such as inference rates of a neural network executing on underlying hardware—may be tested or demonstrated for producers that have lower production rates than consumption rates of the consumer. For example, augmented data instances may be leveraged to augment production data from the producer in order to increase a frequency of transmission of data instances to a consumer. As a result, a data set including additional or…
Detecting visual artifacts in image sequences using a neural network model
Granted: December 5, 2023
Patent Number:
11836597
Motivated by the ability of humans to quickly and accurately detect visual artifacts in images, a neural network model is trained to identify and locate visual artifacts in a sequence of rendered images without comparing the sequence of rendered images against a ground truth reference. Examples of visual artifacts include aliasing, blurriness, mosaicking, and overexposure. The neural network model provides a useful fully-automated tool for evaluating the quality of images produced by…
Accelerating table lookups using a decoupled lookup table accelerator in a system on a chip
Granted: December 5, 2023
Patent Number:
11836527
In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups,…
Kernel coefficient quantization
Granted: December 5, 2023
Patent Number:
11836490
Apparatuses, systems, and techniques to optimize memory usage when performing matrix operations. In at least one embodiment, a matrix is optimized to limit memory and storage requirements while minimizing loss of precision for a sum of the members of the matrix.
Implementing compiler-based memory safety for a graphic processing unit
Granted: December 5, 2023
Patent Number:
11836361
While a compiler compiles source code to create an executable binary, code is added into the compiled source code that, when executed, identifies and stores in a metadata table base and bounds information associated with memory allocations. Additionally, additional code is added into the compiled source code that performs memory safety checks during execution. This updated compiled source code automatically determines a safety of memory access requests during execution by performing an…
Camera based localization for autonomous vehicles
Granted: December 5, 2023
Patent Number:
11835357
Camera based localization performed to determine a current pose of an autonomous vehicle without the aid of depth sensors such as LiDAR. The vehicle comprises an imaging system configured to capture image frames depicting portions of the surrounding area. Based on an initial pose of the vehicle, edgels corresponding to three-dimensional locations are loaded and mapped to corresponding edge pixels of the captured image frame. A pose of the vehicle is optimized based upon the determined…
Calibration of inertial measurement units of vehicles using localization
Granted: December 5, 2023
Patent Number:
11835342
Operations of the present disclosure include obtaining a first measure of velocity of a vehicle based on a plurality of locations determined for the vehicle. The operations also include obtaining, based on IMU measurements of an inertial measurement unit (IMU) of the vehicle, a second measure of velocity of the vehicle. In addition, the operations include performing calibration of the IMU based on the first measure of velocity and the second measure of velocity.
Robotic control system
Granted: December 5, 2023
Patent Number:
11833681
In at least one embodiment, under the control of a robotic control system, a gripper on a robot is positioned to grasp a 3-dimensional object. In at least one embodiment, the relative position of the object and the gripper is determined, at least in part, by using a camera mounted on the gripper.
