Intersection region detection and classification for autonomous machine applications
Granted: March 12, 2024
Patent Number:
11928822
In various examples, live perception from sensors of a vehicle may be leveraged to detect and classify intersection contention areas in an environment of a vehicle in real-time or near real-time. For example, a deep neural network (DNN) may be trained to compute outputs—such as signed distance functions—that may correspond to locations of boundaries delineating intersection contention areas. The signed distance functions may be decoded and/or post-processed to determine instance…
Method for forward progress and programmable timeouts of tree traversal mechanisms in hardware
Granted: March 12, 2024
Patent Number:
11928772
In a ray tracer, to prevent any long-running query from hanging the graphics processing unit, a traversal coprocessor provides a preemption mechanism that will allow rays to stop processing or time out early. The example non-limiting implementations described herein provide such a preemption mechanism, including a forward progress guarantee, and additional programmable timeout options that can be time or cycle based. Those programmable options provide a means for quality of service…
Neural network motion controller
Granted: March 12, 2024
Patent Number:
11928764
Apparatuses, systems, and techniques to animate objects in computer-generated graphics. In at least one embodiment, one or more neural networks are trained to identify one or more forces to be applied to one or more objects based, at least in part, on training data corresponding to two or more aspects of motion of the one or more objects.
Simulating realistic test data from transformed real-world sensor data for autonomous machine applications
Granted: March 12, 2024
Patent Number:
11927502
In various examples, sensor data recorded in the real-world may be leveraged to generate transformed, additional, sensor data to test one or more functions of a vehicle—such as a function of an AEB, CMW, LDW, ALC, or ACC system. Sensor data recorded by the sensors may be augmented, transformed, or otherwise updated to represent sensor data corresponding to state information defined by a simulation test profile for testing the vehicle function(s). Once a set of test data has been…
Using map-based constraints for determining vehicle state
Granted: March 12, 2024
Patent Number:
11927449
According to an aspect of an embodiment, operations may comprise receiving an approximate geographic location of a vehicle, accessing a map of a region within which the approximate geographic location of the vehicle is located, identifying a first region on the map within a first threshold distance of the approximate geographic location of the vehicle, identifying a second region on the map associated with one or more roads on the map, determining a search space on the map within which…
Behavior planning for autonomous vehicles in yield scenarios
Granted: March 12, 2024
Patent Number:
11926346
In various examples, a yield scenario may be identified for a first vehicle. A wait element is received that encodes a first path for the first vehicle to traverse a yield area and a second path for a second vehicle to traverse the yield area. The first path is employed to determine a first trajectory in the yield area for the first vehicle based at least on a first location of the first vehicle at a time and the second path is employed to determine a second trajectory in the yield area…
Projective hash maps
Granted: March 12, 2024
Patent Number:
11925860
This application discloses techniques for generating and querying projective hash maps. More specifically, projective hash maps can be used for spatial hashing of data related to N-dimensional points. Each point is projected onto a projection surface to convert the three-dimensional (3D) coordinates for the point to two-dimensional (2D) coordinates associated with the projection surface. Hash values based on the 2D coordinates are then used as an index to store data in the projective…
Finite aperture omni-directional stereo light transport
Granted: March 5, 2024
Patent Number:
11922568
In various embodiments, a finite aperture omni-directional camera is modeled by aligning a finite aperture lens and focal point with the omni-directional part of the projection. For example, each point on an image plane maps to a direction in camera space. For a spherical projection, the lens can be orientated along this direction and the focal point is picked along this direction at focal distance from the lens. For a cylindrical projection, the lens can be oriented along the projected…
Circuit structures to measure flip-flop timing characteristics
Granted: March 5, 2024
Patent Number:
11923853
A ring oscillator circuit with a frequency that is sensitive to the timing of a clock-to-Q (clk2Q) propagation delay of one or more flip-flops utilized in the ring oscillator. The clock2Q is the delay between the clock signal arriving at the clock pin on the flop and the Q output reflecting the state of the input data signal to the flop. Clk2q delay measurements are made based on measurement of the ring oscillator frequency, leading to more accurate estimates of clk2Q for different types…
3D surface structure estimation using neural networks for autonomous systems and applications
Granted: March 5, 2024
Patent Number:
11922571
In various examples, to support training a deep neural network (DNN) to predict a dense representation of a 3D surface structure of interest, a training dataset is generated using a parametric mathematical modeling. A variety of synthetic 3D road surfaces may be generated by modeling a 3D road surface using varied parameters to simulate changes in road direction and lateral surface slope. In an example embodiment, a synthetic 3D road surface may be created by modeling a longitudinal 3D…
Asynchronous lighting for image illumination
Granted: March 5, 2024
Patent Number:
11922567
The present invention facilitates efficient and effective image processing. A network can comprise: a first system configured to perform a first portion of lighting calculations for an image and combing results of the first portion of lighting calculations for the image with results of a second portion of lighting calculations; and a second system configured to perform the second portion of lighting calculations and forward the results of the second portion of the lighting calculations…
Hybrid differentiable rendering for light transport simulation systems and applications
Granted: March 5, 2024
Patent Number:
11922558
In various examples, information may be received for a 3D model, such as 3D geometry information, lighting information, and material information. A machine learning model may be trained to disentangle the 3D geometry information, the lighting information, and/or material information from input data to provide the information, which may be used to project geometry of the 3D model onto an image plane to generate a mapping between pixels and portions of the 3D model. Rasterization may then…
Ray-traced light resampling using screen space visibility
Granted: March 5, 2024
Patent Number:
11922556
Apparatuses, systems, and techniques to render images. In at least one embodiment, at least one visibility parameter determined for a first image region is reused for a different second image region that neighbors the first image region (e.g., spatially and/or temporally).
Dynamically reducing latency in processing pipelines
Granted: March 5, 2024
Patent Number:
11922533
A weighted average execution time associated with each execution stage of a plurality of execution stages used to process a plurality of frames in parallel is obtained. The processing of each of the plurality of frames is performed at each of the plurality of execution stages in a sequential order, starting with an initial execution stage and continuing with each subsequent execution stage. A first largest weighted average execution time associated with one of the plurality of execution…
User interfaces and methods for generating a new artifact based on existing artifacts
Granted: March 5, 2024
Patent Number:
11921997
User interfaces and methods are disclosed. In some embodiments, a plurality of source artifacts is displayed. A selector is operable to indicate a selected set of the source artifacts. An output artifact is displayed having an output attribute that represents a combination of source attributes from the source artifacts in the selected set. An amount of contribution to the first output attribute by respective ones of the source artifacts in the first selected set is based on a coordinate…
Regression-based line detection for autonomous driving machines
Granted: March 5, 2024
Patent Number:
11921502
In various examples, systems and methods are disclosed that preserve rich spatial information from an input resolution of a machine learning model to regress on lines in an input image. The machine learning model may be trained to predict, in deployment, distances for each pixel of the input image at an input resolution to a line pixel determined to correspond to a line in the input image. The machine learning model may further be trained to predict angles and label classes of the line.…
Using touch sensing to make a trackball behave like a joystick
Granted: March 5, 2024
Patent Number:
11918890
While one type of input, either a mouse input or a joystick input, may be preferred for one type of a game, it may not be preferred, or even compatible, for another type of a game. Introduced herein is a game controller that employs a dedicated input, which is capable of the absolute accuracy of a mouse input or trackball input, but is also capable of measuring how far off center the input is (e.g., how far off center it has moved), and can also return to center when released, as is…
Leveraging multidimensional sensor data for computationally efficient object detection for autonomous machine applications
Granted: February 27, 2024
Patent Number:
11915145
In various examples, a two-dimensional (2D) and three-dimensional (3D) deep neural network (DNN) is implemented to fuse 2D and 3D object detection results for classifying objects. For example, regions of interest (ROIs) and/or bounding shapes corresponding thereto may be determined using one or more region proposal networks (RPNs)—such as an image-based RPN and/or a depth-based RPN. Each ROI may be extended into a frustum in 3D world-space, and a point cloud may be filtered to include…
Image signal processing pipelines for high dynamic range sensors
Granted: February 27, 2024
Patent Number:
11917307
A method of decompression includes decompressing a compressed image according to a power curve to generate a partially decompressed image, wherein the compressed image is decompressed from a second bit depth that is lower than a first bit-depth at which the image was generated.
Multi-view deep neural network for LiDAR perception
Granted: February 27, 2024
Patent Number:
11915493
A deep neural network(s) (DNN) may be used to detect objects from sensor data of a three dimensional (3D) environment. For example, a multi-view perception DNN may include multiple constituent DNNs or stages chained together that sequentially process different views of the 3D environment. An example DNN may include a first stage that performs class segmentation in a first view (e.g., perspective view) and a second stage that performs class segmentation and/or regresses instance geometry…
