Neural network system with temporal feedback for denoising of rendered sequences
Granted: January 17, 2023
Patent Number:
11557022
A neural network-based rendering technique increases temporal stability and image fidelity of low sample count path tracing by optimizing a distribution of samples for rendering each image in a sequence. A sample predictor neural network learns spatio-temporal sampling strategies such as placing more samples in dis-occluded regions and tracking specular highlights. Temporal feedback enables a denoiser neural network to boost the effective input sample count and increases temporal…
Implementing specialized instructions for accelerating Smith-Waterman sequence alignments
Granted: January 10, 2023
Patent Number:
11550584
Various techniques for accelerating Smith-Waterman sequence alignments are provided. For example, threads in a group of threads are employed to use an interleaved cell layout to store relevant data in registers while computing sub-alignment data for one or more local alignment problems. In another example, specialized instructions that reduce the number of cycles required to compute each sub-alignment score are utilized. In another example, threads are employed to compute sub-alignment…
Adversarial scenarios for safety testing of autonomous vehicles
Granted: January 10, 2023
Patent Number:
11550325
Techniques to generate driving scenarios for autonomous vehicles characterize a path in a driving scenario according to metrics such as narrowness and effort. Nodes of the path are assigned a time for action to avoid collision from the node. The generated scenarios may be simulated in a computer.
View synthesis for dynamic scenes
Granted: January 3, 2023
Patent Number:
11546568
Apparatuses, systems, and techniques are presented to perform monocular view synthesis of a dynamic scene. Single and multi-view depth information can be determined for a collection of images of a dynamic scene, and a blender network can be used to combine image features for foreground, background, and missing image regions using fused depth maps inferred form the single and multi-view depth information.
Interlocked redistribution layer interface for flip-chip integrated circuits
Granted: January 3, 2023
Patent Number:
11545450
This disclosure provides an integrated circuit device that includes a RDL that is interlocked with a bump (or “pillar”). The interlocked interface provides the contact RDL-bump interface with increased structural stability that can better withstand the thermal stresses associated with high performance devices IC devices. The interlock structure mitigates crack/delamination that occurs at the RDL-bump interface in large IC chips that are generally subjected to higher stresses during…
Enhancing high-resolution images with data from low-resolution images
Granted: January 3, 2023
Patent Number:
11544818
Users often desire to capture certain images from an application. Existing methods of capturing images can result in low-resolution images due to limitations of the display device providing the images. This disclosure provides a method of capturing higher resolution images from source images. Techniques are also disclosed to reduce the storage size associated with the higher resolution images. Through capturing low-resolution versions of the same source images, image effects can be…
Quickly suspending and resuming applications running on a cloud server
Granted: January 3, 2023
Patent Number:
11541309
Many times, users play games to certain places in the game and decide to save the game and resume it later. When users resume the game, they have to wait for it to load, wade through menus to select the saved game, and wait again for the game to resume. The introduced technique directly suspends and resume games that are rendered on a cloud server based on user initiated suspend and resume control commands. As the games are directly suspended and resumed, the users can skip past menu and…
Projecting images captured using fisheye lenses for feature detection in autonomous machine applications
Granted: December 27, 2022
Patent Number:
11538231
In various examples, sensor data may be adjusted to represent a virtual field of view different from an actual field of view of the sensor, and the sensor data—with or without virtual adjustment—may be applied to a stereographic projection algorithm to generate a projected image. The projected image may then be applied to a machine learning model—such as a deep neural network (DNN)—to detect and/or classify features or objects represented therein.
Determining drivable free-space for autonomous vehicles
Granted: December 27, 2022
Patent Number:
11537139
In various examples, sensor data may be received that represents a field of view of a sensor of a vehicle located in a physical environment. The sensor data may be applied to a machine learning model that computes both a set of boundary points that correspond to a boundary dividing drivable free-space from non-drivable space in the physical environment and class labels for boundary points of the set of boundary points that correspond to the boundary. Locations within the physical…
Multi-view deep neural network for LiDAR perception
Granted: December 20, 2022
Patent Number:
11532168
A deep neural network(s) (DNN) may be used to detect objects from sensor data of a three dimensional (3D) environment. For example, a multi-view perception DNN may include multiple constituent DNNs or stages chained together that sequentially process different views of the 3D environment. An example DNN may include a first stage that performs class segmentation in a first view (e.g., perspective view) and a second stage that performs class segmentation and/or regresses instance geometry…
Deep neural network for detecting obstacle instances using radar sensors in autonomous machine applications
Granted: December 20, 2022
Patent Number:
11531088
In various examples, a deep neural network(s) (e.g., a convolutional neural network) may be trained to detect moving and stationary obstacles from RADAR data of a three dimensional (3D) space. In some embodiments, ground truth training data for the neural network(s) may be generated from LIDAR data. More specifically, a scene may be observed with RADAR and LIDAR sensors to collect RADAR data and LIDAR data for a particular time slice. The RADAR data may be used for input training data,…
Controlling test networks of chips using integrated processors
Granted: December 13, 2022
Patent Number:
11526644
The disclosure provides using test processors to provide a more flexible solution compared to the existing DFX blocks that are used for controlling test networks in chips. The test processors provide a highly flexible solution since programming of the test processors can be changed at any time; even after manufacturing, and can support practically an unlimited number of core chips in any configuration. The high flexibility provided via the test processors can reduce engineering effort…
Shroud for an integrated circuit heat exchanger
Granted: December 6, 2022
Patent Number:
11523539
A protective shroud includes a top plate, a first side plate that is adapted to be disposed proximate a first edge region of a plurality of cooling fins of a heat exchanger for an integrated circuit, and a second side plate that is adapted to be disposed proximate a second edge region of the plurality of cooling fins.
Packed error correction code (ECC) for compressed data protection
Granted: December 6, 2022
Patent Number:
11522565
A packed error correction code (ECC) technique opportunistically embeds ECC check-bits with compressed data. When compressed, the data is encoded in fewer bits and is therefore fragmented when stored or transmitted compared with the uncompressed data. The ECC check-bits may be packed with compressed data at “source” points. The check-bits are transmitted along with the compressed data and, at any “intermediate” point between the source and a “destination” the check-bits may…
Path perception diversity and redundancy in autonomous machine applications
Granted: December 6, 2022
Patent Number:
11520345
In various examples, a path perception ensemble is used to produce a more accurate and reliable understanding of a driving surface and/or a path there through. For example, an analysis of a plurality of path perception inputs provides testability and reliability for accurate and redundant lane mapping and/or path planning in real-time or near real-time. By incorporating a plurality of separate path perception computations, a means of metricizing path perception correctness, quality, and…
Distributed processing of pose graphs for generating high definition maps for navigating autonomous vehicles
Granted: November 29, 2022
Patent Number:
11512964
According to an aspect of an embodiment, operations may comprise obtaining a pose graph that comprises a plurality of nodes. The operations may also comprise dividing the pose graph into a plurality of pose subgraphs, each pose subgraph comprising one or more respective pose subgraph interior nodes and one or more respective pose subgraph boundary nodes. The operations may also comprise generating one or more boundary subgraphs based on the plurality of pose subgraphs, each of the one or…
Determining weights of points of a point cloud based on geometric features
Granted: November 29, 2022
Patent Number:
11514682
According to one or more embodiments, operations may comprise obtaining a first point cloud. The operations also comprise performing segmentation of the first point cloud, the segmentation generating one or more clusters of points of the point cloud. The operations also comprise determining, for each respective cluster of the plurality of clusters, a respective geometric feature of a corresponding object that corresponds to the respective cluster. The operations also comprise obtaining a…
Future object trajectory predictions for autonomous machine applications
Granted: November 29, 2022
Patent Number:
11514293
In various examples, historical trajectory information of objects in an environment may be tracked by an ego-vehicle and encoded into a state feature. The encoded state features for each of the objects observed by the ego-vehicle may be used—e.g., by a bi-directional long short-term memory (LSTM) network—to encode a spatial feature. The encoded spatial feature and the encoded state feature for an object may be used to predict lateral and/or longitudinal maneuvers for the object, and…
State suspension for optimizing start-up processes of autonomous vehicles
Granted: November 29, 2022
Patent Number:
11513814
Diagnostics and boot up for AV hardware and software of a computer system of an autonomous vehicle may be performed based at least on receiving a shutdown or power off indication, then a computing state of the computer system may be suspended with the computer system entering a low-power mode. The suspended computing state can be rapidly restored without requiring a reboot and diagnostics for key-on. To ensure the integrity of the saved computing state, the computer system may exit the…
Techniques for dynamically compressing memory regions having a uniform value
Granted: November 29, 2022
Patent Number:
11513686
Accesses between a processor and its external memory is reduced when the processor internally maintains a compressed version of values stored in the external memory. The processor can then refer to the compressed version rather than access the external memory. One compression technique involves maintaining a dictionary on the processor mapping portions of a memory to values. When all of the values of a portion of memory are uniform (e.g., the same), the value is stored in the dictionary…
