Efficient transforms and transposes for rate-distortion optimization and reconstruction in video encoders
Granted: May 9, 2023
Patent Number:
11647227
Disclosed approaches may provide for non-blocking video processing pipelines that have the ability to efficiently share transform hardware resources. Transform hardware resources may be shared across processing parameters, such as pixel block dimensions, transform types, video stream bit depths, and/or multiple coding formats, as well as for inter-frame and intra-frame encoding. The video processing pipeline may be divided into phases, each phase having half-butterfly circuits to perform…
Equalization adaptation schemes for high-speed links
Granted: May 9, 2023
Patent Number:
11646863
A receiving link device includes a receiver (RX) to receive a data signal from a transmitting link device, the receiver including an equalizer to detect RX tap values and a processing device coupled to the receiver, the processing device to perform operations including: programming the receiver with information related to target RX tap values that are associated RX pre-cursors or RX post-cursors; detecting, using the equalizer, that an RX pre-cursor value is greater or less than a target…
Foveation and spatial hashing in layer-based computer-generated holograms
Granted: April 25, 2023
Patent Number:
11635623
The computational scaling challenges of holographic displays are mitigated by techniques for generating holograms that introduce foveation into a wave front recording planes approach to hologram generation. Spatial hashing is applied to organize the points or polygons of a display object into keys and values.
Adaptive pixel sampling order for temporally dense rendering
Granted: April 25, 2023
Patent Number:
11638028
A method dynamically selects one of a first sampling order and a second sampling order for a ray trace of pixels in a tile where the selection is based on a motion vector for the tile. The sampling order may be a bowtie pattern or an hourglass pattern.
Determination of luminance values using image signal processing pipeline
Granted: April 25, 2023
Patent Number:
11637998
Apparatuses, systems, and techniques to receive, at one or more processors associated with an image signal processing (ISP) pipeline for a camera, an image generated using an image sensor of the camera, wherein the image comprises a plurality of channels associated with color information of the image; process, by the one or more processors, the plurality of channels of the image to generate a plurality of luminance and/or radiance values; generate, by the one or more processors, an…
Techniques for improving the color accuracy of light-emitting diodes in backlit liquid-crystal displays
Granted: April 25, 2023
Patent Number:
11636814
A display device includes an array of LEDs, an array of LCD pixels, and a display controller. The display controller is configured to compensate for one or more sources of color variation in light produced by the LEDs. The display controller can determine a first color variation at a given LCD pixel based on the distance between the given LCD pixel and one or more LEDs. The display controller can also determine a second color variation at the given LCD pixel based on a current level…
Adaptive object tracking algorithm for autonomous machine applications
Granted: April 25, 2023
Patent Number:
11636689
In various examples, lane location criteria and object class criteria may be used to determine a set of objects in an environment to track. For example, lane information, freespace information, and/or object detection information may be used to filter out or discard non-essential objects (e.g., objects that are not in an ego-lane or adjacent lanes) from objects detected using an object detection algorithm. Further, objects corresponding to non-essential object classes may be filtered out…
Gaze determination machine learning system having adaptive weighting of inputs
Granted: April 25, 2023
Patent Number:
11636609
Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject's eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject's face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of…
Hardware accelerated anomaly detection using a min/max collector in a system on a chip
Granted: April 25, 2023
Patent Number:
11636063
In various examples, a VPU and associated components may be optimized to improve VPU performance and throughput. For example, the VPU may include a min/max collector, automatic store predication functionality, a SIMD data path organization that allows for inter-lane sharing, a transposed load/store with stride parameter functionality, a load with permute and zero insertion functionality, hardware, logic, and memory layout functionality to allow for two point and two by two point lookups,…
Techniques for configuring a processor to function as multiple, separate processors
Granted: April 25, 2023
Patent Number:
11635986
A parallel processing unit (PPU) can be divided into partitions. Each partition is configured to operate similarly to how the entire PPU operates. A given partition includes a subset of the computational and memory resources associated with the entire PPU. Software that executes on a CPU partitions the PPU for an admin user. A guest user is assigned to a partition and can perform processing tasks within that partition in isolation from any other guest users assigned to any other…
Method of using a single controller (ECU) for a fault-tolerant/fail-operational self-driving system
Granted: April 25, 2023
Patent Number:
11634149
In a self-driving autonomous vehicle, a controller architecture includes multiple processors within the same box. Each processor monitors the others and takes appropriate safe action when needed. Some processors may run dormant or low priority redundant functions that become active when another processor is detected to have failed. The processors are independently powered and independently execute redundant algorithms from sensor data processing to actuation commands using different…
CMOS signaling front end for extra short reach links
Granted: April 18, 2023
Patent Number:
11632275
A transceiver circuit includes a receiver front end utilizing a ring oscillator, and a transmitter front end utilizing a pass-gate circuit in a first feedback path across a last-stage driver circuit. The transceiver circuit provides low impedance at low frequency and high impedance at high frequency, and desirable peaking behavior.
Iterative spatio-temporal action detection in video
Granted: April 18, 2023
Patent Number:
11631239
Iterative prediction systems and methods for the task of action detection process an inputted sequence of video frames to generate an output of both action tubes and respective action labels, wherein the action tubes comprise a sequence of bounding boxes on each video frame. An iterative predictor processes large offsets between the bounding boxes and the ground-truth.
Fully-fused neural network execution
Granted: April 18, 2023
Patent Number:
11631210
A fully-connected neural network may be configured for execution by a processor as a fully-fused neural network by limiting slow global memory accesses to reading and writing inputs to and outputs from the fully-connected neural network. The computational cost of fully-connected neural networks scale quadratically with its width, whereas its memory traffic scales linearly. Modern graphics processing units typically have much greater computational throughput compared with memory…
Programmable vision accelerator
Granted: April 18, 2023
Patent Number:
11630800
In one embodiment of the present invention, a programmable vision accelerator enables applications to collapse multi-dimensional loops into one dimensional loops. In general, configurable components included in the programmable vision accelerator work together to facilitate such loop collapsing. The configurable elements include multi-dimensional address generators, vector units, and load/store units. Each multi-dimensional address generator generates a different address pattern. Each…
Execution of computation graphs
Granted: April 18, 2023
Patent Number:
11630653
A computation graph is accessed. In the computation graph, operations to be performed are represented as interior nodes, inputs to the operations are represented as leaf nodes, and a result of the operations is represented as a root. Selected sets of the operations are combined to form respective kernels of operations. Code is generated execute the kernels of operations. The code is executed to determine the result.
Foveated display for augmented reality
Granted: April 18, 2023
Patent Number:
11630312
An augmented reality display system includes a first beam path for a foveal inset image on a holographic optical element, a second beam path for a peripheral display image on the holographic optical element, and pupil position tracking logic that generates control signals to set a position of the foveal inset as perceived through the holographic optical element, to determine the peripheral display image, and to control a moveable stage.
Applications of and techniques for quickly computing a modulo operation by a Mersenne or a Fermat number
Granted: April 11, 2023
Patent Number:
11625225
Various embodiments include a modulo operation generator associated with a cache memory in a computer-based system. The modulo operation generator generates a first sum by performing an addition and/or a subtraction function on an input address. A first portion of the first sum is applied to a lookup table that generates a correction value. The correction value is then added to a second portion of the first sum to generate a second sum. The second sum is adjusted, as needed, to be less…
Selecting computational kernel variants using neural networks
Granted: April 11, 2023
Patent Number:
11625605
Apparatuses, systems, and techniques to optimize kernel selection for performing a computation. In at least one embodiment, a neural network is trained and utilized to generate a list of kernels so that an (e.g., optimal) kernel may be identified. The neural network receives characteristics of the input matrices and determines relevancy scores for a list of possible kernels. Based on an ordered listing of kernels by relevant score, a kernel is selected from the list and utilized to…
Read-write page replication for multiple compute units
Granted: April 11, 2023
Patent Number:
11625279
In general, an application executes on a compute unit, such as a central processing unit (CPU) or graphics processing unit (GPU), to perform some function(s). In some circumstances, improved performance of an application, such as a graphics application, may be provided by executing the application across multiple compute units. However, when using multiple compute units in this manner, synchronization must be provided between the compute units. Synchronization, including the sharing of…
