Building a unified machine learning (ML)/ artificial intelligence (AI) acceleration framework across heterogeneous AI accelerators
Granted: December 24, 2024
Patent Number:
12175223
Disclosed is a system for converting a high-level runtime model to a low-level runtime model where the high-level runtime model runs on a client computer system, and the low-level runtime model runs on a server computer system. The server system has installed thereon a pool of hardware accelerators, and the low-level runtime model is targeted to the pool of accelerators. Outputs of the low-level runtime model are returned to the high-level runtime model as if the high-level runtime model…
Methods and apparatus to expose cloud infrastructure resources to tenants in a multi-tenant software system
Granted: December 24, 2024
Patent Number:
12177227
Methods, apparatus, systems, and articles of manufacture are disclosed for provisioning cloud infrastructure resources, the apparatus comprising: resource bundling circuitry to select cloud infrastructure resources to bundle as a virtual private zone; provisioning circuitry to provision the cloud infrastructure resources; and allocation circuitry to allocate the virtual private zone to a first tenant, the first tenant authorized to access the cloud infrastructure resources bundled in the…
Performing deep packet inspection in a software defined wide area network
Granted: December 24, 2024
Patent Number:
12177130
Some embodiments provide a method for performing deep packet inspection (DPI) for an SD-WAN (software defined, wide area network) established for an entity by a plurality of edge nodes and a set of one or more cloud gateways. At a particular edge node, the method uses local and remote deep packet inspectors to perform DPI for a packet flow. Specifically, the method initially uses the local deep packet inspector to perform a first DPI operation on a set of packets of a first packet flow…
Using CRDs to create externally routable addresses and route records for pods
Granted: December 24, 2024
Patent Number:
12177124
Some embodiments provide an automated method for defining externally routable Pods within a Kubernetes cluster. In some embodiments, the Pod operates in a guest cluster has its own VPC (virtual private cloud) network in a datacenter with several other guest clusters that have their own VPC networks and their own set of managers. In some embodiments, a Pod within a GC can be made externally routable so that it can be directly addressable from an external client outside of the Pod's…
Service insertion at logical network gateway
Granted: December 24, 2024
Patent Number:
12177067
Some embodiments provide a method for configuring a gateway machine in a datacenter. The method receives a definition of a logical network for implementation in the datacenter. The logical network includes at least one logical switch to which logical network endpoints attach and a logical router for handling data traffic between the logical network endpoints in the datacenter and an external network. The method receives configuration data attaching a third-party service to at least one…
Methods and apparatus to manage workload domains in virtual server racks
Granted: December 24, 2024
Patent Number:
12175294
Methods and apparatus to manage workload domains in virtual server racks are disclosed. An example apparatus includes processor circuitry to, in response to detecting that a number of available physical racks satisfies a threshold number of physical racks, apply a first resource allocation technique by reserving requested resources by exhausting first available resources of a first physical rack before using second available resources of a second physical rack; in response to detecting…
Optimized memory tiering
Granted: December 24, 2024
Patent Number:
12175290
Disclosed are various embodiments for optimized memory tiering. An ideal tier size for a first memory and an ideal tier size for a second memory can be determined for a process. Then, a host computing device can be identified that can accommodate the ideal tier size for the first memory and the second memory. Subsequently, the process can be assigned to the host computing device.
Exchanging runtime state information between datacenters with a gateway using a controller bridge
Granted: December 24, 2024
Patent Number:
12175276
In an embodiment, a computer-implemented method for dynamically exchanging runtime state data between datacenters with a gateway using a controller bridge is disclosed. In an embodiment, the method comprises: receiving one or more first runtime state data from one or more logical sharding central control planes (“CCPs”) controlling one or more logical sharding hosts; receiving one or more second runtime state data from a gateway that is controlled by a CCP that also controls one or…
Validation of combined software/firmware updates
Granted: December 24, 2024
Patent Number:
12175275
An image of a virtualization software and firmware in a plurality of hosts are upgraded by: retrieving metadata of a base image based on a first input that specifies a version of the base image, metadata of an add-on image based on a second input that specifies a server of an original equipment manufacturer (OEM) in which the virtualization software is to be installed, and metadata of drivers and agents based on a third input that specifies a firmware package for the server of the OEM;…
Provisioning DPU management operating systems using host and DPU boot coordination
Granted: December 24, 2024
Patent Number:
12175257
Disclosed are various examples of provisioning a data processing unit (DPU) management operating system (OS). A host device boots a host provisioning image, which executes a host provisioning agent. The host provisioning agent launches a server component that serves a DPU management OS. A provisioning command is transmitted to a DPU device installed to the host device. The server component transmits the DPU management OS from the host device to the DPU device. A host OS is executed once…
Processes and systems for decentralization of data produced at the edge of a distributed computing system
Granted: December 24, 2024
Patent Number:
12174875
Computer-implemented processes and systems described herein are directed to reducing volumes of data sent from edge devices to a data center. Each edge device runs an agent that collects event information generated by event sources of the edge device in a runtime interval. Each agent reduces the event information to relevant event information at the edge device in accordance with instructions received from a controller server of the data center. The relevant event information contains…
Centralized, scalable cache for containerized applications in a virtualized environment
Granted: December 24, 2024
Patent Number:
12174744
The disclosure provides a method for caching data. The method generally includes receiving, from an application running in a first container, an I/O to write data in a storage virtual disk to a block associated with an LBA, determining a cache is assigned to the first container and the storage virtual disk using a container mapping table comprising a first container mapping table entry mapping the first container and the disk to the cache and a second container mapping table entry…
Cross host beacon probing in a virtualized computing system
Granted: December 17, 2024
Patent Number:
12170714
An example method of beacon probing in a computing system includes: sending, by cross-host beacon probing (CHBP) software executing in a first host of the computing system, a first beacon probe from a first network interface controller (NIC) of the first host to NICs on a same layer 2 domain as the first NIC, the NICs including a second NIC of the first host and cross-host NICs of at least one host other than the first host; receiving, at the CHBP software through the first NIC,…
Network resource selection for flows using flow classification
Granted: December 17, 2024
Patent Number:
12170622
In some embodiments, a method receives a set of packets for a flow and determines a set of features for the flow from the set of packets. A classification of an elephant flow or a mice flow is selected based on the set of features. The classification is selected before assigning the flow to a network resource in a plurality of network resources. The method assigns the flow to a network resource in the plurality of network resources based on the classification for the flow and a set of…
Tunnel-based service insertion in public cloud environments
Granted: December 17, 2024
Patent Number:
12170616
Example methods and systems are provided a network device to perform tunnel-based service insertion in a public cloud environment. An example method may comprise establishing a tunnel between the network device and a service path. The method may also comprise: in response to receiving a first encapsulated packet, identifying the service path specified by a service insertion rule; generating and sending a second encapsulated packet over the tunnel to cause the service path to process an…
Handling memory accounting when suspending and resuming virtual machines to/from volatile memory
Granted: December 17, 2024
Patent Number:
12169730
Techniques that enable a hypervisor to (1) maintain shared memory pages and (2) handle memory accounting for VMs that are suspended to and resumed from the volatile memory of a host system are provided. Regarding (1), the hypervisor can maintain shared memory pages in volatile memory across the suspend-to-memory and resume-from-memory operations, without having to save their reference counts. Regarding (2), the hypervisor can keep track of the volatile memory reserved and consumed by VMs…
Low latency virtual memory management
Granted: December 17, 2024
Patent Number:
12169651
Disclosed are various approaches for decreasing the latency involved in reading pages from swap devices. These approaches can include setting a first queue in the plurality of queues as a highest priority queue and a second queue in the plurality of queues as a low priority queue. Then, an input/output (I/O) request for an address in memory can be received. The type of the I/O request can be determined, and then the I/O request can be assigned to the first queue or the second queue of…
Hypervisor assisted virtual machine clone auto-registration with cloud
Granted: December 17, 2024
Patent Number:
12169554
A method for automatically reregistering a clone virtual machine with a cloud security monitoring service is provided. The method generally includes detecting a connection between a cloud agent running in a virtual machine on a host and a hypervisor module on the host. In response to detecting the connection, the cloud agent queries the hypervisor module for one or more first identifiers of the virtual machine. The method generally includes checking a database, by the cloud agent, for…
System to support native storage of a container image on a host operating system for a container running in a virtual machine
Granted: December 17, 2024
Patent Number:
12169480
Described herein are a system and method for forming a container image. The system and method include obtaining a first layer of a plurality of layers of the container image. The contents of the first layer are stored in a directory such that a first disk image layer file is mounted to the directory. A second layer of the plurality of layers is obtained, and the contents of the second layer are stored in the directory so that the first disk image layer includes contents of the first…
System for software service upgrade
Granted: December 10, 2024
Patent Number:
12164899
Examples are disclosed for upgrading services of a software-based service according to a predefined sequence to account for dependencies between services. An upgrade package that includes a manifest defining an order for upgrading services of the software-based system is retrieved. Each service is upgraded according to the sequence and a status log is modified following each upgrade to include a unified status summary associated with all services being upgraded.
