ATTENTION-BASED DEEP REINFORCEMENT LEARNING FOR AUTONOMOUS AGENTS
Granted: December 28, 2023
Application Number:
20230419113
A data source configured to provide a representation of an environment of one or more agents is identified. Using a data set obtained from the data source, a neural network-based reinforcement learning model with one or more attention layers is trained. Importance indicators generated by the attention layers are used to identify actions to be initiated by an agent. A trained version of the model is stored.
RANDOM TOKEN SEGMENTATION FOR TRAINING NEXT TOKEN PREDICTION MODELS
Granted: December 28, 2023
Application Number:
20230419036
Random token segmentation may be implemented for next token prediction. Text data may be received for training a machine learning model to predict a next token given input text tokens. Multiple tokens may be determined from the text data. Different ones of the multiple token may be randomly segmented in to sub-tokens. The machine learning model may then be trained using the multiple tokens including the respective sub-tokens as a training data set.
CONSTRAINED PREFIX MATCHING FOR GENERATING NEXT TOKEN PREDICTIONS
Granted: December 28, 2023
Application Number:
20230418567
Pre-fix matching may constrain the generation of next token predictions. Input text to perform a next token prediction may be received. Multiple tokens may be determined from the input text, including a partial token. From possible tokens, one or more matching possible tokens with the partial token may be identified. Next token predictions may then be filtered using the identified possible tokens in order to ensure that the partial token is matched.
PROGRAMMATICALLY GENERATING EVALUATION DATA SETS FOR CODE GENERATION MODELS
Granted: December 28, 2023
Application Number:
20230418566
Evaluation data sets may be programmatically generated for code generation models. An evaluation data set is obtained that includes items that correspond to different evaluation tests for a code generation system. The individual items of the evaluation data set maybe converted, including the conversion of a function signature for the items, the test statements for the items and using a code generation system to generate the body of the function.
VALIDATING AND PROVIDING PROACTIVELY GENERATED CODE SUGGESTIONS
Granted: December 28, 2023
Application Number:
20230418565
Code completion suggestions may be proactively obtained and validated. An event that triggers obtaining a code completion suggestion for inclusion in a code file being edited using an integrated development environment may be detected. The code completion suggestion may be obtained. The characters of the code completion suggestion may be compared with characters added to the code file after the detection of the event that triggered obtaining the code completion suggestion to determine…
RADIO-BASED APPLICATION PROCESSING SERVER WITH NETWORK FUNCTION ACCELERATOR AT VIRTUALIZATION MANAGEMENT OFFLOADING CARD
Granted: December 21, 2023
Application Number:
20230409363
Instructions stored at a memory of an offloading card of a server, when executed at a processor of the offloading card, perform virtualization management tasks pertaining to a compute instance launched at the server, including allocation of memory of the server to the compute instance. In response to a request from the compute instance, a network function of a radio-based application is executed at an accelerator incorporated within the offloading card.
ENABLING ISOLATED VIRTUAL NETWORK CONFIGURATION OPTIONS FOR NETWORK FUNCTION ACCELERATORS
Granted: December 21, 2023
Application Number:
20230412507
A first security rule set for traffic of a compute instance run at a virtualization server is stored in response to a programmatic request. A second security rule set for traffic of a network function accelerator of the virtualization server is stored in response to another programmatic request. Prior to delivery of network messages to the compute instance or from the accelerator, compliance with the applicable security rule set is verified.
SEARCHING COMPRESSION PROFILES FOR TRAINED NEURAL NETWORKS
Granted: December 21, 2023
Application Number:
20230409584
Compression profiles may be searched for trained neural networks. An iterative compression profile search may be performed response to a search request. Different prospective compression profiles may be generated for trained neural networks according to a search policy. Performance of compressed versions of the trained neural networks according to the compression profiles may be tracked. The search policy may be updated according to an evaluation of the performance of the compression…
MACHINE LEARNING DATA SET MANAGEMENT
Granted: December 21, 2023
Application Number:
20230409528
Centralized data set management techniques are implemented for data sets for machine learning applications. New data sets may be created from a search of managed data set labels. Data objects of the managed data sets that are found in the search are then used to generate a new data set. The new data set is then made available for machine learning applications to use.
TRANSACTION BASED REMOTE DIRECT MEMORY ACCESS
Granted: December 21, 2023
Application Number:
20230409514
Apparatus and methods are disclosed herein for remote, direct memory access (RDMA) technology that enables direct memory access from one host computer memory to another host computer memory over a physical or virtual computer network. In one example, RDMA functionality is provided by combining a host executing instructions for RDMA software applications with dedicated hardware accelerator, where the host has access to substantially all RDMA connection context (e.g., configuration,…
MANAGING NETWORK FUNCTION ACCELERATORS FOR RADIO-BASED APPLICATIONS FROM VIRTUALIZED COMPUTING SERVICE CONTROL PLANE
Granted: December 21, 2023
Application Number:
20230409362
Respective network addresses are assigned to a networking hardware device and a network function accelerator incorporated within an offloading card of a virtualization server by a control plane server of a virtualized computing service. A compute instance is launched at the virtualization server using a virtualization controller of the offloading card. The compute instance executes a network function of a radio-based application in response to a request received using the network address…
SECURITY VULNERABILITY MITIGATION USING ADDRESS SPACE CO-EXECUTION
Granted: December 21, 2023
Application Number:
20230409321
A first set of instructions, which is provided access to a first address space, is scheduled for execution at a first hardware thread of a processor. Prior to executing an instruction of a second set of instructions, which accesses a second address space, at the first hardware thread, a determination is made that the second address space is accessible from a second hardware thread of the processor.
CLOUD-BASED DATABASE FOR SPATIAL DATA LIFECYCLE MANAGEMENT
Granted: December 14, 2023
Application Number:
20230401223
Methods, systems, and computer-readable media for a cloud-based database for spatial data lifecycle management. A spatial database receives elements of spatial data from a plurality of clients of the distributed spatial database. An individual element of the spatial data comprises one or more location values or one or more spatial objects. The spatial database stores the plurality of elements of spatial data using a plurality of storage resources. The spatial database receives a query.…
SYSTEM AND METHOD FOR PERFORMING LIVE PARTITIONING IN A DATA STORE
Granted: December 14, 2023
Application Number:
20230400990
A system that implements a scalable data storage service may maintain tables in a data store on behalf of storage service clients. The service may maintain table data in multiple replicas of partitions that are stored on respective computing nodes in the system. In response to detecting an anomaly in the system, detecting a change in data volume on a partition or service request traffic directed to a partition, or receiving a service request from a client to split a partition, the data…
FAILOVER AND RECOVERY FOR REPLICATED DATA INSTANCES
Granted: December 7, 2023
Application Number:
20230393953
Replicated instances in a database environment provide for automatic failover and recovery. A monitoring component can periodically communicate with a primary and a secondary replica for an instance, with each capable of residing in a separate data zone or geographic location to provide a level of reliability and availability. A database running on the primary instance can have information synchronously replicated to the secondary replica at a block level, such that the primary and…
PRIVATE SERVICE ENDPOINTS IN ISOLATED VIRTUAL NETWORKS
Granted: November 30, 2023
Application Number:
20230388390
A service implemented at a first isolated virtual network of a provider network is added to a database of privately-accessible services. Configuration changes that enable network packets to flow between the first isolated virtual network and a second isolated virtual network without utilizing a network address accessible from the public Internet are implemented. Service requests originating at the second isolated virtual network are transmitted to the first isolated virtual network via…
SPATIAL SEARCH USING KEY-VALUE STORE
Granted: November 30, 2023
Application Number:
20230385353
A spatial search may be performed using representations of geometric shapes stored in a key-value store. A request to perform a spatial search may be received, the request including a geometric shape composed of one or more points. The points of the geometrical shape may be translated into one or more spatial indexes representing spatial cells using a space-filling curve. A key-value store may then be incrementally searched for each spatial index to identify spatial cells intersecting…
MANANGING ACCESS OF MULTIPLE EXECUTING PROGRAMS TO NON-LOCAL BLOCK DATA STORAGE
Granted: November 30, 2023
Application Number:
20230384948
Techniques are described for managing access of executing programs to non-local block data storage. In some situations, a block data storage service uses multiple server storage systems to reliably store network-accessible block data storage volumes that may be used by programs executing on other physical computing systems. A group of multiple server block data storage systems that store block data volumes may in some situations be co-located at a data center, and programs that use…
ARTIFICIAL INELLIGENCE SYSTEM WITH INTUITIVE INTERACTIVE INTERFACES FOR GUIDED LABELING OF TRAINING DATA FOR MACHINE LEARNING MODELS
Granted: November 23, 2023
Application Number:
20230376857
At an artificial intelligence system, during a labeling feedback session, a visualization data set is presented via a programmatic interface. The visualization data set comprises a representation of data items for which labeling feedback is requested for generating a training set of a classifier. At least one of the data items is selected based on an estimated rank with respect to a metric associated with including the data item in a training set. During the session, respective labels…
FAULT TOLERANT RESERVATION STATE DISTRIBUTION FOR MULTI-PARTITION LOGICAL VOLUMES
Granted: November 9, 2023
Application Number:
20230359383
A storage service supports attachment of multiple clients to a distributed storage object and further supports persistent reservations that govern types of access the respective clients are granted with respect to the distributed storage object. In order to efficiently distribute reservation state changes to multiple partitions of the distributed storage object hosted by different data storage units/servers, existing connections are used between the data storage units/servers hosting the…
