METHOD AND SYSTEM FOR DISCOVERY OF INFERENCE SERVERS IN A MACHINE LEARNING SERVING INFRASTRUCTURE
Granted: December 8, 2022
Application Number:
20220391749
A method performs service discovery in a machine learning service. The method includes detecting initialization of at least one service container, identifying label information in the at least one service container, collecting the label information for the initializing at least one service container, and storing the label information in a routing information storage to enable routing of requests to the at least one service container.
METHOD AND SYSTEM FOR APPLICATION PROGRAMMING INTERFACE BASED CONTAINER SERVICE FOR SUPPORTING MULTIPLE MACHINE LEARNING APPLICATIONS
Granted: December 8, 2022
Application Number:
20220391748
A method of a base scorer in a scoring service container includes sending a model identifier to a model loader of an application specific scorer in the scoring service container, receiving a model object from the model loader in response to sending the model identifier, sending a request for a scoring from a client application to a scoring function of the application specific scorer, receiving the scoring from the application specific scorer, and returning the scoring to the client…
ONBOARDING NEW MACHINE LEARNING APPLICATIONS IN A MULTI-TENANT ON-DEMAND MODEL SERVING INFRASTRUCTURE USING CONFIGURATION OBJECTS
Granted: December 8, 2022
Application Number:
20220391747
A method by a router component in a multi-tenant on-demand serving infrastructure to route scoring requests to scoring containers. The method includes receiving a scoring request, determining a machine learning application associated with the scoring request, determining whether a router instance for the machine learning application exists, and responsive to a determination that a router instance for the machine learning application does not exist, obtaining a configuration object for…
DECLARATIVE TRANSACTION CONTROL
Granted: December 8, 2022
Application Number:
20220391383
Disclosed are some implementations of systems, apparatus, methods and computer program products for facilitating the implementation of declarative transaction control. A database transaction control configuration associated with an element of a process flow can be obtained via a graphical user interface (GUI) and stored in association the element. The database transaction control configuration indicates whether a pending database transaction is to be committed to a database prior to…
APPLICATION PROGRAMMING INTERFACE FOR SPINNING UP MACHINE LEARNING INFERENCING SERVER ON DEMAND
Granted: December 8, 2022
Application Number:
20220391239
A method by one or more electronic devices for spinning up a scoring container on demand. The method includes receiving, from an orchestrator component via an application programming interface (API), a request to spin up the scoring container, wherein the scoring container is configured to provide scoring functionality, spinning up the scoring container responsive to receiving the request to spin up the scoring container, and providing, to the orchestrator component via the API, a…
USING TEMPLATES TO PROVISION INFRASTRUCTURES FOR MACHINE LEARNING APPLICATIONS IN A MULTI-TENANT ON-DEMAND SERVING INFRASTRUCTURE
Granted: December 8, 2022
Application Number:
20220391199
A method by one or more electronic devices to provision an infrastructure for a machine learning application in a multi-tenant on-demand serving infrastructure. The method includes storing a plurality of templates, wherein each of the plurality of templates indicates a scoring interface, a web server, a definition of a continuous integration pipeline, and a definition of a continuous deployment pipeline, receiving a request to provision the infrastructure for the machine learning…
SYSTEMS, METHODS, AND DEVICES FOR SYNCHRONIZATION OF CONTENT ASSOCIATED WITH COMPUTING PLATFORMS
Granted: December 1, 2022
Application Number:
20220382531
Systems, methods, and devices facilitate synchronization of content between instances of data records. Servers may be configured to generate a data record comprising a dynamic synchronization data object, receive an input associated with the data record, and determine a plurality of synchronization parameters including a plurality of expansion parameters and a plurality of permission parameters associated with the dynamic synchronization data object. The servers may be configured to…
COMPUTING SYSTEM PERMISSION ADMINISTRATION ENGINE
Granted: December 1, 2022
Application Number:
20220385666
A plurality of permissions associated with the on-demand computing services environment may be identified. Each of the permissions may identify a respective one or more actions permitted to be performed within the on-demand computing services environment. Each of the permissions may be granted to a respective one or more user accounts within the on-demand computing services environment. A degree of overlap between a first group of the user accounts granted a first one of the permissions…
CONFIGURATION MAP BASED SHARDING FOR CONTAINERS IN A MACHINE LEARNING SERVING INFRASTRUCTURE
Granted: December 1, 2022
Application Number:
20220382601
A machine learning serving infrastructure implementing a method of receiving or detecting an update of container metrics including resource usage and serviced requests per model or per container, processing the container metrics per model or per container to determine recent resource usage and serviced requests per model or per container, and rebalancing distribution of models to a plurality of containers to decrease a detected load imbalance between containers or a stressed container in…
METHOD AND SYSTEM FOR MACHINE LEARNING FRAMEWORK AND MODEL VERSIONING IN A MACHINE LEARNING SERVING INFRASTRUCTURE
Granted: December 1, 2022
Application Number:
20220382539
Machine learning version management method for a prediction service includes receiving a prediction request, determining application metadata for the request that defines routing logic and a machine learning framework version, determining model metadata for the request that defines at least one model and at least one model version, forwarding the prediction request to the at least one model with the at least one model version, and returning a prediction from the at least one model to a…
SHARING OBJECTS ACROSS NAMESPACES IN A CONTAINER-ORCHESTRATION SYSTEM
Granted: November 24, 2022
Application Number:
20220377139
A method for replicating a set of parent resources from an administrator namespace to a set of tenant namespaces is described. The method includes receiving, by the administrator namespace, a global object that includes a set of object fields that reference (1) a set of parent resources and (2) the set of tenant namespaces; monitoring, by an operator controller of the administrator namespace, the global object to determine whether a change has been made to the global object; and…
FIELD LEVEL ENCRYPTION SEARCHABLE DATABASE SYSTEM
Granted: November 24, 2022
Application Number:
20220374540
A request to search a database field in a database table for a query value may be received. The query value may be hashed with a designated hash function and a designated hash key to produce a designated keyed-hash value. A row in the database table may be identified based on the designated keyed-hash value. The identified row may include a keyed-hash field value that matches the designated keyed-hash value. The identified row may include an encrypted field value generated by encrypting…
CONTEXT AND RULE BASED DYNAMIC COMMUNICATION CHANNELS FOR COLLABORATION BETWEEN USERS
Granted: November 10, 2022
Application Number:
20220358462
Providing expert help to a user comprises providing an application for execution on a mobile device of the user associated with an entity. A computer receives entity rules from the entity, the entity rules include a definition of how communication channels are created. The entity rules are stored in a rules database in association with the user. A help request initiated by the user through the application program and sent by the mobile device, the help request comprising a current…
SYSTEM AND METHOD FOR FLOW RUNTIME VERSIONING
Granted: October 27, 2022
Application Number:
20220342658
A method in a cloud-based system for implementing behavioral changes to flow engine software that executes user-specific flows for a plurality of users with little or no disruption to the performance of the user-specific flows is provided. The method comprises: receiving a request to load and execute a user-specific flow; identifying an API version identifier for the user-specific flow; loading the user-specific flow; determining whether a software change to the flow engine software…
SYSTEMS, METHODS, AND DEVICES FOR AUTOMATION AND INTEGRATION OF CREDENTIALING AND AUTHENTICATION IN WORKFLOWS ASSOCIATED WITH COMPUTING PLATFORMS
Granted: October 20, 2022
Application Number:
20220337569
A computing platform is configurable to cause initiating a communication session with a user, the user having a user account associated with a workflow data object, the workflow data object being configured to represent a plurality of operations included in a workflow. The computing platform is also configurable to cause identifying a verified status indicator associated with at least one of the plurality of operations, the verified status indicator comprising a verified credential…
BOT BUILDER DIALOG MAP
Granted: October 20, 2022
Application Number:
20220335268
This disclosure relates to tools to facilitate the configuration of interactive agents, sometimes referred to as bots, chatbots, virtual robots, or talkbots. Specifically, the disclosure relates to the provision of a map view visualization of an interactive agent. The map view can display a complexity indicator or usage percentage for each dialog and provide an easy mechanism for creation of new dialogs, actions, parameters, rules, and logic.
SYSTEMS, METHODS, AND DEVICES FOR AUTOMATION AND INTEGRATION OF CREDENTIALING AND AUTHENTICATION IN WORKFLOWS ASSOCIATED WITH COMPUTING PLATFORMS
Granted: October 20, 2022
Application Number:
20220335110
A computing platform is configurable to cause generating a workflow data object configured to represent a plurality of operations included in a workflow associated with a user, the workflow data object being generated based on a designated sequence of the plurality of operations. The computing platform is further configurable to cause receiving a verified status indicator associated with at least one of the plurality of operations, the verified status indicator including a verified…
TEST PROCEDURE SYSTEMS AND METHODS
Granted: October 20, 2022
Application Number:
20220334958
A system for testing a software procedure is provided. The system is configured to: provide a user interface for configuring a test procedure; inject test data into a program execution flow for a target procedure; initiate test execution of the target procedure; evaluate test results based on data flow within actions of the target procedure to determine the success or failure of the actions during the test execution; and providing a GUI for reviewing the data flow within the actions of…
PROCESS FLOW BUILDER FOR EXTENSIBLE WEB COMPONENT SEQUENCES
Granted: October 20, 2022
Application Number:
20220334809
Database systems and methods are provided for visual design and customization of processes for web applications. One method involves obtaining, from a process flow builder graphical user interface (GUI) display at a client device, a sequence of configured components within a region of the process flow builder GUI display, automatically generating process flow code corresponding to the sequence of configured components within the region of the process flow builder GUI display, modifying…
SERVICE FOR SHARING DATA INSIGHTS
Granted: October 13, 2022
Application Number:
20220327226
A method by one or more computing devices implementing a data insights sharing service to allow a first user of the data insights sharing service to share data insights with other users of the data insights sharing service. The method includes storing metadata describing one or more data insights, where the one or more data insights were generated based on analyzing a dataset of the first user, responsive to receiving a request from a second user to access the one or more data insights,…
