Salesforce.com Patent Grants

Dynamic linking of content elements to development tool resources

Granted: February 20, 2024
Patent Number: 11907734
Approaches, techniques, and mechanisms are disclosed for flexible and dynamic modification of elements within textual content to provide an enhanced interface for development or other activities with respect to those elements. In an embodiment, the elements may be augmented with links by which users may quickly access associated items in development tools or other resources. For example, in an embodiment, the elements may be specific lines or blocks of code mentioned in a stack trace or…

Generative language model for few-shot aspect-based sentiment analysis

Granted: December 26, 2023
Patent Number: 11853706
Sentiment analysis is a task in natural language processing. The embodiments are directed to using a generative language model to extract an aspect term, aspect category and their corresponding polarities. The generative language model may be trained as a single, joint, and multi-task model. The single-task generative language model determines a term polarity from the aspect term in the sentence or a category polarity from an aspect category in the sentence. The joint-task generative…

Dialogue state tracking using a global-local encoder

Granted: December 5, 2023
Patent Number: 11836451
A method for maintaining a dialogue state associated with a dialogue between a user and a digital system includes receiving, by a dialogue state tracker associated with the digital system, a representation of a user communication, updating, by the dialogue state tracker, the dialogue state and providing a system response based on the updated dialogue state. The dialogue state is updated by evaluating, based on the representation of the user communication, a plurality of member scores…

Systems and methods for artificial intelligence-based root cause analysis of service incidents

Granted: December 5, 2023
Patent Number: 11836037
Some embodiments of the current disclosure disclose methods and systems for analyzing root causes of an incident disrupting information technology services such as cloud services. In some embodiments, a set of problem review board (PRB) documents including information about said incidents may be parsed using a natural language processing (NLP) neural model to extract structured PRB data from the unstructured investigative information contained in the PRB documents. The structured PRB…

Cross-lingual regularization for multilingual generalization

Granted: November 28, 2023
Patent Number: 11829727
Approaches for cross-lingual regularization for multilingual generalization include a method for training a natural language processing (NLP) deep learning module. The method includes accessing a first dataset having a first training data entry, the first training data entry including one or more natural language input text strings in a first language; translating at least one of the one or more natural language input text strings of the first training data entry from the first language…

Systems and methods for unsupervised paraphrase generation

Granted: November 28, 2023
Patent Number: 11829721
Embodiments described herein provide dynamic blocking, a decoding algorithm which enables large-scale pretrained language models to generate high-quality paraphrases in an un-supervised setting. Specifically, in order to obtain an alternative surface form, when the language model emits a token that is present in the source sequence, the language model is prevented from generating the next token that is the same as the subsequent source token in the source sequence at the next time step.…

Methods and systems for efficient batch active learning of a deep neural network

Granted: November 28, 2023
Patent Number: 11829442
Some embodiments of the current disclosure disclose methods and systems for batch active learning using the Shapley values of data points. In some embodiments, Shapley values of a first subset of labeled data are used to measure the contributions of the first subset of data to the performance of neural network. Further, a regression model that correlates the first subset of data to their Shapley values is trained to predict the Shapley values of a second subset of data that are…

Systems and methods for structured text translation with tag alignment

Granted: November 21, 2023
Patent Number: 11822897
Approaches for the translation of structured text include an embedding module for encoding and embedding source text in a first language, an encoder for encoding output of the embedding module, a decoder for iteratively decoding output of the encoder based on generated tokens in translated text from previous iterations, a beam module for constraining output of the decoder with respect to possible embedded tags to include in the translated text for a current iteration using a beam search,…

Systems and methods for a multilingual speech recognition framework

Granted: October 24, 2023
Patent Number: 11798534
Embodiments described herein provide an Adapt-and-Adjust (A2) mechanism for multilingual speech recognition model that combines both adaptation and adjustment methods as an integrated end-to-end training to improve the models' generalization and mitigate the long-tailed issue. Specifically, a multilingual language model mBERT is utilized, and converted into an autoregressive transformer decoder. In addition, a cross-attention module is added to the encoder on top of the mBERT's…

Systems and methods for scientific contribution summarization

Granted: October 17, 2023
Patent Number: 11790184
Embodiments described herein provide natural language processing (NLP) systems and methods that provide a customized summarization of scientific or technical articles, which disentangles background information from new contributions, and summarizes the background information or the new information (or both) based on a user's preference. Specifically, the systems and methods utilize machine learning classifiers to classify portions of sentences within the article as containing background…

Systems and methods for code understanding and generation

Granted: October 10, 2023
Patent Number: 11782686
Embodiments described herein a code generation and understanding model that builds on a Transformer-based encoder-decoder framework. The code generation and understanding model is configured to derive generic representations for programming language (PL) and natural language (NL) in code domain via pre-training on unlabeled code corpus, and then to benefit many code-related downstream tasks with fine-tuning. Apart from the denoising sequence-to-sequence objectives widely adopted for…

Joint many-task neural network model for multiple natural language processing (NLP) tasks

Granted: October 10, 2023
Patent Number: 11783164
The technology disclosed provides a so-called “joint many-task neural network model” to solve a variety of increasingly complex natural language processing (NLP) tasks using growing depth of layers in a single end-to-end model. The model is successively trained by considering linguistic hierarchies, directly connecting word representations to all model layers, explicitly using predictions in lower tasks, and applying a so-called “successive regularization” technique to prevent…

Unsupervised representation learning with contrastive prototypes

Granted: October 3, 2023
Patent Number: 11776236
The system and method are directed to a prototypical contrastive learning (PCL). The PCL explicitly encodes the hierarchical semantic structure of the dataset into the learned embedding space and prevents the network from exploiting low-level cues for solving the unsupervised learning task. The PCL includes prototypes as the latent variables to help find the maximum-likelihood estimation of the network parameters in an expectation-maximization framework. The PCL iteratively performs an…

Systems and methods for reading comprehension for a question answering task

Granted: October 3, 2023
Patent Number: 11775775
Embodiments described herein provide a pipelined natural language question answering system that improves a BERT-based system. Specifically, the natural language question answering system uses a pipeline of neural networks each trained to perform a particular task. The context selection network identifies premium context from context for the question. The question type network identifies the natural language question as a yes, no, or span question and a yes or no answer to the natural…

Temporary network of edge computing devices

Granted: September 19, 2023
Patent Number: 11765650
Techniques are disclosed relating to temporary networks of edge computing devices. In some embodiments, an edge computing device manages, in response to occurrence of an event, a temporary network of edge computing devices. Managing the temporary network includes: forming the temporary network, managing membership of edge computing devices in the temporary network, causing the temporary network to perform a specified set of tasks, transmitting, to a remote server computing system,…

Weakly supervised natural language localization networks for video proposal prediction based on a text query

Granted: June 27, 2023
Patent Number: 11687588
Systems and methods are provided for weakly supervised natural language localization (WSNLL), for example, as implemented in a neural network or model. The WSNLL network is trained with long, untrimmed videos, i.e., videos that have not been temporally segmented or annotated. The WSNLL network or model defines or generates a video-sentence pair, which corresponds to a pairing of an untrimmed video with an input text sentence. According to some embodiments, the WSNLL network or model is…

Management and remediation of database issues

Granted: June 13, 2023
Patent Number: 11675653
Systems and methods are described identify a database metric value associated with a database instance storing a dataset associated with a user system. A database issue is detected in view of a determination that the database metric value satisfies a condition. In response to satisfaction of the condition, a set of user action metrics associated with the user system is collected from one or more data monitoring systems. At least one notification communication is generated including at…

Systems and methods for learning for domain adaptation

Granted: June 13, 2023
Patent Number: 11676022
A method for training parameters of a first domain adaptation model. The method includes evaluating a cycle consistency objective using a first task specific model associated with a first domain and a second task specific model associated with a second domain, and evaluating one or more first discriminator models to generate a first discriminator objective using the second task specific model. The one or more first discriminator models include a plurality of discriminators corresponding…

Proposal learning for semi-supervised object detection

Granted: June 6, 2023
Patent Number: 11669745
A method for generating a neural network for detecting one or more objects in images includes generating one or more self-supervised proposal learning losses based on the one or more proposal features and corresponding proposal feature predictions. One or more consistency-based proposal learning losses are generated based on noisy proposal feature predictions and the corresponding proposal predictions without noise. A combined loss is generated using the one or more self-supervised…

Robustness evaluation via natural typos

Granted: June 6, 2023
Patent Number: 11669712
A method for evaluating robustness of one or more target neural network models using natural typos. The method includes receiving one or more natural typo generation rules associated with a first task associated with a first input document type, receiving a first target neural network model, and receiving a first document and corresponding its ground truth labels. The method further includes generating one or more natural typos for the first document based on the one or more natural typo…