Three dimensional reconstruction of objects based on geolocation and image data
Granted: April 4, 2023
Patent Number:
11620800
Embodiments of the systems and methods described herein provide a three dimensional reconstruction system that can receive an image from a camera, and then utilize machine learning algorithms to identify objects in the image. The three dimensional reconstruction system can identify a geolocation of a user, identify features of the surrounding area, such as structures or geographic features, and reconstruct the scene including the identified features. The three dimensional reconstruction…
Systems and methods for texture-space ray tracing of transparent and translucent objects
Granted: April 4, 2023
Patent Number:
11620786
Disclosed is a hybrid approach to rendering transparent or translucent objects, which combines object-space ray tracing with texture-space parametrization and integration. Transparent or translucent objects are first parameterized using two textures: (1) a texture that stores the surface normal at each location on the transparent or translucent object, and (2) a texture that stores the world space coordinates at each location on the transparent or translucent object. Ray tracing can then…
Three dimensional reconstruction of objects based on geolocation and image data
Granted: April 4, 2023
Patent Number:
11620800
Embodiments of the systems and methods described herein provide a three dimensional reconstruction system that can receive an image from a camera, and then utilize machine learning algorithms to identify objects in the image. The three dimensional reconstruction system can identify a geolocation of a user, identify features of the surrounding area, such as structures or geographic features, and reconstruct the scene including the identified features. The three dimensional reconstruction…
Systems and methods for texture-space ray tracing of transparent and translucent objects
Granted: April 4, 2023
Patent Number:
11620786
Disclosed is a hybrid approach to rendering transparent or translucent objects, which combines object-space ray tracing with texture-space parametrization and integration. Transparent or translucent objects are first parameterized using two textures: (1) a texture that stores the surface normal at each location on the transparent or translucent object, and (2) a texture that stores the world space coordinates at each location on the transparent or translucent object. Ray tracing can then…
Emotion based music style change using deep learning
Granted: April 4, 2023
Patent Number:
11617952
Various aspects of the subject technology relate to systems, methods, and machine-readable media for changing music of a video game based on a player's emotion. The method includes receiving indicators of emotion comprising in-game attributes of a player in a video game. The method also includes predicting an emotion of the player based on the indicators of emotion from the video game. The method also includes receiving original music from the video game. The method also includes…
Speaker conversion for video games
Granted: March 14, 2023
Patent Number:
11605388
This specification describes a computer-implemented method of generating speech audio for use in a video game, wherein the speech audio is generated using a voice convertor that has been trained to convert audio data for a source speaker into audio data for a target speaker. The method comprises receiving: (i) source speech audio, and (ii) a target speaker identifier. The source speech audio comprises speech content in the voice of a source speaker. Source acoustic features are…
Automated player sponsorship system
Granted: March 7, 2023
Patent Number:
11596872
Embodiments of the systems and methods disclosed herein provide a sponsor matching system in which players and sponsors can be matched. Upon a match based at least in part on stored sponsorship criteria and/or player preferences, a first sponsor can select a set of players to receive permission to select an advertisement associated with the first sponsor. Once a first player of the selected players selects an advertisement and an advertisement placement location associated with the first…
System and method for facilitating user defined virtual space
Granted: February 14, 2023
Patent Number:
11579745
A system and method for facilitating a user defined virtual space is disclosed. One or more virtual space locations and/or activities may be correlated with user specified geolocations. In some implementations, the user specified geolocations may be verified against one or more spatial requirements prior to recording the user selected space-geolocation correlations. A user request to initiate an action or activity in the virtual space may be received. Prior to executing the requested…
Reinforcement learning for concurrent actions
Granted: February 14, 2023
Patent Number:
11580378
A computer-implemented method comprises instantiating a policy function approximator. The policy function approximator is configured to calculate a plurality of estimated action probabilities in dependence on a given state of the environment. Each of the plurality of estimated action probabilities corresponds to a respective one of a plurality of discrete actions performable by the reinforcement learning agent within the environment. An initial plurality of estimated action probabilities…
Mechanism for information propagation and resolution in graph-based programming languages
Granted: February 7, 2023
Patent Number:
11573772
A visual-programming tool processes nodes of a graph corresponding to operations or functions in program code associated with a plurality of programs, (e.g., games), stored as graph of nodes with logical connections signifying inputs, outputs, and/or units of connected nodes. The visual-programming tool resolves valid types and/or units associated with respective connected nodes and can propagate valid types and/or units throughout the graph.
Edutainment overlay for learning foreign languages in video games
Granted: February 7, 2023
Patent Number:
11574557
Various aspects of the subject technology relate to systems, methods, and machine-readable media for learning a foreign language. The method includes executing a video game in a first human language. The method includes pausing gameplay of the video game for a paused time instance. The method includes executing a digital mini-puzzle game during the paused time instance in the gameplay of the video game, the digital mini-puzzle game executed in a second human language, the digital…
User interface rendering and post processing during video game streaming
Granted: January 31, 2023
Patent Number:
11565178
Systems and methods for conservation of bandwidth and improved user experience via enhanced streaming of video games. An example method includes receiving a request to remotely play a video game, the video game being executed by the system and streamed to a user device for presentation. The video game is executed, and rendered image frames are generated. Geometry data associated with the rendered image frames is generated, with the geometry data representing locations of geometric…
Method and system for automatic and interactive model training using domain knowledge in video games
Granted: January 31, 2023
Patent Number:
11565185
A computer-implemented method is provided of allowing a user to automatically transform domain knowledge into a machine learning model to be used in real-time operation of video games. The method comprises providing a user interface which allows a user to define domain knowledge relating to a video game by specifying one or more labeling functions; transforming the labeling functions into executable code; labeling raw data relating to the video game using the executable code to obtain…
Texture compression
Granted: January 31, 2023
Patent Number:
11568572
A computer-implemented method comprises receiving a first compressed representation of a texture map in a first compression format, wherein the first compressed representation has been compressed using a first compressor, and receiving an array of compression parameters for a second compressor, the array of compression parameters including one or more respective compression parameters for each of a plurality of pixel regions of the texture map. The method further comprises decompressing…
Subpixel text rendering
Granted: January 31, 2023
Patent Number:
11568836
A system may render glyphs based on stored textures without loss of quality at subpixel scales. The system may determine a content of a pixel of a display corresponds to a glyph, determine a subpixel alignment offset of a specified screen coordinates for the glyph with respect to the pixels of the display, based on the subpixel alignment offset, select one or more versions of the glyph from a plurality of versions of the glyph, a first version of the glyph of the plurality of versions of…
Generating facial position data based on audio data
Granted: January 24, 2023
Patent Number:
11562521
A computer-implemented method for generating a machine-learned model to generate facial position data based on audio data comprising training a conditional variational autoencoder having an encoder and decoder. The training comprises receiving a set of training data items, each training data item comprising a facial position descriptor and an audio descriptor; processing one or more of the training data items using the encoder to obtain distribution parameters; sampling a latent vector…
Feedback oriented gameplay sessions in video games
Granted: January 24, 2023
Patent Number:
11559746
Systems and methods are described herein for monitoring a gameplay session for violations of a policy and creating a remediation gameplay session through which remediation can be provided to players or player accounts that violate gameplay policies. The systems and methods can create a remediation gameplay session based in part on the game state data of the gameplay session during which the violation occurs.
Feedback oriented gameplay sessions in video games
Granted: January 24, 2023
Patent Number:
11559746
Systems and methods are described herein for monitoring a gameplay session for violations of a policy and creating a remediation gameplay session through which remediation can be provided to players or player accounts that violate gameplay policies. The systems and methods can create a remediation gameplay session based in part on the game state data of the gameplay session during which the violation occurs.
Enhanced animation generation based on motion matching using local bone phases
Granted: January 24, 2023
Patent Number:
11562523
Systems and methods are provided for enhanced animation generation based on using motion mapping with local bone phases. An example method includes accessing first animation control information generated for a first frame of an electronic game including local bone phases representing phase information associated with contacts of a plurality of rigid bodies of an in-game character with an in-game environment. Executing a local motion matching process for each of the plurality of local…
Generating facial position data based on audio data
Granted: January 24, 2023
Patent Number:
11562521
A computer-implemented method for generating a machine-learned model to generate facial position data based on audio data comprising training a conditional variational autoencoder having an encoder and decoder. The training comprises receiving a set of training data items, each training data item comprising a facial position descriptor and an audio descriptor; processing one or more of the training data items using the encoder to obtain distribution parameters; sampling a latent vector…
