METHODS AND SYSTEMS OF ENRICHING BLENDSHAPE RIGS WITH PHYSICAL SIMULATION
Granted: May 10, 2018
Application Number:
20180130245
Methods, systems, and computer-readable memory are provided for determining time-varying anatomical and physiological tissue characteristics of an animation rig. For example, shape and material properties are defined for a plurality of sample configurations of the animation rig. The shape and material properties are associated with the plurality of sample configurations. An animation of the animation rig is obtained, and one or more configurations of the animation rig are determined for…
RECORDING HIGH FIDELITY DIGITAL IMMERSIVE EXPERIENCES THROUGH OFF-DEVICE COMPUTATION
Granted: May 3, 2018
Application Number:
20180124370
Systems and methods are described for recording high fidelity augmented reality or virtual reality experiences through off-device computation. In one implementation, an augmented reality system renders an augmented reality object overlaid over a real-world environment; captures video and audio data of the real-world environment during rendering of the augmented reality object; and stores augmented reality object data associated with the rendered augmented reality object. The augmented…
INTERACTIVE VIDEO GAME METHOD AND SYSTEM
Granted: April 19, 2018
Application Number:
20180104597
One particular implementation of the present invention may take the form of a method and apparatus for providing various movements as input to a video game. The method and apparatus may detect the body movements of a video game player and interpret those movements as inputs to the video game. The video game may then compare the movements of the user to expected movements to determine if the correct movement was performed by the user. The video game may also display a video game…
REAL TIME SURFACE AUGMENTATION USING PROJECTED LIGHT
Granted: April 12, 2018
Application Number:
20180101987
A method of augmenting a target object with projected light is disclosed. The method includes determining a blend of component attributes to define visual characteristics of the target object, modifying an input image based, at least in part, on an image of the target object, wherein the modified input image defines an augmented visual characteristic of the target object, determining a present location of one or more landmarks on the target object based, at least in part, on the image of…
DISTRIBUTION CHANNEL USING AUDIO/VISUAL RECOGNITION
Granted: April 12, 2018
Application Number:
20180101896
Systems and methods are provided for providing a platform to provide virtual storefronts to consumers. Environmental elements are associated with specific consumer services on computer server. A user in the environment takes audio or visual recordings of an environmental element and uploads the recordings to the server. The server determines the appropriate consumer service associated with the recorded environmental element and provides the user with a reference to the service.…
REAL-TIME HIGH-QUALITY FACIAL PERFORMANCE CAPTURE
Granted: April 5, 2018
Application Number:
20180096511
A method of transferring a facial expression from a subject to a computer-generated character and a system and non-transitory computer-readable medium for the same. The method can include receiving an input image depicting a face of a subject; matching a first facial model to the input image; generating a displacement map representing of finer-scale details not present in the first facial model using a regression function that estimates the shape of the finer-scale details. The…
MULTI-GRANULAR RIGS FOR DISTRIBUTED NODE-BASED INTERACTIVE WORKFLOWS
Granted: April 5, 2018
Application Number:
20180096509
Systems and methods are described for leveraging distributed computation systems to split animation application processing of node graphs into two components: 1) a low complexity, primary node graph, that is evaluated by the application of the local device; and 2) one or more, higher complexity, companion node graphs that connect to the primary node graph, and are evaluated by a distributed computation system. As the local device evaluates the original, low complexity node graph, an…
POINT CLOUD NOISE AND OUTLIER REMOVAL FOR IMAGE-BASED 3D RECONSTRUCTION
Granted: April 5, 2018
Application Number:
20180096463
Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve…
DEEP-LEARNING MOTION PRIORS FOR FULL-BODY PERFORMANCE CAPTURE IN REAL-TIME
Granted: April 5, 2018
Application Number:
20180096259
Training data from multiple types of sensors and captured in previous capture sessions can be fused within a physics-based tracking framework to train motion priors using different deep learning techniques, such as convolutional neural networks (CNN) and Recurrent Temporal Restricted Boltzmann Machines (RTRBMs). In embodiments employing one or more CNNs, two streams of filters can be used. In those embodiments, one stream of the filters can be used to learn the temporal information and…
ARCHITECTURE FOR MANAGING TRANSMEDIA CONTENT DATA
Granted: March 29, 2018
Application Number:
20180091573
A system for managing non-linear transmedia content data is provided. Memory stores a plurality of transmedia content data items and associated linking data which define time-ordered content links between the plurality of transmedia content data items. The plurality of transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween. A control engine receives one or…
VISUALISATION AND NAVIGATION OF TRANSMEDIA CONTENT DATA
Granted: March 29, 2018
Application Number:
20180089905
A method of rendering content items on a display via an electronic device involves mapping linked content items to a three-dimensional object defined by layout data. The layout data is then transmitted to an electronic device for display.
RECOMMENDER ENGINE AND USER MODEL FOR TRANSMEDIA CONTENT DATA
Granted: March 29, 2018
Application Number:
20180089573
A recommender engine is configured to access memory and surface transmedia content items; and/or linked transmedia content subsets; and/or one or more identifications of identified users; and/or content items of the plurality of transmedia content items associated with at least one identified user. The surfaced items are presented for selection by the given user via the transmedia content linking engine as one or more user-selected transmedia content items.
USER MODELLING AND METADATA OF TRANSMEDIA CONTENT DATA
Granted: March 29, 2018
Application Number:
20180089330
There is provided a system for linking transmedia content subsets. A memory stores a plurality of transmedia content data items and associated linking data which define time-ordered content links between the plurality of transmedia content data items. The plurality of transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a transmedia content model that…
RENDERING AND INTERACTING WITH TRANSMEDIA CONTENT DATA
Granted: March 29, 2018
Application Number:
20180089201
A method is provided for rendering a representation of and interacting with transmedia content on an electronic device. Transmedia content data is received at the electronic device. The transmedia content data comprises: a plurality of transmedia content data items; linking data which define time-ordered content links between the plurality of transmedia content data items, whereby the plurality of transmedia content data items are arranged into linked transmedia content subsets…
MODEL-BASED TEETH RECONSTRUCTION
Granted: March 29, 2018
Application Number:
20180085201
A system and method for non-invasive reconstruction of an entire object-specific or person-specific teeth row from just a set of photographs of the mouth region of an object (e.g., an animal) or a person (e.g., an actor or a patient) are provided. A teeth statistic model defining individual teeth in a teeth row can be developed. The teeth statistical model can jointly describe shape and pose variations per tooth, and as well as placement of the individual teeth in the teeth row. In some…
DIRECT MANIPULATION INTERPOLATION AND GHOST WEDGING FOR DISTRIBUTED NODE-BASED INTERACTIVE WORKFLOWS
Granted: March 15, 2018
Application Number:
20180075639
A distributed computation system is leveraged to evaluate many possible results of a rig near the current pose to obtain predicted poses. A user locally runs an animation application instance to manipulate an animated object including a rig and shape. Depending on a user's selection or modification of a rig control of the rig, changes to the rig control are predicted. Based on the predicted changes to the rig control, the distributed computation system evaluates the rig to obtain…
SYSTEM FOR SIMULATING PYROTECHNICS
Granted: March 8, 2018
Application Number:
20180067331
One embodiment of the present disclosure may take the form of a projection module for projecting onto a projection surface. The projection module includes a light source emitting a beam of light, a diffractive optical element in optical communication with the light source, the diffractive optical element acts to split the beam of light into a plurality of diffracted light beams, a lens assembly in optical communication with the diffractive optical element and configured to converge the…
SYSTEM AND METHOD FOR CLIENT-SIDE ADVERTISEMENT RETRIEVAL
Granted: February 15, 2018
Application Number:
20180047066
Techniques are described for retrieving advertisements for insertion into a document. Embodiments receive a document comprising a request to retrieve a plurality of advertisement creatives. In response to transmitting the request specified within the received document to the advertisement management system, a single software object defining all of the plurality of advertisement creatives is received. Embodiments insert each of the plurality of advertisement creatives into the document,…
PLACING LARGE OBJECTS AND OBJECTS SEPARATED BY LARGE DISTANCES IN AUGMENTED REALITY
Granted: February 15, 2018
Application Number:
20180046861
Systems and methods are described for placing large objects and objects separated by large distances in an AR environment. An AR headset system may place and generate digital objects using relative geographical coordinates (e.g., latitude, longitude, and altitude) between the user's current position and the object being placed. In one implementation, a digital object's geographical coordinates may be calculated by determining a user's geographical coordinates, using a distance…
ADAPTIVE POLYNOMIAL RENDERING
Granted: February 8, 2018
Application Number:
20180040160
Embodiments can provide adaptive image filtering. Under this approach, image quality can be enhanced by adjusting an approximation function to better adapt image signals in different parts of an image. Certain parts of the image may be enhanced using a certain approximation function while some other parts of the image may be enhanced using a different approximation function. In certain embodiments, the approximation function selected for a part of the image can be a polynomial function…
