Lucasfilm Patent Grants

Geometry tracking

Granted: October 17, 2017
Patent Number: 9792479
A method of motion capture may include accessing a 3D model of a subject, and associating the 3D model of the subject with a 2D representation of the subject in a plurality of frames. The method may also include identifying a change to the 2D representation of the subject between two or more of the plurality of frames, and deforming the 3D model in a virtual 3D space. In some embodiments, the deforming may be based on the identified change to the 2D representation and at least one…

Real-time content immersion system

Granted: October 3, 2017
Patent Number: 9779538
A method may include presenting a scene from linear content on one or more display devices in an immersive environment, and receiving, from a user within the immersive environment, input to change an aspect of the scene. The method may also include accessing 3-D virtual scene information previously used to render the scene, and changing the 3-D virtual scene information according to the changed aspect of the scene. The method may additionally include rending the 3-D virtual scene to…

Controlling a virtual camera

Granted: October 3, 2017
Patent Number: 9781354
Among other aspects, on computer-implemented method includes: receiving at least one command in a computer system from a handheld device; positioning a virtual camera and controlling a virtual scene according to the command; and in response to the command, generating an output to the handheld device for displaying a view of the virtual scene as controlled on a display of the handheld device, the view captured by the virtual camera as positioned.

Facial animation models

Granted: August 29, 2017
Patent Number: 9747716
A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a…

Adaptive temporal sampling

Granted: August 15, 2017
Patent Number: 9734615
An animation analyzer is configured to receive an animation sequence and to identify a subsample of the frames that are to be rendered. A rendering engine is configured to render the subsample of the frames. The rendering engine is further configured to identify the frames that have not been rendered and to generate in-betweens for the frames that have not been rendered. The rendering engine is further configured to assemble the subsample of frames and the in-betweens into a video…

Deep image data compression

Granted: August 15, 2017
Patent Number: 9734624
A method of compressing a deep image representation may include receiving a deep image, where the deep image may include multiple pixels, and where each pixel in the deep image may include multiple samples. The method may also include compressing the deep image by combining samples in each pixel that are associated with the same primitives. This process may be repeated on a pixel-by-pixel basis. Some embodiments may use primitive IDs to match pixels to primitives through the rendering…

Styling of computer graphics hair through volumetric flow dynamics

Granted: July 18, 2017
Patent Number: 9710966
Methods are disclosed for the computer generation of data for images that include hair, fur, or other strand-like material. A volume for the hair is specified, having a plurality of surfaces. A fluid flow simulation is performed within the volume, with a first surface of the volume being a source area through which fluid is simulated to enter the volume, and a second surface being an exit surface through which fluid is simulated as exiting the volume. The fluid flow simulation may be…

Immersion photography with dynamic matte screen

Granted: July 18, 2017
Patent Number: 9710972
A method may include displaying, on one or more display devices in a virtual-reality environment, a visual representation of a 3-D virtual scene from the perspective of a subject location in the virtual-reality environment. The method may also include displaying, on the one or more display devices, a chroma-key background with the visual representation. The method may further include recording, using a camera, an image of the subject in the virtual-reality environment against the…

Post-render motion blur

Granted: July 11, 2017
Patent Number: 9704229
A method of rendering stereo images includes receiving a first image of an object comprising rendered color information. The first image of the object is rendered using a first camera position. The method also includes receiving a second image of the object. The second image of the object is rendered using a second camera position, and pixels in the second image comprise locations of corresponding pixels in the first image. The method additionally includes coloring the pixels in the…

Deep image identifiers

Granted: July 11, 2017
Patent Number: 9704290
A method may include receiving a plurality of objects from a 3-D virtual scene. The plurality of objects may be arranged in a hierarchy. The method may also include generating a plurality of identifiers for the plurality of objects. The plurality of identifiers may include a first identifier for a first object in the plurality of objects, and the identifier may be generated based on a position of the first object in the hierarchy. The method may additionally include performing a…

Flight path correction in virtual scenes

Granted: June 20, 2017
Patent Number: 9684993
A method includes receiving a first motion path for an object, where an orientation of the object is not aligned with the first motion path for the object for at least a portion of the first motion path. The method also includes receiving a first motion path for a virtual camera and determining a speed of the object along the first motion path for the object. The method additionally includes calculating a second motion path for the object based on the speed of the object along the first…

Scale independent tracking pattern

Granted: June 6, 2017
Patent Number: 9672417
In one aspect, a computer implemented method of motion capture, the method includes tracking the motion of a dynamic object bearing a pattern configured such that a first portion of the patterns is tracked at a first resolution and a second portion of the pattern is tracked at a second resolution. The method further includes causing data representing the motion to be stored to a computer readable medium.

Simulation object connections

Granted: May 30, 2017
Patent Number: 9665966
Representing a connection between objects in a simulation includes identifying, on a source object to be used in a simulation process, a source point that is available for creating a connection to another object. On a target object, a target point is identified for use in creating the connection. At least one of the source object and the target object is a rigid object. A spring element having respective ends at the source point and the target point is created, and at least one property…

Automated camera calibration methods and systems

Granted: May 2, 2017
Patent Number: 9641830
Methods and systems are disclosed for calibrating a camera using a calibration target apparatus that contains at least one fiducial marking on a planar surface. The set of all planar markings on the apparatus are distinguishable. Parameters of the camera are inferred from at least one image of the calibration target apparatus. In some embodiments, pixel coordinates of identified fiducial markings in an image are used with geometric knowledge of the apparatus to calculate camera…

Virtual-scene control device

Granted: April 18, 2017
Patent Number: 9626786
A handheld device includes: an input control configured to control and modify a virtual scene including a virtual camera; and a display that shows a representation of the controlled and modified virtual scene generated by the virtual camera. A system includes: a computer system configured to execute program instructions for generating a virtual scene including a virtual camera; and handheld device configured to communicate with the computer system for controlling and modifying the…

Determining control values of an animation model using performance capture

Granted: March 21, 2017
Patent Number: 9600742
Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input…

Animation environment

Granted: January 31, 2017
Patent Number: 9558578
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for animation. An animation application creates an animation environment. An input device receives input from a user to the animation application. An output device displays output to the user of the animation application. The animation application is configured to have a mode of operation that includes displaying, through the output device, a 3D animation view of the animation environment…

Calibrating stereoscopic cameras

Granted: December 13, 2016
Patent Number: 9519976
A stereoscopic camera calibration target includes: first illumination points on a first surface; second illumination points on a second surface, the first and second surfaces being planar, parallel to each other, and spaced from each other; and circuitry that sets a strobe frequency of the first and second illumination points. A method includes: moving a calibration target in front of a stereoscopic camera, the calibration target comprising first points on a first surface and second…

Path and speed based character control

Granted: November 29, 2016
Patent Number: 9508176
A 3D animation environment that includes an animation object is generated. A movement speed is assigned to object the 3D animation environment. An animation path containing at least first and second waypoints is generated. An animation sequence is generated by identifying a first section of the animation path connected to the first waypoint. A first animation of the animation object is generated in which the animation object moves along the first section of the path at the movement…

Flexible 3-D character rigging blocks with interface obligations

Granted: November 29, 2016
Patent Number: 9508178
A method of generating an animation rig for a 3-D computing environment may include accessing a plurality of blocks, each representing a particular rig element, and including interfaces that govern interactions with other rig elements and information for generating a portion of the animation rig corresponding to the particular rig element represented by the block. The method may also include receiving a selection of a first block that includes a first interface and first information and…