Story Manager by Watson helps artists explore story!
Story Manager by Watson uses Watson’s cognitive ability to understand both story and people, enabling both filmmakers and VR experience creators the ability to rapidly create and try out different ideas without the enormous time overhead involved with making new edits or writing AI branching software in gaming engines. This amplifies creativity by seeding the director with a solution to story as well as the ability to drive changes in a more efficient way, ultimately leading to the best possible creative solution.
Who will this help?
Story Manager will help producers cut costs by reducing the time spent editing. Virtual Reality software engineers will also save time by not having to write and test machine learning algorithms to implement branching schemes in emergent narratives. This breakthrough will help the bottom line for all productions and promote creative freedom.
Story Manager by Watson is a tool used in two ways: 1) as a plugin to non linear video applications such as Adobe Premiere, Avid Media Composer or Final Cut Pro and 2) as an api object used in gaming engines like Unity or Unreal to create interactive cinematic VR experiences.
Story Manager Plug in for Non Linear Video Editing applications
Once the plug in is launched the user will be presented with GUI that asks for:
- The input and output specifics of the video… Traditional Video/360 Video
- The script for the project
Once the data is entered the plug in will analyze all video files and present another GUI where all faces identified in the video are presented along with names parsed from the script. The intent is for the user to help Watson identify all persons in the video by name. After every person in the video is identified Watson then edits a rough cut of the video.
Supervised Machine Learning (Domain Knowledge)
Watson learns how to edit by analyzing hundreds of movies produced in the past. For a specific film he learns genre, characters, emotion, point of view and how it relates to how the film is edited. He learns how and when to cut for subjectivity based on whose scene it is in the film (point of view). Watson is also able to learn cinematography as a byproduct. Voice assisted editing is also enabled for fine tune editing after the rough cut.
Story Manager API for Unity and Unreal Gaming Engines
The story manager API for Unity and Unreal interprets user tone and intent by using natural processing. This information along with user interaction within the VR experience will help Watson determine which story node to branch the user down. Story nodes and experience management treatments will be provided for Watson to ingest and Watson uses his knowledge about story plus deduction concerning user intent to branch each user.
Similar to the plugin example, Watson will ingest treatments and nodal information and present GUI to the software engineer to determine all characters in the drama.
Story Manager by Watson
Now let’s create it!