Live FX Documentation
  • 📚Getting Started
    • Introduction
      • Feature Comparison
      • Download & Install
      • Settings
        • System Settings
          • Custom Commands
          • Advanced
        • User Settings
        • Video IO Settings
          • Black Magic Troubleshooting
      • Helpful Shortcuts
        • Construct Shortcuts
        • Player Shortcuts
        • Viewport Shortcuts
        • ColorFX Shortcuts
        • Stage Lights Shortcuts
    • The Basics
      • Project Settings
      • Change Shot Framerate and Resolution
      • Change the Shot Length
      • Timecode
      • Working with Layers
      • General Tips
    • Helpful Links
    • First Time Start-Up
    • User Interface
  • ⚡Quickstart Example Projects
    • Simple Video Playback
    • Green Screen with 360 Background
    • LED Wall - Projection Mapping
    • LED Wall - Without Projection Mapping
    • Packaged Unreal Engine project Example
  • 📼Video Playback
    • Video-IO Settings
    • Playback h.264 files
    • Import Media and Maintain Folder Structure
  • 🎥Camera Tracking
    • Camera and Lens Calibration
    • Camera Trackers
      • REtracker Bliss
      • ZEISS CinCraft Scenario
      • MoSys
      • Stype
      • OptiTrack
      • HTC Mars Camtrack
      • Free D
      • iPhone Apps
    • How to apply camera tracking to a layer, image, or mask
    • How to manually adjust camera tracking speed and delay
    • How to delay the Inner Frustum
    • How to apply FIZ (Zoom and Focus) from Camera Tracking
  • Motion Control
    • Mark Roberts Motion Control (MRMC)
    • Motorized Precision
    • eMotimo
    • SISU
  • 🟩Green Screen Workflow
    • Qualifiers
    • Green Screen with Set Extension Workflow
    • Working with Ultimatte
  • 📺LED Workflow
    • Setting up an LED Wall
      • Set Up Nvidia Mosaic
      • Nvidia Multi-GPU Configuration
    • Stage Manager
    • How to make the inner frustum green
    • Switcher Node
    • Tips when using Projection Mapping
    • Using HDR
    • Projection Mapping Tutorials
      • Part 1: General Introduction to Projection Mapping
      • Part 2: : Projection Mapping - Media Types & Projection Models
      • Part 3: Projection Mapping on multiple walls
      • Part 4: Projection Mapping with Unreal Engine
      • Part 5: Set Extensions
  • 💡Lighting
    • Getting started with Image Based Lighting
    • Lighting Brands
      • Aputure
      • Creamsource
      • Kino Flo
        • Mimik 120
        • Freestyle
      • Prolycht
      • Quasar Science
    • How to Sample Multiple Video Sources through Videowall
    • Rec2020 Example Project
      • Megapixel HELIOS settings for Mimik
      • Blackmagic UltraStudio 4k Mini Settings
      • Setup Display Colorspace
      • Video IO Settings
      • Create and Set up your Project
      • Create and set up your Shot
      • Fix Jitter
  • 🎮Unreal Engine
    • Known Issues with Live FX <> Unreal
    • Set up Unreal Engine with Live FX
    • Play your Unreal Engine scene as a Game
    • How to Package an Unreal Engine Project for Live FX
      • Command Line Arguments
      • Before You Package
    • Unreal Web Remote Control (Optional)
    • Control UE through OSC
    • Take Recorder
    • Working with Sequencer
    • Unreal Optimization
      • Console Commands / Command Line Arguments
      • List of all Console Variables and Commands
        • Scalability Groups Console Variables
        • Renderer Console Variables
      • Baking Light
      • DLSS
  • ©️Cuebric Workflow
    • Projection Mapping with Cuebric Files
    • Non-Projection Mapping with Cuebric
  • 🧊2.5d Workflow
    • Projection Mapping 2.5d Workflow
    • Non-Projection Mapping 2.5d Workflow
  • 🖥️Multi-Computer Workflows
    • Sync Players
    • Sync Projects across Multiple Nodes
  • 🌅Live Looks - Live Grade LED Walls
    • How to Purchase and Install Live Looks
    • How to set up Live Looks with Brompton
    • Live Grading with Live Looks
  • 🗃️Compositing
    • Working with the Alpha Channel
    • Re-Map EXR channels
    • Working with Mattes
    • Opacity and Blend Modes
  • 🆘General Troubleshooting
    • 📰Licensing the Software
    • 🕙Dealing with Delay
    • 🖥️Networking Tips
    • ❓Frequently Asked Questions (FAQs)
      • Does Live FX support Unreal 5.3?
      • Why won't Live FX open when I have a second monitor hooked up?
      • How do I switch the toolset from Live FX to Scratch?
      • Where is the record button?
      • Why is my image dark (or why are my colors wrong)?
      • How do I close Live FX?
      • How do I minimize Live FX?
      • What is SCRATCH? What is Assimilate? Are they the same thing as Live FX?
      • How do I change the mouse from moving in circles to left/right?
    • Stuttering Playback
  • 📘User Guide (Old)
Powered by GitBook
On this page
  • Overview
  • 1. Required Setup
  • 2. Download and install Live FX Plugin for Unreal Engine Plugin
  • 3. Enable Plugins in UE
  • 4. Enable Live Link
  • 5. Save Live Link as Preset (Optional)
  • 6. Add Camera in Unreal Engine
  • 7. Set up Texture Share in Live FX
  • 8. Unreal Engine Live Link in Live FX
  • 9. Press Play in Unreal Engine
  1. Unreal Engine

Set up Unreal Engine with Live FX

PreviousKnown Issues with Live FX <> UnrealNextPlay your Unreal Engine scene as a Game

Last updated 1 year ago

Overview

Live FX works with Unreal Engine in various ways, but here is the basic overview:

  • Live FX takes in Camera Tracking data.

  • Live FX forwards tracking information to Unreal Engine and moves the Virtual Camera.

  • Unreal Engine Texture Share SDK is used to share the image from UE to Live FX.

  • Live FX then uses the image with LED and Greenscreen workflows.

Live FX implements camera tracking directly and forwards it to Unreal Engine, which means that even if your camera tracking solution doesn't have their own Unreal Engine plugin, or if it is outdated, it will still work as long as it is supported in Live FX.

You can also leverage to make changes to your unreal scene from other computers or tablets.

Make sure to follow each step as you go along.

1. Required Setup

Currently, you must be on a Windows machine and use Unreal Engine 5.3 for Live FX to work properly. There is a workaround for earlier versions of Unreal, make sure to if you need it.


2. Download and install Live FX Plugin for Unreal Engine Plugin

Download and Install the Live FX Plugin for UE.

  1. Download the latest Live FX Unreal Engine Plugin here:

  2. Unzip and place the whole Plug-in folder into your Project Plugins folder (recommended) or Engine Plugins folder.

  3. If your project does not have a Plugins folder, you can create one. Make sure to capitalize P and spell it “Plugins”. Your folder structure should look like this:

3. Enable Plugins in UE

  1. Go to Plugins and search for Live FX, if it’s not enabled, enable the plugin.

  1. Go to Plugins and search for Texture Share, enable the plugin (built-in).

  1. You can enable Web Remote Control now if you know you are going to use it later (optional).

  1. After enabling your plugins, restart Unreal Engine.

4. Enable Live Link

  1. Go to Window>Virtual Production and open the Live Link window.

You can also click on Window and just start searching for Live Link.

  1. In the Live Link Window, Click on Source, and go down to LiveFX LiveLink. You can leave the settings by default if using the same computer and press Ok.

    This can be because either Assimilate is not on, or it’s not set up correctly.

    If you have set up Live FX, make sure that in the Camera tab, the camera is set to “Active”.

5. Save Live Link as Preset (Optional)

It’s good practice to save your Preset.

  1. Click on Presets.

  2. Click on Save As Preset, and give it a name.

  1. Then in Edit>Project Settings

Search for Live Link Preset, select the “Default Live Link Preset”, and select the newly created preset.

6. Add Camera in Unreal Engine

Now let's set up the Camera in Unreal Engine.

  1. Add a Basic>Actor

  2. Rename this actor to something like “00_CamOffset”.

We will attach a camera with camera tracking, and this empty actor will allow us to move the camera without affecting tracking.

  1. Add a Cinematic>Cine Camera Actor.

  2. Give it a name, like “00_LiveFXCam”

I use the prefix 00_ so that it shows up at the top.

  1. In the Outliner, Click and drag the Cine camera onto the Empty Actor, so that the actor becomes the parent. The camera should be indented and look like this if done correctly:

  2. With the LiveFXCam selected, click on the “Add Component” button. Search for “Live FX” and attach the “Live FX Runtime Camera”.

  3. With the LiveFXCam selected, click on the “Add Component” button.

    Search for “Live Link” and attach the “Live Link Controller” component.

  4. With the Live Link ComponentController selected,

    Click on the dropdown for the Subject Representation, and select the LiveFX - Camera.

When you press play if the selected camera is not playing in the viewport, you may want to set up manually.

Optionally, instead of adding the "LiveFX_RuntimeCamera as a component to the camera, you can add it in the level blueprint, and by doing so, also allow for things like switching cameras dynamically.

You would set your blueprint up like this, drag your camera from the outliner into the level blueprint to get a reference of it, and replace the "0_Zeiss_CineCameraActor" reference with your camera:

A copy of this blueprint is provided here:

7. Set up Texture Share in Live FX

There are a few ways to work with the Texture Share image that comes from Unreal Engine.

If you are using a Camera Projection method with an Inner Frustum, you can choose the Projection Setup and then under Project Media, choose Live Capture > Unreal Texture Share, then you can follow your normal workflow.

For small walls, sometimes this is not necessary and it's preferred to not have an inner frustum at all. Here is one method to achieve that.

  1. Create a new project and set the resolution as needed, in my case I just use 1920x1080.

    In the construct, go to the Filler dropdown and add black or whichever you want.

  2. With the new Layer selected, on the bottom left, go to “Plug-Ins”.

  3. Select “Unreal Texture Share” and Apply on Layer.

8. Unreal Engine Live Link in Live FX

  1. Click on the Live FX menu, then click on the Live Links Menu.

  2. Click on Unreal Live Link. Press On.

    (Optional) Click Broadcast.

    Click Connect.

    *IP can be 127.0.0.1 if using the local machine

    **If you see numbers moving at the bottom, this is set up correctly.

  3. If using camera tracking, make sure your tracking is set up correctly and that you press “Apply” so that it applies to your camera.

  4. If not using camera tracking, go to the Camera tab and press “Active”

    You can manually move the camera in UE, by changing the values.

9. Press Play in Unreal Engine

  1. Go back to Unreal. Next to the Play button, click the hamburger button and select “New Editor Window (PIE)”,

  2. Go back to Live FX (The keyboard shortcut is Alt+Tab). If all is set up, you should see the image!

    If you see stretching pixels on the side, that means your comp is higher resolution than the Window you opened.

  3. If you are using camera tracking, try physically moving your camera.

    If you don't have camera tracking set up, try changing the pan from the camera menu. If all is set up correctly, you should see the scene moving in Unreal Engine.

If you want to be able to trigger Take Recorder from Unreal, make sure to select Auto Record here. Otherwise, you can leave it unchecked. If you haven’t set up Live FX properly yet, then you will likely see a yellow dot, and you may see the message “Can’t Evaluate frame for Live FX”.

Notice the Yellow Dot, which indicates it's not set up correctly yet.

Go to the Add Menu

Go to the Add Menu

Make sure the Camera is indented under the Actor
Add the Live FX Runtime Camera component to the Camera
Add the Live Link Controller component to the Camera

Maximize this new window so it takes up the entire screen. The size of the New Editor Window will be the resolution in Live FX, so if it is not maximized, it will be smaller than your monitor. For example, if you resize the window so that it is the left half of your 1920x1080 screen, the resolution would be 960x1080 (960=1920/2).

Try going to full screen with the UE scene and Alt+Tab to go back and check Assimilate. You can also to be smaller to match your window size.

Notice the pixel stretching. This is when the window is not in full screen mode.
Our scene looks and behaves as expected with Camera Tracking.
🎮
💡
ℹ️
https://blueprintue.com/blueprint/dhaupwq4/
change your composition resolution
Unreal Engine's Web Remote Control
contact us and let us know
https://www.assimilatesupport.com/akb/Download51050.aspx