Operatie Infiltratie
An interactive virtual play where children are playfully challenged to make their voices heard through mini-games via Twitch, infiltrating places normally inaccessible to them. The story unfolds based on participants' input during a live stream.
Project Info
- Engine:
- Unreal Engine 5.2.1
- Language:
- UE Blueprints
- Duration:
- 10 weeks (4 days/week)
- Type:
- Virtual Production/Mixed Reality
- Reason:
- Project for VPRO Medialab
My Contributions
- ✓ Worked on Twitch x Unreal Engine Compatibility
- ✓ Worked on Minigame #1
- ✓ Created & Implemented SFX for Minigame #1
- ✓ Created OST for Minigame #2
- ✓ Contributed ideas to the show concept.
Gallery
Twitch Integration
We have used the TwiWorks 3rd party plugin to be able to read the Twitch Chat inside of Unreal Engine and fire off events that way, so that the chat was actually interactive. Since we only had 10 weeks to do everything from start to finish, creating something from scratch would not be feasible. Whenever “the game” starts, a browser pops up, causing you to log in and those credentials are being sent thru to the project. The Twitch Chat itself gets stored into a variable for later use. (see first blueprint) Every time a message is sent, that message will be stored into a “Twitch Message” variable, the latest message will be stored in the “Latest Message” variable and then “OnNewMessage” will run. (see second blueprint)
Twitch Login/Credentials
Visual representation of the Twitch login flow.
Twitch New Message Handling
Graffiti Font
I have imported the Graffiti Font made by Rida into the Engine and created a Material with it so we could use it to have text in different places during the experience.
Graffiti Font Material
The material setup for the custom font.
SFX & OST
I have sound-designed all the SFX for Minigame #1 and the OST for Minigame #2 using Fl Studio with creative input from Hendrik Walther.
OST Minigame #2
The original soundtrack created for the second minigame.