Skip to main content

Elys Listen

Offline speech-to-text for Unreal Engine 5. Elys Listen captures microphone audio and transcribes it locally with a bundled whisper.cpp backend — no cloud, no network, no API keys. It is Blueprint-first and ships as a fully standalone plugin (no other Elys plugin required).

Why Elys Listen​

  • 100% offline — audio never leaves the machine. Multiplayer-safe: only the transcribed text needs to be replicated, never the audio.
  • Whisper, multilingual — 99+ languages out of the box (MIT-licensed models).
  • Pluggable backend — IERP_STTBackend lets you swap in other engines later.
  • Transparent chaining — emits an OnText (FString) event that drops straight into Elys Mind (LLM) or Elys Speak (TTS). See Chaining.

Installation​

Install Elys Listen from the FAB Marketplace via the Epic Games Launcher (Vault → Add to Project), then enable it in Edit → Plugins → Elys'Plugins.

Download a Whisper model from Tools → Elys Listen → Download Whisper Models, pick a backend in Project Settings → Plugins → Elys Listen (STT), and you are ready. See the Setup Guide.

A 30-second example​

UERP_STTComponent* STT = Actor->FindComponentByClass<UERP_STTComponent>();
STT->OnSTTResult.AddDynamic(this, &AMyActor::HandleTranscript);
STT->StartListening();

In Blueprint: add an Elys STT Component, bind On STT Result, call Start Listening. That's it.

At a glance​

EngineUE 5.7 (Win64; Mac/Linux planned)
Backendwhisper.cpp (MIT), multilingual
DependencyAudioCapture (engine plugin) — no external Elys plugin
OutputOnSTTResult (FERP_STTResult) and neutral OnText (FString)