Changelog.ggBeta
HomeGamesUpdatesPricingMethodology
Steam News31 January 20251y ago

LlaMaCpp integration in Unreal Engine 5

I have managed to integrate the LlaMaC++ project in UE5 to load Large Language Models (Meta Llama 3.1) and generate text dynamically.

Full notes

Full More than words update

Read the full published notes in a cleaner layout. The original post stays linked below.

What changed

0 fixes0 additions5 changes0 removals
  • UI and audio
changedI have managed to integrate the LlaMaC++ project in UE5 to load Large Language Models (Meta Llama 3.1) and generate text dynamically. The main improvement is that now the speed in the generation of the responses is substantially better than previous versions.
changedInterface to configure the android was finished.
changedStartup interface was finished.
changedMain interaction interface was updated.
changedNext step: State machine for animations, localization for different languages, auto-save option, etc.

More than words changes

changedI have managed to integrate the LlaMaC++ project in UE5 to load Large Language Models (Meta Llama 3.1) and generate text dynamically. The main improvement is that now the speed in the generation of the responses is substantially better than previous versions.
changedInterface to configure the android was finished.
changedStartup interface was finished.
changedMain interaction interface was updated.
changedNext step: State machine for animations, localization for different languages, auto-save option, etc.

I have managed to integrate the LlaMaC++ project in UE5 to load Large Language Models (Meta Llama 3.1) and generate text dynamically. The main improvement is that now the speed in the generation of the responses is substantially better than previous versions.

  • Integration of LlaMaC++ in UE5 which allows to run the LLM locally (no internet needed and anonymous conversation).

  • The execution of the LLM supports the speeds: Normal, Medium, High and Real Time (default option, only the CPU is used).

  • You can choose the sampler: Top K or Mirostat 2.

  • The android has memories of past conversations.

  • Interface to configure the android was finished.

  • Startup interface was finished.

  • Main interaction interface was updated.

Next step: State machine for animations, localization for different languages, auto-save option, etc.

Note: I have managed to apply a workaround to completely decensor the LLM, however, it seems to cause the LLM to become more repetitive, more experimentation is necessary.

Source

Steam News / 31 January 2025

Open original post

Changelog.gg summarizes and formats this update. How we read updates.