For the past couple of months I’ve been working on bringing TensorFlow to UE4, enabling the use of state of the art machine learning in Unreal Engine projects. The plugin has reached something I think is ready to try out, but it is very much a work in progress so please check it out and give some feedback if you can!

There’s the plugin

https://github.com/getnamo/tensorflow-ue4

and the examples project

https://github.com/getnamo/tensorflow-ue4-examples

There are pretty detailed instructions at the repositories outlining how to use the plugin with examples.

What examples you ask?

Basic Add/Subtract float arrays

https://github.com/getnamo/tensorflow-ue4-examples/blob/master/Content/Scripts/addExample.py

A simple example that shows how to pass data into python, running tensorflow with the data and then passing results back out to UE4

Mnist Recognition using UE4 textures

https://github.com/getnamo/tensorflow-ue4-examples/blob/master/Content/Scripts/mnistSpawnSamples.py

Maybe you want to recognize hand written digits using UE4 textures? How about drawing shapes in your browser?

Upcoming Pong example

Not quite ready to use yet, but soon there will be a pong AI example, trained using basic q learning

Which one will be the champion?

Try it out and pop any feedback you may have on https://forums.unrealengine.com/community/work-in-progress/1357673-tensorflow