For the past couple of months I’ve been working on bringing TensorFlow to UE4, enabling the use of state of the art machine learning in Unreal Engine projects. The plugin has reached something I think is ready to try out, but it is very much a work in progress so please check it out and give some feedback if you can!
There’s the plugin
https://github.com/getnamo/tensorflow-ue4
and the examples project
https://github.com/getnamo/tensorflow-ue4-examples
There are pretty detailed instructions at the repositories outlining how to use the plugin with examples.
What examples you ask?
Basic Add/Subtract float arrays
https://github.com/getnamo/tensorflow-ue4-examples/blob/master/Content/Scripts/addExample.py
A simple example that shows how to pass data into python, running tensorflow with the data and then passing results back out to UE4
Mnist Recognition using UE4 textures
https://github.com/getnamo/tensorflow-ue4-examples/blob/master/Content/Scripts/mnistSpawnSamples.py
Maybe you want to recognize hand written digits using UE4 textures? How about drawing shapes in your browser?
Upcoming Pong example
Not quite ready to use yet, but soon there will be a pong AI example, trained using basic q learning
Which one will be the champion?
Try it out and pop any feedback you may have on https://forums.unrealengine.com/community/work-in-progress/1357673-tensorflow
Getnamo - Devblog 