Samsung wanted a marquee technology to show off their Artik embedded platform. We worked with Samsung to design an experience that would be engaging. This meant close collaboration on the content and quick pivots. We had to pivot quickly from one form factor to another due to licensing disagreements at the last minute, which meant last minute fabrication of a whole new formfactor.
We created a space ship that performed real-time image recognition. The result was a fun little toy that a child could move around a room and have it play audio that identified either friendly or enemy ships and an accompanying SFX. This was so successful that it was
highlighted at the Korean Electronics Show.
The technology that FS Studio implemented was a DeepNet using a Convolutional Neural Network (CNN). The DeepNet was implemented as a pure CPU (no
GPU) implementation in C++ and ran in realtime at approximately 20Hz. With further optimization we believe we could have gotten an order of magnitude speed increase.