Just three months ago Facebook set out to do something nobody else had done before: ship AI-based style transfer running live, in real time, on mobile devices. “This was a major engineering challenge,” reports Mike Schroepfer, CTO, Facebook.
Caffe2Go was born; a new deep learning platform that can capture, analyze and process pixels in real time on a mobile device. “We found that by condensing the size of the AI model used to process images and videos by 100x, we’re able to run deep neural networks with high efficiency on both iOS and Android,” add Schroepfer. It all happens in the palm of your hand, so you can apply styles to videos as you’re taking them.
AI is already making an impact on Facebook users. “AI assists in automatically translating posts for friends who speak different languages, and in ranking News Feed to show people more relevant stories, says Schroepher. Over the next three to five years, we’ll see even more new features as AI expands across Facebook.”