We teamed up with PieLab for this project, where we had to develop both a custom hardware and software solution, as well as creating the animated content. The latter was our biggest challenge in the project. The museum's desire to have the characters talk, and tell their story themselves, required a great deal of innovation.
In order for us to deliver on this challenge, a technology analysis scoped the possibilities. The first solution would be to 3D animate the characters from the bottom up, which would be very expensive and time consuming. The second solution would be a sort of “cut-out” animation (like in Monty Python), which would be inexpensive but also poor quality.
A third solution was identified, with the new emergence of deepfake technology, wherein we would use original images, and apply artificial intelligence (AI) software, to manipulate the pixels within the images and make them “talk”.