The Lord of the Rings: The Hunt for Gollum will be the first major Hollywood film to use AI for a very specific reason: to recreate the iconic eyes of Andy Serkis’s Gollum character.
The Return of a Legend
Andy Serkis, the mastermind behind Gollum’s unforgettable performance, has confirmed that AI will play a role in the upcoming trilogy of Amazon’s The Lord of the Rings: The War of the Rohirrim, however it has also been revealed to be in use for the upcoming ‘The Lord of the Rings: The Hunt for Gollum’. This time, the technology won’t be used to create an entire character, but rather to perfect the tiny, yet vital, details – specifically Gollum’s eyes. Serkis has been working with AI developer and researcher, Tomer Shalev, to make the AI-powered eyes as realistic as possible.
Serkis has been pushing the boundaries of motion capture for years, and his collaborations with the likes of Weta Digital have set new standards in the industry. This time, however, he’s focusing on a specific challenge that has proven difficult to overcome using traditional methods – recreating the way Gollum’s eyes appear in the dark.
The Limitations of Traditional Motion Capture
Traditional motion capture relies on a series of cameras and sensors to track an actor’s movements and translate them into digital data. However, this process can be limited in its ability to capture the subtleties of light and shadow, particularly when it comes to small details like eye movements. AI, on the other hand, can analyze vast amounts of data and make predictions about how a character’s eyes would behave in different lighting conditions, allowing for a more realistic and immersive experience.
While AI is being used in various aspects of film production, this project marks a significant milestone in the use of AI for motion capture. The goal is to create a more natural and organic look, without the need for extensive post-processing or CGI.
What This Means
The use of AI in The Lord of the Rings: The Hunt for Gollum marks a significant step forward in the use of AI for motion capture in film. By leveraging AI to recreate the subtleties of Gollum’s eyes, the filmmakers are pushing the boundaries of what’s possible in motion capture. This technology has the potential to revolutionize the way we create digital characters, allowing for more realistic and immersive experiences in the future.



