One of the disadvantages of video conferencing is that there is often no eye contact between users because the user's eyes are not looking at the camera. This is what Nvidia is trying to fix via Nvidia Broadcast 1.4.
The feature in question is called Eye Contact and is still in beta. The way it works is that the software will estimate and "change" the direction of the user's view so that it looks like he is looking at the camera. So the user can look in another direction -- for example a monitor -- but his eyes still look towards the camera.
Nvidia is not the first company to try to simulate the direction of the user's eyes during a video conference or video call. Apple did the same in 2019, when they released FaceTime Attention Correction in iOS 13.
Apple added this feature to "change" the direction of the user's eyes while looking at the screen in a FaceTime call, so that "eye contact" still occurs while on a video call.
Microsoft has also added a similar feature to the Surface Pro X in 2020, which works in video calling applications such as Teams and Skype, we were quoted as saying from Techspot, Monday (16/1/2023).
But the difference is, if Apple designed this point of view correction based on a conversation between two people, Nvidia's implementation is slightly different and looks more sophisticated. This Nvidia feature is designed for people who read scripts while recording video or doing live streaming.
Nvidia Broadcast 1.4 can also try to guess to stop this feature when the speaker is deliberately looking in a further direction, namely by making smoother transitions between real eyes and simulated eyes.
Of course, this feature is still in beta, and Nvidia still needs to test it with different types of eyes, colors and lighting conditions. They also ask users to send video clips to them to train the artificial intelligence-based system.