Imagine watching a video in a different language, where the speaker’s lips match the new language, and their voice sounds just like the original. That’s exactly what Panjaya, a startup founded by deep learning specialists, is offering with its cutting-edge technology.
The company is changing the game in video dubbing by using artificial intelligence to create hyperrealistic translations. This innovative tool, called BodyTalk, automatically adapts videos to different languages, making them feel as natural as the original.
Panjaya’s Big Debut: BodyTalk and $9.5 Million in Funding
After quietly working behind the scenes for three years, Panjaya has finally unveiled its first product, BodyTalk, alongside securing $9.5 million in outside funding. The investment will help Panjaya grow its platform and reach more businesses in need of high-quality, multilingual video content.
BodyTalk is powered by generative AI and deepfake technology, but with a twist—it’s designed to enhance the video experience in a professional, business-friendly way.
A Look at the Founders and Their Journey
Panjaya’s founders, Hilik Shani and Ariel Shalom, are no strangers to deep learning technology. Before starting Panjaya, they spent most of their careers working on deep learning projects for the Israeli government. In 2021, they decided to take the leap into the startup world.
A year and a half ago, Guy Piekarz joined the team as CEO. Piekarz, who had sold his previous startup, Matcha, to Apple in 2013, brings a wealth of experience in media and technology. His background adds valuable leadership to Panjaya’s innovative approach.
How BodyTalk Works: Seamless Dubbing with AI
At the heart of Panjaya’s BodyTalk technology is a unique ability to offer video translations that go beyond just voice. The process begins with the AI translating the audio of the video into 29 different languages.
Then, the voice of the original speaker is mimicked, and their lip movements and physical gestures are modified to match the new language. The result is a dubbed video where the speaker appears to be naturally speaking the new language.
This process isn’t just automatic—it’s also flexible. Users can upload their videos to the platform, which then processes them in just a few minutes. The platform even comes with a dashboard that lets users make further edits to the video. While the technology is currently near real-time, Panjaya is aiming to improve it even further, bringing it closer to real-time video dubbing in the future.
A Custom AI Engine for Lip Syncing
What sets Panjaya apart from other companies in the video dubbing space is its lip-syncing technology. Unlike other tools, Panjaya’s deep learning team has built its own lip-syncing engine, ensuring that the speaker’s mouth movements match the new language in the most accurate way possible.
This is especially important when dealing with multiple speakers, different video angles, and various business use cases.
Join 450,000+ professionals from top companies like Microsoft, Apple, & Tesla and get the AI trends and tools you need to know to stay ahead of the curve 👇
Expanding Across Industries: Panjaya’s B2B Focus
Currently, Panjaya is focusing on B2B clients. Some of their early customers include well-known companies like TED and JFrog, which are using BodyTalk to enhance their video content. TED has reported that using Panjaya’s technology to dub their talks has led to a significant increase in viewership and engagement.
For example, TED talks dubbed with Panjaya’s tool have seen a 115% increase in views, with video completion rates doubling. Panjaya’s plans for the future are ambitious. While the company is currently focused on the business-to-business sector, it intends to expand into other industries, such as healthcare, sports, education, and marketing.
The company also plans to roll out an API, making it easier for other platforms to integrate the technology into their own systems.
Steering Clear of Deepfake Concerns
While Panjaya’s technology shares some similarities with deepfake tools, the company wants to distance itself from the negative connotations often associated with deepfakes. According to CEO Guy Piekarz, Panjaya isn’t focused on creating deceptive or misleading content.
Instead, the company prefers to describe its work as being part of the “deep real” category, emphasizing that its AI-generated translations are authentic and designed to serve legitimate business needs.
To ensure that its technology is used responsibly, Panjaya is implementing “guardrails” to protect against misuse. This includes plans for watermarking videos to make it clear when content has been altered. Panjaya is committed to maintaining ethical standards and preventing the spread of misinformation in the AI media space.
The Growing Demand for Dubbing in Global Markets
Though subtitles are common in today’s video content, dubbed videos still hold significant value, especially for international audiences. Research has shown that content delivered in a native language often results in better engagement and higher viewer retention.
For example, when TED used Panjaya’s BodyTalk to dub their talks, they saw a remarkable improvement in viewership. Panjaya’s pitch is that more natural, native-language content can help businesses build stronger connections with customers worldwide.
Whether it’s for marketing, education, or customer service, companies can use BodyTalk to create more authentic and engaging video content for global audiences.
A Competitive Market: Panjaya vs. Others in Video Dubbing
Panjaya is not the only company working on AI-driven video dubbing. Competitors like Vimeo, Eleven Labs, and Speechify are also in the mix. However, Panjaya’s custom-built technology, particularly its lip-syncing engine, gives it a unique edge in the market.
Join 450,000+ professionals from top companies like Microsoft, Apple, & Tesla and get the AI trends and tools you need to know to stay ahead of the curve 👇
By focusing on B2B applications and maintaining control over who accesses its tools, Panjaya is able to ensure that its technology is used ethically and effectively. The company’s commitment to addressing the challenges of AI-generated media, such as misinformation and misuse, positions it as a leader in the field.
Looking Ahead: What’s Next for Panjaya
Panjaya is on the cutting edge of video dubbing, and its innovative approach is poised to change how businesses approach video translation. With plans to expand its offerings and continue improving its AI tools, Panjaya is setting the stage for a future where video content can easily and accurately reach audiences in any language.
Key Takeaways:
- Panjaya’s BodyTalk uses AI to create realistic video dubbing with synchronized speech and lip movements.
- The product supports 29 languages and is available through an easy-to-use platform.
- Panjaya’s technology boosts video engagement, with TED experiencing a 115% increase in views.
- The company targets B2B clients but plans to expand into healthcare and education.
- Panjaya prioritizes ethical AI use and actively works to prevent misinformation.
Panjaya’s deepfake technology may be transforming video dubbing, but the company’s emphasis on authenticity and business applications makes it a standout in a crowded market. With its innovative approach and promising future, Panjaya is a name to watch in the world of AI-driven media.
