Technology Pipeline for Large Scale Cross-Lingual Dubbing of Lecture Videos into Multiple Indian Languages
Authors:
Anusha Prakash,
Arun Kumar,
Ashish Seth,
Bhagyashree Mukherjee,
Ishika Gupta,
Jom Kuriakose,
Jordan Fernandes,
K V Vikram,
Mano Ranjith Kumar M,
Metilda Sagaya Mary,
Mohammad Wajahat,
Mohana N,
Mudit Batra,
Navina K,
Nihal John George,
Nithya Ravi,
Pruthwik Mishra,
Sudhanshu Srivastava,
Vasista Sai Lodagala,
Vandan Mujadia,
Kada Sai Venkata Vineeth,
Vrunda Sukhadia,
Dipti Sharma,
Hema Murthy,
Pushpak Bhattacharya
, et al. (2 additional authors not shown)
Abstract:
Cross-lingual dubbing of lecture videos requires the transcription of the original audio, correction and removal of disfluencies, domain term discovery, text-to-text translation into the target language, chunking of text using target language rhythm, text-to-speech synthesis followed by isochronous lipsyncing to the original video. This task becomes challenging when the source and target languages…
▽ More
Cross-lingual dubbing of lecture videos requires the transcription of the original audio, correction and removal of disfluencies, domain term discovery, text-to-text translation into the target language, chunking of text using target language rhythm, text-to-speech synthesis followed by isochronous lipsyncing to the original video. This task becomes challenging when the source and target languages belong to different language families, resulting in differences in generated audio duration. This is further compounded by the original speaker's rhythm, especially for extempore speech. This paper describes the challenges in regenerating English lecture videos in Indian languages semi-automatically. A prototype is developed for dubbing lectures into 9 Indian languages. A mean-opinion-score (MOS) is obtained for two languages, Hindi and Tamil, on two different courses. The output video is compared with the original video in terms of MOS (1-5) and lip synchronisation with scores of 4.09 and 3.74, respectively. The human effort also reduces by 75%.
△ Less
Submitted 1 November, 2022;
originally announced November 2022.
Nontrivial electrophoresis of silica micro and nanorods in a nematic liquid crystal
Authors:
Muhammed Rasi M,
Archana S,
Ravi Kumar Pujala,
Surajit Dhara
Abstract:
We study DC and AC electrophoresis of silica micro and nanorods in a thin film of a nematic liquid crystal. These particles induce virtual topological defects and also demonstrate nontrivial electrophoresis in a nematic liquid crystal. We measure several nonlinear electrophoretic mobility coefficients and compare with those calculated theoretically. We demonstrate a competing effect of the elastic…
▽ More
We study DC and AC electrophoresis of silica micro and nanorods in a thin film of a nematic liquid crystal. These particles induce virtual topological defects and also demonstrate nontrivial electrophoresis in a nematic liquid crystal. We measure several nonlinear electrophoretic mobility coefficients and compare with those calculated theoretically. We demonstrate a competing effect of the elastic and electrostatic torques that arises due to tilting of the rods with respect to the liquid crystal director. A basic theory describing this effect allows us to measure the effective polarizability of the rods. Our approach is simple and applicable to a wide variety of asymmetric and polarizable particles.
△ Less
Submitted 24 April, 2022;
originally announced April 2022.
Interactions of charged microrods in chiral nematic liquid crystals
Authors:
Muhammed Rasi M,
Ravi Kumar Pujala,
Sathyanarayana Paladugu,
Surajit Dhara
Abstract:
We study the pair interaction of charged silica microrods in chiral nematic liquid crystals and show that the microrods with homeotropic surface anchoring form a bound state due to the competing effect of electrostatic (Coulomb) and elastic interactions. The robustness of the bound state is demonstrated by applying external electrical and mechanical forces that perturbs their equilibrium position…
▽ More
We study the pair interaction of charged silica microrods in chiral nematic liquid crystals and show that the microrods with homeotropic surface anchoring form a bound state due to the competing effect of electrostatic (Coulomb) and elastic interactions. The robustness of the bound state is demonstrated by applying external electrical and mechanical forces that perturbs their equilibrium position as well as orientation. In the bound state we have measured the correlated thermal fluctuations of the position, using two-particle cross-correlation spectroscopy that uncovers their hydrodynamic interaction. These findings reveal unexplored aspects of liquid-crystal dispersions which are important for understanding the assembly and dynamics of nano and microparticles in chiral nematic liquid crystals.
△ Less
Submitted 12 November, 2022; v1 submitted 9 February, 2021;
originally announced February 2021.
