In August 2001, Singh was brought to New Japan Pro Wrestling by Masahiro Chono and Giant Silva, the biggest Tag Team in history. They first teamed up at the Tokyo Dome in October, called "Club 7", and won a Handicap Match against Yutaka Yoshie, Kenzo Suzuki, Hiroshi Tanahashi and Wataru Itonue. Singh suffered another big loss on Tag Team in March, being defeated by Manabu Nakanishi.
The Great Khali made his debut on Smackdown, defeating wrestlers such as Funaki and Rey Mysterio. He had his first feud with The Undertaker on Smackdown, where he defended and defended him until he was unconscious. Khali later entered the ring to hit The Undertaker in a Last Man Standing match at SummerSlam, but The Undertaker won the match with a chokeslam.
On October 31, Khali and his manager Daivari made their ECW debut, a match between Daivari and Shannon Moore. Khali attacked Moore after his fight against Daivari and continued fighting with his rivals.
During WWE Season XXII in 2007, Khali faced several hardships, including losing to Batista at Summerslam, losing to Rey Mysterio in a match, and losing to The Great Khali in a Triple Threat match. At Survivor Series (2007), Khali defeated Hornswoggle due to Finlay's interference in the match, leading to a brawl. At Armageddon, Khali lost to Finlay after defeating him with the Shillelagh. Khali participated in the Royal Rumble, but was eliminated by The Undertaker. At WrestleMania XXIV, he participated in a Battle Royal, losing to The Undertaker. He also feuded with Big Show, who defeated Khali at Backlash. On SmackDown! Since May! In the episode, Khali was tasked with taking the title from Undertaker, but was attacked by Gogoplata and suffered a neck injury.
Khali participated in Royal Rumble, losing to Randy Orton and Vladimir Kozlov. He also lost in a Triple Threat match in Smackdown and in a real match in ECW for Money in the Bank in Wrestlemania. Khali defeated Santino Marella in Smackdown and later defeated CM Punk in RAW. In Backlash 2009, Khali attempted to betray Santina but was unsuccessful. She was enraged by SmackDown! comedian Jim Ross and Beth Phoenix, who retorted Santina for her crown and offered Khali a pin. Khali tried to betray Santina, but she was eliminated.