After performing in the Nahal Brigade entertainment troupe during his army time, Gaon joined the "Yarkon Bridge Trio" (שלישיית גשר הירקון).

He was in the original singing group "HaTarnegolim" ("The Roosters"), founded in 1960 by Naomi Polani.

He became well known for his rendition of Naomi Shemer's Od Lo Ahavti Dai (lit.
I have not Loved Enough Yet).
 He performed at the Nobel Prize ceremony of Yitzhak Rabin, Shimon Peres and Yasser Arafat in Oslo, in 1994.
In 2009, Gaon recorded the song "Shir Ha’avoda Vehamlacha" for the organization Pioneers For A Cure, with the proceeds benefiting The Israel Cancer Association (ICA).

Gaon appeared with the Israel Cameri Theatre in productions that included "Chips with Everything", "Vitzek," and  "Kinneret Kinneret," by the National Laureate, Nathan Alterman.
 He left Israel in the early 1960s to study acting at the famous Herbert Berghof Studio in New York, under well-known acting teacher Uta Hagen, later graduating with honors from the RCA Institute for TV Production.

He returned to Israel to play the starring role in the 1966 stage production of the original Israeli musical comedy Kazablan, which became an immediate hit, and ran for more than 600 performances.
 The musical's huge success made this "young Jerusalem-born singer...not only...an overnight singing star, but also a figure of solidarity and pride for people of Sephardic origin, many of whom were entering a theatre for the first time."
Gaon later reprised his role in the 1974 film version.

He was cast as Yonatan Netanyahu in the Israeli film Mivtza Yonatan (English: Operation Thunderbolt) (1977).
He also appeared in Siege, Every Bastard a King, The Eagles Attack at Dawn, Joker, The Lover, and No-Way Street.
 He starred in the autobiographical feature, Ani Yerushalmi (lit.
I am a Jerusalemite) (1971).

He starred in several other TV series, including Krovim Krovim (1983), an Israeli sitcom.
He hosted his own TV show called Shishi BeGaon ("Friday with Gaon") on Israeli Channel One.
The show was extremely popular, with a successful run for a number of years.
 He later hosted a weekend talk show on commercial Channel 2.
Since 1997, he has been hosting a radio show on Reshet Bet called as "Gaon on the radio" (גאון ברדיו), in which he talks about the current weekly events and expresses his personal views on the various current weekly events.

Gaon moderated the Israel Broadcasting Authority documentary series for the Jubilee Year, entitled, T’kuma.
In 1998 he resigned from the show, explaining in his letter of resignation that he believed that the series displayed "overly biased pro-Arab views."
 "Gaon told the producers of the Channel 1 TV series that he could not tolerate one of the episodes, during which Arab terrorists, responsible for killing many Israelis in the 1970s, were seen to be glorified on the show."
After performing in the Nahal Brigade entertainment troupe during his army time, Gaon joined the "Yarkon Bridge Trio" (שלישיית גשר הירקון).
He was in the original singing group "HaTarnegolim" ("The Roosters"), founded in 1960 by Naomi Polani.
He became well known for his rendition of Naomi Shemer's Od Lo Ahavti Dai (lit. I have not Loved Enough Yet).  He performed at the Nobel Prize ceremony of Yitzhak Rabin, Shimon Peres and Yasser Arafat in Oslo, in 1994. In 2009, Gaon recorded the song "Shir Ha’avoda Vehamlacha" for the organization Pioneers For A Cure, with the proceeds benefiting The Israel Cancer Association (ICA).
Gaon appeared with the Israel Cameri Theatre in productions that included "Chips with Everything", "Vitzek," and  "Kinneret Kinneret," by the National Laureate, Nathan Alterman.  He left Israel in the early 1960s to study acting at the famous Herbert Berghof Studio in New York, under well-known acting teacher Uta Hagen, later graduating with honors from the RCA Institute for TV Production.
He returned to Israel to play the starring role in the 1966 stage production of the original Israeli musical comedy Kazablan, which became an immediate hit, and ran for more than 600 performances.  The musical's huge success made this "young Jerusalem-born singer...not only...an overnight singing star, but also a figure of solidarity and pride for people of Sephardic origin, many of whom were entering a theatre for the first time." Gaon later reprised his role in the 1974 film version.
He was cast as Yonatan Netanyahu in the Israeli film Mivtza Yonatan (English: Operation Thunderbolt) (1977). He also appeared in Siege, Every Bastard a King, The Eagles Attack at Dawn, Joker, The Lover, and No-Way Street.  He starred in the autobiographical feature, Ani Yerushalmi (lit. I am a Jerusalemite) (1971).
He starred in several other TV series, including Krovim Krovim (1983), an Israeli sitcom. He hosted his own TV show called Shishi BeGaon ("Friday with Gaon") on Israeli Channel One. The show was extremely popular, with a successful run for a number of years.  He later hosted a weekend talk show on commercial Channel 2. Since 1997, he has been hosting a radio show on Reshet Bet called as "Gaon on the radio" (גאון ברדיו), in which he talks about the current weekly events and expresses his personal views on the various current weekly events.
Gaon moderated the Israel Broadcasting Authority documentary series for the Jubilee Year, entitled, T’kuma. In 1998 he resigned from the show, explaining in his letter of resignation that he believed that the series displayed "overly biased pro-Arab views."  "Gaon told the producers of the Channel 1 TV series that he could not tolerate one of the episodes, during which Arab terrorists, responsible for killing many Israelis in the 1970s, were seen to be glorified on the show."
Yehoram Gaon