В 1917 году переехал с родителями в США. С 1920 года выступал дирижёром и руководителем театральных оркестров, сопровождавших немое кино. Работал в компании Universal Pictures, где с 1940 года и до выхода на пенсию в 1969 году был директором музыкального департамента. Был музыкальным директором практически всех картин киностудии между 1949 и 1969 годами. Как продюсер и режиссёр с 1940 по 1948 год выступал также под псевдонимом Джозеф Сэнфорд (Joseph G. Sanford). Был дирижёром и руководителем «The Universal International Orchestra», принимавшим участие как в записи саундтрэков к картинам киностудии, так и в сольной деятельности и звукозаписи (оркестр, в частности, сопровождал Фрэнка Синатру и Сэмми Дэвиса-младшего).
Джозеф Гершенсон был номинирован на премию «Оскар» в 1955 году за кинокартину «История Глена Миллера» (англ. ), с Джеймсом Стюартом в главной роли, и в 1967 году за музыкальную кинокартину «Весьма современная Милли» (англ. ), с Джули Эндрюс в главной роли.
Автор музыки к советскому мультипликационному фильму «Снежная королева» (1957, с Фрэнком Скиннером и Артемием Айвазяном). Среди известных фильмов Дж. Гершенсона — «Спартак», «Папа Гусь» (англ. ), «Имитация жизни». Особенно плодотворно работал в жанре вестерна.
Музыкальный директор, дирижёр
- Angel in My Pocket (1969)
- Sweet Charity (1969)
- Hellfighters (1968)
- The Pink Jungle (1968)
- The Hell with Heroes (1968)
- In Enemy Country (1968)
- Did You Hear the One About the Traveling Saleslady? (1968)
- The Shakiest Gun in the West (1968)
- Journey to Shiloh (1968)
- What’s So Bad About Feeling Good? (1968)
- Madigan (1968)
- Nobody’s Perfect (1968)
- Rosie! (1967)
- Counterpoint (1967)
- Games (1967)
- Banning (1967)
- The King’s Pirate (1967)
- Rough Night in Jericho (1967)
- The Reluctant Astronaut (1967)
- Ride to Hangman’s Tree (1967)
- Thoroughly Modern Millie (1967)
- Tobruk (1967)
- Gunfight in Abilene (1967)
- The Ballad of Josie (1967)
- Gambit (1966)
- Let’s Kill Uncle, Before Uncle Kills Us (1966)
- Texas Across the River (1966)
- The Appaloosa (1966)
- Beau Geste (1966)
- And Now Miguel (1966)
- A Man Could Get Killed (1966)
- Gunpoint (1966)
- Madame X (1966)
- Incident at Phantom Hill (1966)
- The Rare Breed (1966)
- The Ghost and Mr. Chicken (1966)
- Moment to Moment (1965)
- Blindfold (1965)
- The War Lord (1965)
- That Funny Feeling (1965)
- Love and Kisses (1965)
- A Very Special Favor (1965)
- I Saw What You Did (1965)
- The Art of Love (1965)
- Fluffy (1965)
- Shenandoah (1965)
- Mirage (1965)
- The Sword of Ali Baba (1965)
- The World of Abbott and Costello (1965)
- Bus Riley’s Back in Town (1965)
- Strange Bedfellows (1965)
- The Night Walker (1964)
- Taggart (1964)
- Father Goose (1964)
- Kitten with a Whip (1964)
- Send Me No Flowers (1964)
- The Lively Set (1964)
- I’d Rather Be Rich (1964)
- Island of the Blue Dolphins (1964)
- Bullet for a Badman (1964)
- Bedtime Story (1964)
- The Brass Bottle (1964)
- Captain Newman, M.D. (1963)
- For Love or Money (1963)
- The Thrill of It All (1963)
- A Gathering of Eagles (1963)
- Tammy and the Doctor (1963)
- The List of Adrian Messenger (1963)
- Showdown (1963)
- The Ugly American (1963)
- Freud (1962)
- If a Man Answers (1962)
- Kingu Kongu tai Gojira (King Kong vs. Godzilla, 1962)
- The Spiral Road (1962)
- Lonely Are the Brave (1962)
- Six Black Horses (1962)
- Lover Come Back (1961)
- Back Street (1961)
- Come September (1961)
- The Last Sunset (1961)
- Posse from Hell (1961)
- The Secret Ways (1961)
- The Great Impostor (1961)
- Midnight Lace (1960)
- Spartacus (1960)
- Seven Ways from Sundown (1960)
- Portrait in Black (1960)
- Hell Bent for Leather (1960)
- Operation Petticoat (1959)
- Pillow Talk (1959)
- The Big Fisherman (1959)
- This Earth Is Mine (1959)
- The Wild and the Innocent (1959)
- Imitation of Life (1959)
- A Stranger in My Arms (1959)
- No Name on the Bullet (1959)
- Never Steal Anything Small (1959)
- Money, Women and Guns (1958)
- The Perfect Furlough (1958)
- The Restless Years (1958)
- Once Upon a Horse… (1958)
- Ride a Crooked Trail (1958)
- Kathy O' (1958)
- Raw Wind in Eden (1958)
- The Saga of Hemp Brown (1958)
- Wild Heritage (1958)
- Voice in the Mirror (1958)
- The Thing That Couldn’t Die (1958)
- This Happy Feeling (1958)
- The Last of the Fast Guns (1958)
- Girls on the Loose (1958)
- Live Fast, Die Young (1958)
- Touch of Evil (1958)
- Summer Love (1958)
- Damn Citizen (1958)
- Flood Tide (1958)
- Day of the Bad Man (1958)
- The Lady Takes a Flyer (1958)
- The Female Animal (1958)
- Love Slaves of the Amazons (1957)
- The Monolith Monsters (1957)
- Slim Carter (1957)
- The Tarnished Angels (1957)
- My Man Godfrey (1957)
- Appointment with a Shadow (1957)
- Joe Dakota (1957)
- Interlude (1957)
- Man in the Shadow (1957)
- Slaughter on Tenth Avenue (1957)
- The Land Unknown (1957)
- Man of a Thousand Faces (1957)
- The Midnight Story (1957)
- Quantez (1957)
- The Deadly Mantis (1957)
- Joe Butterfly (1957)
- The Kettles on Old MacDonald’s Farm (1957)
- Tammy and the Bachelor (1957)
- The Girl in the Kremlin (1957)
- Man Afraid (1957)
- The Night Runner (1957)
- Kelly and Me (1957)
- The Tattered Dress (1957)
- Mister Cory (1957)
- The Incredible Shrinking Man (1957)
- Battle Hymn (1957)
- Gun for a Coward (1957)
- Four Girls in Town (1957)
- Istanbul (1957)
- This Is Russia! (1957)
- Rock, Pretty Baby (1956)
- The Great Man (1956)
- The Mole People (1956)
- Written on the Wind (1956)
- The Unguarded Moment (1956)
- Showdown at Abilene (1956)
- Pillars of the Sky (1956)
- Walk the Proud Land (1956)
- Away All Boats (1956)
- I’ve Lived Before (1956)
- Behind the High Wall (1956)
- Congo Crossing (1956)
- Francis in the Haunted House (1956)
- The Toy Tiger (1956)
- Star in the Dust (1956)
- A Day of Fury (1956)
- The Kettles in the Ozarks (1956)
- The Creature Walks Among Us (1956)
- Red Sundown (1956)
- Raw Edge (1956)
- Backlash (1956)
- The Price of Fear (1956)
- Never Say Goodbye (1956)
- World in My Corner (1956)
- The Benny Goodman Story (1956)
- There’s Always Tomorrow (1956)
- The Square Jungle (1955)
- The Spoilers (1955)
- Tarantula (1955)
- The Rawhide Years (1955)
- Running Wild (1955)
- Lady Godiva of Coventry (1955)
- The Second Greatest Sex (1955)
- Kiss of Fire (1955)
- All That Heaven Allows (1955)
- Female on the Beach (1955)
- To Hell and Back (1955)
- Francis in the Navy (1955)
- The Private War of Major Benson (1955)
- One Desire (1955)
- Foxfire (1955)
- Abbott and Costello Meet the Mummy (1955)
- Ain’t Misbehavin' (1955)
- The Shrike (1955)
- The Purple Mask (1955)
- This Island Earth (1955)
- The Looters (1955)
- Cult of the Cobra (1955)
- Ma and Pa Kettle at Waikiki (1955)
- Chief Crazy Horse (1955)
- The Man from Bitter Ridge (1955)
- Smoke Signal (1955)
- Revenge of the Creature (1955)
- Man Without a Star (1955)
- Captain Lightfoot (1955)
- So This Is Paris (1955)
- Abbott and Costello Meet the Keystone Kops (1955)
- Six Bridges to Cross (1955)
- Destry (1954)
- Sign of the Pagan (1954)
- The Yellow Mountain (1954)
- Bengal Brigade (1954)
- Four Guns to the Border (1954)
- Ricochet Romance (1954)
- Naked Alibi (1954)
- The Black Shield of Falworth (1954)
- Dawn at Socorro (1954)
- Magnificent Obsession (1954)
- Francis Joins the WACS (1954)
- Далёкий край, где золото под ногами (The Far Country, 1954)
- Black Horse Canyon (1954)
- Drums Across the River (1954)
- Johnny Dark (1954)
- Tanganyika (1954)
- Fireman Save My Child (1954)
- Playgirl (1954)
- Rails Into Laramie (1954)
- Yankee Pasha (1954)
- Saskatchewan (1954)
- Ma and Pa Kettle at Home (1954)
- Creature from the Black Lagoon (1954)
- Ride Clear of Diablo (1954)
- The Glenn Miller Story (1954)
- Border River (1954)
- Tumbleweed (1953)
- War Arrow (1953)
- Walking My Baby Back Home (1953)
- The Glass Web (1953)
- The Veils of Bagdad (1953)
- The All American (1953)
- East of Sumatra (1953)
- The Golden Blade (1953)
- Abbott and Costello Meet Dr. Jekyll and Mr. Hyde (1953)
- All I Desire (1953)
- The Great Sioux Uprising (1953)
- Take Me to Town (1953)
- Francis Covers the Big Town (1953)
- The Lone Hand (1953)
- It Came from Outer Space (1953)
- Column South (1953)
- Law and Order (1953)
- Abbott and Costello Go to Mars (1953)
- It Happens Every Thursday (1953)
- Ma and Pa Kettle on Vacation (1953)
- Gunsmoke (1953)
- Seminole (1953)
- City Beneath the Sea (1953)
- Girls in the Night (1953)
- The Lawless Breed (1953)
- The Redhead from Wyoming (1953)
- Meet Me at the Fair (1953)
- The Black Castle (1952)
- The Raiders (1952)
- Back at the Front (1952)
- Horizons West (1952)
- Yankee Buccaneer (1952)
- Lost in Alaska (1952)
- Son of Ali Baba (1952)
- The Duel at Silver Creek (1952)
- Francis Goes to West Point (1952)
- Ma and Pa Kettle at the Fair (1952)
- Just Across the Street (1952)
- Has Anybody Seen My Gal (1952)
- Scarlet Angel (1952)
- Red Ball Express (1952)
- Bronco Buster (1952)
- Steel Town (1952)
- The Treasure of Lost Canyon (1952)
- Here Come the Nelsons (1952)
- The Cimarron Kid (1952)
- Meet Danny Wilson (1951)
- Flame of Araby (1951)
- The Strange Door (1951)
- Cave of Outlaws (1951)
- Reunion in Reno (1951)
- The Lady from Texas (1951)
- Little Egypt (1951)
- Iron Man (1951)
- Cattle Drive (1951)
- Comin' Round the Mountain (1951)
- Hollywood Story (1951)
- The Fat Man (1951)
- Smuggler’s Island (1951)
- Ma and Pa Kettle Back on the Farm (1951)
- Air Cadet (1951)
- Abbott and Costello Meet the Invisible Man (1951)
- Up Front (1951)
- Under the Gun (1951)
- Target Unknown (1951)
- Mystery Submarine (1950)
- Kansas Raiders (1950)
- Undercover Girl (1950)
- Wyoming Mail (1950)
- Saddle Tramp (1950)
- Shakedown (1950)
- Western Courage (1950, Joe Gershenson)
- Winchester '73 (1950)
- Peggy (1950)
- Spy Hunt (1950)
- Abbott and Costello in the Foreign Legion (1950)
- South of Santa Fe (1949)
- Side Show Fakir (1938)
- Fits and Benefits (1938, Josef Gershenson)
Продюсер
- The Leech Woman (1960)
- Curse of the Undead (1959)
- Monster on the Campus (1958)
- Step Down to Terror (1958)
- Bob and Sally (1948, J. G. Sanford)
- The Time of Their Lives (1946)
- The Runaround (1946)
- She Wrote the Book (1946, Joe Gershenson)
- Tangier (1946, Joe Gershenson)
- Little Giant (1946)
- House of Dracula (1945)
- Shady Lady (1945, Joe Gershenson)
- Enter Arsene Lupin (1944)
- Hat Check Honey (1944)
- So’s Your Uncle (1943)
- He’s My Guy (1943)
- The Great Impersonation (1942)
- Strictly in the Groove (1942, Joseph G. Sanford)
- Juke Box Jenny (1942, Joseph G. Sanford)
- Swing It Soldier (1941, Joseph G. Sanford)
- Cracked Nuts (1941, Joseph G. Sanford)
- Too Many Blondes (1941, Joseph G. Sanford)
- Double Date (1941, Joseph G. Sanford)
- Six Lessons from Madame La Zonga (1941, Joseph G. Sanford)
- Where Did You Get That Girl? (1941, Joseph G. Sanford)
- Dark Streets of Cairo (1940, Joseph G. Sanford)
- Law and Order (1940, Joseph G. Sanford)
- I’m Nobody’s Sweetheart Now (1940, Joseph Sanford)
- Meet the Wildcat (1940, Joseph G. Sanford)
- Ragtime Cowboy Joe (1940, Joseph G. Sanford)
- Son of Roaring Dan (1940, Joseph G. Sanford)
- Bad Man from Red Butte (1940, Joseph Sanford)
- Riders of Pasco Basin (1940, Joseph G. Sanford)
- Ma, He’s Making Eyes at Me (1940, Joseph G. Sanford)
- West of Carson City (1940, Joseph G. Sanford)
Композитор
- Six Black Horses (1962)
- The Snow Queen (1957)
Саундтрэк
- Get Shorty (1995)
- The Reluctant Astronaut (1967)
- The Brass Bottle (1964)
- Touch of Evil (1958)
- Slim Carter (1957)
Актёр
- Midnight Lace (1960) — дирижёр
- Fits and Benefits (1938, Josef Gershenson) — дирижёр
Книги
- The reminiscences of Joseph Gershenson (воспоминания Джозефа Гершенсона). American Film Institute, 1976.
- Joseph Gershenson. American National Biography. т. 8, 1999.