Too many hunter and gatherer societies were focused on just hunting and gathering (and nomadic) to develop this stuff really early on. Religion, arts, music, etc. developed once people settled down near a stable food resource, or had agriculture.
Blombos cave in South Africa provided pierced shell beads...art...dated to 100,000 years before present.
There is a bone flute attributed to Neanderthals (Divja Babe, Slovenia)...music...dated at 55,000 years before present. Not even anatomically modern humans, our species seems to have gotten music from Neanderthals.
The Indonesian island of Sulawesi has given up cave paintings that rival the oldest in Europe for age, as old as those at El Castillo in Spain dated nearly 41,000 years before present, and remarkable because the "reverse handprint" style graffiti seems a common theme throughout the Paleolithic era and across the span of continents.
Portable art in the form of "Venus" fertility figures, various animals, and even the "Lion Man" Löwenmensch from Hohlenstein, many of which date up to 40,000 years before present.
Red Ochre is another common theme throughout, ritual use as a pigment and as a medium to be carved can again be found across the gamut and throughout the time period under discussion.
My point being "(r)eligion, arts, music, etc." have been with humanity a VERY long time, cross culturally and cross species of homo, appear to be universal pursuits, and are linked inextricably with reaching out to the Divine.
Moreover, at Skhul cave at Qafzeh, Israel the oldest known to date careful human burials were found, dated conservatively at 100,000 years old, including a Cro Magnon man with a boar mandible placed carefully across his chest, and a mother and child whose bones were deliberately stained with red ochre.
The oldest careful Neanderthal burial is noted as 130,000 years ago, at Krapina in Croatia.
Shanidar 1 (Iraq) is a Neanderthal that was not only carefully buried, but because of illness and injury had to have a great deal of compassionate assistance to survive during his 40 years of life. This demonstrates Neanderthals were cooperative to the point of providing aid to their elderly and infirm. Another Neanderthal find at La Chapelle-aux-Saints suggests the same theme, though this find still seems to be under question.
The oldest ritual burial in Australia is dated at 42,000 years ago at Lake Mungo.
So the question to me is not "who has seniority?" among world religions. Every single major world faith owes a debt of gratitude to our prehistoric forebears.
The question to me has long been "why are we religious, if there is nothing there?"