It would be really hard to make a case for Sunday worship deriving from pagan cults. AFAIK, there are NO pagan cults that had a weekly worship. Some cults apparently met for meals, but not on a weekly basis. (Does anyone know about Mithraism?)
In Judaism, of course, there was the Sabbath...