They were devoutees of Kali (the goddess that Indiana Jones fought), and some of the muslim "invaders" became devoutees of Kali. The Muslims who came to India adopted a lot of Hindu customs. Likewise with christianity in Europe. Roman Catholicism is Roman paganism.
