Originally Caityas were said to be the natural homes of earth spirits and were most often recognized in small stands of trees or even in a single tree. According to Jaina and Buddhist texts from about 200 BC, wandering Indian ascetics often gathered near Caityas. Pashupatinath is home to many Hindu mystics commonly called Sadhus. These particular Caityas line the steps opposite the main temple complex.

Pashupatinath is the most important Hindu temple in Kathmandu. Pilgrims travel from all over Nepal and India to offer prayers at the Temple. It is believed that to die, be creamated and have ones ashes carried away by the holy Bagmati River at Pashupatinath is to release one from the eternal cycle of birth, death and rebirth.