The monastery was founded by Sabbas the Sanctified in 483,[1] on the eastern side of the Kidron Valley, where - according to the monastery's own website - the first seventy hermits gathered around the hermitage of St Sabbas.[2] Later on, the laura relocated to the opposite, western side of the gorge, where the Church of Theoktistos was built in 486 and consecrated in 491.[2] The constant growth of the community meant that soon after, in 502, the Church of the God-bearing Virgin Mary, in Greek Theotokos, was built to serve as the main church of the monastery.[2] Saint Sabbas' Typikon, the set of rules applied at the Great Laura and recorded by the saint, eventually became the worldwide model of monastic life and liturgical order[2] known as the Byzantine Rite.

Mar Saba was the home of St. John of Damascus (676–749; Arabic: يوحنا الدمشقي), a key religious figure in the Iconoclastic Controversy, who, around 726, wrote letters to the Byzantine emperor Leo III the Isaurian refuting his edicts prohibiting the veneration of icons (images of Christ or other Christian religious figures). Born to a prominent Damascence political family, John worked as a high financial officer to the Umayyad Caliph Abd al-Malik; he eventually felt a higher calling and migrated to the Judaean desert, where he was tonsured and was ordained a hieromonk (monastic priest) at the Monastery of Mar Saba. St. John's tomb lies in a cave under the monastery.

Ancient sources describe an Arab attack on the monastery in 797, leading to the massacre of twenty monks.[3] The community seems to have also suffered under the persecutions of calip al-Hakim in 1009 as well as Turkmen raids in the 11th century but experienced occasional phases of peace as can be seen by the scribal and artistic activities.[4]

Mar Saba was the home of the famous Georgian monk and scribe Ioane-Zosime, who moved before 973 to Saint Catherine's Monastery taking several parchment manuscripts with him.[5]

The monastery kept its importance during the existence of the Catholic Kingdom of Jerusalem established by Crusaders in 1099.[6]

In 1504, the Serbian monastic community of Palestine, based out of the fourteenth century monastery of St. Michael the Archangel, purchased Mar Saba, which at the time was abandoned due to Bedouin raids. The Serbs controlled the monastery until the late 1630s, and the significant financial support the monastery received from the Tsar of Russia allowed them to run the monastery semi-independently from the Patriarch of Jerusalem, the monastery's nominal overseer (much to the vexation of the patriarchate). The Serbs' control of Mar Saba allowed them to play an important role in the politics of the Orthodox Church of Jerusalem, often siding with the Arabic laity and priests against the Greeks who dominated the episcopate. Serbian control of the monastery eventually ended in the 1600s when the monastery got into massive debt due to the simultaneous combination of a massive building program at the monastery and a cutting off of financial support from Russia due to the outbreak of the Time of Troubles. The Serbs were forced to sell the monastery to the Patriarch of Jerusalem in order to pay off their debts.[7]

Today,[when?] the complex houses 9 monks.