There are two Karaite sources on the early Karaite settlement in Jerusalem: the writings of Daniel al-Qumisi and the lists of the heads of the community (nesi`im).

Daniel al-Qumisi composed two major works: (i) An epistle to the Diaspora - the author calls upon the Karaites living outside the Holy Land to settle in Jerusalem, to mourn the city's destruction and to pray that God take mercy upon his people and redeem them. During this period many Karaites settled in Jerusalem, which had become a major center of Karaism. (b) A commentary on the Book of Daniel - this holds a chronology of the author's activities in Persia, his homeland. He left his hometown Qumis westward no later than 873 CE, and in c. 875 journeyed to Palestine through Syria, where he was active until c. 900 CE.

The lists of the heads of the community (nesi`im) - in Jerusalem, Cairo and Damascus - trace their descent to `Anan and the House of David. The lists trace the first nesi`im of Jerusalem back to the ninth century CE, though this theory seems improbable as it leaves many gaps in the genealogy starting from `Anan. Furthermore, the Karaite nesi`im, which are said to have held office in Jerusalem during the ninth century, are not mentioned in any non-Karaite document.