It has been reported on the authority of Jabir b. Samura who said:

I went with my father to the Messenger of Allah (may peeace be upon him) and I heard him say: This religion would continue to remain powerful and dominant until there have been twelve Caliphs. Then he added something which I couldn't catch on account of the noise of the people. I asked my father: What did he say? My father said: He has said that all of them will be from the Quraish.
حَدَّثَنَا نَصْرُ بْنُ عَلِيٍّ الْجَهْضَمِيُّ، حَدَّثَنَا يَزِيدُ بْنُ زُرَيْعٍ، حَدَّثَنَا ابْنُ عَوْنٍ، ح وَحَدَّثَنَا أَحْمَدُ بْنُ عُثْمَانَ النَّوْفَلِيُّ، - وَاللَّفْظُ لَهُ - حَدَّثَنَا أَزْهَرُ، حَدَّثَنَا ابْنُ عَوْنٍ، عَنِ الشَّعْبِيِّ، عَنْ جَابِرِ بْنِ سَمُرَةَ، قَالَ انْطَلَقْتُ إِلَى رَسُولِ اللَّهِ صلى الله عليه وسلم وَمَعِي أَبِي فَسَمِعْتُهُ يَقُولُ ‏"‏ لاَ يَزَالُ هَذَا الدِّينُ عَزِيزًا مَنِيعًا إِلَى اثْنَىْ عَشَرَ خَلِيفَةً ‏"‏ ‏.‏ فَقَالَ كَلِمَةً صَمَّنِيهَا النَّاسُ فَقُلْتُ لأَبِي مَا قَالَ قَالَ ‏"‏ كُلُّهُمْ مِنْ قُرَيْشٍ ‏"‏ ‏.‏
Reference : Sahih Muslim 1821 f
In-book reference : Book 33, Hadith 10
USC-MSA web (English) reference : Book 20, Hadith 4482
  (deprecated numbering scheme)