Language:
كتاب مناقب الأنصار
63  
Merits of the Helpers in Madinah (Ansaar)
(25)
Chapter: The building of the Ka'bah
(25)
باب بُنْيَانُ الْكَعْبَةِ
Sahih al-Bukhari 3830

Narrated `Amr bin Dinar and 'Ubaidullah bin Abi Yazid:

In the lifetime of the Prophet (ﷺ) there was no wall around the Ka`ba and the people used to pray around the Ka`ba till `Umar became the Caliph and he built the wall around it. 'Ubaidullah further said, "Its wall was low, so Ibn Az-Zubair built it."

حَدَّثَنَا أَبُو النُّعْمَانِ، حَدَّثَنَا حَمَّادُ بْنُ زَيْدٍ، عَنْ عَمْرِو بْنِ دِينَارٍ، وَعُبَيْدِ اللَّهِ بْنِ أَبِي يَزِيدَ، قَالاَ لَمْ يَكُنْ عَلَى عَهْدِ النَّبِيِّ صلى الله عليه وسلم حَوْلَ [place]الْبَيْتِ [/place]حَائِطٌ، كَانُوا يُصَلُّونَ حَوْلَ [place]الْبَيْتِ، [/place]حَتَّى كَانَ عُمَرُ، فَبَنَى حَوْلَهُ حَائِطًا ـ قَالَ عُبَيْدُ اللَّهِ ـ جَدْرُهُ قَصِيرٌ، فَبَنَاهُ ابْنُ الزُّبَيْرِ‏.‏
Reference : Sahih al-Bukhari 3830
In-book reference : Book 63, Hadith 55
USC-MSA web (English) reference : Vol. 5, Book 58, Hadith 171
  (deprecated numbering scheme)