(48) بَابُ مَنْ تَرَكَ بَعْضَ الاِخْتِيَارِ مَخَافَةَ أَنْ يَقْصُرَ فَهْمُ بَعْضِ النَّاسِ عَنْهُ فَيَقَعُوا فِي أَشَدَّ مِنْهُ
Narrated Aswad:
Ibn Az-Zubair said to me, "Aisha used to tell you secretly a number of things. What did she tell you about the Ka`ba?" I replied, "She told me that once the Prophet (ﷺ) said, 'O `Aisha! Had not your people been still close to the pre-Islamic period of ignorance (infidelity)! I would have dismantled the Ka`ba and would have made two doors in it; one for entrance and the other for exit." Later on Ibn Az-Zubair did the same.
Reference: Sahih al-Bukhari 126
In-book reference: Book 3, Hadith 68
USC-MSA web (English) reference(deprecated numbering scheme): Vol. 1, Book 3, Hadith 128