It was narrated from Aishah that:
the Messenger of Allah (ﷺ) swore to keep away from his wives, because Zainab had sent back her gift and 'Aishah said: "She has disgraced you." He became angry and swore to keep away from them. (ES)
English reference (ES): Vol. 3, Book 10, Hadith 2060 (ES)
Arabic reference (ES): Book 10, Hadith 2138 (ES)