It wasnarrated from 'Aishah that the Prophet (ﷺ) said:
"If a manstays among a people, he should not fast without their permission." (ID)
English reference (ID): Vol. 1, Book 7, Hadith 1763 (ID)
Arabic reference (ID): Book 7, Hadith 1835 (ID)