Taking jibe at burqa, Johnson on Sunday mocked women who wear the full-body veil "look like letter boxes" and compared them to "bank robbers".
Founder and president of the Conservative Muslim Forum Lord Sheikh told the BBC the party should take "severe action" against Mr Johnson.
"It is any wonder that many younger women have internalised this poisonous chauvinism by asserting that it is their human right to hide their faces?"
Speaking in East Lothian, she said: "I think that this wasn't an off-the-cuff slip".
Chelsea sign goalkeeper Kepa Arrizabalaga for world-record £71m fee
Castles told the Transfer Window podcast: "Kovacic has been offered to Chelsea to facilitate a deal for Courtois ". Athletic Bilbao has already confirmed that Spaniard's release clause of £71m has been paid.
If you use the analogy of Christianity, would you ever write in The Telegraph that you should have a debate about banning Christians for wearing crucifixes?
Johnson resigned as Foreign Secretary in July, accusing Theresa May of killing "the Brexit dream" with her plan to seek close economic ties with the European Union after the United Kingdom leaves the bloc next year.
Following a growing chorus of condemnation over Johnson's derogatory views he made about Muslim women wearing burqas, Britain's Conservative Party Chairman Brandon Lewis said on Tuesday he had asked Johnson to apologize. "If we fail to speak up for liberal values then we are simply yielding ground to reactionaries and extremists".
"It is crass and it must stop, and it must be condemned by the leadership right from the prime minister down".
But a Sky News poll found that 45% of voters thought he should apologise, while 48% thought he should not.