"I say that truly, deeply my heart goes out to Afghan women and girls in the country today under the Taliban," Sullivan said during a press briefing.

"We’ve seen what they’ve done before.  And that’s a very hard thing for any of us to face,' he said.

Meanwhile, Taliban spokesperson Zabihullah Mujahid on Tuesday said the group will support women's rights and a free media under Islamic law.

He made the remark during the first press conference addressed by the group since capturing Kabul on Sunday and taking control over the presidential palace.

"We want to do away with the factors for conflict. Therefore, the Islamic Emirate does not have any kind of hostility or animosity towards anybody," he was quoted as saying by Geo News, with an interpreter translating his speech in English.

He added that all animosity "has come to an end".

"We would like to live peacefully. We do not want any internal enemies or external enemies," he said.

"War has ended [...] (the leader) has pardoned everyone," he said.

"I would like to assure [them] that after consultations that will be completed very soon, we will be witnessing the formation of a strong, Islamic, and inclusive government, InshaAllah," he said.

On August 15, the Taliban completed their takeover of Afghanistan by entering Kabul.

Afghan President Ashraf Ghani left the country to prevent what he described as bloodshed that would occur if militants had to fight for the city.

Most countries have reduced or evacuated their diplomatic missions in the Central Asian country following the events.