John Smyth QC, who abused as many as 130 boys and young men at Christian summer camps, could have been brought to justice a decade ago, an independent review found.
Smyth – believed to be the most prolific serial abuser associated with the church – died in Cape Town in 2018 at the age of 75.
Mr Welby “could and should” have formally reported the abuse to authorities in 2013, the review said.
It found that “had that been done, on the balance of probabilities” Smyth could have been brought to justice “at a much earlier point” than a Hampshire Police investigation in early 2017.
Speaking to Channel 4 News on Thursday, Mr Welby said: “I have been giving [resigning] a lot of thought for actually quite a long time, there is nothing over the last 10 years that has been as horrible as dealing with numerous abuse cases.
“I have given [resigning] a lot of thought and have taken advice as recently as this morning from senior colleagues, and, no, I am not going to resign.”
Asked if he considered resigning on Thursday morning, Mr Welby said “yes”.
The archbishop also said he donated money to Smyth on missions in Zimbabwe.
He added: “Lots of people funded his mission out there. I think on two separate occasions I gave £40 or £50.”