Judging by the TW ladies Jack first encountered, Yvonne Hartman's One was Amnesty International, but, yeah, Jack certainly knows he made a difference in the "culture" of TW, & it must surely have been a long, hard slog, & after the fall of One, it was all on his back. Given that--plus everything else the Doctor put him through--it's no wonder that Jack snapped back when the Doctor tried to chew him out, it's a wonder Jack didn't send him into another regeneration.