Scarlet Letter Question help?!!!?

It has been a long time for me since reading the novel but I believe the minister sees this because he is an adulterer along with Hester...in other words, this is the first moment of realization that he too should be attributed the letter A.