Hello Wolfgang,
ADV7612 just puts whatever is in the audio packets on the HDMI stream out on the pins-- it doesn't process or interact with the data at all so I'm not sure how the ADV7612 could add any noise. What do you see on the output pins when there is a problem?
Dave