What you're saying is a reason why it is controversial. However, in my view, many people (Catholic or otherwise) who venerate Mary with what I consider false narratives about her being a perpetual virgin, and leading ultimately to calling her "Queen of Heaven", praying to her, etc. is idolatry...