Should I be getting Ovarian Cysts at my age?

I am 53, menopausal with no cervix or uterus but still have my ovaries. I've had a right ovarian cyst now for 2+ years that the GYN is watching closely. Recently, the ultrasound showed a size 4.5 cyst and more (small) cysts are showing up not only on my right ovary but on my left as well. I've been referred to a GYN/Oncologist based on the Ultrasound I had 2 weeks ago. My question is how am I getting these when I haven't ovulated in over 10 years and why did my GYN wait so long. Also, right about the time the cyst first showed up my stomach has grown to a size that makes me look pregnant. Could this be related to the cyst?