I think this is a fantastic idea to follow through with

you never know what could happen and knowing what your medical condition is (a name ) might help you on your life path. Maybe even finding ways to eliminate different symptoms.
So I would go full steam ahead with making an appointment with a geneticist.
The only thing that may put a stop to things...........you don't have names for your families health problems, just stories of past family history (on the female side) so that might be an issue. I guess all you can do is try, explain what has occured with the female line (symptoms etc) and see what the geneticist has to say.
There is no harm what soever in trying this avenue
