Thank you so much! This is potentially the family.
It's so interesting, this woman would be the exact age as the women my ancestor remarried and had children with. Same age, same ethnicity. Makes me wonder if he remarried my great-great grandma because she reminded him of this woman.
My ancestor allegedly emigrated from Norway to America in 1888, so it's likely the two could have met then.
He married her in 1892, and she disappears from the face of the Earth after that. If this is the same women, she could have returned home and lost contact, they could have went separate ways, who knows. I'll try to do some more searching of the American records for an Olga now, and see what comes up.
My ancestor remarried the woman in 1896 in another state, but I believe was living with her in 1895.