A Reflection of Kindness, by Kannan Feng
I'll confess I was a little puzzled by this story, until I remembered "The Trap" written by Lovecraft in collaboration with Henry S Whitehead, with it's take on the "haunted mirror" trope. Here, we again get the idea that the reflection, the Other, is preferable to the reality of a loveless, passionless marriage. We also get hints of the protagonist being awakened to her own hunger for experience, and becoming a willing explorer of the world of the Mythos. A good reflection of the usual Lovecraftian premise.
Lovecraft also liked to play with the styles of writers he admired, like Lord Dunsany, Arthur Machen and especially Edgar Allen Poe, and his work includes stories of a more familiar cast of magic and fantasy, rather than his distinctive tone of cosmic horror.
Lovecraft Girl by *cluedog on deviantART
When the Stars Come, by Alex Pichetti
Again, we get the untold version of the story we already know, in this case the tale of Lavinia Whately, who will eventually give birth to Wilbur Whately and "The Dunwich Horror". Perhaps the most disturbing moment of Lovecraft's story is when the invisible creature, being killed by mere humans, pleads to its father for help to no avail. He is the Christ of a new/older god, and that makes Lavinia the (non-)virgin mother. Is this any stranger or more unnatural than immaculate conception or rising from the dead, as Lavinia herself asks?
While you have to squint a bit to see it, I'm suspect this story was also inspired by Arthur Machen's works like The Great God Pan and the deeply weird and unsettling "The White People", both of which are ripe with erotic inspiration and female sexuality. Machen was an inspiration to Lovecraft and a major light of the "weird tales" establishment. Thanks to the public domain and free ebooks, it's never been easier to read these old stories that were the predecessors of modern science fiction, horror and fantasy.