Makes sense to me.
If you didn't have our modern understanding of how life, death and childbirth work (which is actually kind of sketchy) is there any reason for this idea to be particularly implausible?
Once you've accepted the possibility that improperly buried corpses can turn into zombies and vampires, then it's not much of a leap to declare that stillborn corpses are the worst kind.
Many tribal cultures have complex and fearful superstitions, regarding dead babies and orphaned infants.
I can see Ceviel playing Voltaire's Easy When You're Evil, but then I heard the song for the first time yesterday, and now it's stuck in my head. It's not the right instrument, and it's a bit more overt, but it has a similar vibe.
I expect his music is a bit more Symphony of the Night or Phantom of the Opera, but you have to admit it could be made to work in the location, if not the for the character.