Do Edgar Allen Poes short stories really fall into the horror genre?
They more often fall under the sub-genre of “psychological horror”, or were probably meant to. However, Poe’s emotions/attitudes regarding what he was writing were very possibly closer to what you’re finding there: humor, curiosity, and even playfulness. The contradiction of that is one of the things that can make his work interesting, if you’re a fan.