it is serious and you need to do a lot of checking and doublechecking as your wood and plaster dry out.
Once the paper face of drywall has been wet or damp for a long time, it has mold in it. Not just "spores" which are the equivalent of seeds in the mold world. If it all dries out, it is still there and offgassing still, and will immediately go into high gear when humidity comes back which could happen on any given day. In other words, once contaminated forever bad.
On wood (real, solid wood) mold grows on the surface but can't get down into the whole cellulose underneath until years of rot happen. On wood products made of wood fibers or chips, mold can migrate fast into the core of the product's body. So paper facing of drywall, OSB, even plywood, can all be seriously infected.
Mold offgasses toxins; these are their excretions, just as all living organisms release (or excrete, or defecate) byproducts of their metabolism. Mold toxins are "mycotoxins". Search on that and you will see that most mammals suffer badly from inhaling mycotoxins, and humans just happen to have complex enough immmune systems to handle it fairly well compared to pets, farm animals, zoo animals and caged animals. In other words, animals get sick and listless, and often die, whie we just get listless, lifeless, irritable, tired and stressed. Mold is not always toxic "per se" and a billion kinds have not been studied yet, but it is not a good gas to have in the house or in any closed environment.
David