Yes- People treat it like it is some sort of super radioactive compound.
Finding a big old weathered chunk on the the brake of an old mining hoist in mountains, grinding it in your hands, and deep breathing the dust- not a good idea.
Walking across a floor with asphalt bonded asbestos tile- not very concerning.
Not airborne, not scary...