Isn't the point though that the gravitational wave observatories are looking specifically for "black swans" rather than just observing swans generally. So when a swan with a lower reflectivity is observed then it now fits the "black swan" profile. Could be just a swan covered in soot; you need more data to show that this swan is always black or that the lower reflectivity wasn't caused by a measuring anomaly, etc.

I may have pushed the analogy too far!