Noise ceilings are really useful: You can estimate the reliability of your data and get an index of how well your model can possibly perform given the noise in the data. But, contrary to what you may think, noise ceilings do not provide an absolute index of data quality. Let's dive into why. 🧵