Comment on paper "Unsupervised Learning by Predicting Noise"

This is a short comment about something that occurred me while reading the recent paper Unsupervised Learning by Predicting Noise. Suppose we have a set of measurements of a variable $X$, which we assume were sampled from a distribution $p_{X}(x)$.