Contrast sensitivity varies substantially as a function of spatial frequency and luminance intensity. The variation as a function of luminance intensity is well known and characterized by three laws that can be attributed to the impact of three internal noise sources: early spontaneous neural activity limiting contrast sensitivity at low luminance intensities (i.e. early noise responsible for the linear law), probabilistic photon absorption at intermediate luminance intensities (i.e. photon noise responsible for de Vries-Rose law) and late spontaneous neural activity at high luminance intensities (i.e. late noise responsible for Weber’s law). The aim of this study was to characterize how the impact of these three internal noise sources vary with spatial frequency and determine which one is limiting contrast sensitivity as a function of luminance intensity and spatial frequency. To estimate the impact of the different internal noise sources, the current study used an external noise paradigm to factorize contrast sensitivity into equivalent input noise and calculation efficiency over a wide range of luminance intensities and spatial frequencies. The impact of early and late noise was found to drop linearly with spatial frequency, whereas the impact of photon noise rose with spatial frequency due to ocular factors.