Quantum entanglement plays a prominent role in both foundational physics and emerging quantum technologies. Light is especially promising as a platform for experimental realizations of high-dimensional entanglement, for which the time-frequency degree of freedom provides a natural encoding. Here, we propose and demonstrate a technique to determine the full quantum state of a pair of photons entangled in the time-frequency domain. Our approach, based on spectral shearing interferometry, is entirely self-referenced. To test our system, we measure a photon-pair source with nonlocal spectral phase that results in entanglement between the photons, in which the time when either photon is detected is correlated with the frequency of the other photon. The results demonstrate an effective new tool for exploring the temporal and spectral characteristics of multipartite quantum systems exhibiting high-dimensional entanglement.