While nonstoichiometric binary III-V compounds are known to contain group-V antisites, the growth of ternary alloys consisting of two group-V elements might give additional degrees of freedom in the chemical nature of these antisites. Using cross-sectional scanning tunneling microscopy (STM), we investigate low-temperature-grown dilute GaAs1−xPx alloys. High concentrations of negatively charged point defects are found. Combined with transmission electron microscopy and pump-probe transient reflectivity, this study shows that the defects have a behavior similar to the group-V antisites. Further analyses with x-ray diffraction point to the preferential incorporation of arsenic antisites, consistent with ab initio calculations, that yield a formation energy 0.83 eV lower than for phosphorus antisites. Although the negative charge carried by the arsenic antisites in the STM images is shown to be induced by the proximity of the STM tip, the arsenic antisites are not randomly distributed in the alloy, providing insight into the evolution of their charge state during the growth.