We investigate the impact of charged-current-neutrino processes on the formation and evolution of neutrino spectra during the deleptonization of proto-neutron stars. To this end we develop the full kinematics of these reaction rates consistent with the nuclear equation of state, including weak magnetism contributions. This allows us to systematically study the impact of inelastic contributions and weak magnetism on the νe and ν̄e luminosities and average energies. Furthermore, we explore the role of the inverse neutron decay, also known as the direct Urca process, on the emitted spectra of ν̄e. This process is commonly considered in the cooling scenario of cold neutron stars but has so far been neglected in the evolution of hot proto-neutron stars. We find that the inverse neutron decay becomes the dominating opacity source for low-energy ν̄e. Accurate three-flavor Boltzmann neutrino transport enables us to relate the magnitude of neutrino fluxes and spectra to details of the treatment of weak processes. This allows us to quantify the corresponding impact on the conditions relevant for the nucleosynthesis in the neutrino-driven wind, which is ejected from the proto-neutron star surface during the deleptonization phase.