IMAC in combination with mass sectrometry is a promising approach for global analysis of protein phosphorylation. Nevertheless this approach suffers from two shortcomings: inadequate efficiency of IMAC and poor fragmentation of phosphopeptides in the mass spectrometer. Here we report optimization of the IMAC procedure using 32P-labeled tryptic peptides and development of MS/MS/MS (MS3) for identifying phosphopeptide sequences and phosphorylation sites. The improved IMAC method allowed recovery of phosphorylated tryptic peptides up to ∼77% with only minor retention of unphosphorylated peptides. MS3 led to efficient fragmentation of the peptide backbone in phosphopeptides for sequence assignment. Proteomics of mitochondrial phosphoproteins using the resulting IMAC protocol and MS3 revealed 84 phosphorylation sites in 62 proteins, most of which have not been reported before. These results revealed diverse phosphorylation pathways involved in the regulation of mitochondrial functions. Integration of the optimized batchwise IMAC protocol with MS3 offers a relatively simple and more efficient approach for proteomics of protein phosphorylation.