The Ste20p protein kinase was immunopurified from yeast cells and analyzed in an in vitro assay system. Ste20p immune complexes exhibited autophosphorylating activity at serine and threonine residues and specifically phosphorylated a bacterially expressed glutathione S-transferase (GST) fusion of Ste11p (a mitogen-activated protein or extracellular signal-regulated kinase kinase (MEK) kinase homologue) at serine and threonine residues. In contrast, GST fusions either of Ste7p (a MEK homologue) or the beta-subunit of the mating response G-protein and immunoprecipitated Ste5p were not phosphorylated by the Ste20p immune complexes. Myelin basic protein was identified as an excellent in vitro substrate, whereas histone H1 was only poorly phosphorylated. Evidence was obtained that autophosphorylation might play a regulatory role for the in vitro kinase activity. The in vitro activity was found to be Ca(2+)-independent. Both the in vivo and in vitro activities were abolished by mutational changes of either the conserved lysine residue 649 within the ATP binding site or threonine 777 between the catalytic subdomains VII and VIII. Wild-type Ste20p and the catalytically inactive T777A mutant were identified as phosphoproteins in vivo. The phosphorylation occurred at serine and threonine residues independent of pheromone stimulation. Based on the genetically determined significance of Ste20p in pheromone signal transduction and on our in vitro studies, we propose the model that Ste20p represents a yeast MEK kinase kinase whose function is to link G-protein-coupled receptors through G beta gamma to a mitogen-activated protein kinase module.