Histone methylation regulates transcription, chromatin structure, and the epigenetic state of the cell. Recent studies identified the JmjC domain as a catalytic module for histone demethylation. Schizosaccharomyces pombe contains seven JmjC proteins, but it was unclear whether any of them functioned as histone demethylases. In this report, we show that the JmjC protein Jmj2, which is evolutionarily conserved from yeast to human, reversed trimethylated H3-Lys-4 to di- and mono-but not unmethylated products. Overexpression of Jmj2 but not a catalytically inactive mutant reduced H3-Lys-4 trimethylation levels in vivo and suppressed the toxicity caused by overexpression of the H3-Lys-4-me3-binding protein Yng1 in budding yeast. Genome-wide analysis showed that the loss of jmj2 was associated with an increase in the H3-Lys-4-me3 signal, which was enriched near the transcriptional start sites and the coding regions. At the mating-type locus, the loss of jmj2 or substitution of jmj2 with a catalytically inactive form is correlated with increased reporter gene transcription and H3-Lys-4-me3/2 levels, suggesting that Jmj2 and its demethylase activity may play a role in heterochromatin biology. Our findings identified a novel S. pombe histone demethylase with specificity toward di- and trimethylated histone H3-Lys-4 and a possible role in heterochromatin regulation.