The Kohanim and the Levites both come from the Tribe of Levi. The Kohanim are the direct descendants of the first High Priest, Aaron. These lineages are passed down from father to son. Historically, due to the dispersion of the Ten Tribes before the destruction of the First Temple nearly all Jews who are not Kohanim and Levites are from the tribes of Judah and Benjamin.