The special feature of a 1.e4 repertoire is that transpositions are rare. You can have independent repertoires against each of black's replies. This is very different from 1.c4, 1.d4 and 1.Nf3 where moves can often be played in many different orders and you always have to watch out for transpositions between your various lines.
Then these are the "big four":
1...e5 -- The Open Game
1...c5 -- The Sicilian
1...e6 -- The French
1...c6 -- The Caro-Kann
Most of your time should go to those, especially the first three (the CK is also very good but not as popular at amateur level).
Then there is the rest, like
1...d5 -- the Scandinavian
1...d6 and 1...g6 -- the Pirc and Modern (there are transpositions between those)
1...Nf6 -- the Alekhine
And other lines that you can skip for now.
The reason for this is that 1.e4 puts an undefended pawn in the center, and the intended follow-up 2.d4 is hard to prevent as it will be defended by the queen. This is different from 1.d4 where 2.e4 is easy to prevent. That means all replies must immediately have some specific way to deal with that, and the different ways of doing that immediately prevent transpositions.
1...e5 -- black just does the same. 1...c5 -- black will exchange his c-pawn for the d-pawn if it arrives on d4. 1...e6 and 1...c6 -- black will also put a pawn on d5. 1...d5 black immediately puts a pawn on d5 but can't recapture with a pawn. 1...Nf6 -- black attacks the undefended e4 pawn. 1...d6 and 1...g6 -- black lets white play 2.d4 and intends to attack the center later.
Hope this helps.