Is it ok to have the set-up as the youngest age group starts first and they do both the speed and endurance for their age group?

No.  FINA standard guidelines require that the Speed and Endurance events are considered two separate events, one following the other.  This helps ensure that there is adequate and sufficient rest for the athletes between courses.