I will not be able to be in Germany by the time my studies start. Do I still have to take out health insurance before that?

Yes! We cannot register you as a student at our university without your health insurance confirmation. It is irrelevant in this matter where you are at the time of enrolment or the start of your studies.