Do I need to have the IELTS score at the time of applying to universities?

No, you do not need to have the IELTS score with you at the time of applying.