Can I change the emails candidates get?

Yes. In Settings → Email templates, edit the subject and words of each: application received, interview invitation, offer letter, rejection, reference request and portal access. Words in double braces, such as {{candidate_name}} or {{role_title}}, are filled in when the email goes.