I think it is all about the egg white for Angel Food cake. The single most important tip I can recall my mom drilling into me is that, like anything else involving whipped egg white, you should make absolutely certain that there's no oil or grease anywhere near it as you're whipping. No plastic bowls or utensils, either.
Is it possible you're over-beating? That can be a problem, too.