I guess the usage of chanters depends on playstyle. They work great for me, as I use my rogue to snipe/insta-kill one of the mobs, then go back to the party. By the time the mob reaches the group, at least 1 token is already up.
Having said that, there is definitely a problem with higher level phrases. As they are now, I prefer not using them at all. They shouldn't last longer than level 1s, as that directly affects the token count, so I prefer just leaving my chants at level 1 phrases so the tokens go faster and I can use the more powerful incantations. Maybe they could change it so they last the same, but you need a chain of the lower level ones 'building up the tempo', so to sing a level three phrase it needs to go after a level 1 and level 2 phrase (but they all last 4 seconds each).