Big blobs look like sponges to me, wouldn't really affect the growth of the chaeto... the smaller things would be hard to get an ID on without a closer pic (Unless they're the same as the big blobs). Smaller things could be something eating it.
Could also be something hidden eating away at it- crabs and such are great hiders, so you might have to take a peek at night after lights are off.