> Correct me if I’m wrong, but I don’t think S3 has an equivalent way to append to a value, which makes it clunky to work with as a log sink.

You are correct. (There are multipart uploads, but that's kinda different.)

ELB logs are delivered as separate object every few minutes, FWIW.