I haven’t spent enough effort understanding ActivityPub to come up with something coherent. But i often find myself with similar thoughts, although for me its usually focused on “would it be possible to create some kind of service-agnostic ActivityPub client?”