@vantablack it baffles me that the link preview isn't just generated once, by the client of the person posting the link, and just attached to the AP note as extra data during federation after publishing.

This is how a lot of messaging apps handle it, which always ensures a link preview is only ever generated once whenever a user shares it.