跨文本、图像、音频模态的 ML 技术是否存在可归类的重复模式？[R]

Are there fundamental repeating patterns in ML techniques across modalities (text, image, audio) that let us group them? [R]

AI 导读

有研究者提出，tokenisation、masking（MLM / MAE / 音频掩码）、diffusion、next-token / next-frame prediction 等技术在不同模态间反复出现，只是名称不同。其询问是否存在按底层模式而非模态（NLP / 视觉 / 音频）划分的现有分类法或心智模型，以便归类研究论文并引用该领域已有工作。

正文

I’ve been noticing that a lot of techniques seem to repeat across modalities with just a different name.

For example, tokenisation, masking (MLM / MAE / audio masking), diffusion, next-token / next-frame prediction, etc.

Is there an existing taxonomy or mental model that groups ML techniques by their underlying pattern rather than by modality (NLP / vision / audio)?

This will help me to group the research papers and then make reference to work already done in that domain

submitted by /u/OkCampaign8400
[link] [留言]