Arxiv Papers

This paper investigates the impact of social media influencers on the visibility and citation counts of machine learning research. The study finds that papers endorsed by influencers have significantly higher citation counts, emphasizing the growing influence of social media in scholarly communication.

https://arxiv.org/abs//2401.13782

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper proposes a novel pretraining framework called Cross-Attention Masked Autoencoders (CrossMAE) that leverages cross-attention between masked and visible tokens, resulting in improved representation learning with reduced decoding compute. CrossMAE outperforms MAE on ImageNet classification and COCO instance segmentation.

https://arxiv.org/abs//2401.14391

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper proposes a novel pretraining framework called Cross-Attention Masked Autoencoders (CrossMAE) that leverages cross-attention between masked and visible tokens, resulting in improved representation learning with reduced decoding compute. CrossMAE outperforms MAE on ImageNet classification and COCO instance segmentation.

https://arxiv.org/abs//2401.14391

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

This study explores the representation learning abilities of Denoising Diffusion Models (DDM) and finds that only a few modern components are critical for learning good representations, leading to a simplified approach resembling a classical Denoising Autoencoder (DAE).

https://arxiv.org/abs//2401.14404

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

This study explores the representation learning abilities of Denoising Diffusion Models (DDM) and finds that only a few modern components are critical for learning good representations, leading to a simplified approach resembling a classical Denoising Autoencoder (DAE).

https://arxiv.org/abs//2401.14404

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

MambaByte, a token-free language model trained on byte sequences, demonstrates computational efficiency and competitive performance compared to subword Transformers, making it a viable option for token-free language modeling.

https://arxiv.org/abs//2401.13660

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

MambaByte, a token-free language model trained on byte sequences, demonstrates computational efficiency and competitive performance compared to subword Transformers, making it a viable option for token-free language modeling.

https://arxiv.org/abs//2401.13660

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces DITTO, a method for improving the role-playing capabilities of large language models (LLMs) by leveraging their extensive knowledge of characters and dialogues. DITTO outperforms open-source baselines and achieves performance comparable to advanced proprietary chatbots.

https://arxiv.org/abs//2401.12474

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

The paper introduces DITTO, a method for improving the role-playing capabilities of large language models (LLMs) by leveraging their extensive knowledge of characters and dialogues. DITTO outperforms open-source baselines and achieves performance comparable to advanced proprietary chatbots.

https://arxiv.org/abs//2401.12474

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Meta-prompting is a technique that enhances the functionality of language models by transforming them into multi-faceted conductors. It guides the models to break down complex tasks into smaller subtasks, which are handled by expert instances of the same model. This approach improves performance across various tasks and simplifies user interaction. The integration of external tools, such as a Python interpreter, further expands its applicability. Experimental results show that meta-prompting outperforms conventional scaffolding methods.

https://arxiv.org/abs//2401.12954

YouTube: https://www.youtube.com/@ArxivPapers

TikTok: https://www.tiktok.com/@arxiv_papers

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers