The paper analyzes the effectiveness of self-repair in large language models (LLMs) for code generation, specifically GPT-3.5 and GPT-4, on a challenging dataset called APPS. The study finds that self-repair is only effective in GPT-4 and is bottlenecked by the feedback stage. Using expert human programmers to give feedback on the programs generated by GPT-4 unlocks significant performance gains.

https://arxiv.org/abs//2306.09896

YouTube: https://www.youtube.com/@ArxivPapers

PODCASTS:

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Researchers introduce MagicBrush, a large-scale, manually annotated dataset for instruction-guided real image editing, to address the limitations of existing methods and improve text-guided image editing models.

https://arxiv.org/abs//2306.10012

YouTube: https://www.youtube.com/@ArxivPapers

PODCASTS:

Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016

Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Researchers propose a new optimizer, LOMO, that reduces memory usage to enable full parameter fine-tuning of large language models on a single machine.

https://arxiv.org/abs//2306.09782

The paper proposes a diffusion-based architecture called TryOnDiffusion that generates photorealistic visualizations of garments on different body shapes and poses, achieving state-of-the-art performance.

This paper proposes a zero-shot text-guided video-to-video translation framework to adapt image models to videos, achieving global style and local texture temporal consistency at a low cost.

https://arxiv.org/abs//2306.07954

YouTube: https://www.youtube.com/@ArxivPapers

The paper presents GLoRA, an advanced approach for universal parameter-efficient fine-tuning tasks. GLoRA employs a generalized prompt module to optimize pre-trained model weights and adjust intermediate activations, providing more flexibility and capability across diverse tasks and datasets. It outperforms previous methods in natural, specialized, and structured benchmarks, achieving superior accuracy with fewer parameters and computations on various datasets.

YouTube: https://www.youtube.com/@ArxivPapers

The LongMem framework enables large language models to utilize extended historical data by introducing a decoupled network architecture with memory encoding and adaptive memory retrieval components. This method significantly improves performance on long-context modeling and in-context learning tasks.

Orthogonal Finetuning (OFT) is introduced to guide text-to-image diffusion models for downstream tasks, preserving hyper-spherical energy essential for semantic generation. Constrained Orthogonal Finetuning (COFT) improves stability. It outperforms existing methods in quality and speed.

FasterViT is a hybrid CNN-ViT neural network that combines the strengths of CNNs and ViTs, achieving high image throughput for computer vision tasks. It introduces a Hierarchical Attention (HAT) approach for efficient self-attention, resulting in state-of-the-art accuracy and faster performance.