AI Chat: AI News on Claude, ChatGPT, Gemini, Grok, Perplexity

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Meta has unveiled an open-source AI research project, ImageBind, which can combine six types of data—visual, audio, text, depth, temperature, and movement—into a single multidimensional index, pushing the boundaries of generative AI systems. This research underscores Meta's commitment to sharing AI advancements while competitors like OpenAI and Google become more closed-off.

ImageBind is the first AI model to integrate this variety of data into one "embedding space", a concept crucial to the explosion of generative AI technologies. For instance, AI image generators like DALL-E, Stable Diffusion, and Midjourney establish links between text and images during training, facilitating image creation based on textual cues. ImageBind builds on this, broadening the data spectrum.

This model could potentially enable future AI systems to cross-reference various data, akin to current text-input-based AI. Imagine a VR device that generates not only audio-visual input but also simulates environmental and physical conditions based on this data. However, this is purely speculative at this point.

Meta has hinted at the possibility of adding other sensory inputs like touch, speech, smell, and brain fMRI signals to future models. They claim this would bring machines closer to human-like, holistic learning from diverse information sources.

Despite the potential, immediate applications of such research will likely be more modest. Previous works, like Meta's text-to-video AI model, indicate that future iterations could incorporate more diverse data streams.

This research is particularly notable as Meta continues to endorse open-sourcing in AI, a practice under increased scrutiny. Critics argue that open-sourcing enables plagiarism and misuse of advanced AI models. Supporters, however, believe it promotes system transparency, helps rectify faults, and can even offer commercial benefits by engaging third-party developers in improvements.

Despite setbacks like the leak of its LLaMA language model, Meta remains committed to the open-source approach. Its relatively lower commercial success in AI compared to competitors has, to some extent, facilitated this stance. With ImageBind, Meta affirms its open-source strategy.

-------------------------

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Hugging Face has had a busy week filled with AI advancements, launching Transformers Agent, a new tool that enables users to manage over 100,000 HF models through conversation with the Transformers and Diffusers interface. This latest API suite can generate other HF models to solve complex, multimodal problems.

Transformers Agent offers a natural language API, an array of curated tools, and an agent capable of interpreting natural language and utilizing these tools. This extensible system can integrate any relevant community-developed tools. Users must initiate an agent, a Long Language Model (LLM), before using the agent.run function. The system supports both OpenAI modes and open-source alternatives from BigCode and OpenAssistant.

The tools are single functions with designated names and descriptions, each designed to perform a specific task. The agent learns how to utilize these tools through prompts that demonstrate how they can achieve the desired outcome.

Users have two APIs at their disposal: single execution (run) and chat-based execution (chat). The run method enables the agent to select and use the necessary tools for the task, while the chat method is useful for maintaining the state across different instructions.

The user-provided code runs using a small Python interpreter. To mitigate arbitrary code execution risks, only functions provided by Hugging Face and the print function can be executed, and attribute lookups and imports are not allowed.

The curated tools range from document-based question answering using Donut and text-based question answering with Flan-T5, to image segmentation with CLIPSeg and text summarization with BART. Custom tools include a text downloader, a text-to-image creator, an image transformer, and a text-to-video generator.

Hugging Face has also recently partnered with ServiceNow to create a new open-source language model for codes named StarCoder. Part of the BigCode initiative, StarCoder has surpassed larger models like PaLM, LaMDA, and LLaMA in performance and has demonstrated comparability or superiority to closed models like OpenAI’s code-Cushman-001.

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Download Selfpause the AI Life Coach: https://Selfpause.com/AIBox

Get our Daily AI Newsletter: ⁠https://AIBox.ai⁠

Join our ChatGPT Community: ⁠https://www.facebook.com/groups/739308654562189/⁠

Follow me on Twitter: ⁠https://twitter.com/jaeden_ai⁠

Whether you're an industry insider or simply curious about the power of AI, the AIBox newsletter has you covered. Each day, our team of expert researchers and writers curate the most important stories, ideas, and perspectives from the world of AI and ChatGPT.

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.