Skip to main content
Made with ❤️ by Pixit
Made with ❤️ by Pixit

AI News #73

AI News #73

Pix
Jun 3, 2024 10:21:43 AM

Microsoft Unveils Phi-3-Vision, a Multimodal AI Model for Image Analysis

phi3vision

Story: Microsoft has introduced Phi-3-Vision, a small language model that incorporates computer vision capabilities. This AI model pushes the current boundaries of what's possible with compact AI systems by enabling them to process and understand visual information alongside text.

Key Findings:

  • Compact Size: Phi-3-Vision boasts a small model size of just 4.2B million parameters, making it highly efficient and deployable on a wide range of devices.

  • Multimodal Capabilities: Unlike most small language models, Phi-3-Vision can process both text and images, allowing for more context-aware understanding and generation.

  • Vision-Language Tasks: Phi-3-Vision excels at various vision-language tasks such as image captioning, visual question answering, and image-text retrieval.

  • Broad Applications: The model's multimodal abilities open up new possibilities for AI-powered applications in fields like education, accessibility, and creative tools.

  • Open Source Release: Microsoft plans to open source Phi-3-Vision, fostering collaboration and accelerating research in the AI community.

Pixit‘s Two Cents: Microsoft's Phi-3-Vision is a big step in terms of compact AI models. By integrating computer vision into a small language model, Phi-3-Vision shows the potential for creating more capable and versatile AI assistants that can understand and interact with the world in a multimodal way (Think GPT-4o). As AI continues develop more and more in our lives, models like Phi-3-Vision could pave the way for a new generation of intelligent applications in language and vision alike. We expect to see exciting developments especially in mobile device capabilities looking at you WWDC (Apple’s coming developer conference).

Mistral launches Codestral: A Powerful Code-Centric AI Model for Developers

bench_codestral

Story: Mistral has launched Codestral, its first code-centric large language model (LLM). This 22B parameter, open-weight generative AI model is designed to empower developers by specializing in coding tasks, from generation to completion, across more than 80 programming languages.

Key Findings:

  • Versatile Language Support: Codestral is trained on a diverse dataset of over 80 programming languages, including popular ones like Python, Java, C++, and JavaScript, as well as specialized languages like Swift and Fortran.

  • Enhanced Developer Productivity: The model assists developers by completing coding functions, writing tests, and filling in partial code using a fill-in-the-middle mechanism, reducing errors and bugs.

  • Impressive Performance: Codestral outperforms existing code-centric models like CodeLlama 70B and Deepseek Coder 33B on various benchmarks, setting a new standard for code generation performance and latency.

  • Accessible and Integratable: The model is available under a non-commercial license on Hugging Face, through dedicated API endpoints, and is integrated with popular tools like LlamaIndex, LangChain, Continue.dev, and Tabnine.

Pixit‘s Two Cents: By combining an extensive language base, impressive performance, and seamless integration with popular tools, Codestral has the potential to shake up the way developers write and interact with code. As AI continues to transform the software development landscape, models like Codestral will play a crucial role in enhancing developer productivity and enabling the creation of advanced AI applications. We expect to see many more developers leveraging Codestral's capabilities and are eager to try it out ourselves even locally with our new deep learning workstation.

Cohere’s Open-Source LLM, Aya, Speaks 23 Languages

benchmarks Large

Story: Cohere has introduced Aya 23, an AI model with open weights designed to support nearly two dozen languages. This move aims to democratize access to powerful language models by allowing researchers and developers to use and build on Aya 23.

Key Findings:

  • Multilingual Support: Aya 23 supports a wide range of languages (i.e., 23) from English, to German, to Turkish.

  • Open Weights: Cohere released the weights to enable developers and researchers to fine-tune and customize it for specific needs. You can access the weights via HuggingFace.

  • Performance: According to Cohere, Aya 23 performed better than models like Gemma, Mistral and Mixtral “on an extensive range of discriminative and generative tasks”

  • Missing Information: Cohere did not disclose any information about the training data.

Pixit‘s Two Cents: It’s great to see that LLMs are available in different languages, including languages that were not greatly supported yet. Still, other languages spoken in Asia and Africa are still missing.

Small Bites, Big Stories:
Tags:
Pix
Post by Pix
Jun 3, 2024 10:21:43 AM