The News Feed

Category: LLM

  • Nvidia Unveils Open-Source Llama and Cosmos Nemotron LLM Model Families to Build AI Agents at CES 2025

    Nvidia Unveils Open-Source Llama and Cosmos Nemotron LLM Model Families to Build AI Agents at CES 2025

    At CES 2025, NVIDIA revealed the Nemotron model families, a groundbreaking step in artificial intelligence. These models include the open-source Llama Nemotron large language models (LLMs) and the Cosmos Nemotron vision language models (VLMs). Designed to boost AI agents’ abilities, these models are available as NVIDIA NIM microservices, making them easy to use on a variety of systems, from data centers to edge devices.

    What is the Nemotron Ecosystem?

    • NVIDIA NIM Microservices
      These microservices make it simple to add Nemotron models to different setups, ensuring high-performance AI capabilities with flexibility and scalability.
    • Llama Nemotron LLMs
      Based on the successful Llama architecture, these models come in three sizes: Nano, Super, and Ultra. Each size caters to specific needs, from low-latency tasks to high-accuracy applications. These LLMs are optimized for key AI tasks like generating human-like responses, coding, and solving complex math problems.
    • Cosmos Nemotron VLMs
      These vision language models combine image understanding with language processing, enabling AI agents to interpret and interact with visual data. This is useful for tasks like autonomous driving, medical analysis, and retail planning.
    • Scalable and Efficient Performance
      The Nemotron models use NVIDIA’s advanced training and optimization techniques to ensure they perform well and scale effectively across different hardware systems.

    Real-World Use Cases

    Major companies like SAP and ServiceNow are already using these models.

    • SAP is integrating them to improve AI-driven supply chain management.
    • ServiceNow aims to enhance its customer service AI agents for better user experiences.

    These early applications highlight how Nemotron models can automate complex tasks, improve decision-making, and streamline operations in industries like logistics, customer service, and healthcare.

    How It Works

    NVIDIA’s NeMo framework allows users to customize the Nemotron models for specific needs. For faster deployment, NVIDIA Blueprints offer ready-made solutions for building AI agents.

    Community Buzz and Open-Source Impact

    The Nemotron models have generated excitement across social platforms like X, where developers and AI enthusiasts are discussing their potential. NVIDIA’s decision to open-source the Llama Nemotron models encourages global collaboration, allowing developers to adapt and expand their capabilities for different industries.

    The Future of AI Agents

    NVIDIA’s Nemotron models pave the way for smarter, more capable AI agents that can handle complex tasks in real-world scenarios. With advancements in language and vision processing, these models could reshape industries and drive innovation in AI applications worldwide.

    Links

    https://build.nvidia.com/nvidia/llama-3_1-nemotron-70b-instruct

    https://build.nvidia.com/nvidia/cosmos-nemotron-34b

    https://huggingface.co/models?search=nemotron

    https://huggingface.co/nvidia/nemotron-3-8b-base-4k

    https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

    https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Reward

  • Aitomatic Launches SemiKong,An Open-Source LLM for Semiconductor Industry

    Aitomatic Launches SemiKong,An Open-Source LLM for Semiconductor Industry

    Aitomatic, in partnership with members of the AI Alliance, has introduced SemiKong, the world’s first open-source Large Language Model (LLM) designed specifically for semiconductor manufacturing, design, and innovation. Announced at SEMICON West 2024, SemiKong is expected to revolutionize the semiconductor industry, which is valued at $500 billion, and reshape its landscape over the next five years.

    What is SemiKong?

    SemiKong is built on Meta’s Llama 3.1 platform and has been fine-tuned using a semiconductor-specific dataset that includes industry documents, research papers, and anonymized operational data. This specialized LLM demonstrates improvements in accuracy, relevance, and understanding of semiconductor processes, outperforming general-purpose models in tasks specific to the industry.

    Performance Highlights

    • Faster Chip Design: SemiKong can reduce chip design time-to-market by up to 30%, cutting costs and improving efficiency.
    • Better Manufacturing Outcomes: It improves first-time-right manufacturing by 15-25%, offering tangible benefits for semiconductor companies.

    Key Features of SemiKong

    • Domain-Specific Knowledge: SemiKong is trained to understand the unique terminology and processes of the semiconductor industry.
    • Integration with Domain-Expert Agents (DXAs): This feature allows companies to create AI agents that capture and scale the expertise of veteran engineers for specific industry challenges.
    • Multilingual Capabilities: With training on a 3 trillion token multilingual corpus, SemiKong can understand various languages, addressing the global nature of the semiconductor industry.

    Industry and Expert Reactions

    Industry experts have praised the launch of SemiKong. Dr. Christopher Nguyen, CEO of Aitomatic, said the model will “redefine semiconductor manufacturing” with its open innovation approach. Daisuke Oku from Tokyo Electron noted that SemiKong represents “the beginning of an exciting journey in open-source AI for semiconductors.” The announcement has also sparked discussions on platforms like X (formerly Twitter), where tech experts are excited about the potential for faster and more efficient chip design and manufacturing.

    Potential Impact on the Semiconductor Industry

    • Innovation: By reducing the learning curve for new engineers and enabling quicker access to expert knowledge, SemiKong could speed up innovation within the sector.
    • Cost Savings: Faster design and manufacturing processes could lead to significant cost reductions, potentially making consumer electronics more affordable.
    • Open-Source Collaboration: As an open-source model, SemiKong encourages broader industry collaboration, which could drive a wave of innovation as more companies and researchers contribute to its development.

    Looking Ahead

    Aitomatic plans to continue enhancing SemiKong with future updates aimed at addressing more specific challenges in semiconductor fabrication and design. With ongoing R&D, SemiKong is poised to become an essential tool in the semiconductor industry’s push toward innovation and efficiency.

    Links

    https://github.com/aitomatic/semikong

    https://huggingface.co/pentagoniac/SEMIKONG-8b-GPTQ

    https://huggingface.co/pentagoniac/SEMIKONG-70B