Nvidia Nemotron 3 NVIDIA Open Source
Mamba-Transformer-MoE hybrid architecture, Apache 2.0 protocol open source
🟢 What is Nemotron 3?
Nemotron 3 is a new generation of open source large models released by Nvidia in December 2025. It uses innovative Mamba-Transformer-MoE A hybrid architecture that combines the efficient sequence modeling of Mamba, the powerful expressive power of Transformer, and the sparse computing advantages of MoE (Mixed Expert).
Hybrid architecture diagram
🏗️ Architectural features
🐍 Mamba layer
State space model, linear complexity processing ultra-long sequences, efficient reasoning
🔄 Transformer layer
Attention mechanism handles complex dependencies and powerful context understanding
🎯 MoE sparse activation
Only some experts are activated in 253B parameters, greatly reducing calculation costs.
⚡ Inference optimization
Optimized for Nvidia GPU, natively supported by TensorRT-LLM
📊 Model specifications
Nemotron-3-253B-Instruct Ultimate version
The most powerful version, suitable for high-demand tasks such as complex reasoning, code generation, and long text understanding.
Nemotron-3-70B Balanced version
Balances performance and efficiency, suitable for most enterprise-level application scenarios.
Nemotron-3-8B Lightweight version
Suitable for edge deployment and resource-constrained scenarios, maintaining basic capabilities.
💻 Get started quickly
Loading Nemotron 3 using Hugging Face Transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
model_name = "nvidia/Nemotron-3-70B-Instruct"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
model_name,
torch_dtype="auto",
device_map="auto"
)
messages = [
{"role": "user", "content": "解释一下 Mamba 架构的优势"}
]
input_ids = tokenizer.apply_chat_template(
messages,
return_tensors="pt"
).to(model.device)
output = model.generate(input_ids, max_new_tokens=512)
print(tokenizer.decode(output[0], skip_special_tokens=True))
🎯 Typical application scenarios
🔬 Scientific research
Long text understanding, paper analysis, data processing
💻 Code generation
High-quality code completion, refactoring, and document generation
🤖 Agent Build
Build an intelligent agent with reasoning capabilities
🏢 Enterprise deployment
Apache 2.0 protocol, free for commercial use