At 4 requests/user/day (totaling 1,200 queries/mo), running Document summarization on NVIDIA Nemotron-4 340B costs $47.16 / month ($4.716 / user / mo).
Document summarization for a 10 active users (alpha / internal testing) audience means 40 requests per day on average, each carrying 25,000 input and 600 output tokens at a 10% cacheable share — so the effective per-request cost on NVIDIA Nemotron-4 340B is $0.0393, of which $0.00/mo comes back from prompt caching. Per active user that's $4.716/mo — the number to hold against your pricing tier and gross margin. Charging at least $23.58/user/mo keeps gross margin at or above 80%.
Quick answer
For 10 Active Users, Document summarization on NVIDIA Nemotron-4 340B is modeled at 1,200 requests per month, costing $47.16 per month or $4.716 per active user.
Method & trust
This projection combines the selected active-user tier, requests per user per day, input/output tokens per request, and the modeled cache share. It is an operating estimate, not a provider invoice; production traffic and retries should be measured against it.
Total expected API invoice for 10 Active Users generating 1,200 queries.
Direct inference cost per MAU to model your SaaS pricing tiers and gross margins.
Savings generated by exploiting 10% cache hits on prompt context.
| Model | Provider | Monthly Spend (10 Active Users) | Cost / User / Mo | Annual Spend | Context Limit |
|---|---|---|---|---|---|
| NVIDIA Nemotron-4 340B (Current) | nvidia | $47.16 | $4.716 | $565.92 | 128,000 |
| GPT-5.6 Sol | openai | $158.10 | $15.81 | $1,897.20 | 1,050,000 |
| GPT-5.6 Cyber | openai | $395.25 | $39.525 | $4,743.00 | 1,050,000 |
| GPT-5.5 Standard | openai | $158.10 | $15.81 | $1,897.20 | 512,000 |
| GPT-5.5 Pro | openai | $948.60 | $94.86 | $11,383.20 | 512,000 |
| o3-pro (Frontier Reasoning) | openai | $603.60 | $60.36 | $7,243.20 | 1,000,000 |
At 4 queries per user/day with NVIDIA Nemotron-4 340B, the estimated cost is $4.716 per monthly active user (MAU). Total monthly bill for 10 Active Users is $47.16.
Assuming a 10% cache hit rate on repeated system and context tokens, prompt caching saves $0.00 per month ($0.00/year) on NVIDIA Nemotron-4 340B.
With a direct COGS of $4.716 per user/month on NVIDIA Nemotron-4 340B, charging at least $23.58 per user/month ensures an 80%+ software gross margin.