@cryptotaxi247 / netdata / commits / 855f9a3b3

Update scalability.md (#21030)

Kanela committed Sep 22, 2025 at 14:48 UTC 855f9a3b359b984ab1e03bd6255b7a2993558658
1 file changed +86 -32
docs/scalability.md
+86 -32
@@ -76,7 +76,11 @@ We tested a single installation Netdata Parent and Prometheus, at **4.6 million
76 | **Parent** | Workload distributor & aggregator | 10 cores, 40 GiB RAM per 1M metrics/sec | Same + ML training if enabled | Linear scaling |
77 | **Cloud** | Control plane & federation | Minimal | Minimal | Unlimited Parents |
78
79 -**Offloading:** Agents can offload ML, alerting, dashboards, and retention to Parents - typically cutting agent CPU ≈50%, RAM ≈25%, and eliminating disk I/O entirely.
79 +:::note
80 +
81 +Agents can offload ML, alerting, dashboards, and retention to Parents - typically cutting agent CPU ≈50%, RAM ≈25%, and eliminating disk I/O entirely.
82 +
83 +:::
84
85 ### The Edge Advantage
86
@@ -148,7 +152,11 @@ The architecture adapts to your needs - train where you have resources, use ever
152 | ~250 nodes | ~1M/sec | 10 cores, 40 GiB RAM |
153 | ~500 nodes | ~2M/sec | 20 cores, 80 GiB RAM |
154
151 -**Key principle:** Scale horizontally with more Parents, not vertically with bigger Parents. Beyond 500 nodes per Parent, resource usage grows non-linearly.
155 +:::tip
156 +
157 +Scale horizontally with more Parents, not vertically with bigger Parents. Beyond 500 nodes per Parent, resource usage grows non-linearly.
158 +
159 +:::
160
161 ### Parent Placement Strategy
162
@@ -242,49 +250,95 @@ This isn't just optimization. It's a fundamentally different architecture that r
250
251 ## FAQ
252
245 -**Q: How many nodes can a single Netdata Parent handle?**<br/>
246 -A: We recommend running Parents with up to 500 Agents (1.5M metrics/s). We have customers running larger Parents, but resources increase and performance decreases non-linearly.
253 +<details>
254 +<summary><strong>How many nodes can a single Netdata Parent handle?</strong></summary><br/>
255
248 -**Q: What happens if a Parent goes down?**<br/>
249 -A: If the Parent was clustered, agents will connect to the other Parent and replicate to it any metrics collected during the transition. If there is no other Parent to connect to, Agents keep collecting and storing data locally, which will be replicated to the Parent when it becomes available. Note that the replication of past metrics uses only tier-0 (high-res data), so Agents must have enough retention in tier-0 to avoid gaps in the charts.
256 +We recommend running Parents with up to 500 Agents (1.5M metrics/s). We have customers running larger Parents, but resources increase and performance decreases non-linearly.
257
251 -**Q: Do I always need Parents?**<br/>
252 -A: No. Agents alone may be enough. Parents are usually required when you have ephemeral nodes.
258 +</details>
259
254 -**Q: How much overhead does Netdata introduce on my systems?**<br/>
255 -A: Less than 5% CPU and ~200 MiB RAM per agent in standalone mode. Offloaded agents (streaming to a Parent) drop to &lt;2% CPU and ~150 MiB RAM with zero disk I/O. Netdata is designed to be "polite citizen" to production workloads, so it spreads its workload across time and avoids all kinds of sudden and intense spikes.
260 +<details>
261 +<summary><strong>What happens if a Parent goes down?</strong></summary><br/>
262
257 -**Q: How efficient is Netdata’s storage?**<br/>
258 -A: Tier 0 (per-second) is ~0.6 bytes/sample - the industry’s most efficient. Tiers 1 & 2 keep per-minute and per-hour aggregates, letting you retain months or years of history cheaply.
263 +If the Parent was clustered, agents will connect to the other Parent and replicate to it any metrics collected during the transition. If there is no other Parent to connect to, Agents keep collecting and storing data locally, which will be replicated to the Parent when it becomes available. Note that the replication of past metrics uses only tier-0 (high-res data), so Agents must have enough retention in tier-0 to avoid gaps in the charts.
264
260 -**Q: How do I deploy Parents in multi-region or multi-cloud setups?**<br/>
261 -A: Place Parents close to the agents they serve (same DC/region/AZ). Deploy multiple Parents per region for HA. Use Netdata Cloud to unify dashboards and queries across Parents.
265 +</details>
266
263 -**Q: What’s the difference between monitoring and automation alerts?**<br/>
264 -A: Since Netdata evaluates alerts at the edge, it allows you to specify scripts to be executed when an alert triggers. This enables automation, e.g. "restart service if API endpoint is not responding".
267 +<details>
268 +<summary><strong>Do I always need Parents?</strong></summary><br/>
269
266 -**Q: Is Netdata really energy-efficient?**<br/>
267 -A: Yes. A peer-reviewed 2023 study (ICSOC, University of Amsterdam) found Netdata to be the most energy-efficient tool among the ones tested, with the lowest CPU and RAM overhead even at 1-second collection.
270 +No. Agents alone may be enough. Parents are usually required when you have ephemeral nodes.
271
269 -**Q: Is 100,000+ nodes single installation real?**<br/>
270 -A: Yes. Even Netdata Cloud SaaS itself (our commercial service) is such a single installation that serves way more than 100k reachable nodes.
272 +</details>
273
272 -**Q: Do you promote per-second collection and unlimited metrics because your revenue depends on volume?**<br/>
273 -A: No. Our commercial offerings are priced per node, with volume discounts (smaller price as the number of nodes increases). Our revenue is not related to the number of metrics or the volume of observability data collected or viewed. We designed Netdata for maximum performance at scale and volume for your benefit. Not ours.
274 +<details>
275 +<summary><strong>How much overhead does Netdata introduce on my systems?</strong></summary><br/>
276
275 -**Q: If I have multiple Parents, how Netdata Cloud provides unified dashboards?**<br/>
276 -A: Think of Netdata Cloud as the headend of a distributed database. Each Netdata Parent and Agent dynamically becomes part of that database. So, Netdata Cloud queries them all in parallel, to provide the unified view required.
277 +Less than 5% CPU and ~200 MiB RAM per agent in standalone mode. Offloaded agents (streaming to a Parent) drop to <2% CPU and ~150 MiB RAM with zero disk I/O. Netdata is designed to be "polite citizen" to production workloads, so it spreads its workload across time and avoids all kinds of sudden and intense spikes.
278
278 -**Q: Is querying 100 remote systems in parallel slower than querying a bigger one locally?**<br/>
279 -A: There is some extra Network latency involved, but this is usually small (a few ms), because the data transferred are tiny (your web browser will receive 500-1000 points max, even if the query is 10 days of per-second data). However, the aggregate horse power and parallelism of 100 totally independent systems is orders of magnitude more, compared to any single local system. The queries are actually quite faster.
279 +</details>
280
281 -## Next Steps
281 +<details>
282 +<summary><strong>How efficient is Netdata's storage?</strong></summary><br/>
283 +
284 +Tier 0 (per-second) is ~0.6 bytes/sample - the industry's most efficient. Tiers 1 & 2 keep per-minute and per-hour aggregates, letting you retain months or years of history cheaply.
285 +
286 +</details>
287 +
288 +<details>
289 +<summary><strong>How do I deploy Parents in multi-region or multi-cloud setups?</strong></summary><br/>
290 +
291 +Place Parents close to the agents they serve (same DC/region/AZ). Deploy multiple Parents per region for HA. Use Netdata Cloud to unify dashboards and queries across Parents.
292 +
293 +</details>
294 +
295 +<details>
296 +<summary><strong>What's the difference between monitoring and automation alerts?</strong></summary><br/>
297 +
298 +Since Netdata evaluates alerts at the edge, it allows you to specify scripts to be executed when an alert triggers. This enables automation, e.g. "restart service if API endpoint is not responding".
299 +
300 +</details>
301 +
302 +<details>
303 +<summary><strong>Is Netdata really energy-efficient?</strong></summary><br/>
304 +
305 +Yes. A peer-reviewed 2023 study (ICSOC, University of Amsterdam) found Netdata to be the most energy-efficient tool among the ones tested, with the lowest CPU and RAM overhead even at 1-second collection.
306
283 -- **[Deploy your first Agent](./deployment/agents.md)** - Start monitoring in 60 seconds
284 -- **[Configure Parents](./deployment/parents.md)** - Scale to hundreds of nodes
285 -- **[Design for Enterprise](./deployment/enterprise.md)** - Architect for thousands
286 -- **[Try Netdata Cloud](https://netdata.cloud)** - Unified visibility across everything
307 +</details>
308 +
309 +<details>
310 +<summary><strong>Is 100,000+ nodes single installation real?</strong></summary><br/>
311 +
312 +Yes. Even Netdata Cloud SaaS itself (our commercial service) is such a single installation that serves way more than 100k reachable nodes.
313 +
314 +</details>
315 +
316 +<details>
317 +<summary><strong>Do you promote per-second collection and unlimited metrics because your revenue depends on volume?</strong></summary><br/>
318 +
319 +No. Our commercial offerings are priced per node, with volume discounts (smaller price as the number of nodes increases). Our revenue is not related to the number of metrics or the volume of observability data collected or viewed. We designed Netdata for maximum performance at scale and volume for your benefit. Not ours.
320 +
321 +</details>
322 +
323 +<details>
324 +<summary><strong>If I have multiple Parents, how does Netdata Cloud provide unified dashboards?</strong></summary><br/>
325 +
326 +Think of Netdata Cloud as the headend of a distributed database. Each Netdata Parent and Agent dynamically becomes part of that database. So, Netdata Cloud queries them all in parallel, to provide the unified view required.
327 +
328 +</details>
329 +
330 +<details>
331 +<summary><strong>Is querying 100 remote systems in parallel slower than querying a bigger one locally?</strong></summary><br/>
332 +
333 +There is some extra network latency involved, but this is usually small (a few ms), because the data transferred are tiny (your web browser will receive 500-1000 points max, even if the query is 10 days of per-second data). However, the aggregate horse power and parallelism of 100 totally independent systems is orders of magnitude more, compared to any single local system. The queries are actually quite faster.
334 +
335 +</details>
336 +
337 +## Next Steps
338
288 ----
339 +- **[Deploy your first Agent](/docs/deployment-guides/standalone-deployment.md)** - Start monitoring in 60 seconds
340 +- **[Configure Parents](/docs/deployment-guides/deployment-with-centralization-points.md)** - Scale to hundreds of nodes
341 +- **[Design for Enterprise](/docs/netdata-enterprise-evaluation-corrected.md)** - Architect for thousands
342 +- **[Try Netdata Cloud](/docs/netdata-cloud/README.md)** - Unified visibility across everything
343
344 *Based on real production deployments, independent research (University of Amsterdam, ICSOC 2023), and comparative testing (2025). All metrics and resource usage figures represent typical production scenarios.*