Update README.md
Costa Tsaousis committed
Jul 17, 2023 at 15:18 UTC
f241471ad68859fbbda861be1cf623661bcea81d
1 file changed
+64
-4
README.md
+64
-4
@@ -178,6 +178,9 @@ When using Netdata Parents, all the functions of a Netdata Agent (except data co
178
179
Of course it is! We do our best to ensure it is!
180
181
+<details><summary>Click to see detailed answer ...</summary>
182
+ <br/> <br/>
183
+
184
We understand that Netdata is a software piece that is installed on millions of production systems across the world. So, it is important for us, Netdata to be as secure as possible:
185
186
- We follow the [Open Source Security Foundation](https://bestpractices.coreinfrastructure.org/en/projects/2231) best practices.
@@ -185,25 +188,40 @@ We understand that Netdata is a software piece that is installed on millions of
188
- Netdata is a popular open-source project and is frequently tested by many security analysts.
189
- Check also our [security policies and advisories published so far](https://github.com/netdata/netdata/security).
190
191
+ <br/> <br/>
192
+</details>
193
+
194
### :cyclone: Will this consume a lot of resources on my servers?
195
196
No. It will not! We promise this will be fast!
197
198
+<details><summary>Click to see detailed answer ...</summary>
199
+ <br/> <br/>
200
+
201
Although each Netdata Agent is a complete monitoring solution packed into a single application, and despite the fact that Netdata collects **every metric every single second** and trains **multiple ML models** per metric, you will find that Netdata has amazing performance! In many cases, it outperforms other monitoring solutions that have significantly fewer features or far smaller data collection rates.
202
203
This is what you should expect:
204
196
- - For production systems, each Netdata Agent with default settings (everything enabled, ML, Health, DB) should consume about 5% CPU utilization of one core and about 150 MiB or RAM. By using a Netdata parent and streaming all metrics to that parent, you can disable ML & health and use an ephemeral DB mode (like `alloc`) on the children, leading to utilization of about 1% CPU of a single core and 100 MiB of RAM. Of course, these depend on how many metrics are collected.
205
+ - For production systems, each Netdata Agent with default settings (everything enabled, ML, Health, DB) should consume about 5% CPU utilization of one core and about 150 MiB or RAM.
206
+
207
+ By using a Netdata parent and streaming all metrics to that parent, you can disable ML & health and use an ephemeral DB mode (like `alloc`) on the children, leading to utilization of about 1% CPU of a single core and 100 MiB of RAM. Of course, these depend on how many metrics are collected.
208
+
209
- For Netdata Parents, for about 1 to 2 million metrics, all collected every second, we suggest a server with 16 cores and 32GB RAM. Less than half of it will be used for data collection and ML. The rest will be available for queries.
210
211
Netdata has extensive internal instrumentation to help us reveal how the resources consumed are used. All these are available in the "Netdata Monitoring" section of the dashboard. Depending on your use case, there are many options to optimize resource consumption.
212
213
Even if you need to run Netdata on extremely weak embedded or IoT systems, you will find that Netdata can be tuned to be very performant.
214
215
+ <br/> <br/>
216
+</details>
217
+
218
### :scroll: How much retention can I have?
219
220
As much as you need!
221
222
+<details><summary>Click to see detailed answer ...</summary>
223
+ <br/> <br/>
224
+
225
Netdata supports **tiering**, to downsample past data and save disk space. With default settings, it has 3 tiers:
226
227
1. `tier 0`, with high resolution, per-second, data.
@@ -212,17 +230,30 @@ Netdata supports **tiering**, to downsample past data and save disk space. With
230
231
All tiers are updated in parallel during data collection. Just increase the disk space you give to Netdata to get a longer history for your metrics. Tiers are automatically chosen at query time depending on the time frame and the resolution requested.
232
233
+ <br/> <br/>
234
+</details>
235
+
236
### :rocket: Does it scale? I have really a lot of servers!
237
238
Yes, of course it does!
239
240
+<details><summary>Click to see detailed answer ...</summary>
241
+ <br/> <br/>
242
+
243
- :airplane: Netdata Parents provide great vertical scalability, so you can have as big parents as the CPU, RAM and Disk resources you can dedicate to them. In our lab we constantly stress test Netdata Parents with about 2 million metrics collected per second.
244
+
245
- :rocket: In addition, Netdata Cloud provides virtually unlimited horizontal scalability. It "merges" all the Netdata parents you have into one unified infrastructure at query time. Netdata Cloud itself is probably the biggest single installation monitoring platform ever created, currently monitoring about 100k online servers with about 10k servers changing state (added/removed) per day!
246
247
+ <br/> <br/>
248
+</details>
249
+
250
### :floppy_disk: My production servers are very sensitive in disk I/O. Can I use Netdata?
251
252
Yes, you can!
253
254
+<details><summary>Click to see detailed answer ...</summary>
255
+ <br/> <br/>
256
+
257
We suggest the following:
258
259
1. Use database mode `alloc` or `ram` to disable writing metric data to disk.
@@ -232,8 +263,16 @@ We suggest the following:
263
264
Using the above, the Netdata Agent on your production system will not need a disk.
265
266
+ <br/> <br/>
267
+</details>
268
+
269
### :raised_eyebrow: How is Netdata different from a Prometheus and Grafana setup?
270
271
+Netdata is a "ready to use" monitoring solution. Prometheus and Grafana are tools to build your own monitoring solution.
272
+
273
+<details><summary>Click to see detailed answer ...</summary>
274
+ <br/> <br/>
275
+
276
First we have to say that Prometheus as a time-series database and Grafana as a visualizer are excellent tools for what they do.
277
278
However, we believe that such a setup is missing a key element: A Prometheus and Grafana setup assumes that you know everything about the metrics you collect and you understand deeply how they are structured, they should be queried and visualized.
@@ -242,16 +281,26 @@ In reality this setup has a lot of problems. The vast number of technologies, op
281
282
So, the biggest difference of Netdata to Prometheus and Grafana, is that we decided that the tool needs to have a much better understanding of the components, the applications and the metrics it monitors.
283
245
- - When compared to Prometheus, Netdata needs for each metric much more than just a name, some labels and a value over time. A metric in Netdata is a structured entity that correlates with other metrics in a certain way, has specific attributes that depict how it should be organized, treated, queried and visualized. We call this the NIDL (Nodes, Instances, Dimensions, Labels) framework. To maintain such an index is a challenge: first because the raw metrics collected do not provide this information, so we have to add it, and second because we need to maintain this index for the lifetime of each metric, which with our current database retention, it is usually more than a year.
284
+ - When compared to Prometheus, Netdata needs for each metric much more than just a name, some labels and a value over time. A metric in Netdata is a structured entity that correlates with other metrics in a certain way, has specific attributes that depict how it should be organized, treated, queried and visualized. We call this the NIDL (Nodes, Instances, Dimensions, Labels) framework.
285
+
286
+ To maintain such an index is a challenge: first because the raw metrics collected do not provide this information, so we have to add it, and second because we need to maintain this index for the lifetime of each metric, which with our current database retention, it is usually more than a year.
287
247
- - When compared to Grafana, Netdata is fully automated. Grafana has more customization capabilities than Netdata, but Netdata presents fully functional dashboards by itself and most importantly it gives you the means to understand, analyze, filter, slice and dice the data without the need for you to edit queries or be aware of any peculiarities the underlying metrics may have. Furthermore, to help you when you need to find the needle in the haystack, Netdata has advanced troubleshooting tools provided by the Netdata metrics scoring engine, that allows it to score metrics based on their anomaly rate, their differences or similarities for any given time-frame.
288
+ - When compared to Grafana, Netdata is fully automated. Grafana has more customization capabilities than Netdata, but Netdata presents fully functional dashboards by itself and most importantly it gives you the means to understand, analyze, filter, slice and dice the data without the need for you to edit queries or be aware of any peculiarities the underlying metrics may have.
289
+
290
+ Furthermore, to help you when you need to find the needle in the haystack, Netdata has advanced troubleshooting tools provided by the Netdata metrics scoring engine, that allows it to score metrics based on their anomaly rate, their differences or similarities for any given time-frame.
291
292
Still, if you are already familiar with Prometheus and Grafana, Netdata integrates nicely with them, and we have reports from users who use Netdata with Prometheus and Grafana in production.
293
294
+ <br/> <br/>
295
+</details>
296
+
297
### :cloud: Do I have to subscribe to Netdata Cloud?
298
299
No. But we hope you will find it useful.
300
301
+<details><summary>Click to see detailed answer ...</summary>
302
+ <br/> <br/>
303
+
304
The Netdata Agent dashboard and the Netdata Cloud dashboard are the same. Still, Netdata Cloud provides additional features, that the Netdata Agent is not capable of. These include:
305
306
1. Customizability (custom dashboards and other settings are persisted when you are signed in to Netdata Cloud)
@@ -263,12 +312,23 @@ The Netdata Agent dashboard and the Netdata Cloud dashboard are the same. Still,
312
313
So, although it is not required, you can get the most out of your Netdata installation by using Netdata Cloud.
314
315
+ <br/> <br/>
316
+</details>
317
+
318
### :office: Who uses Netdata?
319
268
-Netdata is a popular project. Check its [stargazers on github](https://github.com/netdata/netdata/stargazers). You will find people from quite popular companies and enterprises, including: SAP, Qualcomm, IBM, Amazon, Intel, AMD, Unity, Baidu, Cisco, Samsung, Netflix, Facebook and hundreds more.
320
+Netdata is a popular project. Almost everyone uses it.
321
+
322
+<details><summary>Click to see detailed answer ...</summary>
323
+ <br/> <br/>
324
+
325
+Check its [stargazers on github](https://github.com/netdata/netdata/stargazers). You will find people from quite popular companies and enterprises, including: SAP, Qualcomm, IBM, Amazon, Intel, AMD, Unity, Baidu, Cisco, Samsung, Netflix, Facebook and hundreds more.
326
327
Netdata is also popular in universities, including New York University, Columbia University, New Jersey University, and dozens more.
328
329
+ <br/> <br/>
330
+</details>
331
+
332
## :book: Documentation
333
334
Netdata's documentation is available at [**Netdata Learn**](https://learn.netdata.cloud).