@cryptotaxi247 / netdata-1 / commits / f241471ad

Update README.md

Costa Tsaousis committed Jul 17, 2023 at 15:18 UTC f241471ad68859fbbda861be1cf623661bcea81d
1 file changed +64 -4
README.md
+64 -4
@@ -178,6 +178,9 @@ When using Netdata Parents, all the functions of a Netdata Agent (except data co
178
179 Of course it is! We do our best to ensure it is!
180
181 +<details><summary>Click to see detailed answer ...</summary>
182 +&nbsp;<br/>&nbsp;<br/>
183 +
184 We understand that Netdata is a software piece that is installed on millions of production systems across the world. So, it is important for us, Netdata to be as secure as possible:
185
186 - We follow the [Open Source Security Foundation](https://bestpractices.coreinfrastructure.org/en/projects/2231) best practices.
@@ -185,25 +188,40 @@ We understand that Netdata is a software piece that is installed on millions of
188 - Netdata is a popular open-source project and is frequently tested by many security analysts.
189 - Check also our [security policies and advisories published so far](https://github.com/netdata/netdata/security).
190
191 +&nbsp;<br/>&nbsp;<br/>
192 +</details>
193 +
194 ### :cyclone: Will this consume a lot of resources on my servers?
195
196 No. It will not! We promise this will be fast!
197
198 +<details><summary>Click to see detailed answer ...</summary>
199 +&nbsp;<br/>&nbsp;<br/>
200 +
201 Although each Netdata Agent is a complete monitoring solution packed into a single application, and despite the fact that Netdata collects **every metric every single second** and trains **multiple ML models** per metric, you will find that Netdata has amazing performance! In many cases, it outperforms other monitoring solutions that have significantly fewer features or far smaller data collection rates.
202
203 This is what you should expect:
204
196 - - For production systems, each Netdata Agent with default settings (everything enabled, ML, Health, DB) should consume about 5% CPU utilization of one core and about 150 MiB or RAM. By using a Netdata parent and streaming all metrics to that parent, you can disable ML & health and use an ephemeral DB mode (like `alloc`) on the children, leading to utilization of about 1% CPU of a single core and 100 MiB of RAM. Of course, these depend on how many metrics are collected.
205 + - For production systems, each Netdata Agent with default settings (everything enabled, ML, Health, DB) should consume about 5% CPU utilization of one core and about 150 MiB or RAM.
206 +
207 + By using a Netdata parent and streaming all metrics to that parent, you can disable ML & health and use an ephemeral DB mode (like `alloc`) on the children, leading to utilization of about 1% CPU of a single core and 100 MiB of RAM. Of course, these depend on how many metrics are collected.
208 +
209 - For Netdata Parents, for about 1 to 2 million metrics, all collected every second, we suggest a server with 16 cores and 32GB RAM. Less than half of it will be used for data collection and ML. The rest will be available for queries.
210
211 Netdata has extensive internal instrumentation to help us reveal how the resources consumed are used. All these are available in the "Netdata Monitoring" section of the dashboard. Depending on your use case, there are many options to optimize resource consumption.
212
213 Even if you need to run Netdata on extremely weak embedded or IoT systems, you will find that Netdata can be tuned to be very performant.
214
215 +&nbsp;<br/>&nbsp;<br/>
216 +</details>
217 +
218 ### :scroll: How much retention can I have?
219
220 As much as you need!
221
222 +<details><summary>Click to see detailed answer ...</summary>
223 +&nbsp;<br/>&nbsp;<br/>
224 +
225 Netdata supports **tiering**, to downsample past data and save disk space. With default settings, it has 3 tiers:
226
227 1. `tier 0`, with high resolution, per-second, data.
@@ -212,17 +230,30 @@ Netdata supports **tiering**, to downsample past data and save disk space. With
230
231 All tiers are updated in parallel during data collection. Just increase the disk space you give to Netdata to get a longer history for your metrics. Tiers are automatically chosen at query time depending on the time frame and the resolution requested.
232
233 +&nbsp;<br/>&nbsp;<br/>
234 +</details>
235 +
236 ### :rocket: Does it scale? I have really a lot of servers!
237
238 Yes, of course it does!
239
240 +<details><summary>Click to see detailed answer ...</summary>
241 +&nbsp;<br/>&nbsp;<br/>
242 +
243 - :airplane: Netdata Parents provide great vertical scalability, so you can have as big parents as the CPU, RAM and Disk resources you can dedicate to them. In our lab we constantly stress test Netdata Parents with about 2 million metrics collected per second.
244 +
245 - :rocket: In addition, Netdata Cloud provides virtually unlimited horizontal scalability. It "merges" all the Netdata parents you have into one unified infrastructure at query time. Netdata Cloud itself is probably the biggest single installation monitoring platform ever created, currently monitoring about 100k online servers with about 10k servers changing state (added/removed) per day!
246
247 +&nbsp;<br/>&nbsp;<br/>
248 +</details>
249 +
250 ### :floppy_disk: My production servers are very sensitive in disk I/O. Can I use Netdata?
251
252 Yes, you can!
253
254 +<details><summary>Click to see detailed answer ...</summary>
255 +&nbsp;<br/>&nbsp;<br/>
256 +
257 We suggest the following:
258
259 1. Use database mode `alloc` or `ram` to disable writing metric data to disk.
@@ -232,8 +263,16 @@ We suggest the following:
263
264 Using the above, the Netdata Agent on your production system will not need a disk.
265
266 +&nbsp;<br/>&nbsp;<br/>
267 +</details>
268 +
269 ### :raised_eyebrow: How is Netdata different from a Prometheus and Grafana setup?
270
271 +Netdata is a "ready to use" monitoring solution. Prometheus and Grafana are tools to build your own monitoring solution.
272 +
273 +<details><summary>Click to see detailed answer ...</summary>
274 +&nbsp;<br/>&nbsp;<br/>
275 +
276 First we have to say that Prometheus as a time-series database and Grafana as a visualizer are excellent tools for what they do.
277
278 However, we believe that such a setup is missing a key element: A Prometheus and Grafana setup assumes that you know everything about the metrics you collect and you understand deeply how they are structured, they should be queried and visualized.
@@ -242,16 +281,26 @@ In reality this setup has a lot of problems. The vast number of technologies, op
281
282 So, the biggest difference of Netdata to Prometheus and Grafana, is that we decided that the tool needs to have a much better understanding of the components, the applications and the metrics it monitors.
283
245 - - When compared to Prometheus, Netdata needs for each metric much more than just a name, some labels and a value over time. A metric in Netdata is a structured entity that correlates with other metrics in a certain way, has specific attributes that depict how it should be organized, treated, queried and visualized. We call this the NIDL (Nodes, Instances, Dimensions, Labels) framework. To maintain such an index is a challenge: first because the raw metrics collected do not provide this information, so we have to add it, and second because we need to maintain this index for the lifetime of each metric, which with our current database retention, it is usually more than a year.
284 + - When compared to Prometheus, Netdata needs for each metric much more than just a name, some labels and a value over time. A metric in Netdata is a structured entity that correlates with other metrics in a certain way, has specific attributes that depict how it should be organized, treated, queried and visualized. We call this the NIDL (Nodes, Instances, Dimensions, Labels) framework.
285 +
286 + To maintain such an index is a challenge: first because the raw metrics collected do not provide this information, so we have to add it, and second because we need to maintain this index for the lifetime of each metric, which with our current database retention, it is usually more than a year.
287
247 - - When compared to Grafana, Netdata is fully automated. Grafana has more customization capabilities than Netdata, but Netdata presents fully functional dashboards by itself and most importantly it gives you the means to understand, analyze, filter, slice and dice the data without the need for you to edit queries or be aware of any peculiarities the underlying metrics may have. Furthermore, to help you when you need to find the needle in the haystack, Netdata has advanced troubleshooting tools provided by the Netdata metrics scoring engine, that allows it to score metrics based on their anomaly rate, their differences or similarities for any given time-frame.
288 + - When compared to Grafana, Netdata is fully automated. Grafana has more customization capabilities than Netdata, but Netdata presents fully functional dashboards by itself and most importantly it gives you the means to understand, analyze, filter, slice and dice the data without the need for you to edit queries or be aware of any peculiarities the underlying metrics may have.
289 +
290 + Furthermore, to help you when you need to find the needle in the haystack, Netdata has advanced troubleshooting tools provided by the Netdata metrics scoring engine, that allows it to score metrics based on their anomaly rate, their differences or similarities for any given time-frame.
291
292 Still, if you are already familiar with Prometheus and Grafana, Netdata integrates nicely with them, and we have reports from users who use Netdata with Prometheus and Grafana in production.
293
294 +&nbsp;<br/>&nbsp;<br/>
295 +</details>
296 +
297 ### :cloud: Do I have to subscribe to Netdata Cloud?
298
299 No. But we hope you will find it useful.
300
301 +<details><summary>Click to see detailed answer ...</summary>
302 +&nbsp;<br/>&nbsp;<br/>
303 +
304 The Netdata Agent dashboard and the Netdata Cloud dashboard are the same. Still, Netdata Cloud provides additional features, that the Netdata Agent is not capable of. These include:
305
306 1. Customizability (custom dashboards and other settings are persisted when you are signed in to Netdata Cloud)
@@ -263,12 +312,23 @@ The Netdata Agent dashboard and the Netdata Cloud dashboard are the same. Still,
312
313 So, although it is not required, you can get the most out of your Netdata installation by using Netdata Cloud.
314
315 +&nbsp;<br/>&nbsp;<br/>
316 +</details>
317 +
318 ### :office: Who uses Netdata?
319
268 -Netdata is a popular project. Check its [stargazers on github](https://github.com/netdata/netdata/stargazers). You will find people from quite popular companies and enterprises, including: SAP, Qualcomm, IBM, Amazon, Intel, AMD, Unity, Baidu, Cisco, Samsung, Netflix, Facebook and hundreds more.
320 +Netdata is a popular project. Almost everyone uses it.
321 +
322 +<details><summary>Click to see detailed answer ...</summary>
323 +&nbsp;<br/>&nbsp;<br/>
324 +
325 +Check its [stargazers on github](https://github.com/netdata/netdata/stargazers). You will find people from quite popular companies and enterprises, including: SAP, Qualcomm, IBM, Amazon, Intel, AMD, Unity, Baidu, Cisco, Samsung, Netflix, Facebook and hundreds more.
326
327 Netdata is also popular in universities, including New York University, Columbia University, New Jersey University, and dozens more.
328
329 +&nbsp;<br/>&nbsp;<br/>
330 +</details>
331 +
332 ## :book: Documentation
333
334 Netdata's documentation is available at [**Netdata Learn**](https://learn.netdata.cloud).