Create ingest dry run check (#21152)
* add workflow * add workflow * add workflow * Apply suggestion from @ilyam8 * Apply suggestion from @ilyam8 * Apply suggestion from @ilyam8 * Add '-f' flag to ingest.py command * Update ingest command to include fail-on-netdata option * Apply suggestions from code review * Apply suggestions from code review * Fix Python setup and update ingest commands * Apply suggestion from @Ancairon * Update .github/workflows/check-markdown.yml * Apply suggestions from code review --------- Co-authored-by: Ilya Mashchenko <ilya@netdata.cloud>
Fotis Voutsas committed
Dec 3, 2025 at 12:31 UTC
dd2202af1206e5fdd7a401d02c0fd4bfdd354ffd
1 file changed
+60
.github/workflows/check-markdown.yml
new
+60
@@ -0,0 +1,60 @@
1
+name: Docs Broken Link Check
2
+
3
+on:
4
+ pull_request:
5
+ paths:
6
+ - '**/*.md'
7
+ - '**/*.mdx'
8
+ - 'docs/**'
9
+ - '**/metadata.yaml'
10
+ - 'integrations/**'
11
+
12
+jobs:
13
+ check-documentation:
14
+ runs-on: ubuntu-latest
15
+ steps:
16
+ - name: Checkout PR branch
17
+ uses: actions/checkout@v6
18
+ with:
19
+ fetch-depth: 0
20
+ path: netdata
21
+
22
+ - name: Checkout netdata/learn repository
23
+ uses: actions/checkout@v6
24
+ with:
25
+ repository: netdata/learn
26
+ path: learn
27
+
28
+ - name: Init python env
29
+ uses: actions/setup-python@v6
30
+ with:
31
+ python-version: "3.9"
32
+
33
+ - name: Setup python dependencies
34
+ run: |
35
+ python3 -m venv ./venv
36
+ source ./venv/bin/activate
37
+ pip install -r learn/.learn_environment/ingest-requirements.txt
38
+ cd netdata && ./integrations/pip.sh
39
+
40
+ - name: Generate Integrations
41
+ run: |
42
+ source ./venv/bin/activate
43
+ cd netdata && python3 integrations/gen_integrations.py
44
+
45
+ - name: Generate Integrations Documentation
46
+ run: |
47
+ source ./venv/bin/activate
48
+ cd netdata && python3 integrations/gen_docs_integrations.py
49
+
50
+ - name: Generate src/collectors/COLLECTORS.md
51
+ run: |
52
+ source ./venv/bin/activate
53
+ cd netdata && python3 integrations/gen_doc_collector_page.py
54
+
55
+ - name: Run Ingest
56
+ working-directory: learn
57
+ run: |
58
+ source ../venv/bin/activate
59
+ echo "Running ingest with local netdata directory"
60
+ python ingest/ingest.py --local-repo "netdata:${{ github.workspace }}/netdata" --ignore-on-prem-repo --fail-links-netdata