| 1 | # WebSphere Monitoring Guide for Netdata |
| 2 | |
| 3 | ## Overview |
| 4 | |
| 5 | IBM WebSphere Application Server comes in multiple editions, each with different monitoring capabilities. This guide helps understand which monitoring interfaces are available in each edition and provides recommendations for comprehensive market coverage. |
| 6 | |
| 7 | ## Netdata Module Mapping |
| 8 | |
| 9 | Netdata ships three dedicated WebSphere collectors implemented in the ibm.d framework. Their source locations and backing protocols are: |
| 10 | |
| 11 | | Module | Source Path | Protocol Layer | |
| 12 | | ------ | ----------- | -------------- | |
| 13 | | `websphere_pmi` | `src/go/plugin/ibm.d/modules/websphere/pmi` | `protocols/websphere/pmi` (PerfServlet XML) | |
| 14 | | `websphere_mp` | `src/go/plugin/ibm.d/modules/websphere/mp` | `protocols/openmetrics` (MicroProfile Metrics) | |
| 15 | | `websphere_jmx` | `src/go/plugin/ibm.d/modules/websphere/jmx` | `protocols/jmxbridge` + `protocols/websphere/jmx` | |
| 16 | |
| 17 | Each module exposes generated contexts under its `contexts/` directory and is configured via `/etc/netdata/ibm.d/websphere_*.conf`. |
| 18 | |
| 19 | ## WebSphere Editions |
| 20 | |
| 21 | ### 1. WebSphere Traditional (Full Profile) |
| 22 | |
| 23 | **Editions:** |
| 24 | - **Base**: Single server deployment, no clustering |
| 25 | - **Network Deployment (ND)**: Full clustering, distributed management |
| 26 | - **Express**: Limited to 480 PVUs, 32-bit only (discontinued) |
| 27 | |
| 28 | **Monitoring Capabilities:** |
| 29 | - **PMI (Performance Monitoring Infrastructure)**: Core monitoring system |
| 30 | - Available via PerfServlet (XML over HTTP) |
| 31 | - Available via wsadmin (Jython scripting) |
| 32 | - Available via metrics.ear (Prometheus format) - **only in 8.5.5.20+ and 9.0.5.7+** |
| 33 | - **JMX**: Full MBean access |
| 34 | - JSR160RMI connector (port 2809-2811 typically) |
| 35 | - SOAP connector (limited capabilities) |
| 36 | - **Admin Console**: Built-in Tivoli Performance Viewer |
| 37 | |
| 38 | **Production Adoption (2024):** |
| 39 | - Still dominates enterprise deployments (~60-70%) |
| 40 | - Version distribution: |
| 41 | - 8.5.5: ~40% (many on Fix Pack 15-18) |
| 42 | - 9.0.5: ~30% (more likely to have newer fix packs) |
| 43 | - Older (7.x, 8.0): ~30% (legacy systems) |
| 44 | |
| 45 | ### 2. WebSphere Liberty |
| 46 | |
| 47 | **Editions:** |
| 48 | - **Liberty Core**: Java EE Web Profile only |
| 49 | - **Liberty Base**: Full Java EE support |
| 50 | - **Liberty ND**: Clustering and collective management |
| 51 | |
| 52 | **Monitoring Capabilities:** |
| 53 | - **MicroProfile Metrics**: Modern metrics API |
| 54 | - Version 1.x-3.x: Custom Prometheus format |
| 55 | - Version 4.x+: OpenMetrics format |
| 56 | - Version 5.0+: Micrometer-based |
| 57 | - **MicroProfile Telemetry**: OpenTelemetry support |
| 58 | - **JMX**: Limited compared to Traditional |
| 59 | - **Admin Center**: Web-based management (optional) |
| 60 | |
| 61 | **Production Adoption (2024):** |
| 62 | - Growing rapidly (~25-30% of new deployments) |
| 63 | - Preferred for cloud-native applications |
| 64 | - Common in containerized environments |
| 65 | |
| 66 | ### 3. Open Liberty |
| 67 | |
| 68 | **Monitoring Capabilities:** |
| 69 | - Same as WebSphere Liberty |
| 70 | - Open source, no license required |
| 71 | - Full MicroProfile support |
| 72 | |
| 73 | **Production Adoption (2024):** |
| 74 | - ~10% of Liberty deployments |
| 75 | - Popular in development/test environments |
| 76 | |
| 77 | ## Monitoring Interface Comparison |
| 78 | |
| 79 | | Feature | Traditional | Liberty | Availability | |
| 80 | |---------|-------------|---------|--------------| |
| 81 | | PerfServlet (XML) | ✓ | ✗ | All Traditional versions | |
| 82 | | metrics.ear (Prometheus) | ✓* | ✗ | Traditional 8.5.5.20+, 9.0.5.7+ | |
| 83 | | MicroProfile Metrics | ✗ | ✓ | All Liberty versions | |
| 84 | | JMX (Full MBeans) | ✓ | Limited | All versions | |
| 85 | | wsadmin/Jython | ✓ | ✗ | All Traditional versions | |
| 86 | | Admin REST API | Limited | ✓ | Liberty only | |
| 87 | |
| 88 | *Requires specific fix pack level |
| 89 | |
| 90 | ## Data Coverage by Interface |
| 91 | |
| 92 | ### PMI (Traditional Only) |
| 93 | - Thread pools |
| 94 | - Connection pools (JDBC, JMS, JCA) |
| 95 | - Servlet/JSP metrics |
| 96 | - EJB metrics |
| 97 | - Transaction manager |
| 98 | - JVM runtime (heap, GC) |
| 99 | - Session manager |
| 100 | - WebContainer statistics |
| 101 | - ORB metrics |
| 102 | - SIB (Service Integration Bus) |
| 103 | |
| 104 | ### MicroProfile Metrics (Liberty Only) |
| 105 | - JVM metrics (memory, threads, GC) |
| 106 | - Application-defined metrics |
| 107 | - JAX-RS endpoint metrics |
| 108 | - MicroProfile components |
| 109 | - Custom business metrics |
| 110 | |
| 111 | ### JMX (Both) |
| 112 | - All PMI data (Traditional) |
| 113 | - Server lifecycle operations |
| 114 | - Configuration MBeans |
| 115 | - Custom application MBeans |
| 116 | - Standard JVM MBeans |
| 117 | |
| 118 | ## Netdata Implementation Recommendations |
| 119 | |
| 120 | ### 1. **websphere_pmi Module** (Traditional WebSphere) |
| 121 | |
| 122 | **Primary Interface:** PerfServlet |
| 123 | - **Pros**: |
| 124 | - Available in ALL Traditional versions |
| 125 | - No authentication required by default |
| 126 | - Simple HTTP/XML parsing |
| 127 | - Comprehensive PMI data |
| 128 | - **Implementation**: |
| 129 | ``` |
| 130 | URL: http://host:9080/wasPerfTool/servlet/perfservlet |
| 131 | Fallback: Try metrics.ear if PerfServlet not deployed |
| 132 | ``` |
| 133 | |
| 134 | **Secondary Interface:** metrics.ear (if available) |
| 135 | - Check for `/metrics` endpoint |
| 136 | - Use if Fix Pack 20+ (8.5.5) or 7+ (9.0.5) |
| 137 | |
| 138 | ### 2. **websphere_jmx Module** (All WebSphere) |
| 139 | |
| 140 | **Primary Interface:** JMX RMI |
| 141 | - **Pros**: |
| 142 | - Access to non-PMI MBeans |
| 143 | - Server control operations |
| 144 | - Works on both Traditional and Liberty |
| 145 | - **Cons**: |
| 146 | - Requires client JARs |
| 147 | - More complex authentication |
| 148 | - Firewall considerations |
| 149 | - **Implementation**: |
| 150 | ``` |
| 151 | Traditional: service:jmx:iiop://host:2809/jndi/JMXConnector |
| 152 | Liberty: service:jmx:rest://host:9443/IBMJMXConnectorREST |
| 153 | ``` |
| 154 | |
| 155 | ### 3. **websphere_mp Module** (Liberty Only) |
| 156 | |
| 157 | **Primary Interface:** MicroProfile Metrics endpoint |
| 158 | - **Pros**: |
| 159 | - Modern Prometheus format |
| 160 | - No special libraries needed |
| 161 | - Standard across Liberty versions |
| 162 | - **Implementation**: |
| 163 | ``` |
| 164 | URL: https://host:9443/metrics |
| 165 | Scopes: /metrics/base, /metrics/vendor, /metrics/application |
| 166 | ``` |
| 167 | |
| 168 | ## Market Coverage Strategy |
| 169 | |
| 170 | ### Recommended Priority: |
| 171 | |
| 172 | 1. **websphere_pmi with PerfServlet** (50-60% coverage) |
| 173 | - Covers all Traditional deployments |
| 174 | - Most common in enterprises |
| 175 | |
| 176 | 2. **websphere_mp for Liberty** (25-30% coverage) |
| 177 | - Growing segment |
| 178 | - Cloud-native deployments |
| 179 | |
| 180 | 3. **websphere_jmx as universal fallback** (15-20% coverage) |
| 181 | - Handles edge cases |
| 182 | - Custom monitoring needs |
| 183 | |
| 184 | ### Detection Logic: |
| 185 | ``` |
| 186 | 1. Try Liberty endpoints first (/metrics, /ibm/api) |
| 187 | → Use websphere_mp if found |
| 188 | |
| 189 | 2. Try PerfServlet (/wasPerfTool/servlet/perfservlet) |
| 190 | → Use websphere_pmi if found |
| 191 | |
| 192 | 3. Try metrics.ear (/metrics with WAS-specific headers) |
| 193 | → Use websphere_pmi if found |
| 194 | |
| 195 | 4. Fall back to JMX discovery |
| 196 | → Use websphere_jmx |
| 197 | ``` |
| 198 | |
| 199 | ## Implementation Notes |
| 200 | |
| 201 | ### Authentication Considerations |
| 202 | - **Traditional**: Often uses basic auth or LTPA tokens |
| 203 | - **Liberty**: Supports OAuth, JWT, basic auth |
| 204 | - **JMX**: May require SSL certificates |
| 205 | |
| 206 | ### Performance Impact |
| 207 | - **PerfServlet**: Low impact, read-only |
| 208 | - **metrics.ear**: Low impact, cached data |
| 209 | - **JMX**: Higher impact, real-time queries |
| 210 | |
| 211 | ### Common Deployment Patterns |
| 212 | - **Banking/Finance**: Traditional ND with PMI set to "Extended" |
| 213 | - **Retail/E-commerce**: Mix of Traditional and Liberty |
| 214 | - **Startups/Cloud**: Primarily Liberty or Open Liberty |
| 215 | - **Government**: Traditional with strict security |
| 216 | |
| 217 | ## Conclusion |
| 218 | |
| 219 | For comprehensive WebSphere monitoring coverage, Netdata should: |
| 220 | |
| 221 | 1. Implement PerfServlet-based monitoring for Traditional WebSphere (largest market share) |
| 222 | 2. Support MicroProfile Metrics for Liberty deployments (growing segment) |
| 223 | 3. Provide JMX as a universal fallback option |
| 224 | 4. Auto-detect WebSphere type and choose appropriate module |
| 225 | |
| 226 | This approach ensures coverage of 95%+ of WebSphere deployments in production today. |