Network Monitoring and Observability
Monitoring tells you when a known condition crosses a threshold. Observability gives you enough context to understand unfamiliar failures. A useful network operations platform combines availability, metrics, logs, traffic flow, configuration history, and active testing.
What to Monitor
- Device and interface availability
- Interface utilization, errors, discards, and queue drops
- Optical receive and transmit levels
- CPU, memory, temperature, fans, and power supplies
- Routing neighbors and route counts
- VPN sessions and tunnel health
- Firewall sessions, denies, and state-table utilization
- DHCP pools, DNS response, and IP address utilization
- Latency, packet loss, and application reachability
- Configuration changes and authentication events
SNMP
SNMP remains widely used for polling counters and receiving traps. Prefer SNMPv3 when supported because it provides authentication and encryption. Polling intervals should match the importance and volatility of the metric; a five-minute average can hide a brief but damaging traffic spike.
Streaming Telemetry
Streaming telemetry publishes structured data from devices at shorter intervals than traditional polling. It is useful for high-resolution interface metrics, routing state, and large environments, but it also requires careful data retention and alert design.
Syslog and Event Data
Centralized logs provide context for state changes:
- Interface up/down events
- Routing neighbor resets
- Authentication failures
- Configuration commits
- Spanning-tree topology changes
- Power, thermal, or hardware alarms
Synchronize time with NTP so events from multiple systems can be correlated accurately.
Flow Data
NetFlow, IPFIX, and sFlow answer who communicated with whom, using which protocol, and how much traffic was transferred. Flow data is valuable for capacity planning, DDoS investigation, unexpected bandwidth use, and identifying top talkers.
Active and Synthetic Testing
Polling a router does not prove that users can reach an application. Synthetic checks should test the actual path and service:
- ICMP reachability and loss
- TCP port connection
- DNS resolution
- HTTP status and response time
- TLS certificate validity
- Path changes through traceroute
Baselines Before Thresholds
A static alert at 80 percent utilization may be too noisy for a short burst and too slow for a low-bandwidth circuit. Establish normal behavior by time of day and day of week. Alert on sustained utilization, sudden deviation, errors, loss, or exhausted headroom.
Designing Useful Alerts
An alert should be actionable. It should identify the affected object, severity, observed value, threshold, start time, and a likely next step. Avoid sending separate notifications for every dependent interface when a core device fails.
| Severity | Example | Expected response |
|---|---|---|
| Informational | Configuration change or noncritical topology event | Record and review |
| Warning | Rising errors, reduced redundancy, sustained high utilization | Investigate before customer impact |
| Critical | Service outage, failed routing adjacency, power loss | Immediate operational response |
Configuration Monitoring
Automated configuration backups provide more than disaster recovery. Diffing revisions can identify exactly what changed before an outage. Store device configurations securely because they may contain sensitive addresses, credentials, and community strings.
A Practical Monitoring Stack
A small or medium environment may combine:
- An SNMP-based network monitoring platform
- Central syslog
- Flow collection for edge and core devices
- Configuration backup and diffing
- External probes for public services
- A status page and incident communication process
Monitoring Failure Modes
- The monitoring system depends on the network path it is supposed to monitor.
- Alerts are so noisy that operators ignore them.
- Only device uptime is monitored, not application experience.
- Graphs retain averages that hide short spikes.
- No one owns the alert or knows the expected response.
- IPv6, backup links, or secondary power paths are not monitored.