source/projects/aloe
2021-12-27 00:49:28 -07:00
..
src/python/aloe Fmt. 2021-12-27 00:49:28 -07:00
BUILD WIP - refactoring towards a better state 2021-12-12 20:55:39 -07:00
README.md Blah. 2021-11-20 23:10:00 -07:00

Aloe

  • A cactus-like plant
  • Traditionally used for a variety of skin conditions

Aloe is a quick and dirty network weathermapping tool, much like MTR or Cacti. Aloe uses multiple threads to first establish a rough network topology via ICMP traceroutes, and then monitor it with ICMP pings.

Usage

$ bazel build //projects/aloe
$ sudo ./bazel-bin/projects/aloe/aloe twitter.com google.com
INFO:__main__:Graph -
                        ┌─────────────────┐
                        │    127.0.0.1    │
                        └─────────────────┘
                          │
                          │
                          ▼
┌─────────────────┐     ┌─────────────────┐
│  68.85.107.81   │ ◀── │    10.0.0.1     │
└─────────────────┘     └─────────────────┘
  │                       │
  │                       │
  │                       ▼
  │                     ┌─────────────────┐
  │                     │  68.85.107.85   │
  │                     └─────────────────┘
  │                       │
  │                       │
  │                       ▼
  │                     ┌─────────────────┐
  │                     │   68.86.103.9   │
  │                     └─────────────────┘
  │                       │
  │                       │
  │                       ▼
  │                     ┌─────────────────┐
  └───────────────────▶ │  68.85.89.213   │
                        └─────────────────┘
                          │
                          │
                          ▼
                        ┌─────────────────┐
                        │ 24.124.155.129  │
                        └─────────────────┘
                          │
                          │
                          ▼
┌─────────────────┐     ┌─────────────────┐     ┌────────────────┐
│  96.110.43.241  │ ◀── │  96.216.22.130  │ ──▶ │ 96.110.43.253  │
└─────────────────┘     └─────────────────┘     └────────────────┘
  │                       │                       │
  │                       │                       │
  ▼                       ▼                       ▼
┌─────────────────┐     ┌─────────────────┐     ┌────────────────┐
│  96.110.38.114  │     │  96.110.43.245  │     │ 96.110.38.126  │
└─────────────────┘     └─────────────────┘     └────────────────┘
  │                       │                       │
  │                       │                       │
  ▼                       ▼                       ▼
┌─────────────────┐     ┌─────────────────┐     ┌────────────────┐
│   96.87.8.210   │     │  96.110.38.118  │     │ 23.30.206.218  │
└─────────────────┘     └─────────────────┘     └────────────────┘
  │                       │                       │
  │                       │                       │
  ▼                       ▼                       ▼
┌─────────────────┐     ┌─────────────────┐     ┌────────────────┐
│ 108.170.252.193 │     │ 173.167.57.142  │     │ 172.253.75.177 │
└─────────────────┘     └─────────────────┘     └────────────────┘
  │                       │                       │
  │                       │                       │
  ▼                       ▼                       ▼
┌─────────────────┐     ┌─────────────────┐     ┌────────────────┐
│ 142.250.69.238  │     │ 213.155.133.171 │     │ 142.250.72.46  │
└─────────────────┘     └─────────────────┘     └────────────────┘
                          │
                          │
                          ▼
┌─────────────────┐     ┌─────────────────┐
│  104.244.42.65  │ ◀── │  62.115.49.193  │
└─────────────────┘     └─────────────────┘
                          │
                          │
                          ▼
                        ┌─────────────────┐
                        │ 104.244.42.129  │
                        └─────────────────┘

If hosts in topology stop responding for 10s or more (the polling interval is ~1s), they are declared to be warning. If hosts in topology stop responding for 5s, they are declared down. If a host in topology resume responding after 5s or more, they are declared to have recovered. If hosts in topology stop responding for 30 min, they are declared dead and monitoring is stopped. The topology is reconfigured every 5 min to account to DHCP and upstream changes.

A log of all these events is built in a plain-text format to incidents.txt. The format of this file is -

UP        <ip>  <date>
WARN      <ip>  <date>
DOWN      <ip>  <date>
RECOVERED <ip>  <date>   <duration>
DEAD      <ip>  <date>   <duration>

Future work

  • Log topology
  • Attempt to identify "root cause" incidents in the route graph which explain downstream failures
  • Use sqlite3 for aggregation not a plain text file
  • Use a more sophisticated counters and debounce model of host state in the main thread
  • Find some way to incorporate rolling counters (mean, median, stddev, deciles, max) into the UI
  • FFS find some way NOT to depend on that nonsense box-diagram service

License

Copyright Reid 'arrdem' McKenzie, 11/20/2021.

Published under the terms of the MIT license.