oy-csv-to-targets

usage: oy-csv-to-targets --input.file=input.csv [<flags>]


Flags:
  -h, --[no-]help             Show context-sensitive help (also try --help-long
                              and --help-man).
      --input.file=input.csv  Path to a CSV file to use as an input.
      --output.file=targets.json  
                              Path to a json file to use as an output.
      --log.level=info        Only log messages with the given severity or
                              above. One of: [debug, info, warn, error]
      --log.format=logfmt     Output format of log messages. One of: [logfmt,
                              json]
      --[no-]version          Show application version.

oy-csv-to-targets takes a list of Prometheus targets as a CSV file as input and produces a JSON file.

The resulting JSON file can then be used by the file_sd discovery mechanism to dynamically discover and scrape the Prometheus targets. This allows the targets to be easily managed and updated without having to manually update the Prometheus configuration file, if your team is not fluent with JSON.

If no output file is specified, the output goes to stdout.

With the following CSV as an input:

,datacenter,availability_zone
prometheus1:9090,dc1,az1
prometheus2:9090,dc1,az2
prometheus3:9090,dc2,az1

The following command:

./oy-csv-to-targets --input.file targets.csv --output.file targets.json

Would produce the following targets.json file:

[
    {
        "labels": {
            "availability_zone": "az1",
            "datacenter": "dc1"
        },
        "targets": [
            "prometheus1:9090"
        ]
    },
    {
        "labels": {
            "availability_zone": "az2",
            "datacenter": "dc1"
        },
        "targets": [
            "prometheus2:9090"
        ]
    },
    {
        "labels": {
            "availability_zone": "az1",
            "datacenter": "dc2"
        },
        "targets": [
            "prometheus3:9090"
        ]
    }
]

You can then configure your Prometheus as follows

scrape_configs:
- job_name: prometheus
  file_sd_configs:
    - files: [targets.json]

wget https://github.com/o11ydev/oy-toolkit/releases/download/main/oy-csv-to-targets -O oy-csv-to-targets && chmod +x oy-csv-to-targets && ./oy-csv-to-targets --help

docker run quay.io/o11y/oy-toolkit:oy-csv-to-targets --help

nix run github:o11ydev/oy-toolkit#oy-csv-to-targets -- --help