Daily Fivetran pipeline status log in Google Sheets

By General Input

Automatically log the status of every Fivetran data pipeline to a Google Sheet each morning, so you can chart uptime and spot pipelines that fail repeatedly.

Integrations

  • Fivetran
  • Google Sheets

Type

Deterministic Code

Categories

  • Operations
  • Engineering

Every day at 7am, log the current status of every Fivetran connection to a Google Sheet so I build a running history of my data pipelines. This is a straight deterministic export: one row per connection per day, with no summarizing or reasoning.

First, call Fivetran's List Connections operation to retrieve every connection in the account. For each connection, read its name, source type (the connection's service), group_id, sync state (status.sync_state), last successful sync time, and paused flag.

Map each connection into one flat row with these columns: date, connection name, source type, group, destination, sync state, last successful sync, and paused. Use today's date for the date column. In Fivetran each connection belongs to a group that corresponds to a destination, so use the group_id for both the group and destination columns.

Append the rows to a tracking tab in my Google Sheet using Google Sheets' Append Values operation. On the first run, if the tab is empty, write the header row first. Always append below the last row and never overwrite existing history, so each day's snapshot stacks on top of the previous days.

The result is a growing daily log I can chart to track pipeline uptime and spot connections that fail repeatedly over time.

Related prompts

Explore more prompts
Call overdue Xero customers with an AI collections agentLocal listing health board for every location you manageLet support send one-off Loops emails without an engineerStop cold emails to anyone with a live deal in PipedriveiMessage campaign console with pre-flight checks and delivery boardLinkedIn Ads budget pacing dashboard for every client accountFront desk appointment confirmation board for the next 3 daysGive your team Looker numbers without buying more seatsBuild audience segments from product usage and push to LoopsTurn the people who engage with your posts into Pipedrive leads