turbo-operations

Original：🇺🇸 English
Translated
1 scripts

Turbo pipeline operations reference — lifecycle commands (pause, resume, restart, delete), pipeline states, checkpoint behavior, streaming vs job-mode differences, CLI syntax for `inspect`/`logs`, TUI shortcuts, and error pattern lookup. Triggers on: 'how do I pause/restart/delete', 'will deleting lose my data', 'what does this error mean', 'inspect TUI shortcuts'. For interactive diagnosis of a broken pipeline, use /turbo-doctor.

13installs
Sourcegoldsky-io/goldsky-agent
Added on

NPX Install

npx skill4agent add goldsky-io/goldsky-agent turbo-operations

Tags

Translated version includes tags in frontmatter
turbo-pipelinedevops-operationscli-referencepipeline-monitoringtroubleshooting

SKILL.md Content

View Translation Comparison →

Turbo Pipeline Operations

Lifecycle commands, monitoring, and error reference for running Turbo pipelines. This is a lookup reference — for interactive troubleshooting of a broken pipeline, use 
/turbo-doctor
. For building new pipelines, use 
/turbo-builder
.

Pipeline States

StateDescription
runningPipeline is actively processing data
startingPipeline is initializing
pausedPipeline is paused (replicas set to 0)
stoppedPipeline is not running (manually stopped)
errorPipeline encountered an error
completedJob-mode pipeline finished processing range

Streaming vs Job Mode Lifecycle

OperationStreaming PipelineJob-Mode Pipeline (
job: true
)
ListShows as 
running
/
paused
Shows as 
running
/
completed
PauseSupportedNot supported
ResumeSupportedNot supported
RestartSupportedNot supported — use delete + apply
DeleteSupportedSupported (auto-cleanup ~1hr after done)
ApplyUpdates in placeMust delete first, then re-apply

Job-Mode Pipeline Lifecycle

Job-mode pipelines (
job: true
) are one-time batch processes:
  1. Start — process data from 
    start_at
    to 
    end_block
  2. Run — process the bounded data range
  3. Complete — automatically stop when range is processed
  4. Auto-cleanup — ~1 hour after completion, automatically removed
Cannot pause, resume, or restart. Must delete before redeploying.

Lifecycle Commands

List Pipelines

bash
goldsky turbo list

Pause a Pipeline

Temporarily stop processing without deleting. Preserves all state for later resumption.
bash
goldsky turbo pause <pipeline-name>

Resume a Pipeline

Restore a paused pipeline. Can only resume a paused pipeline.
bash
goldsky turbo resume <pipeline-name>

Restart a Pipeline

Trigger a pod restart for a running or paused pipeline.
bash
goldsky turbo restart <pipeline-name>
# To clear all checkpoints and reprocess from the beginning:
goldsky turbo restart <pipeline-name> --clear-state

Delete a Pipeline

Permanently remove a pipeline. All checkpoints are lost. Data already written to sinks is preserved.
bash
goldsky turbo delete <pipeline-name>

Delete and Recreate (Fresh Start)

bash
goldsky turbo delete my-pipeline
goldsky turbo apply my-pipeline.yaml

Checkpoint Behavior

  • Deleting a pipeline removes its checkpoints permanently
  • Recreating with the same name starts fresh (no checkpoint recovery)
  • To preserve checkpoints, use 
    apply
    to update instead of delete/recreate
  • Checkpoint state is tied to source names — renaming a source resets its checkpoint
  • Checkpoint state is tied to pipeline names — renaming a pipeline resets all checkpoints

Monitoring Commands

ActionCommand
List pipelines
goldsky turbo list
View live data
goldsky turbo inspect <name>
Inspect specific node
goldsky turbo inspect <name> -n <node>
View logs
goldsky turbo logs <name>
Follow logs
goldsky turbo logs <name> --follow
Logs with timestamps
goldsky turbo logs <name> --timestamps
Last N lines
goldsky turbo logs <name> --tail N
Logs since N seconds ago
goldsky turbo logs <name> --since N

Live Inspect TUI Shortcuts

KeyAction
Tab
/
→
, 
Shift+Tab
/
←
Next/prev tab
1
-
9
Jump to tab number
j
/
k
/ 
↑
/
↓
Scroll
g
/
Home
, 
G
/
End
Top/bottom
Page Up
/
Page Down
Scroll by page
/
→ 
Enter
Search
n
/ 
N
Next/prev match
Esc
Clear search
d
Toggle definition
w
Open web dashboard
e
Open web editor
q
/ 
Ctrl+C
Quit
Shift
+ mouse		Select and copy text
The TUI automatically reconnects when the pipeline is updated, paused, resumed, or temporarily unavailable. It has a 30-minute timeout before closing.

Log Analysis Script

Use the helper script to quickly analyze pipeline logs:
bash
./scripts/analyze-logs.sh <pipeline-name>
./scripts/analyze-logs.sh <pipeline-name> --tail 100
The script checks for common error patterns and reports findings with recommendations.

Common Error Patterns

Detailed error patterns and solutions are in 
data/error-patterns.json
.
Error PatternLikely CauseFix
connection refused
Database unreachableCheck network/firewall settings
authentication failed
Wrong credentialsUpdate secret with correct credentials
secret not found
Missing secretCreate secret with 
goldsky secret create
SQL syntax error
Invalid transform SQLFix SQL in YAML and redeploy
duplicate key
Primary key collisionEnsure unique primary key in transform
script transform error
TypeScript runtime failureCheck script logic, null handling, return types
dynamic_table
error		Backend connection issueVerify dynamic table secret/table exists
WASM execution failed
Script crash in sandboxDebug script — check for undefined access
handler timeout
External HTTP endpoint slowIncrease 
timeout_ms
or fix handler endpoint

Script Transform Issues

IssueFix
undefined
property access		Add null checks: 
input.field ?? ''
Wrong return typeEnsure returned object matches 
schema
exactly
Missing return fieldsAll 
schema
fields must be present in returned object
invoke is not a function
Ensure script defines 
function invoke(data)
BigInt errorsUse 
BigInt()
constructor, not direct number literals

Dynamic Table Issues

IssueFix
Table not foundCreate the table in PostgreSQL before deploying
No matches from checkVerify data exists in the backing table
Stale dataFor postgres backend, verify rows are actually there
Memory pressureLarge in_memory tables → switch to postgres backend

Troubleshooting Quick Reference

SymptomLikely CauseQuick Fix
No data flowing
start_at: latest
Wait for new data or use 
earliest
Auth failedWrong credentialsUpdate secret with correct password
Connection refusedNetwork/firewallCheck host, whitelist Goldsky IPs
Storage exceededNeon free tier (512MB)Upgrade plan or clear data
SQL errorBad transform syntaxValidate YAML first
Pipeline not foundName mismatchRun 
goldsky turbo list
to check names
Permission deniedRole insufficientVerify Editor or Admin role in the project
pipeline already exists
Job-mode staleDelete first, then re-apply
Cannot pause/resume jobJob-mode limitationJob pipelines don't support pause/resume
Cannot restart jobJob-mode limitationDelete + re-apply instead
Can't connect to inspectPipeline not runningCheck status with 
goldsky turbo list
Logs are emptyPipeline just startedWait for data or check 
start_at
TUI disconnectsPipeline interruptedAuto-reconnects within 30 min; check status

Related

  • /turbo-doctor
     — Interactive diagnostic skill for pipeline issues
  • /turbo-builder
     — Build and deploy new pipelines
  • /turbo-pipelines
     — YAML configuration and architecture reference