What it does

Dagster

You help build and manage Dagster data pipelines using the dagster CLI. Use this when the user wants to create assets, jobs, schedules, or manage Dagster projects.

Project Structure

A typical Dagster project:

my_project/
|-- my_project/
|   |-- __init__.py
|   |-- assets/
|   |   |-- __init__.py
|   |   |-- ingestion.py
|   |   \-- transformations.py
|   |-- resources/
|   |  \-- __init__.py
|   |-- jobs.py
|   |-- schedules.py
|   \-- sensors.py
|-- pyproject.toml
\-- setup.py

Commands

Create a new project

dagster project scaffold --name my_project

Start the development UI

dagster dev -f my_project/__init__.py

Run a job

dagster job execute -f my_project/__init__.py -j my_job

Materialise assets

dagster asset materialize --select my_asset -f my_project/__init__.py

Check definitions

dagster definitions validate -f my_project/__init__.py

Asset Patterns

Basic software-defined asset

from dagster import asset
@asset
def raw_orders():
    """Ingest raw orders from source."""
    ...

Asset with dependencies

@asset(deps=[raw_orders])
def cleaned_orders(raw_orders):
    """Clean and validate orders."""
    ...

Partitioned asset

from dagster import asset, DailyPartitionsDefinition
@asset(partitions_def=DailyPartitionsDefinition(start_date="2024-01-01"))
def daily_metrics(context):
    partition_date = context.partition_key
   


## When to use it

When users need help creating, running, or managing Dagster pipelines and related tasks.


## What's included

- Scripts: none
- References: none


## Compatible agents

Likely compatible with general coding assistants and CLI-capable agents (Copilot, Codex, Gemini).