Name: Verify Accuracy (Primus-Turbo)
Author: amd-agi

Verify Accuracy

This skill provides a rigorous framework for proving that a Primus-Turbo operator is numerically correct by comparing it against a higher-precision PyTorch reference for both forward and backward passes.

Core Methodology

Reference Comparison: Uses ground-truth math computed in float32 (FP32) to validate lower-precision outputs.
Precision-Specific Gating:
- FP32/FP16/BF16: Uses allclose tolerances (e.g., $1\text{e-}4$ for FP32).
- FP8/FP4: Uses SNR (Signal-to-Noise Ratio) thresholds (e.g., $\ge 25\text{dB}$ for FP8 E4M3) because element-wise tolerance is often meaningless after quantization.
Encoding Awareness: Accounts for architecture-dependent encodings such as FNUZ (gfx942) and OCP (gfx950).

Validation Workflow

Reference Implementation: Establish a native PyTorch reference in tests/pytorch/ref/.
Parametrization: Test across various shapes, dtypes, layouts, and backends.
Determinism: Verify bitwise reproducibility if required.
Scaling: Move from focused tests to full GPU suites using pytest -n 8.

Verify Accuracy

Core Methodology

Reference Comparison: Uses ground-truth math computed in float32 (FP32) to validate lower-precision outputs.
Precision-Specific Gating:
- FP32/FP16/BF16: Uses allclose tolerances (e.g., $1\text{e-}4$ for FP32).
- FP8/FP4: Uses SNR (Signal-to-Noise Ratio) thresholds (e.g., $\ge 25\text{dB}$ for FP8 E4M3) because element-wise tolerance is often meaningless after quantization.
Encoding Awareness: Accounts for architecture-dependent encodings such as FNUZ (gfx942) and OCP (gfx950).

Validation Workflow

Reference Implementation: Establish a native PyTorch reference in tests/pytorch/ref/.
Parametrization: Test across various shapes, dtypes, layouts, and backends.
Determinism: Verify bitwise reproducibility if required.
Scaling: Move from focused tests to full GPU suites using pytest -n 8.

Verify Accuracy (Primus-Turbo)

Verify Accuracy

Core Methodology

Validation Workflow

Tags

Not yet audited

Information

Related Skills

Verify Accuracy (Primus-Turbo)

Verify Accuracy

Core Methodology

Validation Workflow

Tags

Not yet audited

Information

Related Skills