forked from datafold/data-diff
-
Notifications
You must be signed in to change notification settings - Fork 1
design: cloud database testing strategy (Snowflake, BigQuery, Redshift, Databricks) #49
Copy link
Copy link
Open
Labels
P3-backlogBacklog, do when demand appearsBacklog, do when demand appearstestingTest coverage and infrastructureTest coverage and infrastructuretriage
Description
Problem
5 of 13 drivers (Snowflake, BigQuery, Redshift, Databricks, Oracle) cannot be tested in CI — they require cloud credentials or enterprise licenses. Currently they have zero automated test coverage.
Options to Evaluate
- Nightly CI with secrets — GitHub Actions secrets for cloud DB credentials, scheduled runs
- Emulators/mocks — LocalStack (Redshift), BigQuery emulator, etc.
- Manual acceptance testing — Documented test scripts for contributors to run
- Hybrid — Dialect unit tests in CI + manual integration tests for releases
Deliverable
Design document or ADR recommending an approach, with cost/complexity/coverage tradeoffs.
Acceptance Criteria
- Strategy document covering all 5 cloud databases
- Cost estimate for CI credentials/infrastructure
- Recommended approach with rationale
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P3-backlogBacklog, do when demand appearsBacklog, do when demand appearstestingTest coverage and infrastructureTest coverage and infrastructuretriage