dataops-infra - Infrastructure Catalog for Slalom DataOps

Instructions

Workstation Setup

blah

1. Follow the steps in Windows Development Quickstart, which will automatically install all of the following required tools: Terraform, Docker, VS Code, Python 3, and Git.

2. Clone this repo to your local machine.

3. Initialize your SSH key and local settings file.

   cd catalog/aws-prereqs
   terraform init
   terraform apply -auto-approve

   • Note: If you receive an error that "Provider produced inconsistent final plan", please rerun the final terraform apply step with the same provided input values. This is a known issue and will be resolved in a future update.

Install Infrastructure from the Infrasturcture Catalog

The below instructions will use 'tableau-server-on-aws' as the example. The same steps can be repeated for any Infrastructure Catalog items within 'catalog' folder.

cd catalog/tableau-server-on-aws
terraform init
terraform apply

Debug Info

• Note: It is possible for environments to become stuck due to failures in printing output variables, for instance if SSH keys are accidentally deleted or rotated incorrectly. To ignore errors from outputs which cannot be parsed, first set the environment variable: TF_WARN_OUTPUT_ERRORS=1 and then re-run terraform apply or terrafom destroy. This will warn on output errors instead of failing the process.

Contributions Guide

For information on how to contribute in the form of PRs or Issues, please see CONTRIBUTING.md.

Related Code Repos

• dataops-docs: Documentation Resources
• dataops-infra: Infrastructure Catalog (this code repo)
• dataops-powertools: Python-based dataops tools (pip install slalom.dataops)
• dataops-project-template: A sample dataops project. Clone and modify for your own project.