⚙️ Installing dbt — Let's Get Cooking!

🧑‍🍳 Before We Start

Don't worry — this is one of the easiest setups in the entire data engineering world. If you can install an app on your phone, you can install dbt. We'll go step by step, with screenshots of what you should see at every stage.

📋 What You Need (Prerequisites)

🖥️ Option A: dbt Core (Free, Open Source)

dbt Core is the free, open-source version of dbt. It runs from your terminal (command line). This is what most professionals use, and it's what we recommend for learning because you'll understand exactly what's happening under the hood.

📌 Step 1: Check Your Python Version

Open your terminal and type this command:

python --version

Or on some systems (especially Mac):

python3 --version

You should see something like:

Python 3.11.5

📌 Step 2: Create a Virtual Environment

# Navigate to where you want your project
cd ~/projects

# Create a virtual environment called "dbt-env"
python3 -m venv dbt-env

# Activate it (Mac/Linux)
source dbt-env/bin/activate

# Activate it (Windows)
dbt-env\Scripts\activate

Once activated, you'll see (dbt-env) at the beginning of your terminal prompt. That means you're inside the virtual environment — your separate drawer is open and ready!

(dbt-env) user@laptop ~/projects $

📌 Step 3: Install dbt with Your Adapter

dbt needs an adapter — a plugin that tells it how to talk to your specific data warehouse. Think of adapters like power plug converters when you travel. A US plug doesn't fit a UK socket without an adapter. Similarly, dbt needs the right adapter to connect to Snowflake vs. BigQuery vs. PostgreSQL.

Pick the adapter that matches your data warehouse:

pip install dbt-snowflake

pip install dbt-bigquery

pip install dbt-redshift

pip install dbt-postgres

pip install dbt-duckdb

The installation will download dbt and all its dependencies. This usually takes 1–3 minutes depending on your internet speed. You'll see a bunch of text scrolling by — that's normal!

📌 Step 4: Verify the Installation

Let's make sure dbt installed correctly. Type:

dbt --version

You should see something like this:

Core:
  - installed: 1.9.0
  - latest:    1.9.0 - Up to date!

Plugins:
  - duckdb: 1.9.0 - Up to date!

📌 Step 5: Initialize Your First Project

Now let's create your very first dbt project! This is like setting up the kitchen layout — where the pots go, where the spices are, where the recipes live.

dbt init my_first_project

dbt will ask you a few questions:

Which database would you like to use?
[1] duckdb

Enter a number: 1

Profile my_first_project written to ~/.dbt/profiles.yml.
Your new dbt project "my_first_project" was created!

After this, you'll have a brand new folder called my_first_project with all the files dbt needs. We'll explore every file in the next lesson (Project Structure), but for now — congratulations, your kitchen is built!

☁️ Option B: dbt Cloud (Managed Service)

If you don't want to install anything on your computer, dbt Cloud lets you write and run dbt models entirely in your web browser. It's great for teams and for people who prefer a visual interface.

📌 Step 1: Sign Up

📌 Step 2: Connect Your Data Warehouse

dbt Cloud will walk you through connecting to your warehouse. You'll need:

📌 Step 3: Connect Your Git Repository

dbt Cloud integrates with GitHub, GitLab, or Azure DevOps. This means your dbt project lives in Git (version control), and dbt Cloud pulls the latest code every time it runs.

💰 Pricing Overview

🔗 Connecting to Your Warehouse (profiles.yml)

If you chose dbt Core, the most important configuration file you'll ever meet is profiles.yml. This file tells dbt where your data warehouse is and how to connect to it.

📍 Where Does profiles.yml Live?

By default, dbt looks for this file at:

# Mac / Linux
~/.dbt/profiles.yml

# Windows
C:\Users\YourName\.dbt\profiles.yml

When you ran dbt init, dbt created this file for you automatically. But you'll often need to edit it to match your warehouse credentials.

📄 Example: DuckDB (Simplest — Great for Beginners)

my_first_project:
  target: dev
  outputs:
    dev:
      type: duckdb
      path: my_first_project.duckdb

That's it! Two lines of config and DuckDB is ready. No passwords, no servers, no cloud accounts. This is why we love DuckDB for learning.

📄 Example: PostgreSQL

my_first_project:
  target: dev
  outputs:
    dev:
      type: postgres
      host: localhost
      user: your_username
      password: your_password
      port: 5432
      dbname: my_database
      schema: dbt_dev
      threads: 4

📄 Example: Snowflake

my_first_project:
  target: dev
  outputs:
    dev:
      type: snowflake
      account: xy12345.us-east-1
      user: your_username
      password: your_password
      role: TRANSFORMER
      database: ANALYTICS
      warehouse: TRANSFORMING
      schema: dbt_dev
      threads: 4

📄 Example: BigQuery

my_first_project:
  target: dev
  outputs:
    dev:
      type: bigquery
      method: oauth
      project: my-gcp-project-id
      dataset: dbt_dev
      threads: 4
      location: US

🚀 Your First dbt Run — The Magic Moment

This is it. The moment you've been waiting for. Your kitchen is set up, your address book is configured, and it's time to cook your first dish.

📌 Step 1: Navigate to Your Project

cd my_first_project

📌 Step 2: Run dbt debug — Check the Connection

Before cooking, let's make sure the stove actually turns on. dbt debug checks that dbt can connect to your warehouse.

dbt debug

If everything is configured correctly, you'll see a beautiful wall of green:

Configuration:
  profiles.yml file [OK found and valid]
  dbt_project.yml file [OK found and valid]

Required dependencies:
  - git [OK found]

Connection:
  host: localhost
  port: 5432
  user: your_username
  database: my_database
  schema: dbt_dev
  Connection test: [OK connection ok]

All checks passed!

📌 Step 3: Run dbt run — Cook Your First Models

When you created the project with dbt init, dbt included two example models. Let's run them!

dbt run

Running with dbt=1.9.0
Found 2 models, 4 tests, 0 sources, 0 exposures

Concurrency: 4 threads (target='dev')

1 of 2 START sql table model dbt_dev.my_first_dbt_model ......... [RUN]
1 of 2 OK created sql table model dbt_dev.my_first_dbt_model ..... [SELECT 2]
2 of 2 START sql view model dbt_dev.my_second_dbt_model .......... [RUN]
2 of 2 OK created sql view model dbt_dev.my_second_dbt_model ..... [OK]

Finished running 2 models in 0.42s.

Completed successfully

Done. PASS=2 WARN=0 ERROR=0 SKIP=0 TOTAL=2

📌 Step 4: Run dbt test — Quality Check

Now let's taste-test the food. dbt test runs automated checks on your data to make sure nothing is broken.

dbt test

Running with dbt=1.9.0
Found 2 models, 4 tests, 0 sources

Concurrency: 4 threads (target='dev')

1 of 4 START test not_null_my_first_dbt_model_id ................ [RUN]
1 of 4 PASS not_null_my_first_dbt_model_id ...................... [PASS]
2 of 4 START test unique_my_first_dbt_model_id .................. [RUN]
2 of 4 PASS unique_my_first_dbt_model_id ........................ [PASS]
3 of 4 START test not_null_my_second_dbt_model_id ............... [RUN]
3 of 4 PASS not_null_my_second_dbt_model_id ..................... [PASS]
4 of 4 START test unique_my_second_dbt_model_id ................. [RUN]
4 of 4 PASS unique_my_second_dbt_model_id ....................... [PASS]

Finished running 4 tests in 0.28s.

Completed successfully

Done. PASS=4 WARN=0 ERROR=0 SKIP=0 TOTAL=4

🔧 Common Installation Issues

Even the best chefs sometimes have a stove that won't light or a fridge that makes weird noises. Here are the most common problems people run into when installing dbt, and how to fix them:

🧠 Test Your Knowledge

Let's make sure you've got the key concepts down! Answer these 3 questions:

📋 Lesson Summary