Skip to content

Update workflows, test the Docker image #513

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
fityannugroho merged 9 commits into from
Aug 15, 2025
Merged

Update workflows, test the Docker image #513

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
92f1791
chore: update Dependabot configuration for npm and GitHub Actions
fityannugroho Aug 15, 2025
ce35f2d
chore: upgrade actions/checkout to version 5 in workflows
fityannugroho Aug 15, 2025
b01ca5f
ci: update GitHub Actions workflow to use actions/checkout@v5 and add…
fityannugroho Aug 15, 2025
db7b4ec
ci: enhance docker image smoke tests with dynamic database handling a…
fityannugroho Aug 15, 2025
41ce379
ci: enhance MongoDB setup in Docker tests with replica set and improv…
fityannugroho Aug 15, 2025
39541ef
ci: update MongoDB setup in Docker tests to use single-node replica s…
fityannugroho Aug 15, 2025
638b213
ci: setup e2e tests in `pr-tests.yml`
fityannugroho Aug 15, 2025
9ada43f
ci: update Node.js version matrix and enhance database readiness chec…
fityannugroho Aug 15, 2025
bfbe8d0
ci: consolidate CI workflows into a single configuration with enhance…
fityannugroho Aug 15, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 25 additions & 11 deletions .github/dependabot.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,15 +1,29 @@
# To get started with Dependabot version updates, you'll need to specify which
# package ecosystems to update and where the package manifests are located.
# Please see the documentation for all configuration options:
# https://docs.github.com/github/administering-a-repository/configuration-options-for-dependency-updates
# Dependabot configuration
# Docs: https://docs.github.com/github/administering-a-repository/configuration-options-for-dependency-updates

version: 2
updates:
- package-ecosystem: 'npm' # See documentation for possible values
directory: '/' # Location of package manifests
# NPM / PNPM (Dependabot understands pnpm-lock.yaml in the npm ecosystem)
- package-ecosystem: npm
directory: /
schedule:
interval: 'daily'
ignore:
# Only update the patch versions for all dependencies
- dependency-name: '*'
update-types: ['version-update:semver-major', 'version-update:semver-minor']
interval: weekly
day: monday
open-pull-requests-limit: 2
versioning-strategy: increase-if-necessary

# Only update direct dependencies (transitive dependencies remain if there's a security advisory)
allow:
- dependency-type: direct

# Refine Dependabot PR commit message
commit-message:
prefix: "chore"
include: "scope"

# Update GitHub Actions in .github/workflows
- package-ecosystem: github-actions
directory: /
schedule:
interval: weekly
labels: [ci, dependencies]
289 changes: 289 additions & 0 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,289 @@
name: App & Container CI
on:
pull_request:
branches:
- main
push:
branches:
- main
workflow_dispatch:

jobs:
build-tests:
name: "App build & tests (Node ${{ matrix.node-version }} / DB ${{ matrix.db }})"
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
node-version: [20, 22]
db: [postgresql, mysql, mongodb, sqlite]
# Matrix: run full build + unit + e2e across each DB provider (and Node versions)
steps:
- name: Checkout code
uses: actions/checkout@v5

- name: Install pnpm
uses: pnpm/action-setup@v4
with:
version: 9

- name: Set up Node.js
uses: actions/setup-node@v4
with:
node-version: ${{ matrix.node-version }}
cache: 'pnpm'

- name: Install dependencies
run: pnpm install

# --- Database setup (only one of the following three runs) ---
- name: Start PostgreSQL
if: matrix.db == 'postgresql'
run: |
PW=$(openssl rand -hex 12); echo "PG_PASS=$PW" >> $GITHUB_ENV
docker run -d --name db -p 5432:5432 \
-e POSTGRES_USER=test -e POSTGRES_PASSWORD=$PW -e POSTGRES_DB=test \
postgres:14
# Wait for PostgreSQL to accept connections
ready=0
for i in {1..40}; do
if docker exec db pg_isready -U test >/dev/null 2>&1; then echo "Postgres ready"; ready=1; break; fi
sleep 2
done
if [ $ready -eq 0 ]; then echo "Postgres failed to start"; docker logs db || true; exit 1; fi

- name: Start MySQL
if: matrix.db == 'mysql'
run: |
PW=$(openssl rand -hex 12); echo "MYSQL_PASS=$PW" >> $GITHUB_ENV
docker run -d --name db -p 3306:3306 \
-e MYSQL_ROOT_PASSWORD=$PW -e MYSQL_DATABASE=test mysql:8
ready=0
for i in {1..60}; do
if docker exec db mysql -uroot -p$PW -e 'SELECT 1' >/dev/null 2>&1; then echo "MySQL ready"; ready=1; break; fi
sleep 2
done
if [ $ready -eq 0 ]; then echo "MySQL failed to start"; docker logs db || true; exit 1; fi

- name: Start MongoDB
if: matrix.db == 'mongodb'
run: |
docker run -d --name db -p 27017:27017 mongo:7 --replSet rs0 --bind_ip_all
for i in {1..40}; do docker run --rm --network host mongo:7 mongosh "mongodb://localhost:27017/admin" --quiet --eval "db.runCommand({ ping: 1 }).ok" 2>/dev/null | grep 1 && break; sleep 2; done
docker run --rm --network host mongo:7 mongosh "mongodb://localhost:27017/admin" --quiet --eval 'try { rs.initiate({_id:"rs0", members:[{_id:0, host:"localhost:27017"}]}); } catch(e) { }'
for i in {1..40}; do state=$(docker run --rm --network host mongo:7 mongosh "mongodb://localhost:27017/admin" --quiet --eval 'try { rs.status().members && rs.status().members[0].stateStr } catch(e) { "" }'); [ "$state" = "PRIMARY" ] && break; sleep 2; done

# --- Dynamic DB env variables used by Prisma scripts ---
- name: Set DB env vars
run: |
if [ "${{ matrix.db }}" = "postgresql" ]; then
echo "DB_PROVIDER=postgresql" >> $GITHUB_ENV
echo "DB_URL=postgresql://test:$PG_PASS@localhost:5432/test" >> $GITHUB_ENV
elif [ "${{ matrix.db }}" = "mysql" ]; then
echo "DB_PROVIDER=mysql" >> $GITHUB_ENV
echo "DB_URL=mysql://root:$MYSQL_PASS@localhost:3306/test" >> $GITHUB_ENV
elif [ "${{ matrix.db }}" = "mongodb" ]; then
echo "DB_PROVIDER=mongodb" >> $GITHUB_ENV
echo "DB_URL=mongodb://localhost:27017/test?replicaSet=rs0" >> $GITHUB_ENV
else
echo "DB_PROVIDER=sqlite" >> $GITHUB_ENV
echo "DB_URL=file:./dev.db" >> $GITHUB_ENV
fi

# --- Build & test pipeline ---
- name: Lint
run: pnpm run lint

- name: Verify DB readiness
if: matrix.db != 'sqlite'
run: |
echo "Verifying readiness for ${{ matrix.db }}"
if [ "${{ matrix.db }}" = "postgresql" ]; then
for i in {1..10}; do
if docker exec db pg_isready -U test >/dev/null 2>&1; then echo "Postgres still ready"; break; fi; sleep 2;
done
elif [ "${{ matrix.db }}" = "mysql" ]; then
for i in {1..15}; do
if docker exec db mysql -uroot -p$MYSQL_PASS -e 'SELECT 1' >/dev/null 2>&1; then echo "MySQL still ready"; break; fi; sleep 2;
done
elif [ "${{ matrix.db }}" = "mongodb" ]; then
for i in {1..15}; do
state=$(docker run --rm --network host mongo:7 mongosh "mongodb://localhost:27017/admin" --quiet --eval 'try { rs.status().members && rs.status().members[0].stateStr } catch(e) { "" }');
[ "$state" = "PRIMARY" ] && echo "Mongo PRIMARY confirmed" && break; sleep 2;
done
fi

- name: Generate Prisma Client
run: pnpm run prisma:gen

- name: Migrate DB
run: pnpm run db:migrate

- name: Seed DB
run: pnpm run db:seed

- name: Build
run: pnpm run build

- name: Unit tests
run: pnpm run test

- name: E2E tests
run: pnpm run test:e2e

- name: DB Logs on failure
if: failure() && matrix.db != 'sqlite'
run: docker logs db || true

- name: Cleanup
if: always() && matrix.db != 'sqlite'
run: docker rm -f db || true

container-smoke:
name: "App container smoke (DB ${{ matrix.db }})"
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
db: [postgresql, mysql, mongodb, sqlite]
steps:
- name: Checkout code
uses: actions/checkout@v5

- name: Setup network (non-sqlite)
if: matrix.db != 'sqlite'
run: docker network create integration

# --- Database container (one per matrix entry) ---
- name: Start PostgreSQL
if: matrix.db == 'postgresql'
run: |
PW=$(openssl rand -hex 16)
echo "POSTGRES_PASSWORD=$PW" >> $GITHUB_ENV
docker run -d --name db --network integration \
-e POSTGRES_USER=test \
-e POSTGRES_PASSWORD=$PW \
-e POSTGRES_DB=test \
postgres:14
ready=0
for i in {1..40}; do
if docker exec db pg_isready -U test >/dev/null 2>&1; then echo "Postgres ready"; ready=1; break; fi
sleep 2
done
if [ $ready -eq 0 ]; then echo "Postgres failed to start"; docker logs db || true; exit 1; fi

- name: Start MySQL
if: matrix.db == 'mysql'
run: |
MPW=$(openssl rand -hex 16)
echo "MYSQL_ROOT_PASSWORD=$MPW" >> $GITHUB_ENV
docker run -d --name db --network integration \
-e MYSQL_ROOT_PASSWORD=$MPW \
-e MYSQL_DATABASE=test \
mysql:8
ready=0
for i in {1..60}; do
if docker exec db mysql -uroot -p$MPW -e 'SELECT 1' >/dev/null 2>&1; then echo "MySQL ready"; ready=1; break; fi
sleep 2
done
if [ $ready -eq 0 ]; then echo "MySQL failed to start"; docker logs db || true; exit 1; fi

- name: Start MongoDB
if: matrix.db == 'mongodb'
run: |
docker run -d --name db --network integration \
-p 27017:27017 \
mongo:7 --replSet rs0 --bind_ip_all
for i in {1..40}; do \
docker run --rm --network integration mongo:7 mongosh "mongodb://db:27017/admin" --quiet --eval "db.runCommand({ ping: 1 }).ok" 2>/dev/null | grep 1 && break; \
sleep 2; \
done
docker run --rm --network integration mongo:7 mongosh "mongodb://db:27017/admin" --quiet --eval 'try { rs.initiate({_id:"rs0", members:[{_id:0, host:"db:27017"}]}); } catch(e) { print(e); }'
for i in {1..40}; do \
state=$(docker run --rm --network integration mongo:7 mongosh "mongodb://db:27017/admin" --quiet --eval 'try { rs.status().members && rs.status().members[0].stateStr } catch(e) { "" }'); \
if [ "$state" = "PRIMARY" ]; then echo "Replica set PRIMARY"; break; fi; \
sleep 2; \
done

# --- Set connection string for migrations & runtime ---
- name: Set DB environment variables
run: |
if [ "${{ matrix.db }}" = "postgresql" ]; then
echo "DB_PROVIDER=postgresql" >> $GITHUB_ENV
echo "DB_URL=postgresql://test:$POSTGRES_PASSWORD@db:5432/test" >> $GITHUB_ENV
elif [ "${{ matrix.db }}" = "mysql" ]; then
echo "DB_PROVIDER=mysql" >> $GITHUB_ENV
echo "DB_URL=mysql://root:$MYSQL_ROOT_PASSWORD@db:3306/test" >> $GITHUB_ENV
elif [ "${{ matrix.db }}" = "mongodb" ]; then
echo "DB_PROVIDER=mongodb" >> $GITHUB_ENV
echo "DB_URL=mongodb://db:27017/test?replicaSet=rs0" >> $GITHUB_ENV
else
echo "DB_PROVIDER=sqlite" >> $GITHUB_ENV
echo "DB_URL=file:/data/dev.db" >> $GITHUB_ENV
fi

# --- Build the application image (provider-specific Prisma client) ---
- name: Build docker image
run: docker build --build-arg DB_PROVIDER=$DB_PROVIDER -t idn-area:${{ github.sha }} .

# --- Run schema migrations and seed data inside image ---
- name: Run migration & seed
run: |
if [ "${{ matrix.db }}" = "sqlite" ]; then
docker volume create sqlite-data > /dev/null
NET_ARGS="-v sqlite-data:/data"
else
NET_ARGS="--network integration"
fi
if [ "${{ matrix.db }}" = "sqlite" ]; then
docker run --rm $NET_ARGS \
-e DB_PROVIDER=$DB_PROVIDER \
-e DB_URL="$DB_URL" \
idn-area:${{ github.sha }} sh -c 'set -e; pnpm run db:migrate; pnpm run db:seed'
else
docker run --rm $NET_ARGS \
-e DB_PROVIDER=$DB_PROVIDER \
-e DB_URL="$DB_URL" \
idn-area:${{ github.sha }} pnpm run db:migrate
docker run --rm $NET_ARGS \
-e DB_PROVIDER=$DB_PROVIDER \
-e DB_URL="$DB_URL" \
idn-area:${{ github.sha }} pnpm run db:seed
fi

# --- Launch container and wait for health ---
- name: Start app container
run: |
if [ "${{ matrix.db }}" = "sqlite" ]; then
NET_ARGS="-v sqlite-data:/data"
else
NET_ARGS="--network integration"
fi
docker run -d --name app $NET_ARGS \
-e DB_PROVIDER=$DB_PROVIDER \
-e DB_URL="$DB_URL" \
-p 3000:3000 \
idn-area:${{ github.sha }}
for i in {1..40}; do
if curl -fsS http://localhost:3000/health > /dev/null; then echo "App is up"; break; fi; sleep 2; done

# --- Simple smoke assertion on /health ---
- name: Smoke test /health endpoint
run: |
curl -v http://localhost:3000/health | tee /tmp/health.json
grep 'OK' /tmp/health.json

- name: Show logs on failure
if: failure()
run: |
docker logs app || true
docker ps -a || true
docker logs db || true

- name: Cleanup
if: always()
run: |
docker rm -f app || true
docker rm -f db || true
docker network rm integration || true
docker images | grep idn-area | awk '{print $3}' | xargs -r docker rmi -f
2 changes: 1 addition & 1 deletion .github/workflows/codeql.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ jobs:

steps:
- name: Checkout repository
uses: actions/checkout@v3
uses: actions/checkout@v5

# Initializes the CodeQL tools for scanning.
- name: Initialize CodeQL
Expand Down
51 changes: 0 additions & 51 deletions .github/workflows/pr-tests.yml
View file
Open in desktop

This file was deleted.

Loading
Loading