Skip to content

Commit 3bc8a04

Browse files
author
Yandu Oppacher
committed
Merge pull request apache#30 from Shopify/split-broken-flag
Lets deploy spark to the nodes that we can but don't start them automatically
2 parents 0375d4c + ec6b521 commit 3bc8a04

File tree

1 file changed

+4
-2
lines changed

1 file changed

+4
-2
lines changed

Capfile

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,13 +8,15 @@ set :shared_logs_path, "/u/apps/spark/shared/log"
88
set :shared_conf_path, "/u/apps/spark/shared/conf"
99
set :gateway, nil
1010

11-
BROKEN = ["dn04.chi.shopify.com", "dn06.chi.shopify.com", "dn07.chi.shopify.com", "dn08.chi.shopify.com", "dn11.chi.shopify.com", "dn14.chi.shopify.com"]
11+
MAINTENANCE = ["dn04.chi.shopify.com", "dn07.chi.shopify.com", "dn08.chi.shopify.com", "dn11.chi.shopify.com", "dn14.chi.shopify.com"] # Node is up but should not be part of the production cluster
12+
DECOMISSIONED = ["dn06.chi.shopify.com"] # Node is down don't try to send code
13+
BROKEN = MAINTENANCE + DECOMISSIONED
1214

1315
task :production do
1416
role :app, *((4..47).map {|i| "dn%02d.chi.shopify.com" % i } - (["dn05.chi.shopify.com"] + BROKEN))
1517
role :master, "dn05.chi.shopify.com"
1618
role :history, "dn05.chi.shopify.com"
17-
role :code, "hadoop-etl1.chi.shopify.com", "spark-etl1.chi.shopify.com", "reports-reportify-etl3.chi.shopify.com", "reports-reportify-skydb4.chi.shopify.com", "platfora2.chi.shopify.com"
19+
role :code, "hadoop-etl1.chi.shopify.com", "spark-etl1.chi.shopify.com", "reports-reportify-etl3.chi.shopify.com", "reports-reportify-skydb4.chi.shopify.com", "platfora2.chi.shopify.com", *MAINTENANCE
1820
end
1921

2022
task :staging do

0 commit comments

Comments
 (0)