Resources

Breakers Gem

Breakers Grafana Dashboard

Prepare to Run Rake Command

williamryan:~ $ ssh ip-xxx-xxx-xx-xxx.us-gov-west-1.compute.internal
[dsva@ip-xxx-xxx-xx-xxx ~]$ sudo -u vets-api bash
bash-4.2$ cd /srv/vets-api/src/
CODE

List the Available Services

docker exec -it vets-api bundle exec rake breakers:list_services

e.g.

bash-4.2$ RAILS_ENV=production bundle exec rake breakers:list_services
I, [2018-11-13T22:46:26.912071 #4133]  INFO -- sentry: ** [Raven] Raven 2.1.2 ready to catch errors
/srv/vets-api/src/config/initializers/redis.rb:4: warning: already initialized constant REDIS_CONFIG
/srv/vets-api/src/rakelib/connectivity.rake:11: warning: previous definition of REDIS_CONFIG was here
Available Services:
["AppealsStatus", "Rx", "BB", "EmisMilitaryInformation", "EmisPayment", "EmisVeteranStatus", "EVSS/Claims", "EVSS/Common", "EVSS/Documents", "EVSS/Letters", "EVSS/PCIUAddress", "EVSS/GiBillStatus", "VHA_Access_PWT", "VHA_Access_SHEP", "VIC2", "GI", "HCA", "MHVAcctCreation", "MVI", "Preneeds", "SM", "Vet360/ContactInformation", "Search/Results", "OKTA", "CentralMail"]
CODE

Force an Outage of an External Service

⚠️ Forced outages do not recover automatically and can only be stopped by calling end_forced_outage ⚠️

docker exec -it vets-api bundle exec rake breakers:begin_forced_outage service=<SERVICE_NAME>

End a Forced Outage of an External Service

docker exec -it vets-api bundle exec rake breakers:end_forced_outage service=<SERVICE_NAME>

e.g.

bash-4.2$ RAILS_ENV=production bundle exec rake breakers:end_forced_outage service=EVSS/Claims
CODE