I started this post back in November, but got rather distracted last month.
I have been wanting to setup a CI pipeline for Salesforce scratch orgs for a long time. The documentation out there isn’t great, and it’s taken me awhile to get around to powering through the details. For testing that my scratch org configurations for Education Cloud and Nonprofit Cloud to work properly I finally bit the bullet and setup a Github action.
What you’ll need
- An SFDX-style project on Github that you want to setup for automated testing that includes a Salesforce scratch org.
- An org with Devhub enabled. I recommend using a production org for this, not a developer org because of the higher scratch org limits. There are no good reasons not to enable Devhub.
- A working install of sf cli with a connection to that devhub-enabled org.
Setup Github Secret
For your action to work it will need to use your connection to your Salesforce Devhub. Salesforce CLI stores the needed key on your local machine, which includes tokens to open the org. You will need to put those keys into a Github secret for proper security.
Note: Should that key ever be compromised, they attacker will be able to open the org as the same user. I suggest you consider using a dedicated user with either a Free Limited Access License, or another similarly restrictive set of permissions. These users are designed to avoid exposing data if they are compromised (they are also free, which has some upsides). That said, you can get yourself started with any user that can access to Devhub objects and then switch out to something more restricted later.
To get the key from sf cli, run sf org display -o [your devhub alias] --verbose
where [your devhub alias]
is the name of the connection you selected when setting up the connection. The output of that command will include: “Sfdx Auth Url”, that is the value you need in your Github secret.
- In Github, go to your repository’s settings, expand Secrets and Variables from the left menu, and select Actions.
- Create a new Repository secret.
- Name the secret
DEVHUB_SFDX_URL
- Copy and Paste the Sfdx Auth Url value into the Secret field.
Create the Github Action
The full details of Github Actions are a deep topic, as are the full capabilities of sf cli for testing. So I’m going to focus on setup of an action the creates your scratch org. From there you can expand your workflow as you need.
In your project root create a .github
folder, and workflows
folder within if you don’t already have them. In the workflows folder create a file called buildScratch.yml
.
Copy the following code (explained below) into your file:
name: test run scratch
# Definition when the workflow should run
on:
# The workflow will run whenever an event happens on a pull request
pull_request:
types: [opened, synchronize]
jobs:
validate_scratch_deploy:
runs-on: ubuntu-latest
steps:
# Install Salesforce CLI
- name: "Install Salesforce CLI"
run: |
npm install @salesforce/cli --location=global
nodeInstallPath=$(npm config get prefix)
echo "$nodeInstallPath/bin" >> $GITHUB_PATH
sf --version
# Checkout the code in the pull request
- name: "Checkout source code"
uses: actions/checkout@v3
# Load secret for dev hub
- name: "Populate auth file with SFDX_URL secret"
shell: bash
run: "echo ${{ secrets.DEVHUB_SFDX_URL}} > ./SFDX_URL_STORE.txt"
- name: "Authenticate with dev hub"
run: sf org login sfdx-url -f ./SFDX_URL_STORE.txt -a devhub -d
# Create a scratch org
- name: "Create scratch org"
run: "sf org create scratch -d -f config/project-scratch.json -a our-scratch-org --duration-days 1"
# Deploy Project Manifest
- name: "Deploy Metadata"
run: "sf project deploy start --manifest manifest.xml --target-org our-scratch-org"
Action Breakdown
The first few lines are common to all actions, it gets a name, then a set of conditions to trigger the workflow. In this case we’re calling our workflow “test run scratch” and it will run when a Pull Request is opened or gets new commits.
The jobs section is the more interesting bit. We tell Github to create a virtual machine using the most recent version of Ubuntu Linux. Next we install Salesforce CLI onto that virtual machine. Once that’s done, we tell it to checkout our code from Github onto this virtual machine. With all our tools in place we’re ready to start the real work.
The next two steps extract the Github secret we defined earlier into a file on the virtual machine and use that file to authenticate to your Salesforce devhub. All that work gets this temporary virtual machine into the same position as your personal device probably was when we started.
The last two steps create the scratch org based on a hypothetical scratch org configuration file and gives the scratch org a short life of one day. Finally deploy your project’s manifest-tracked metadata. This last step could use any version of the deploy command. It could also be added by more steps to deploy other metadata, run tests, or anything else you want to have happen.
Closing Thoughts
Building from this point you can do all kinds of things. For example, if you don’t need to gain access to the org itself, you can include a step to delete the scratch org when you’re done to help avoid the active scratch limit.
You’ll want to pay attention to the limits of your org to see if you need to tweak the triggers of your workflow. If you aren’t using a production org you scratch limit is only 6 per day, and three at a time; I blew through that testing the steps in this article. Even larger orgs only have 200 per day. So be thoughtful about when your action runs, and how often you clean up.
As always, if you find a flaw in my solution please let me know. I’m always interested in making these better.