Contributing to Security Scorecards

Thank you for contributing your time and expertise to the Security Scorecards project. This document describes the contribution guidelines for the project.

Note: Before you start contributing, you must read and abide by our Code of Conduct.

• Contributing code
  • Getting started
  • Environment Setup
• Contributing steps
• Error handling
• How to build scorecard locally
• PR Process
• What to do before submitting a pull request
• Permission for GitHub personal access tokens
• Where the CI Tests are configured
• dailyscore-cronjob
  • Deploying the cron job
• How do I add additional GitHub repositories to be scanned by scorecard dailyscore?
• Adding New Checks
• Updating Docs
• Choosing checks to run

Contributing code

Getting started

1. Create a GitHub account
2. Create a personal access token
3. Set up your development environment

Environment Setup

You must install these tools:

1. git: For source control

2. go: You need go version v1.17 or higher.

3. docker: v18.9 or higher.

Contributing steps

1. Submit an issue describing your proposed change to the repo in question.
2. The repo owners will respond to your issue promptly.
3. Fork the desired repo, develop and test your code changes.
4. Submit a pull request.

Error handling

See errors.

How to build scorecard locally

Note that, by building the scorecard from the source code we are allowed to test the changes made locally.

1. Run the following command to clone your fork of the project locally

git clone [email protected]:<user>/scorecard.git $GOPATH/src/github.com/<user>/scorecard.git

1. Ensure you activate module support before continue ($ export GO111MODULE=on)
2. Run the command make build to build the source code

PR Process

Every PR should be annotated with an icon indicating whether it's a:

• Breaking change: ⚠️ (:warning:)
• Non-breaking feature: ✨ (:sparkles:)
• Patch fix: 🐛 (:bug:)
• Docs: 📖 (:book:)
• Infra/Tests/Other: 🌱 (:seedling:)
• No release note: 👻 (:ghost:)

Use 👻 (no release note) only for the PRs that change or revert unreleased changes, which don't deserve a release note. Please don't abuse it.

You can also use the equivalent emoji directly, since GitHub doesn't render the :xyz: aliases in PR titles.

Individual commits should not be tagged separately, but will generally be assumed to match the PR. For instance, if you have a bugfix in with a breaking change, it's generally encouraged to submit the bugfix separately, but if you must put them in one PR, you should mark the whole PR as breaking.

What to do before submitting a pull request

Following the targets that can be used to test your changes locally.

Command	Description	Is called in the CI?
make all	Runs go test,golangci lint checks, fmt, go mod tidy	yes
make e2e	Runs e2e tests	yes

Permission for GitHub personal access tokens

The personal access token need the following scopes:

• repo:status - Access commit status
• repo_deployment - Access deployment status
• public_repo - Access public repositories

Where the CI Tests are configured

1. See the action files to check its tests, and the scripts used on it.

dailyscore-cronjob

scorecard scans https://github.com/ossf/scorecard/blob/main/cron/projects.txt repositories in GCP k8s and publishes the results in GCS bucket ossf-scorecards.

The cron definition ./scorecard/cron/cron.sh and the k8s for the cron is in ./scorecard/cron/k8s/cron.yaml

The logs for the cron are available at https://console.cloud.google.com/kubernetes/cronjob/us-central1-c/openssf/default/daily-score/logs?project=openssf

Deploying the cron job

The cronjob can be deployed into k8s by running kubectl apply -f ./scorecard/cron/k8s/cron.yaml. This will deploy a k8s cron job.

Any updates to the ./scorecard/cron/cron.sh will be deployed by the docker container ./scorecard/Dockerfile.gsutil

How do I add additional GitHub repositories to be scanned by scorecard dailyscore?

Scorecard maintains the list of repositories in a file https://github.com/ossf/scorecard/blob/main/cron/projects.txt

Submit a PR for this file and scorecard would start scanning in subsequent runs.

Adding New Checks

See checks/write.md. When you add new checks, you need to also update the docs.

Updating Docs

A summary for each check needs to be included in the README.md. In most cases, to update the documentation simply edit the corresponding .md file, which the notable exception of the auto-generated file checks.md.

Details about each check need to provided in docs/checks/internal/checks.yaml. If you want to update its documentation, updates that checks.yaml file.

Whenever you modify the checks.yaml file, run the following to generate checks/checks.md:

make generate-docs

DO NOT edit docs/checks.md directly, as that is an auto-generated file. Edit docs/checks/internal/checks.yaml instead.

Choosing checks to run

You can use the --checks option to select which checks to run. This is useful if, for example, you only want to run the check you're currently developing.