Commit Graph

88 Commits

Author SHA1 Message Date
innovaker
f62f86258a feat: change parent (base) image to ubuntu
Aligns with Zephyr and avoids Debian compatibility issues (cmake 3.15, libcurl4, python 3.8).

PR: zmkfirmware/zmk-docker#80
2021-06-16 19:14:51 +01:00
innovaker
af6c5091aa feat: Zephyr 2.5.0
Based on:
https://docs.zephyrproject.org/2.5.0/getting_started/index.html
https://docs.zephyrproject.org/2.5.0/getting_started/installation_linux.html#install-requirements-and-dependencies
2021-06-14 20:56:05 +01:00
innovaker
540a2cee25 feat: Zephyr SDK 0.12.4
See: https://github.com/zephyrproject-rtos/sdk-ng/releases/tag/v0.12.4
PR: zmkfirmware/zmk-docker#77
2021-06-14 14:42:50 +01:00
innovaker
b1904e7b15 feat: Zephyr SDK 0.12.3
See: https://github.com/zephyrproject-rtos/sdk-ng/releases/tag/v0.12.3
PR: zmkfirmware/zmk-docker#77
2021-06-14 14:42:50 +01:00
innovaker
e32bd8599d feat: Zephyr SDK 0.12.2
See: https://github.com/zephyrproject-rtos/sdk-ng/releases/tag/v0.12.2
PR: zmkfirmware/zmk-docker#77
2021-06-14 14:42:50 +01:00
innovaker
4627c7e7c5 feat: Zephyr SDK 0.12.1
See: https://github.com/zephyrproject-rtos/sdk-ng/releases/tag/v0.12.1
PR: zmkfirmware/zmk-docker#77
2021-06-14 14:42:50 +01:00
innovaker
b8341e185a feat: Zephyr SDK 0.12.0
See: https://github.com/zephyrproject-rtos/sdk-ng/releases/tag/v0.12.0
PR: zmkfirmware/zmk-docker#77
2021-06-14 14:42:50 +01:00
innovaker
cdbb6eb708 feat: disable fail-fast for candidates jobs
Prevents a job failure from halting the other jobs.

PR: zmkfirmware/zmk-docker#45
2021-06-14 14:28:19 +01:00
innovaker
919ad96cc5 feat: add remaining architectures
Recent design improvements permit building all of Zephyr's supported architectures simultaneously.  So why not?

PR: zmkfirmware/zmk-docker#58
2021-06-14 11:55:53 +01:00
innovaker
60596b949a feat: remove max-parallel for candidates jobs
`max-parallel: 1` is no longer necessary.

See: 27b9ac19f3
PR: zmkfirmware/zmk-docker#57
2021-06-14 11:35:25 +01:00
innovaker
eb804342e2 fix: add guard conditions for west build tests
The RAM report, ROM report and clean steps depend on the success of the board/shield build.

PR: zmkfirmware/zmk-docker#51
2021-06-14 10:38:14 +01:00
innovaker
df85393001 feat: add ignore-actions-cache secret
By default, a workflow re-run reuses the dev-generic GitHub Actions cache created by the previous attempt.  The `ignore-actions-cache` secret acts as a flag for ignoring the former cache.

PR: zmkfirmware/zmk-docker#76
2021-06-14 10:13:50 +01:00
innovaker
67075dfb7b refactor: always rebuild dev-generic
The `dev-generic` job was originally optimized to only build once per workflow run.  Subsequent re-runs skipped the build steps.  This unfortunately made it difficult to analyze dev-generic cache problems after merging.  This change removes this optimization.

The cache key has a timestamp suffix so that the cache is always built anew.  This provides more integrity, traceability and flexibility at the cost of increased cache turnover across the repository.

PR: zmkfirmware/zmk-docker#74
2021-06-14 10:01:26 +01:00
innovaker
406388461c refactor: move timestamp into dedicated job
Provides a unique timestamp across all jobs.

PR: zmkfirmware/zmk-docker#74
2021-06-14 10:01:26 +01:00
innovaker
f0b02aecfd refactor: change zmk-dev-generic-cache into zmk-dev-generic image
Makes it easier to inspect the layers/image.

PR: zmkfirmware/zmk-docker#73
2021-06-13 15:17:04 +01:00
innovaker
413a53ae13 feat: add no-cache secret
Acts as a flag to force the workflow to ignore the cache.
2021-06-13 14:01:01 +01:00
innovaker
434bd09f6e feat(dev): add socat
Required for piping serial over IP.

PR: zmkfirmware/zmk-docker#55
2021-06-13 10:30:53 +01:00
innovaker
fe276be4a9 feat(dev): add gdb
Required for local or remote debugging.

Closes: zmkfirmware/zmk-docker#7
PR: zmkfirmware/zmk-docker#54
2021-06-12 20:21:04 +01:00
innovaker
e656baa7da feat(dev): set PAGER=less
Requested by @mcrosson.

Closes: zmkfirmware/zmk-docker#1
PR: zmkfirmware/zmk-docker#52
2021-06-12 20:20:00 +01:00
innovaker
a01e40a640 feat(dev): add less
Requested by @mcrosson.

See: zmkfirmware/zmk-docker#1
PR: zmkfirmware/zmk-docker#52
2021-06-12 20:20:00 +01:00
innovaker
455347f20a feat: add python3 --version to tests
Makes it easy to check the `python` version against the Zephyr documentation.

PR: #72
2021-06-12 19:26:42 +01:00
innovaker
b5481baf02 refactor(common): move cmake --version from Dockerfile to tests
Makes it easier to check the `cmake` version against the Zephyr documentation, especially when the layer is already cached.

PR: #71
2021-06-12 19:23:29 +01:00
innovaker
4404d011c4 refactor(dev-generic): remove node --version from Dockerfile
This line in the Dockerfile has been superseded by the tests.

See: 70e225f229
PR: #70
2021-06-12 19:12:38 +01:00
innovaker
bc822a193a feat: rewrite release system to support multiple images per commit
A critical limitation of the first design was the assumption that there would only be one Docker build per commit.  As such, software packages were often only refreshed when Zephyr was upgraded.

This new design opens the door to better CI practices.  It allows regular rebuilds of the Docker images irrespective of version control.  This is critical for incorporating the latest security fixes and bug patches as soon as possible.

Maintainers are still required to trigger stable releases (via tags), but this can be revisited in the future if further automation is necessary.

PR: #50
2021-06-12 18:56:05 +01:00
innovaker
69df2553ed refactor: replace latest tag
`latest` can be ambiguous and misunderstood.

See: #62
PR: #67
2021-06-12 16:35:28 +01:00
innovaker
56e01d70cb feat: schedule nightly rebuild at 02:00 UTC
Rebuilds the default branch from scratch every night.  This ensures that the latest security patches are available for testers.

PR: #66
2021-06-12 16:06:57 +01:00
innovaker
2a830a7633 feat: add no-cache support
`no-cache` rebuilds everything from scratch.  This is critical for integrating security patches and bug fixes as soon as possible.

PR: #65
2021-06-12 14:26:39 +01:00
innovaker
93b6eedd33 docs: add examples to tags
Illustrates the form of the tags.

PR: #68
2021-06-12 11:54:29 +01:00
innovaker
88620c678e feat: add cache-from major-minor-branch
Lets any branch utilize its corresponding major-minor-branch cache.

See: #62
PR: #68
2021-06-12 11:54:29 +01:00
innovaker
b551a568f5 feat: add cache-from upstream
Provides a quick start for new forks.

PR: #64
2021-06-10 10:42:27 +01:00
innovaker
f531452a17 feat: add cache-from dev-generic (GitHub Actions cache)
Pre-builds the dev-generic stage and provides it to all subsequent jobs.  This improves the integrity between the jobs within a particular workflow run, especially in the absence of registry credentials.  It also reduces the workflow run duration when building multiple architectures in parallel.

PR: #61
2021-06-09 19:59:33 +01:00
innovaker
fa56205570 feat: add cache-from base
Lets PRs utilize their base (branch) cache.

PR: #63
2021-06-09 14:23:47 +01:00
innovaker
27b9ac19f3 refactor: combine build and dev jobs
Bringing `build` and `dev` into the same job lets `dev` use `build` as a cache-from source without requiring registry credentials.

PR: #60
2021-06-08 10:15:40 -04:00
innovaker
910fcf7a8a refactor: describe "registry.io/namespace/image:tag" as paths
Improves the readability and makes it easier to extend.

PR: #59
2021-05-25 19:18:02 +01:00
innovaker
0042254202 feat: replace registry cache with inline cache(s)
A simpler, leaner and more scalable approach to the cache.  Scopes the cache by architecture as well as branch.

PR: #56
2021-05-23 10:36:28 +01:00
innovaker
3a6b0f0d23 feat: restrict workflow concurrency per branch
Protects the cache from competing workflow runs on a per branch basis.

PR: #53
2021-05-22 15:01:34 +01:00
innovaker
2eb634739f refactor: drop dev from cache tag
`dev` is longer necessary because the branch name was added.

PR: #53
2021-05-22 15:01:34 +01:00
innovaker
768a24ad9d feat: scope cache by branch
Lets each branch manage its own cache.

PR: #53
2021-05-22 15:01:34 +01:00
innovaker
935b111322 refactor: remove git-tag job's guard conditions
These guard conditions are now superfluous because the `git-tag` job depends on the `releases` job.

PR: #43
2021-05-20 15:27:45 +01:00
innovaker
30b4589480 refactor: simplify release step with local env variables
Improves the readability and makes it easier to debug.

PR: #42
2021-05-20 15:26:32 +01:00
innovaker
70e225f229 feat: add integration tests
Runs a set of tests before the candidate image can be pushed.  The tests aim to cover all common use cases.

It was not possible to run the tests as a separate set of jobs because `actions/upload-artifact` and `actions/download-artifact` are too slow.  Moreover, a separate set of jobs would create a bottleneck because some architectures complete their docker builds faster than others.

The custom docker shell may require maintenance if GitHub change the underlying runner environment in the future.  It doesn't (yet?) support multi-line run commands.

PR: #46
2021-05-20 14:31:37 +01:00
innovaker
11a99e0826 refactor: move credentials checks into workflow env
This is a simpler and cleaner approach than previous implementations.

PR: #49
See: 7b71139613
See: 40f6d7bf50
2021-05-20 13:59:38 +01:00
innovaker
8e1ab724e4 refactor: move namespaces into workflow env
This is a simpler and cleaner approach than any of the previous implementations.

PR: #48
See: 7426042429
2021-05-19 21:14:12 +01:00
innovaker
7426042429 fix: refactor namespaces back into steps
Further testing has suggested that GitHub Actions sanitizes any secrets in job outputs.  The namespace definitions must therefore be duplicated across each job that needs them.

PR: #47
See: b65d7974a2
See: 7cf9196c14
2021-05-19 13:52:00 +01:00
innovaker
2f991a1709 refactor: split docker job into candidates and releases
This design approach has improved separation of concerns with minimal repetition.  It's also easier to refactor.

PR: #41
2021-05-18 20:04:04 +01:00
innovaker
5b98c4d20c refactor: move repository-name into a dedicated step
Completes laying the groundwork for splitting the `docker` job into `candidates` and `releases`.

PR: #41
2021-05-18 20:04:04 +01:00
innovaker
82f80a41f6 refactor: move tags into its own job
Lays the groundwork for splitting the `docker` job into `candidates` and `releases`.

PR: #41
2021-05-18 20:04:04 +01:00
innovaker
7cf9196c14 refactor: move ghcr namespace to the namespaces job
Lays the groundwork for splitting the `docker` job into `candidates` and `releases`.

PR: #41
2021-05-18 20:04:04 +01:00
innovaker
b65d7974a2 refactor: move docker-hub-namespace into a namespaces job
Lays the groundwork for splitting the `docker` job into `candidates` and `releases`.

PR: #41
2021-05-18 20:04:04 +01:00
innovaker
40f6d7bf50 refactor: move credentials checks into their own job
Lays the groundwork for splitting the `docker` job into `candidates` and `releases`.

PR: #41
2021-05-18 20:04:04 +01:00