Commit graph

16275 commits

Author SHA1 Message Date
Jennifer Richards e99286f400 ci: use values for PVClaims, STATIC_URL (#7317)
* ci: Expose PV parameters as values

* ci: complain about missing value in dev mode

* ci: Allow override of STATIC_URL
2024-05-13 21:41:36 -04:00
Jennifer Richards 206a4bb749 ci: clean up labels and service values (#7314)
* ci: Remove unused service values

* ci: Reorg labels
2024-05-13 21:41:36 -04:00
Jennifer Richards c4a2ea9822 ci: Adjust secrets in values.yaml (#7288)
* ci: Require secrets, even in "development"

* ci: More secrets-requiring

* ci: Strip whitespace out before b64 decoding

* ci: Adjust values.yaml

* ci: Comment in values.yaml
2024-05-13 21:41:36 -04:00
Jennifer Richards 46e521ea9a ci: shared PersistentVolumeClaim on /a (#7283)
* ci: shared PersistentVolumeClaim on /a

* ci: Increase storage request, add comment
2024-05-13 21:41:36 -04:00
Jennifer Richards 8872e31e30 ci: Get APP_API_TOKENS from env (#7271)
* ci: Get APP_API_TOKENS from env

* ci: chart fixup

* ci: Remove canned APP_API_TOKENs

(setec astronomy)
2024-05-13 21:41:36 -04:00
Jennifer Richards 253ba1dfbd fix: mypy/flakes lint 2024-05-13 21:41:36 -04:00
Jennifer Richards f58bbc3caa ci: parameterize / update settings (#7248)
* ci: parameterize gunicorn in datatracker-start.sh

* fix: typo

* ci: update settings_local for helm chart

* ci: Add todo comment

* ci: Drop redundant USE_TZ setting

* ci: Require secrets in production

* ci: fix indentation

* style: Black

* ci: memcached cfg from env in settings.py

* ci: set SITE_URL in settings.py

* refactor: /www/htpasswd -> /a/www/htpasswd

(it's a symlink on production)

* refactor: Remove obsolete SECR_ settings

* refactor: SECR_MAX_UPLOAD_SIZE -> DATATRACKER_...

* refactor: SECR_PPT2PDF_COMMAND -> PPT2PDF_COMMAND

* ci: Fix up helm/settings_local

* ci: Remove commented-out settings

* ci: Refactor/improve env var guards

* ci: More env refactoring / guards
2024-05-13 21:41:36 -04:00
Jennifer Richards e3d0290480 ci: install libreoffice (#7262)
Use bullseye-backports to get something more recent
(ietfa has 7.3.6.2; bullseye has 7.0.x.x;
bullseye-backports has 7.4.7.2)
2024-05-13 21:41:36 -04:00
Jennifer Richards 7a238a363e ci: collectstatic --no-input (#7252) 2024-05-13 21:41:36 -04:00
Robert Sparks 1c90789b49 chore: reduce worker count and disable live checks for the datatracker pod (#7240) 2024-05-13 21:41:36 -04:00
Jennifer Richards ad34104f68 ci: Deploy rabbitmq with a password (#7239) 2024-05-13 21:41:36 -04:00
Robert Sparks b36ff61805 feat: use gunicorn (#7215)
* feat: use gunicorn

* fix: let gunicorn emit logs to stdout/stderr

* fix: log to stdout/stderr in json format

* fix: run collectstatic for the local copy of the statics
2024-05-13 21:41:36 -04:00
Jennifer Richards f1e6c3729f ci: give rabbitmq a persistent volume claim (#7235)
* ci: give rabbitmq a persistent volume claim

This relies on minikube's dynamic creation of
persistent volumes - expect changes likely
needed for production deployment.

* ci: that's not an f-string

* ci: todo is todone
2024-05-13 21:41:36 -04:00
Jennifer Richards c987bacc95 ci: Rabbitmq progress (wip) (#7233)
* ci: rabbitmq service (wip)

* ci: customize rabbitmq config
2024-05-13 21:41:36 -04:00
Nicolas Giard f6db3e8e1b ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Nicolas Giard 0faf4d868c ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Jennifer Richards c6372992c6 ci: use datatracker image values for celery/beat (#7213)
* ci: use datatracker image values for celery/beat

* ci: refactor exec command lists as JSON

---------

Co-authored-by: Robert Sparks <rjsparks@nostrum.com>
2024-05-13 21:41:36 -04:00
Robert Sparks f91ea45813 chore: CRLF -> LF (#7214) 2024-05-13 21:41:36 -04:00
Jennifer Richards cd225018f9 ci: Memcached service (#7185)
* ci: service.yaml -> services/datatracker.yaml

* ci: memcached service

* ci: simplify memcached service name

* ci: Use correct service.type for memcached
2024-05-13 21:41:36 -04:00
Jennifer Richards dca77db250 ci: package and push helm chart 2024-05-13 21:41:36 -04:00
Jennifer Richards 6ed19bb2ab ci: nearly deployable helm chart (wip) (#7176)
* style: CRLF -> LF

* build: Use AppVersion for image

* chore: Helm YAML indent_size = 2

* ci: Deploy settings_local.py via helm

* ci: misc progress on the helm chart (WIP)

* ci: move configmap to env in values.yaml

* ci: Refactor env and configmap formats

* ci: merge fixup + helm debugging

* ci: Fix rabbitmq.yaml and its values

* ci: fix up other deployments

* ci: fix copy error in beat.yaml and celery.yaml

* ci: install correct images and volumes
2024-05-13 21:41:36 -04:00
Jennifer Richards bf74f2db31 ci: still need to chmod start.sh 2024-05-13 21:41:36 -04:00
Jennifer Richards f980954336 ci: add missing "&&" 2024-05-13 21:41:36 -04:00
Nicolas Giard c867d6f0da ci: helm values + deployment files for all 5 services (wip) 2024-05-13 21:41:36 -04:00
Robert Sparks ff228a5913 feat: merge dt and celery container builds (#6973)
* feat: merge dt and celery container builds

* fix: mount /a instead of /assets

* feat: use consolidated script

* fix: get start.sh dependencies. Remove watchdog

* fix: correct source path
2024-05-13 21:41:36 -04:00
Jennifer Richards 661941dbf1 feat: Split datatracker/celery start scripts (#6974) 2024-05-13 21:41:36 -04:00
dependabot[bot] 565486ee83
chore(deps): bump codecov/codecov-action from 4.3.0 to 4.3.1 (#7394)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.3.0 to 4.3.1.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v4.3.0...v4.3.1)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:06:24 -04:00
dependabot[bot] 5fbeb8cd90
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7397)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:47 -04:00
dependabot[bot] 342905fef8
chore(deps): bump tar from 7.0.1 to 7.1.0 in /dev/diff in the npm group (#7398)
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:18 -04:00
Robert Sparks bd25bc6034
fix: improve file investigation results (#7376) 2024-05-06 07:45:36 -05:00
dependabot[bot] 000e6b7dca
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7323)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:30 -04:00
dependabot[bot] 64ff6b8e2e
chore(deps): bump tar from 6.2.1 to 7.0.1 in /dev/diff in the npm group (#7325)
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:05 -04:00
dependabot[bot] 1e8b1ac7f5
chore(deps): bump codecov/codecov-action from 4.2.0 to 4.3.0 (#7326)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.2.0 to 4.3.0.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v4.2.0...v4.3.0)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:11:17 -04:00
dependabot[bot] 428a42497d
chore(deps): bump slackapi/slack-github-action from 1.25.0 to 1.26.0 (#7348)
Bumps [slackapi/slack-github-action](https://github.com/slackapi/slack-github-action) from 1.25.0 to 1.26.0.
- [Release notes](https://github.com/slackapi/slack-github-action/releases)
- [Commits](https://github.com/slackapi/slack-github-action/compare/v1.25.0...v1.26.0)

---
updated-dependencies:
- dependency-name: slackapi/slack-github-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:10:22 -04:00
dependabot[bot] f8ba357974
chore(deps): bump actions/download-artifact from 4.1.4 to 4.1.7 (#7377)
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 4.1.4 to 4.1.7.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v4.1.4...v4.1.7)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:09:47 -04:00
Robert Sparks be763a65aa
ci: merge main to release (pull request #7360)
ci: merge main to release
2024-04-24 12:03:50 -05:00
Robert Sparks d4d1cd4ed0
ci: merge release to main (pull request #7359)
ci: merge release to main
2024-04-24 12:02:37 -05:00
Jennifer Richards 2767fc55d2
chore: remove do-nothing cron script (#7358) 2024-04-24 11:34:50 -05:00
Nicolas Giard bfa35fb6d8
feat: add links to system status (#7286)
* feat: add links to system status

* fix: Update menu.html casing
2024-04-23 11:45:15 -05:00
Robert Sparks 6b11291216
feat: investigate file authenticity (#7331)
* feat: investigate file authenticity

* fix: use django-provided validation
2024-04-23 11:43:48 -05:00
Jennifer Richards 0616b07d2d
feat: email ingestion API (#7342)
* feat: IANA review email ingestor API

* refactor: Replace iana email api with generic one

* chore: Add type hint

* feat: Ingest ipr responses

* feat: Ingest nomcom feedback

* refactor: message -> msg

* fix: Typo

* feat: Send email on nomcom ingestion failure

* feat: Send email on IPR mail ingestion error

* feat: Check content type, handle more errs

* fix: drop additionalProperties: false

Unfortunately this does not mix well with
the conditional "year" property.

* test: Test ingest_email view

* Revert "test: Test ingest_email view"

This reverts commit e498022829f834a0d3cebcb0dafb0d5f5a5d162e.

* test: Test ingest_email view

* fix: pass new test

* test: Test ingest_review_email

* fix: Pass new test

* test: Test ipr ingest_response_email

* fix: pass new test

* test: test nomcom ingest_feedback_email

* chore: fix typo found in code reviw

* fix: De-lint
2024-04-23 09:07:50 -05:00
Robert Sparks 18e98aa899
fix: clarify comment at beginning of nonwg lists page (#7341) 2024-04-22 10:28:49 -05:00
Robert Sparks cedd58f950
feat: obviate ghostlinkd (#7336)
* wip: identify whats needed to obviate ghostlinkd

* fix: hardlink new charter files to ftp directory

* fix: hardlink new charter files to ftp directory (continued)

* chore: bring settings comment up to date

* chore: add archive and ftp dirs to setup of various environments

* fix: test charter submits write to ftp dir

* chore: remove debug

* fix: test charter approval writes to ftp dir

* fix: link review revisions into ftp dir

* fix: link to all archive and ftp on submission post

* chore: clean comments, move action to github issue

* fix: link idindex files to all archive and ftp

* chore: deflake

* chore: remove TODO comment

* fix: use settings

* chore: rename new setting
2024-04-19 16:18:52 -05:00
Robert Sparks 370c3b24ed
chore: remove alreay used on-shot import commands (#7333) 2024-04-18 10:25:02 -05:00
Robert Sparks b458d475a5
chore: remove dead (relies on svn) command (#7332) 2024-04-16 18:32:08 -05:00
dependabot[bot] 280481b924
chore(deps): bump nanoid in /dev/deploy-to-container in the npm group (#7299)
Bumps the npm group in /dev/deploy-to-container with 1 update: [nanoid](https://github.com/ai/nanoid).


Updates `nanoid` from 5.0.6 to 5.0.7
- [Release notes](https://github.com/ai/nanoid/releases)
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ai/nanoid/compare/5.0.6...5.0.7)

---
updated-dependencies:
- dependency-name: nanoid
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 17:05:32 -04:00
dependabot[bot] b9c6259f1f
chore(deps): bump codecov/codecov-action from 4.1.1 to 4.2.0 (#7301)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.1.1 to 4.2.0.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v4.1.1...v4.2.0)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 17:02:48 -04:00
Robert Sparks b528b3cfbb
ci: merge main to release (pull request #7313)
ci: merge main to release
2024-04-10 11:46:24 -05:00
Robert Sparks b76fad11a7
ci: merge mai to release (pull request #7312)
ci: merge main to release (pull request #7265)
2024-04-10 11:44:59 -05:00
Jennifer Richards 2fb550ffce
feat: add room_id param to createRoom API (#7308)
* feat: add room_id param to createRoom API

* test: update tests_helpers.py
2024-04-09 11:21:35 -05:00