Commit graph

16119 commits

Author SHA1 Message Date
Jennifer Richards 253ba1dfbd fix: mypy/flakes lint 2024-05-13 21:41:36 -04:00
Jennifer Richards f58bbc3caa ci: parameterize / update settings (#7248)
* ci: parameterize gunicorn in datatracker-start.sh

* fix: typo

* ci: update settings_local for helm chart

* ci: Add todo comment

* ci: Drop redundant USE_TZ setting

* ci: Require secrets in production

* ci: fix indentation

* style: Black

* ci: memcached cfg from env in settings.py

* ci: set SITE_URL in settings.py

* refactor: /www/htpasswd -> /a/www/htpasswd

(it's a symlink on production)

* refactor: Remove obsolete SECR_ settings

* refactor: SECR_MAX_UPLOAD_SIZE -> DATATRACKER_...

* refactor: SECR_PPT2PDF_COMMAND -> PPT2PDF_COMMAND

* ci: Fix up helm/settings_local

* ci: Remove commented-out settings

* ci: Refactor/improve env var guards

* ci: More env refactoring / guards
2024-05-13 21:41:36 -04:00
Jennifer Richards e3d0290480 ci: install libreoffice (#7262)
Use bullseye-backports to get something more recent
(ietfa has 7.3.6.2; bullseye has 7.0.x.x;
bullseye-backports has 7.4.7.2)
2024-05-13 21:41:36 -04:00
Jennifer Richards 7a238a363e ci: collectstatic --no-input (#7252) 2024-05-13 21:41:36 -04:00
Robert Sparks 1c90789b49 chore: reduce worker count and disable live checks for the datatracker pod (#7240) 2024-05-13 21:41:36 -04:00
Jennifer Richards ad34104f68 ci: Deploy rabbitmq with a password (#7239) 2024-05-13 21:41:36 -04:00
Robert Sparks b36ff61805 feat: use gunicorn (#7215)
* feat: use gunicorn

* fix: let gunicorn emit logs to stdout/stderr

* fix: log to stdout/stderr in json format

* fix: run collectstatic for the local copy of the statics
2024-05-13 21:41:36 -04:00
Jennifer Richards f1e6c3729f ci: give rabbitmq a persistent volume claim (#7235)
* ci: give rabbitmq a persistent volume claim

This relies on minikube's dynamic creation of
persistent volumes - expect changes likely
needed for production deployment.

* ci: that's not an f-string

* ci: todo is todone
2024-05-13 21:41:36 -04:00
Jennifer Richards c987bacc95 ci: Rabbitmq progress (wip) (#7233)
* ci: rabbitmq service (wip)

* ci: customize rabbitmq config
2024-05-13 21:41:36 -04:00
Nicolas Giard f6db3e8e1b ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Nicolas Giard 0faf4d868c ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Jennifer Richards c6372992c6 ci: use datatracker image values for celery/beat (#7213)
* ci: use datatracker image values for celery/beat

* ci: refactor exec command lists as JSON

---------

Co-authored-by: Robert Sparks <rjsparks@nostrum.com>
2024-05-13 21:41:36 -04:00
Robert Sparks f91ea45813 chore: CRLF -> LF (#7214) 2024-05-13 21:41:36 -04:00
Jennifer Richards cd225018f9 ci: Memcached service (#7185)
* ci: service.yaml -> services/datatracker.yaml

* ci: memcached service

* ci: simplify memcached service name

* ci: Use correct service.type for memcached
2024-05-13 21:41:36 -04:00
Jennifer Richards dca77db250 ci: package and push helm chart 2024-05-13 21:41:36 -04:00
Jennifer Richards 6ed19bb2ab ci: nearly deployable helm chart (wip) (#7176)
* style: CRLF -> LF

* build: Use AppVersion for image

* chore: Helm YAML indent_size = 2

* ci: Deploy settings_local.py via helm

* ci: misc progress on the helm chart (WIP)

* ci: move configmap to env in values.yaml

* ci: Refactor env and configmap formats

* ci: merge fixup + helm debugging

* ci: Fix rabbitmq.yaml and its values

* ci: fix up other deployments

* ci: fix copy error in beat.yaml and celery.yaml

* ci: install correct images and volumes
2024-05-13 21:41:36 -04:00
Jennifer Richards bf74f2db31 ci: still need to chmod start.sh 2024-05-13 21:41:36 -04:00
Jennifer Richards f980954336 ci: add missing "&&" 2024-05-13 21:41:36 -04:00
Nicolas Giard c867d6f0da ci: helm values + deployment files for all 5 services (wip) 2024-05-13 21:41:36 -04:00
Robert Sparks ff228a5913 feat: merge dt and celery container builds (#6973)
* feat: merge dt and celery container builds

* fix: mount /a instead of /assets

* feat: use consolidated script

* fix: get start.sh dependencies. Remove watchdog

* fix: correct source path
2024-05-13 21:41:36 -04:00
Jennifer Richards 661941dbf1 feat: Split datatracker/celery start scripts (#6974) 2024-05-13 21:41:36 -04:00
dependabot[bot] 565486ee83
chore(deps): bump codecov/codecov-action from 4.3.0 to 4.3.1 (#7394)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.3.0 to 4.3.1.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v4.3.0...v4.3.1)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:06:24 -04:00
dependabot[bot] 5fbeb8cd90
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7397)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:47 -04:00
dependabot[bot] 342905fef8
chore(deps): bump tar from 7.0.1 to 7.1.0 in /dev/diff in the npm group (#7398)
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:18 -04:00
Robert Sparks bd25bc6034
fix: improve file investigation results (#7376) 2024-05-06 07:45:36 -05:00
dependabot[bot] 000e6b7dca
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7323)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:30 -04:00
dependabot[bot] 64ff6b8e2e
chore(deps): bump tar from 6.2.1 to 7.0.1 in /dev/diff in the npm group (#7325)
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:05 -04:00
dependabot[bot] 1e8b1ac7f5
chore(deps): bump codecov/codecov-action from 4.2.0 to 4.3.0 (#7326)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.2.0 to 4.3.0.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v4.2.0...v4.3.0)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:11:17 -04:00
dependabot[bot] 428a42497d
chore(deps): bump slackapi/slack-github-action from 1.25.0 to 1.26.0 (#7348)
Bumps [slackapi/slack-github-action](https://github.com/slackapi/slack-github-action) from 1.25.0 to 1.26.0.
- [Release notes](https://github.com/slackapi/slack-github-action/releases)
- [Commits](https://github.com/slackapi/slack-github-action/compare/v1.25.0...v1.26.0)

---
updated-dependencies:
- dependency-name: slackapi/slack-github-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:10:22 -04:00
dependabot[bot] f8ba357974
chore(deps): bump actions/download-artifact from 4.1.4 to 4.1.7 (#7377)
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 4.1.4 to 4.1.7.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v4.1.4...v4.1.7)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:09:47 -04:00
Robert Sparks d4d1cd4ed0
ci: merge release to main (pull request #7359)
ci: merge release to main
2024-04-24 12:02:37 -05:00
Jennifer Richards 2767fc55d2
chore: remove do-nothing cron script (#7358) 2024-04-24 11:34:50 -05:00
Nicolas Giard bfa35fb6d8
feat: add links to system status (#7286)
* feat: add links to system status

* fix: Update menu.html casing
2024-04-23 11:45:15 -05:00
Robert Sparks 6b11291216
feat: investigate file authenticity (#7331)
* feat: investigate file authenticity

* fix: use django-provided validation
2024-04-23 11:43:48 -05:00
Jennifer Richards 0616b07d2d
feat: email ingestion API (#7342)
* feat: IANA review email ingestor API

* refactor: Replace iana email api with generic one

* chore: Add type hint

* feat: Ingest ipr responses

* feat: Ingest nomcom feedback

* refactor: message -> msg

* fix: Typo

* feat: Send email on nomcom ingestion failure

* feat: Send email on IPR mail ingestion error

* feat: Check content type, handle more errs

* fix: drop additionalProperties: false

Unfortunately this does not mix well with
the conditional "year" property.

* test: Test ingest_email view

* Revert "test: Test ingest_email view"

This reverts commit e498022829f834a0d3cebcb0dafb0d5f5a5d162e.

* test: Test ingest_email view

* fix: pass new test

* test: Test ingest_review_email

* fix: Pass new test

* test: Test ipr ingest_response_email

* fix: pass new test

* test: test nomcom ingest_feedback_email

* chore: fix typo found in code reviw

* fix: De-lint
2024-04-23 09:07:50 -05:00
Robert Sparks 18e98aa899
fix: clarify comment at beginning of nonwg lists page (#7341) 2024-04-22 10:28:49 -05:00
Robert Sparks cedd58f950
feat: obviate ghostlinkd (#7336)
* wip: identify whats needed to obviate ghostlinkd

* fix: hardlink new charter files to ftp directory

* fix: hardlink new charter files to ftp directory (continued)

* chore: bring settings comment up to date

* chore: add archive and ftp dirs to setup of various environments

* fix: test charter submits write to ftp dir

* chore: remove debug

* fix: test charter approval writes to ftp dir

* fix: link review revisions into ftp dir

* fix: link to all archive and ftp on submission post

* chore: clean comments, move action to github issue

* fix: link idindex files to all archive and ftp

* chore: deflake

* chore: remove TODO comment

* fix: use settings

* chore: rename new setting
2024-04-19 16:18:52 -05:00
Robert Sparks 370c3b24ed
chore: remove alreay used on-shot import commands (#7333) 2024-04-18 10:25:02 -05:00
Robert Sparks b458d475a5
chore: remove dead (relies on svn) command (#7332) 2024-04-16 18:32:08 -05:00
dependabot[bot] 280481b924
chore(deps): bump nanoid in /dev/deploy-to-container in the npm group (#7299)
Bumps the npm group in /dev/deploy-to-container with 1 update: [nanoid](https://github.com/ai/nanoid).


Updates `nanoid` from 5.0.6 to 5.0.7
- [Release notes](https://github.com/ai/nanoid/releases)
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ai/nanoid/compare/5.0.6...5.0.7)

---
updated-dependencies:
- dependency-name: nanoid
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 17:05:32 -04:00
dependabot[bot] b9c6259f1f
chore(deps): bump codecov/codecov-action from 4.1.1 to 4.2.0 (#7301)
Bumps [codecov/codecov-action](https://github.com/codecov/codecov-action) from 4.1.1 to 4.2.0.
- [Release notes](https://github.com/codecov/codecov-action/releases)
- [Changelog](https://github.com/codecov/codecov-action/blob/main/CHANGELOG.md)
- [Commits](https://github.com/codecov/codecov-action/compare/v4.1.1...v4.2.0)

---
updated-dependencies:
- dependency-name: codecov/codecov-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 17:02:48 -04:00
Robert Sparks b528b3cfbb
ci: merge main to release (pull request #7313)
ci: merge main to release
2024-04-10 11:46:24 -05:00
Robert Sparks b76fad11a7
ci: merge mai to release (pull request #7312)
ci: merge main to release (pull request #7265)
2024-04-10 11:44:59 -05:00
Jennifer Richards 2fb550ffce
feat: add room_id param to createRoom API (#7308)
* feat: add room_id param to createRoom API

* test: update tests_helpers.py
2024-04-09 11:21:35 -05:00
Jennifer Richards 279fb8565a
fix: Split up API tokens (#7294) 2024-04-05 14:03:04 -05:00
Jennifer Richards 6b4a806e42
feat: API to list role-holder addresses (#7291)
* feat: API to list role-holder addresses

* test: Test new API endpoint

* fix: role_holder_addresses gets own API token

* refactor: Move role_holder_addresses to ietf.api.views

* test: test for group.utils.role_holder_emails

* test: Clean up test_role_holder_addresses

* fix: Missed a change in urls.py

* refactor: Remove old view

* chore: Remove unused import

* chore: Remove unused import
2024-04-05 14:02:40 -05:00
Jennifer Richards 8d7e8d6830
chore(deps): revert ical.js to 1.5.0 (#7293)
* chore(deps): revert ical.js to 1.5.0

@fullcalendar/icalendar needs < 2.0.0

* chore(deps): Add ical.js to yarn cache
2024-04-05 10:40:21 -05:00
Robert Sparks 864b19f21a
chore: refactor ballot search query (#7290) 2024-04-04 10:59:16 -05:00
dependabot[bot] 837bbeed09
chore(deps): bump the yarn group with 5 updates (#7280)
Bumps the yarn group with 5 updates:

| Package | From | To |
| --- | --- | --- |
| [caniuse-lite](https://github.com/browserslist/caniuse-lite) | `1.0.30001599` | `1.0.30001603` |
| [ical.js](https://github.com/kewisch/ical.js) | `1.5.0` | `2.0.0` |
| [eslint-plugin-vue](https://github.com/vuejs/eslint-plugin-vue) | `9.23.0` | `9.24.0` |
| [html-validate](https://gitlab.com/html-validate/html-validate) | `8.16.0` | `8.18.1` |
| [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) | `4.5.2` | `4.5.3` |


Updates `caniuse-lite` from 1.0.30001599 to 1.0.30001603
- [Commits](https://github.com/browserslist/caniuse-lite/compare/1.0.30001599...1.0.30001603)

Updates `ical.js` from 1.5.0 to 2.0.0
- [Release notes](https://github.com/kewisch/ical.js/releases)
- [Changelog](https://github.com/kewisch/ical.js/blob/main/CHANGELOG.md)
- [Commits](https://github.com/kewisch/ical.js/compare/v1.5.0...v2.0.0)

Updates `eslint-plugin-vue` from 9.23.0 to 9.24.0
- [Release notes](https://github.com/vuejs/eslint-plugin-vue/releases)
- [Commits](https://github.com/vuejs/eslint-plugin-vue/compare/v9.23.0...v9.24.0)

Updates `html-validate` from 8.16.0 to 8.18.1
- [Release notes](https://gitlab.com/html-validate/html-validate/tags)
- [Commits](https://gitlab.com/html-validate/html-validate/compare/v8.16.0...v8.18.1)

Updates `vite` from 4.5.2 to 4.5.3
- [Release notes](https://github.com/vitejs/vite/releases)
- [Changelog](https://github.com/vitejs/vite/blob/v4.5.3/packages/vite/CHANGELOG.md)
- [Commits](https://github.com/vitejs/vite/commits/v4.5.3/packages/vite)

---
updated-dependencies:
- dependency-name: caniuse-lite
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: yarn
- dependency-name: ical.js
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: yarn
- dependency-name: eslint-plugin-vue
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: yarn
- dependency-name: html-validate
  dependency-type: direct:development
  update-type: version-update:semver-minor
  dependency-group: yarn
- dependency-name: vite
  dependency-type: direct:development
  update-type: version-update:semver-patch
  dependency-group: yarn
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-03 17:57:40 -05:00
Robert Sparks ed5e4863b9
fix: handle probes for unknown ballot ids (#7289) 2024-04-03 16:59:52 -05:00