Commit graph

273 commits

Author SHA1 Message Date
rjsparks e5b6e330b1 ci: update base image target version to 20241127T2054 2024-11-27 21:05:52 +00:00
rjsparks 15f3ebd2d5 ci: update base image target version to 20241127T0116 2024-11-27 01:27:15 +00:00
Jennifer Richards 4b57602404
chore: log in-flight request lists on worker term (#8272)
* chore: log in-flight request lists on worker term

* style: Black

* chore: suppress empty in-flight logs

* chore: use list consistently
2024-11-25 12:51:44 -06:00
Nicolas Giard bdf753e052
chore: set gitattributes for normalizing line endings (#8245)
* chore: add proper .gitattributes

* chore: normalize file endings

* chore: fix .gitattributes

* chore: normalize file endings (2)
2024-11-20 16:48:00 -06:00
dependabot[bot] 7c025c9f2b
chore(deps): bump nanoid in /dev/deploy-to-container in the npm group (#8098)
Bumps the npm group in /dev/deploy-to-container with 1 update: [nanoid](https://github.com/ai/nanoid).


Updates `nanoid` from 5.0.7 to 5.0.8
- [Release notes](https://github.com/ai/nanoid/releases)
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md)
- [Commits](https://github.com/ai/nanoid/compare/5.0.7...5.0.8)

---
updated-dependencies:
- dependency-name: nanoid
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-11-20 12:59:39 -05:00
NGPixel 84a5aa3805 ci: update base image target version to 20241114T1954 2024-11-14 20:05:03 +00:00
Jennifer Richards 7293e10a64
feat: log start of gunicorn request (#8154)
* feat: log start of gunicorn request

* feat: add query string
2024-11-04 16:46:23 +00:00
Nicolas Giard d13b47064f
docs: update dev/tests/debug.sh 2024-10-29 22:47:31 -04:00
NGPixel 0d43663e9b ci: update base image target version to 20241029T1632 2024-10-29 16:43:21 +00:00
Jennifer Richards 8ec185cbb9
ci: fixed base image for prod (#8103) 2024-10-28 15:24:14 -05:00
dependabot[bot] db4ff66fbd
chore(deps): bump the npm group across 1 directory with 2 updates (#7789)
Bumps the npm group with 2 updates in the /dev/diff directory: [luxon](https://github.com/moment/luxon) and [tar](https://github.com/isaacs/node-tar).


Updates `luxon` from 3.4.4 to 3.5.0
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md)
- [Commits](https://github.com/moment/luxon/compare/3.4.4...3.5.0)

Updates `tar` from 7.4.0 to 7.4.3
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.4.0...v7.4.3)

---
updated-dependencies:
- dependency-name: luxon
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-15 16:02:08 -04:00
dependabot[bot] 51f96eb952
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7793)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.4.0 to 7.4.3
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.4.0...v7.4.3)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-15 16:01:15 -04:00
dependabot[bot] 39ba425089
build(deps): bump the npm group across 1 directory with 2 updates (#8021)
Bumps the npm group with 2 updates in the /dev/coverage-action directory: [@actions/core](https://github.com/actions/toolkit/tree/HEAD/packages/core) and [luxon](https://github.com/moment/luxon).


Updates `@actions/core` from 1.10.1 to 1.11.1
- [Changelog](https://github.com/actions/toolkit/blob/main/packages/core/RELEASES.md)
- [Commits](https://github.com/actions/toolkit/commits/HEAD/packages/core)

Updates `luxon` from 3.4.4 to 3.5.0
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md)
- [Commits](https://github.com/moment/luxon/compare/3.4.4...3.5.0)

---
updated-dependencies:
- dependency-name: "@actions/core"
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
- dependency-name: luxon
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-15 15:59:22 -04:00
Lars Eggert 35074660dc
chore: Prevent test suite artifact creation in work directory (#6438)
* chore: Prevent test suite artifact creation in work directory

Also remove a few other stale test assets while I'm here.

* Try and fix CI

* Change IDSUBMIT_REPOSITORY_PATH

* Make the dir

* test: clean up media/nomcom directories

* test: de-dup settings_temp_path_overrides

* chore: remove debug

* refactor: avoid premature import of test_utils

* refactor: drop useless lambda wrapper

---------

Co-authored-by: Jennifer Richards <jennifer@staff.ietf.org>
2024-09-18 14:08:01 -05:00
Jennifer Richards d8d52eedbf
feat: email ingestor api test endpoint (#7915)
* feat: email ingestor api test endpoint

* ci: add ingestion test token for sandbox

* chore: fix comments
2024-09-09 10:00:54 -05:00
Jennifer Richards 8f14dabcf5
ci: don't start if checks fail (#7674)
* ci: run checks when migrating

* ci: don't start if checks fail
2024-07-11 10:30:19 -05:00
Nicolas Giard ec1238d4fd
ci: disable coverage chart generation (#7672) 2024-07-10 20:53:49 -04:00
Nicolas Giard 5cc436cfb9
ci: fix coverage-action node version 2024-07-10 17:29:37 -04:00
Jennifer Richards 9c95689baf
ci: run migrations via init container (#7663)
* chore: split auth/dt/migration start

* chore: migrations via init container

* chore: no checks before migration

* chore: indicate celery start

* chore: additional log output
2024-07-10 15:33:03 -05:00
dependabot[bot] b6667a8ad2
chore(deps): bump tar in /dev/diff in the npm group across 1 directory (#7587)
Bumps the npm group with 1 update in the /dev/diff directory: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.1.0 to 7.4.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.1.0...v7.4.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-26 17:20:11 -04:00
dependabot[bot] b0e2e1877f
chore(deps): bump tar (#7586)
Bumps the npm group with 1 update in the /dev/deploy-to-container directory: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.1.0 to 7.4.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.1.0...v7.4.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-26 17:19:49 -04:00
Jennifer Richards c7d157e221
fix: enable gunicorn log config (#7600) 2024-06-26 16:02:26 -05:00
Jennifer Richards 6a96a69234
feat: improve / clean up logging (#7591)
* refactor: always use console log handler

* refactor: json for k8s, plain otherwise

* chore: remove syslog from wsgi.py

* chore: remove debug.log()

* chore: drop syslog from settings.py

* refactor: use log.log() in person.utils

* refactor: fetch_meeting_attendance->log.log()

* chore: gunicorn logs as JSON (wip)

* feat: better json log formatting

* refactor: improve log config

* feat: gunicorn access log fields

* fix: remove type hints

The gunicorn logger plays tricks with the
LogRecord args parameter to let it have string
keys instead of being a simple tuple.
The mypy tests rightly flag this. Rather
than fighting the typing, just remove the
hints and leave a comment warning not to
use the gunicorn-specific formatter with
other loggers.
2024-06-26 14:53:05 -05:00
Jennifer Richards 774fe78d3f
chore: gunicorn access logs / capture_output (#7534) 2024-06-14 10:43:06 -05:00
Jennifer Richards c1941df7e7
chore: adjustments for k8s deployment (#7531)
* chore: handle TERM in datatracker-start.sh

* chore: delay celery start if migration needed

* chore: skip-checks when migrating

* chore: label beat/celery as deleteBeforeUpgrade

Used by the infra-k8s deployment process to flag
these as needing to be shut down before a new
release rolls out.

* chore: increase termination grace periods
2024-06-14 09:28:14 -05:00
Matthew Holloway c1f1e1b830
fix: Formatting blockquotes in datatrackers rendered markdown (#7500)
* Formatting blockquotes in datatrackers rendered markdown

* Blockquote default formatting, with overrides for legacy blockquote

* Removing unnecessary 'richtext' CSS class

---------

Co-authored-by: Matthew Holloway <Matthew Holloway>
2024-06-06 15:42:23 -05:00
Nicolas Giard d344f5fd3c
ci: fix deploy-to-container script 2024-05-16 16:34:38 -04:00
Jennifer Richards b744f2b318 chore: switch back to uid/gid=1000 2024-05-13 21:41:36 -04:00
Jennifer Richards dd46a8af6f ci: use ietfa uid/gid for datatracker user (#7407)
* ci: use ietfa uid/gid for datatracker user

* chore: add comment
2024-05-13 21:41:36 -04:00
Jennifer Richards 8f87573144 ci: Fill in settings_local for docker 2024-05-13 21:41:36 -04:00
Jennifer Richards c8ee43da95 ci: run datatracker pod as non-root user (#7366)
* feat: patch_libraries management command

* ci: Patch libraries in docker img build

* ci: non-root datatracker user

* ci: securityContext for datatracker pod
2024-05-13 21:41:36 -04:00
Jennifer Richards 9379bbad7d ci: remove reminder comment 2024-05-13 21:41:36 -04:00
Jennifer Richards 6ccde89a68 ci: do not re-run yarn / collectstatics (#7353) 2024-05-13 21:41:36 -04:00
Jennifer Richards ebaf6b5680 ci: quotes around shell parameters 2024-05-13 21:41:36 -04:00
Jennifer Richards 48f908020f ci: collect statics when building image 2024-05-13 21:41:36 -04:00
Jennifer Richards f58bbc3caa ci: parameterize / update settings (#7248)
* ci: parameterize gunicorn in datatracker-start.sh

* fix: typo

* ci: update settings_local for helm chart

* ci: Add todo comment

* ci: Drop redundant USE_TZ setting

* ci: Require secrets in production

* ci: fix indentation

* style: Black

* ci: memcached cfg from env in settings.py

* ci: set SITE_URL in settings.py

* refactor: /www/htpasswd -> /a/www/htpasswd

(it's a symlink on production)

* refactor: Remove obsolete SECR_ settings

* refactor: SECR_MAX_UPLOAD_SIZE -> DATATRACKER_...

* refactor: SECR_PPT2PDF_COMMAND -> PPT2PDF_COMMAND

* ci: Fix up helm/settings_local

* ci: Remove commented-out settings

* ci: Refactor/improve env var guards

* ci: More env refactoring / guards
2024-05-13 21:41:36 -04:00
Jennifer Richards e3d0290480 ci: install libreoffice (#7262)
Use bullseye-backports to get something more recent
(ietfa has 7.3.6.2; bullseye has 7.0.x.x;
bullseye-backports has 7.4.7.2)
2024-05-13 21:41:36 -04:00
Jennifer Richards 7a238a363e ci: collectstatic --no-input (#7252) 2024-05-13 21:41:36 -04:00
Robert Sparks 1c90789b49 chore: reduce worker count and disable live checks for the datatracker pod (#7240) 2024-05-13 21:41:36 -04:00
Robert Sparks b36ff61805 feat: use gunicorn (#7215)
* feat: use gunicorn

* fix: let gunicorn emit logs to stdout/stderr

* fix: log to stdout/stderr in json format

* fix: run collectstatic for the local copy of the statics
2024-05-13 21:41:36 -04:00
Nicolas Giard f6db3e8e1b ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Nicolas Giard 0faf4d868c ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Jennifer Richards bf74f2db31 ci: still need to chmod start.sh 2024-05-13 21:41:36 -04:00
Jennifer Richards f980954336 ci: add missing "&&" 2024-05-13 21:41:36 -04:00
Robert Sparks ff228a5913 feat: merge dt and celery container builds (#6973)
* feat: merge dt and celery container builds

* fix: mount /a instead of /assets

* feat: use consolidated script

* fix: get start.sh dependencies. Remove watchdog

* fix: correct source path
2024-05-13 21:41:36 -04:00
Jennifer Richards 661941dbf1 feat: Split datatracker/celery start scripts (#6974) 2024-05-13 21:41:36 -04:00
dependabot[bot] 5fbeb8cd90
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7397)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:47 -04:00
dependabot[bot] 342905fef8
chore(deps): bump tar from 7.0.1 to 7.1.0 in /dev/diff in the npm group (#7398)
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:18 -04:00
dependabot[bot] 000e6b7dca
chore(deps): bump tar in /dev/deploy-to-container in the npm group (#7323)
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:30 -04:00
dependabot[bot] 64ff6b8e2e
chore(deps): bump tar from 6.2.1 to 7.0.1 in /dev/diff in the npm group (#7325)
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar).


Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases)
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md)
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1)

---
updated-dependencies:
- dependency-name: tar
  dependency-type: direct:production
  update-type: version-update:semver-major
  dependency-group: npm
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:05 -04:00