Jennifer Richards
7293e10a64
feat: log start of gunicorn request ( #8154 )
...
* feat: log start of gunicorn request
* feat: add query string
2024-11-04 16:46:23 +00:00
Nicolas Giard
d13b47064f
docs: update dev/tests/debug.sh
2024-10-29 22:47:31 -04:00
NGPixel
0d43663e9b
ci: update base image target version to 20241029T1632
2024-10-29 16:43:21 +00:00
Jennifer Richards
8ec185cbb9
ci: fixed base image for prod ( #8103 )
2024-10-28 15:24:14 -05:00
dependabot[bot]
db4ff66fbd
chore(deps): bump the npm group across 1 directory with 2 updates ( #7789 )
...
Bumps the npm group with 2 updates in the /dev/diff directory: [luxon](https://github.com/moment/luxon ) and [tar](https://github.com/isaacs/node-tar ).
Updates `luxon` from 3.4.4 to 3.5.0
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md )
- [Commits](https://github.com/moment/luxon/compare/3.4.4...3.5.0 )
Updates `tar` from 7.4.0 to 7.4.3
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v7.4.0...v7.4.3 )
---
updated-dependencies:
- dependency-name: luxon
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-15 16:02:08 -04:00
dependabot[bot]
51f96eb952
chore(deps): bump tar in /dev/deploy-to-container in the npm group ( #7793 )
...
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 7.4.0 to 7.4.3
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v7.4.0...v7.4.3 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-15 16:01:15 -04:00
dependabot[bot]
39ba425089
build(deps): bump the npm group across 1 directory with 2 updates ( #8021 )
...
Bumps the npm group with 2 updates in the /dev/coverage-action directory: [@actions/core](https://github.com/actions/toolkit/tree/HEAD/packages/core ) and [luxon](https://github.com/moment/luxon ).
Updates `@actions/core` from 1.10.1 to 1.11.1
- [Changelog](https://github.com/actions/toolkit/blob/main/packages/core/RELEASES.md )
- [Commits](https://github.com/actions/toolkit/commits/HEAD/packages/core )
Updates `luxon` from 3.4.4 to 3.5.0
- [Changelog](https://github.com/moment/luxon/blob/master/CHANGELOG.md )
- [Commits](https://github.com/moment/luxon/compare/3.4.4...3.5.0 )
---
updated-dependencies:
- dependency-name: "@actions/core"
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
- dependency-name: luxon
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-10-15 15:59:22 -04:00
Lars Eggert
35074660dc
chore: Prevent test suite artifact creation in work directory ( #6438 )
...
* chore: Prevent test suite artifact creation in work directory
Also remove a few other stale test assets while I'm here.
* Try and fix CI
* Change IDSUBMIT_REPOSITORY_PATH
* Make the dir
* test: clean up media/nomcom directories
* test: de-dup settings_temp_path_overrides
* chore: remove debug
* refactor: avoid premature import of test_utils
* refactor: drop useless lambda wrapper
---------
Co-authored-by: Jennifer Richards <jennifer@staff.ietf.org>
2024-09-18 14:08:01 -05:00
Jennifer Richards
d8d52eedbf
feat: email ingestor api test endpoint ( #7915 )
...
* feat: email ingestor api test endpoint
* ci: add ingestion test token for sandbox
* chore: fix comments
2024-09-09 10:00:54 -05:00
Jennifer Richards
8f14dabcf5
ci: don't start if checks fail ( #7674 )
...
* ci: run checks when migrating
* ci: don't start if checks fail
2024-07-11 10:30:19 -05:00
Nicolas Giard
ec1238d4fd
ci: disable coverage chart generation ( #7672 )
2024-07-10 20:53:49 -04:00
Nicolas Giard
5cc436cfb9
ci: fix coverage-action node version
2024-07-10 17:29:37 -04:00
Jennifer Richards
9c95689baf
ci: run migrations via init container ( #7663 )
...
* chore: split auth/dt/migration start
* chore: migrations via init container
* chore: no checks before migration
* chore: indicate celery start
* chore: additional log output
2024-07-10 15:33:03 -05:00
dependabot[bot]
b6667a8ad2
chore(deps): bump tar in /dev/diff in the npm group across 1 directory ( #7587 )
...
Bumps the npm group with 1 update in the /dev/diff directory: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 7.1.0 to 7.4.0
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v7.1.0...v7.4.0 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-26 17:20:11 -04:00
dependabot[bot]
b0e2e1877f
chore(deps): bump tar ( #7586 )
...
Bumps the npm group with 1 update in the /dev/deploy-to-container directory: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 7.1.0 to 7.4.0
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v7.1.0...v7.4.0 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-26 17:19:49 -04:00
Jennifer Richards
c7d157e221
fix: enable gunicorn log config ( #7600 )
2024-06-26 16:02:26 -05:00
Jennifer Richards
6a96a69234
feat: improve / clean up logging ( #7591 )
...
* refactor: always use console log handler
* refactor: json for k8s, plain otherwise
* chore: remove syslog from wsgi.py
* chore: remove debug.log()
* chore: drop syslog from settings.py
* refactor: use log.log() in person.utils
* refactor: fetch_meeting_attendance->log.log()
* chore: gunicorn logs as JSON (wip)
* feat: better json log formatting
* refactor: improve log config
* feat: gunicorn access log fields
* fix: remove type hints
The gunicorn logger plays tricks with the
LogRecord args parameter to let it have string
keys instead of being a simple tuple.
The mypy tests rightly flag this. Rather
than fighting the typing, just remove the
hints and leave a comment warning not to
use the gunicorn-specific formatter with
other loggers.
2024-06-26 14:53:05 -05:00
Jennifer Richards
774fe78d3f
chore: gunicorn access logs / capture_output ( #7534 )
2024-06-14 10:43:06 -05:00
Jennifer Richards
c1941df7e7
chore: adjustments for k8s deployment ( #7531 )
...
* chore: handle TERM in datatracker-start.sh
* chore: delay celery start if migration needed
* chore: skip-checks when migrating
* chore: label beat/celery as deleteBeforeUpgrade
Used by the infra-k8s deployment process to flag
these as needing to be shut down before a new
release rolls out.
* chore: increase termination grace periods
2024-06-14 09:28:14 -05:00
Matthew Holloway
c1f1e1b830
fix: Formatting blockquotes in datatrackers rendered markdown ( #7500 )
...
* Formatting blockquotes in datatrackers rendered markdown
* Blockquote default formatting, with overrides for legacy blockquote
* Removing unnecessary 'richtext' CSS class
---------
Co-authored-by: Matthew Holloway <Matthew Holloway>
2024-06-06 15:42:23 -05:00
Nicolas Giard
d344f5fd3c
ci: fix deploy-to-container script
2024-05-16 16:34:38 -04:00
Jennifer Richards
b744f2b318
chore: switch back to uid/gid=1000
2024-05-13 21:41:36 -04:00
Jennifer Richards
dd46a8af6f
ci: use ietfa uid/gid for datatracker user ( #7407 )
...
* ci: use ietfa uid/gid for datatracker user
* chore: add comment
2024-05-13 21:41:36 -04:00
Jennifer Richards
8f87573144
ci: Fill in settings_local for docker
2024-05-13 21:41:36 -04:00
Jennifer Richards
c8ee43da95
ci: run datatracker pod as non-root user ( #7366 )
...
* feat: patch_libraries management command
* ci: Patch libraries in docker img build
* ci: non-root datatracker user
* ci: securityContext for datatracker pod
2024-05-13 21:41:36 -04:00
Jennifer Richards
9379bbad7d
ci: remove reminder comment
2024-05-13 21:41:36 -04:00
Jennifer Richards
6ccde89a68
ci: do not re-run yarn / collectstatics ( #7353 )
2024-05-13 21:41:36 -04:00
Jennifer Richards
ebaf6b5680
ci: quotes around shell parameters
2024-05-13 21:41:36 -04:00
Jennifer Richards
48f908020f
ci: collect statics when building image
2024-05-13 21:41:36 -04:00
Jennifer Richards
f58bbc3caa
ci: parameterize / update settings ( #7248 )
...
* ci: parameterize gunicorn in datatracker-start.sh
* fix: typo
* ci: update settings_local for helm chart
* ci: Add todo comment
* ci: Drop redundant USE_TZ setting
* ci: Require secrets in production
* ci: fix indentation
* style: Black
* ci: memcached cfg from env in settings.py
* ci: set SITE_URL in settings.py
* refactor: /www/htpasswd -> /a/www/htpasswd
(it's a symlink on production)
* refactor: Remove obsolete SECR_ settings
* refactor: SECR_MAX_UPLOAD_SIZE -> DATATRACKER_...
* refactor: SECR_PPT2PDF_COMMAND -> PPT2PDF_COMMAND
* ci: Fix up helm/settings_local
* ci: Remove commented-out settings
* ci: Refactor/improve env var guards
* ci: More env refactoring / guards
2024-05-13 21:41:36 -04:00
Jennifer Richards
e3d0290480
ci: install libreoffice ( #7262 )
...
Use bullseye-backports to get something more recent
(ietfa has 7.3.6.2; bullseye has 7.0.x.x;
bullseye-backports has 7.4.7.2)
2024-05-13 21:41:36 -04:00
Jennifer Richards
7a238a363e
ci: collectstatic --no-input ( #7252 )
2024-05-13 21:41:36 -04:00
Robert Sparks
1c90789b49
chore: reduce worker count and disable live checks for the datatracker pod ( #7240 )
2024-05-13 21:41:36 -04:00
Robert Sparks
b36ff61805
feat: use gunicorn ( #7215 )
...
* feat: use gunicorn
* fix: let gunicorn emit logs to stdout/stderr
* fix: log to stdout/stderr in json format
* fix: run collectstatic for the local copy of the statics
2024-05-13 21:41:36 -04:00
Nicolas Giard
f6db3e8e1b
ci: Update Dockerfile
2024-05-13 21:41:36 -04:00
Nicolas Giard
0faf4d868c
ci: Update Dockerfile
2024-05-13 21:41:36 -04:00
Jennifer Richards
bf74f2db31
ci: still need to chmod start.sh
2024-05-13 21:41:36 -04:00
Jennifer Richards
f980954336
ci: add missing "&&"
2024-05-13 21:41:36 -04:00
Robert Sparks
ff228a5913
feat: merge dt and celery container builds ( #6973 )
...
* feat: merge dt and celery container builds
* fix: mount /a instead of /assets
* feat: use consolidated script
* fix: get start.sh dependencies. Remove watchdog
* fix: correct source path
2024-05-13 21:41:36 -04:00
Jennifer Richards
661941dbf1
feat: Split datatracker/celery start scripts ( #6974 )
2024-05-13 21:41:36 -04:00
dependabot[bot]
5fbeb8cd90
chore(deps): bump tar in /dev/deploy-to-container in the npm group ( #7397 )
...
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:47 -04:00
dependabot[bot]
342905fef8
chore(deps): bump tar from 7.0.1 to 7.1.0 in /dev/diff in the npm group ( #7398 )
...
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 7.0.1 to 7.1.0
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v7.0.1...v7.1.0 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-minor
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-05-06 10:04:18 -04:00
dependabot[bot]
000e6b7dca
chore(deps): bump tar in /dev/deploy-to-container in the npm group ( #7323 )
...
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:30 -04:00
dependabot[bot]
64ff6b8e2e
chore(deps): bump tar from 6.2.1 to 7.0.1 in /dev/diff in the npm group ( #7325 )
...
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 6.2.1 to 7.0.1
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.1...v7.0.1 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-major
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-29 14:12:05 -04:00
Robert Sparks
cedd58f950
feat: obviate ghostlinkd ( #7336 )
...
* wip: identify whats needed to obviate ghostlinkd
* fix: hardlink new charter files to ftp directory
* fix: hardlink new charter files to ftp directory (continued)
* chore: bring settings comment up to date
* chore: add archive and ftp dirs to setup of various environments
* fix: test charter submits write to ftp dir
* chore: remove debug
* fix: test charter approval writes to ftp dir
* fix: link review revisions into ftp dir
* fix: link to all archive and ftp on submission post
* chore: clean comments, move action to github issue
* fix: link idindex files to all archive and ftp
* chore: deflake
* chore: remove TODO comment
* fix: use settings
* chore: rename new setting
2024-04-19 16:18:52 -05:00
dependabot[bot]
280481b924
chore(deps): bump nanoid in /dev/deploy-to-container in the npm group ( #7299 )
...
Bumps the npm group in /dev/deploy-to-container with 1 update: [nanoid](https://github.com/ai/nanoid ).
Updates `nanoid` from 5.0.6 to 5.0.7
- [Release notes](https://github.com/ai/nanoid/releases )
- [Changelog](https://github.com/ai/nanoid/blob/main/CHANGELOG.md )
- [Commits](https://github.com/ai/nanoid/compare/5.0.6...5.0.7 )
---
updated-dependencies:
- dependency-name: nanoid
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-10 17:05:32 -04:00
dependabot[bot]
960ede93e8
chore(deps): bump the npm group in /dev/diff with 1 update ( #7255 )
...
Bumps the npm group in /dev/diff with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 6.2.0 to 6.2.1
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.0...v6.2.1 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-02 13:32:37 -04:00
dependabot[bot]
ca98af431a
chore(deps): bump the npm group ( #7256 )
...
Bumps the npm group in /dev/deploy-to-container with 1 update: [tar](https://github.com/isaacs/node-tar ).
Updates `tar` from 6.2.0 to 6.2.1
- [Release notes](https://github.com/isaacs/node-tar/releases )
- [Changelog](https://github.com/isaacs/node-tar/blob/main/CHANGELOG.md )
- [Commits](https://github.com/isaacs/node-tar/compare/v6.2.0...v6.2.1 )
---
updated-dependencies:
- dependency-name: tar
dependency-type: direct:production
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-02 13:32:21 -04:00
dependabot[bot]
9e8c41aaee
chore(deps-dev): bump the npm group ( #7277 )
...
Bumps the npm group in /dev/coverage-action with 1 update: [npm-check-updates](https://github.com/raineorshine/npm-check-updates ).
Updates `npm-check-updates` from 16.14.17 to 16.14.18
- [Release notes](https://github.com/raineorshine/npm-check-updates/releases )
- [Changelog](https://github.com/raineorshine/npm-check-updates/blob/main/CHANGELOG.md )
- [Commits](https://github.com/raineorshine/npm-check-updates/compare/v16.14.17...v16.14.18 )
---
updated-dependencies:
- dependency-name: npm-check-updates
dependency-type: direct:development
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-02 13:32:10 -04:00
dependabot[bot]
cb84ad3f44
chore(deps-dev): bump the npm group ( #7228 )
...
Bumps the npm group in /dev/coverage-action with 1 update: [npm-check-updates](https://github.com/raineorshine/npm-check-updates ).
Updates `npm-check-updates` from 16.14.15 to 16.14.17
- [Release notes](https://github.com/raineorshine/npm-check-updates/releases )
- [Changelog](https://github.com/raineorshine/npm-check-updates/blob/main/CHANGELOG.md )
- [Commits](https://github.com/raineorshine/npm-check-updates/compare/v16.14.15...v16.14.17 )
---
updated-dependencies:
- dependency-name: npm-check-updates
dependency-type: direct:development
update-type: version-update:semver-patch
dependency-group: npm
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-21 02:13:44 -04:00