Commit graph

41 commits

Author SHA1 Message Date
Jennifer Richards 232a861f8a
chore: config gunicorn secure_scheme_headers (#8632)
* chore: config gunicorn secure_scheme_headers

* chore: typo in comment
2025-03-03 12:51:14 -06:00
rjsparks 826f4d8747 ci: update base image target version to 20250128T1728 2025-01-28 17:39:50 +00:00
rjsparks 03d6d598ed ci: update base image target version to 20250117T1516 2025-01-17 15:28:12 +00:00
rjsparks d1d33e7ad5 ci: update base image target version to 20250116T2033 2025-01-16 20:44:55 +00:00
rjsparks a2f27d3d51 ci: update base image target version to 20241212T1741 2024-12-12 17:53:09 +00:00
rjsparks 6b77807c05 ci: update base image target version to 20241210T1557 2024-12-10 16:08:48 +00:00
Jennifer Richards 167752ba76
feat: log ASN (#8309)
* feat: log ip_src_asnum in nginx

* feat: log asn from gunicorn
2024-12-06 11:17:55 -06:00
rjsparks e5b6e330b1 ci: update base image target version to 20241127T2054 2024-11-27 21:05:52 +00:00
rjsparks 15f3ebd2d5 ci: update base image target version to 20241127T0116 2024-11-27 01:27:15 +00:00
Jennifer Richards 4b57602404
chore: log in-flight request lists on worker term (#8272)
* chore: log in-flight request lists on worker term

* style: Black

* chore: suppress empty in-flight logs

* chore: use list consistently
2024-11-25 12:51:44 -06:00
Nicolas Giard bdf753e052
chore: set gitattributes for normalizing line endings (#8245)
* chore: add proper .gitattributes

* chore: normalize file endings

* chore: fix .gitattributes

* chore: normalize file endings (2)
2024-11-20 16:48:00 -06:00
NGPixel 84a5aa3805 ci: update base image target version to 20241114T1954 2024-11-14 20:05:03 +00:00
Jennifer Richards 7293e10a64
feat: log start of gunicorn request (#8154)
* feat: log start of gunicorn request

* feat: add query string
2024-11-04 16:46:23 +00:00
NGPixel 0d43663e9b ci: update base image target version to 20241029T1632 2024-10-29 16:43:21 +00:00
Jennifer Richards 8ec185cbb9
ci: fixed base image for prod (#8103) 2024-10-28 15:24:14 -05:00
Jennifer Richards 8f14dabcf5
ci: don't start if checks fail (#7674)
* ci: run checks when migrating

* ci: don't start if checks fail
2024-07-11 10:30:19 -05:00
Jennifer Richards 9c95689baf
ci: run migrations via init container (#7663)
* chore: split auth/dt/migration start

* chore: migrations via init container

* chore: no checks before migration

* chore: indicate celery start

* chore: additional log output
2024-07-10 15:33:03 -05:00
Jennifer Richards c7d157e221
fix: enable gunicorn log config (#7600) 2024-06-26 16:02:26 -05:00
Jennifer Richards 6a96a69234
feat: improve / clean up logging (#7591)
* refactor: always use console log handler

* refactor: json for k8s, plain otherwise

* chore: remove syslog from wsgi.py

* chore: remove debug.log()

* chore: drop syslog from settings.py

* refactor: use log.log() in person.utils

* refactor: fetch_meeting_attendance->log.log()

* chore: gunicorn logs as JSON (wip)

* feat: better json log formatting

* refactor: improve log config

* feat: gunicorn access log fields

* fix: remove type hints

The gunicorn logger plays tricks with the
LogRecord args parameter to let it have string
keys instead of being a simple tuple.
The mypy tests rightly flag this. Rather
than fighting the typing, just remove the
hints and leave a comment warning not to
use the gunicorn-specific formatter with
other loggers.
2024-06-26 14:53:05 -05:00
Jennifer Richards 774fe78d3f
chore: gunicorn access logs / capture_output (#7534) 2024-06-14 10:43:06 -05:00
Jennifer Richards c1941df7e7
chore: adjustments for k8s deployment (#7531)
* chore: handle TERM in datatracker-start.sh

* chore: delay celery start if migration needed

* chore: skip-checks when migrating

* chore: label beat/celery as deleteBeforeUpgrade

Used by the infra-k8s deployment process to flag
these as needing to be shut down before a new
release rolls out.

* chore: increase termination grace periods
2024-06-14 09:28:14 -05:00
Jennifer Richards b744f2b318 chore: switch back to uid/gid=1000 2024-05-13 21:41:36 -04:00
Jennifer Richards dd46a8af6f ci: use ietfa uid/gid for datatracker user (#7407)
* ci: use ietfa uid/gid for datatracker user

* chore: add comment
2024-05-13 21:41:36 -04:00
Jennifer Richards 8f87573144 ci: Fill in settings_local for docker 2024-05-13 21:41:36 -04:00
Jennifer Richards c8ee43da95 ci: run datatracker pod as non-root user (#7366)
* feat: patch_libraries management command

* ci: Patch libraries in docker img build

* ci: non-root datatracker user

* ci: securityContext for datatracker pod
2024-05-13 21:41:36 -04:00
Jennifer Richards 9379bbad7d ci: remove reminder comment 2024-05-13 21:41:36 -04:00
Jennifer Richards 6ccde89a68 ci: do not re-run yarn / collectstatics (#7353) 2024-05-13 21:41:36 -04:00
Jennifer Richards ebaf6b5680 ci: quotes around shell parameters 2024-05-13 21:41:36 -04:00
Jennifer Richards 48f908020f ci: collect statics when building image 2024-05-13 21:41:36 -04:00
Jennifer Richards f58bbc3caa ci: parameterize / update settings (#7248)
* ci: parameterize gunicorn in datatracker-start.sh

* fix: typo

* ci: update settings_local for helm chart

* ci: Add todo comment

* ci: Drop redundant USE_TZ setting

* ci: Require secrets in production

* ci: fix indentation

* style: Black

* ci: memcached cfg from env in settings.py

* ci: set SITE_URL in settings.py

* refactor: /www/htpasswd -> /a/www/htpasswd

(it's a symlink on production)

* refactor: Remove obsolete SECR_ settings

* refactor: SECR_MAX_UPLOAD_SIZE -> DATATRACKER_...

* refactor: SECR_PPT2PDF_COMMAND -> PPT2PDF_COMMAND

* ci: Fix up helm/settings_local

* ci: Remove commented-out settings

* ci: Refactor/improve env var guards

* ci: More env refactoring / guards
2024-05-13 21:41:36 -04:00
Jennifer Richards e3d0290480 ci: install libreoffice (#7262)
Use bullseye-backports to get something more recent
(ietfa has 7.3.6.2; bullseye has 7.0.x.x;
bullseye-backports has 7.4.7.2)
2024-05-13 21:41:36 -04:00
Jennifer Richards 7a238a363e ci: collectstatic --no-input (#7252) 2024-05-13 21:41:36 -04:00
Robert Sparks 1c90789b49 chore: reduce worker count and disable live checks for the datatracker pod (#7240) 2024-05-13 21:41:36 -04:00
Robert Sparks b36ff61805 feat: use gunicorn (#7215)
* feat: use gunicorn

* fix: let gunicorn emit logs to stdout/stderr

* fix: log to stdout/stderr in json format

* fix: run collectstatic for the local copy of the statics
2024-05-13 21:41:36 -04:00
Nicolas Giard f6db3e8e1b ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Nicolas Giard 0faf4d868c ci: Update Dockerfile 2024-05-13 21:41:36 -04:00
Jennifer Richards bf74f2db31 ci: still need to chmod start.sh 2024-05-13 21:41:36 -04:00
Jennifer Richards f980954336 ci: add missing "&&" 2024-05-13 21:41:36 -04:00
Robert Sparks ff228a5913 feat: merge dt and celery container builds (#6973)
* feat: merge dt and celery container builds

* fix: mount /a instead of /assets

* feat: use consolidated script

* fix: get start.sh dependencies. Remove watchdog

* fix: correct source path
2024-05-13 21:41:36 -04:00
Jennifer Richards 661941dbf1 feat: Split datatracker/celery start scripts (#6974) 2024-05-13 21:41:36 -04:00
Nicolas Giard e3de3943e2
ci: add release docker image build + base helm template 2024-01-25 21:57:10 -05:00