altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 3 Packages Projects Releases Wiki Activity
14886 commits 1 branch 0 tags 2.6 GiB
Commit graph

79 commits

Author SHA1 Message Date
Jim Fenton 0f1a6c960f
chore: Update test docs to postgresql; remove extraneous sqlite stuff (#5400) 
* chore: Update test docs to postgresql; remove extraneous sqlite stuff

* Reverted addition of settings_postgrestest.py to .gitignore
 2023-03-29 10:45:03 +09:00
Jennifer Richards 6b826fd985
refactor: Purge old migrations and update ci to build on a clean schema (#5431) 
* refactor: Remove all existing migrations

* refactor: Create clean set of migrations

* chore: Skip check_statetype_slugs when DB is not yet populated

* fix: Do not cache active_groups_menu on module import

* fix: Do not patch timezone awareness out of oidc-provider

* refactor: Migrate to create postgres schema, only use pgloader for data

* ci: Use migration scripts from feat/pg-migrations branch

* Revert "ci: Use migration scripts from feat/pg-migrations branch"

This reverts commit c82f64c614241ccede4865a50d494725c8a47c15.

* ci: Run check before migrate

* fix: Remove redundant migration caused by merge error

* chore: Add casts/ALTER TABLEs to eliminate pgloader errors/warnings

* chore: Change schema name to match docker image assumptions

* chore: Clear out schema so we get a clean start in case of a retry
 2023-03-28 18:06:07 +09:00
Robert Sparks 88a78cf1ab
Merge remote-tracking branch 'ietf-tools/main' into feat/postgres 2023-03-20 13:46:32 -05:00
Robert Sparks c3e6708b72
chore: change the way migrations are invoked for actions and dev builds (#5356) 2023-03-16 12:24:03 -05:00
Robert Sparks 82f23da2b3
Merge remote-tracking branch 'ietf-tools/main' into feat/postgres 2023-02-28 16:25:46 -06:00
Robert Sparks ad553ccdc0
fix: repair app container use of assets (#5241) 2023-02-28 15:01:16 -06:00
Robert Sparks 117bb2a5b8
ci: clean up after recent exploration. 2023-02-02 13:19:37 -06:00
Robert Sparks ec0f718191
ci: further pg_restore tuning 2023-02-02 11:59:41 -06:00
Robert Sparks 1d26aa0004
ci: change prestate before pg_restore 2023-02-02 11:30:41 -06:00
Robert Sparks 2ebe85872c
ci: let pgloader do all the clean and creation work 2023-02-02 10:52:13 -06:00
Nicolas Giard a1185a8eeb
ci: enable citext on db without schema 2023-02-02 04:05:00 -05:00
Nicolas Giard 58844720b6
ci: enable citext on public schema 2023-02-02 03:38:45 -05:00
Nicolas Giard fff220c7fd
ci: set schema search path before pg_restore 2023-02-02 03:09:41 -05:00
Nicolas Giard 85b352676b
ci: add citext pg extension to import script 2023-02-01 21:05:39 -05:00
Robert Sparks 24bb789cd2
feat: add citext to default db template (#5069) 2023-02-01 15:12:38 -06:00
Nicolas Giard 51b68d6365
ci: fix db-pg-migrate script to use pgdb instead of pg 2022-12-19 18:11:23 -05:00
Nicolas Giard c01054432b
ci: set pgloader workers to 3 2022-12-19 17:50:48 -05:00
Nicolas Giard 29731bf36d
ci: reduce pgloader workers arg to 1 2022-12-19 16:50:46 -05:00
Nicolas Giard 24c8738e1e
ci: fix db migrate script to use mysql first 2022-12-19 16:37:56 -05:00
Nicolas Giard cdef8f4114
ci: use lower batch size for pg migrate 2022-12-15 17:45:15 -05:00
Nicolas Giard 94d367000b
ci: add search path modif to db dump import 2022-12-15 15:43:25 -05:00
Nicolas Giard a60d52253e
chore: use prebuilt pg db image in dev (#4890) 2022-12-15 14:00:51 -06:00
Nicolas Giard 6f8caaf342
ci: add createdb to db-pg-import.sh 2022-12-14 02:13:44 +00:00
Nicolas Giard 96be49f9d3
ci: add dropdb to db-pg-import.sh 2022-12-14 02:02:21 +00:00
Nicolas Giard 6a70cefb55
ci: remove dropdb from db-pg-import.sh 2022-12-14 01:21:26 +00:00
Nicolas Giard b4bbd7a592
ci: fix pg_dump 2022-12-14 01:08:12 +00:00
Nicolas Giard 5e76cd47b7
ci: adapt db-pg.Dockerfile to import db dump 2022-12-14 00:54:39 +00:00
Nicolas Giard 9daa628d8b
ci: create export dump in db-pg-migrate.sh 2022-12-14 00:25:13 +00:00
Nicolas Giard 5d26f908c9
ci: remove quotes for batch size 2022-12-13 23:45:09 +00:00
Nicolas Giard 735c851e67
ci: pgloader set batch size 2022-12-13 23:38:30 +00:00
Nicolas Giard 4eae51f0be
ci: remove time from db-pg-migrate.sh 2022-12-13 18:07:43 -05:00
Nicolas Giard 0f5cfc80ee
ci: remove typo in dg-pg-migrate.sh 2022-12-13 18:01:13 -05:00
Nicolas Giard dc66d7506d
ci: use pgdb service container 2022-12-13 17:50:28 -05:00
Robert Sparks 912c7b5ee3
fix: simplify migrations when building postgres db image (#4889) 
* chore: remove the effectively unused DATABASE_TEST_OPTIONS setting

* fix: simplify default settings_local so that db-include-fix.py is not needed in CI

* fix: simplify migrations in db-pg-migrate.sh
 2022-12-13 17:37:24 -05:00
Nicolas Giard a42086bef2
ci: fix pg db data path 2022-12-13 21:42:53 +00:00
Nicolas Giard 3b76c64002
ci: improve pg db script 2022-12-13 20:50:37 +00:00
Nicolas Giard f2e9701302
ci: pg db nightly build script 2022-12-13 20:29:57 +00:00
Robert Sparks 15569771ff
Merge remote-tracking branch 'upstream/main' into feat/postgres 2022-12-12 09:54:49 -06:00
Robert Sparks 562d5cceeb
fix: include html when syncing extra assets 2022-12-02 16:28:08 -06:00
Robert Sparks abe640e57f
Merge remote-tracking branch 'upstream/main' into feat/postgres 2022-11-30 16:35:33 -06:00
Robert Sparks 2636c59f99
feat: stop supporting pre-tzaware migration database dumps. (#4782) 
* feat: stop supporting pre-tzaware migration database dumps.

* chore: remove unnecessary env variable
 2022-11-28 10:17:22 -06:00
Robert Sparks e35ab924d6
fix: deal with post 9.0.0 database dumps 2022-11-17 14:36:27 -06:00
Robert Sparks 27fccc6ba0
feat: move to postgresql (#4744) 
* feat: move to postgresql

* fix: repair fractional replace statement

* fix: use pathlib to manipulate settings_local

Co-authored-by: Jennifer Richards <jennifer@painless-security.com>

* fix: do two string replacements, not one followed by another that throws away the first.

Co-authored-by: Jennifer Richards <jennifer@painless-security.com>

* fix: use pathlib again to manipulate settings_local

Co-authored-by: Jennifer Richards <jennifer@painless-security.com>

* fix: properly use assert (1/2)

Co-authored-by: Jennifer Richards <jennifer@painless-security.com>

* fix: properly use assert (2/2)

Co-authored-by: Jennifer Richards <jennifer@painless-security.com>

Co-authored-by: Jennifer Richards <jennifer@painless-security.com>
 2022-11-11 11:01:01 +00:00
Robert Sparks eb4b523e66
chore: merge main (#4714) 2022-11-06 12:36:14 -06:00
Jennifer Richards 1366b6de38
Merge branch 'feat/tzaware' into jennifer/main-to-tzaware-conflicts 2022-09-14 12:36:33 -03:00
Lars Eggert 743484fb4c
fix: Suppress useradd/groupadd errors (#4408) 2022-09-06 12:04:30 -05:00
Robert Sparks 4bcf896fef
fix: manage initial container migration more carefully. (#4396) 2022-08-31 16:22:24 -03:00
Robert Sparks f7f0ca99d3
fix: don't migrate dumpinfo. automate migrations and setting USE_TZ. (#4389) 
* fix: don't migrate dumpinfo - it's already in UTC.

* chore: leave mode bits alone

* fix: migrate the container db, automating setting USE_TZ.
 2022-08-31 12:38:48 -03:00
Nicolas Giard 41ae0cfac1
ci: update baseline coverage on build + new file URL (#4365) 2022-08-25 09:58:16 -05:00
Nicolas Giard 9e55ec1fd4
chore: improve devcontainer build (#4241) 2022-07-23 10:33:41 -04:00