Commit graph

272 commits

Author SHA1 Message Date
Jim Fenton 0f1a6c960f
chore: Update test docs to postgresql; remove extraneous sqlite stuff (#5400)
* chore: Update test docs to postgresql; remove extraneous sqlite stuff

* Reverted addition of settings_postgrestest.py to .gitignore
2023-03-29 10:45:03 +09:00
Jennifer Richards 6b826fd985
refactor: Purge old migrations and update ci to build on a clean schema (#5431)
* refactor: Remove all existing migrations

* refactor: Create clean set of migrations

* chore: Skip check_statetype_slugs when DB is not yet populated

* fix: Do not cache active_groups_menu on module import

* fix: Do not patch timezone awareness out of oidc-provider

* refactor: Migrate to create postgres schema, only use pgloader for data

* ci: Use migration scripts from feat/pg-migrations branch

* Revert "ci: Use migration scripts from feat/pg-migrations branch"

This reverts commit c82f64c614241ccede4865a50d494725c8a47c15.

* ci: Run check before migrate

* fix: Remove redundant migration caused by merge error

* chore: Add casts/ALTER TABLEs to eliminate pgloader errors/warnings

* chore: Change schema name to match docker image assumptions

* chore: Clear out schema so we get a clean start in case of a retry
2023-03-28 18:06:07 +09:00
Robert Sparks 736382a13e
fix: default settings_local needs a pyflakes ignore (#5381) 2023-03-20 17:19:49 -05:00
Robert Sparks 88a78cf1ab
Merge remote-tracking branch 'ietf-tools/main' into feat/postgres 2023-03-20 13:46:32 -05:00
Robert Sparks c3e6708b72
chore: change the way migrations are invoked for actions and dev builds (#5356) 2023-03-16 12:24:03 -05:00
Robert Sparks 82f23da2b3
Merge remote-tracking branch 'ietf-tools/main' into feat/postgres 2023-02-28 16:25:46 -06:00
Robert Sparks ad553ccdc0
fix: repair app container use of assets (#5241) 2023-02-28 15:01:16 -06:00
Robert Sparks f010766654
Merge remote-tracking branch 'ietf-tools/main' into feat/postgres 2023-02-27 12:55:47 -06:00
Lars Eggert 1fb5bd7429
fix: Use the location app-rsync-extras.sh uses for the I-D archive (#5161) 2023-02-16 09:04:20 -06:00
Robert Sparks e1206fa91e
Merge remote-tracking branch 'upstream/main' into feat/postgres 2023-02-13 09:17:05 -06:00
Nicolas Giard d98dc6fb10
ci: remove duplicate pg client tools from app image 2023-02-07 17:34:38 -05:00
Nicolas Giard 6513b4dbb1
ci: add pg client tools to base image 2023-02-07 17:33:45 -05:00
Nicolas Giard 9e340cd0e4
ci: add pg client to base app image 2023-02-07 17:00:54 -05:00
Robert Sparks 117bb2a5b8
ci: clean up after recent exploration. 2023-02-02 13:19:37 -06:00
Robert Sparks ec0f718191
ci: further pg_restore tuning 2023-02-02 11:59:41 -06:00
Robert Sparks 1d26aa0004
ci: change prestate before pg_restore 2023-02-02 11:30:41 -06:00
Robert Sparks 2ebe85872c
ci: let pgloader do all the clean and creation work 2023-02-02 10:52:13 -06:00
Nicolas Giard a1185a8eeb
ci: enable citext on db without schema 2023-02-02 04:05:00 -05:00
Nicolas Giard 58844720b6
ci: enable citext on public schema 2023-02-02 03:38:45 -05:00
Nicolas Giard fff220c7fd
ci: set schema search path before pg_restore 2023-02-02 03:09:41 -05:00
Nicolas Giard 85b352676b
ci: add citext pg extension to import script 2023-02-01 21:05:39 -05:00
Robert Sparks 24bb789cd2
feat: add citext to default db template (#5069) 2023-02-01 15:12:38 -06:00
Nicolas Giard 51b68d6365
ci: fix db-pg-migrate script to use pgdb instead of pg 2022-12-19 18:11:23 -05:00
Nicolas Giard c01054432b
ci: set pgloader workers to 3 2022-12-19 17:50:48 -05:00
Nicolas Giard 29731bf36d
ci: reduce pgloader workers arg to 1 2022-12-19 16:50:46 -05:00
Nicolas Giard 24c8738e1e
ci: fix db migrate script to use mysql first 2022-12-19 16:37:56 -05:00
Nicolas Giard cdef8f4114
ci: use lower batch size for pg migrate 2022-12-15 17:45:15 -05:00
Nicolas Giard 94d367000b
ci: add search path modif to db dump import 2022-12-15 15:43:25 -05:00
Nicolas Giard 233ac51ab2
chore: modify cleandb script to remove pg volume 2022-12-15 15:05:13 -05:00
Nicolas Giard a60d52253e
chore: use prebuilt pg db image in dev (#4890) 2022-12-15 14:00:51 -06:00
Nicolas Giard 6f8caaf342
ci: add createdb to db-pg-import.sh 2022-12-14 02:13:44 +00:00
Nicolas Giard 96be49f9d3
ci: add dropdb to db-pg-import.sh 2022-12-14 02:02:21 +00:00
Nicolas Giard 6a70cefb55
ci: remove dropdb from db-pg-import.sh 2022-12-14 01:21:26 +00:00
Nicolas Giard b4bbd7a592
ci: fix pg_dump 2022-12-14 01:08:12 +00:00
Nicolas Giard 5e76cd47b7
ci: adapt db-pg.Dockerfile to import db dump 2022-12-14 00:54:39 +00:00
Nicolas Giard 9daa628d8b
ci: create export dump in db-pg-migrate.sh 2022-12-14 00:25:13 +00:00
Nicolas Giard 5d26f908c9
ci: remove quotes for batch size 2022-12-13 23:45:09 +00:00
Nicolas Giard 735c851e67
ci: pgloader set batch size 2022-12-13 23:38:30 +00:00
Nicolas Giard 4eae51f0be
ci: remove time from db-pg-migrate.sh 2022-12-13 18:07:43 -05:00
Nicolas Giard 0f5cfc80ee
ci: remove typo in dg-pg-migrate.sh 2022-12-13 18:01:13 -05:00
Nicolas Giard dc66d7506d
ci: use pgdb service container 2022-12-13 17:50:28 -05:00
Robert Sparks 912c7b5ee3
fix: simplify migrations when building postgres db image (#4889)
* chore: remove the effectively unused DATABASE_TEST_OPTIONS setting

* fix: simplify default settings_local so that db-include-fix.py is not needed in CI

* fix: simplify migrations in db-pg-migrate.sh
2022-12-13 17:37:24 -05:00
Nicolas Giard f09ad380c6
ci: fix pg db pgdata path 2022-12-13 21:51:59 +00:00
Nicolas Giard a42086bef2
ci: fix pg db data path 2022-12-13 21:42:53 +00:00
Nicolas Giard 3b76c64002
ci: improve pg db script 2022-12-13 20:50:37 +00:00
Nicolas Giard f2e9701302
ci: pg db nightly build script 2022-12-13 20:29:57 +00:00
Robert Sparks 15569771ff
Merge remote-tracking branch 'upstream/main' into feat/postgres 2022-12-12 09:54:49 -06:00
Robert Sparks e257ddbfea
fix: restore sql_debug functionality from the container (#4835) 2022-12-06 08:48:23 -06:00
Robert Sparks 562d5cceeb
fix: include html when syncing extra assets 2022-12-02 16:28:08 -06:00
Robert Sparks abe640e57f
Merge remote-tracking branch 'upstream/main' into feat/postgres 2022-11-30 16:35:33 -06:00