Commit graph

178 commits

Author SHA1 Message Date
Nicolas Giard 8a7f67d4d1
test: make tests run without root access (#3968) 2022-05-14 08:11:44 -05:00
Nicolas Giard f1472ffcac
chore: run devcontainer as user vscode instead of root (#3948) 2022-05-13 14:13:50 -05:00
Lars Eggert 5598762608
fix: add more HTML validation & fixes (#3891)
* Update vnu.jar

* Fix py2 -> py3 issue

* Run pyupgrade

* test: Add default-jdk to images

* test: Add option to also validate HTML with vnu.jar

Since it's already installed in bin. Don't do this by default, since it
increases the time needed for tests by ~50%.

* fix: Stop the urlizer from urlizing in linkified mailto: text

* More HTML fixes

* More HTML validation fixes

* And more HTML fixes

* Fix floating badge

* Ignore unicode errors

* Only URLize docs that are existing

* Final fixes

* Don't URLize everything during test-crawl

* Feed HTML into vnu using python rather than Java to speed things up

* Allow test-crawl to start vnu on a different port

* Increase retry count to vnu. Restore batch size to 30.

* More HTML validation fixes

* Use urllib3 to make requests to vnu, since overriding requests_mock is tricky

* Undo commit of unmodified file

* Also urlize ftp links

* Fix matching of file name

* More HTML fixes

* Add `is_valid_url` filter

* weekday -> data-weekday

* urlencode URLs

* Add and use vnu_fmt_message. Bump vnu max buffer.

* Simplify doc_exists

* Don't add tab link to mail archive if the URL is invalid

* Run urlize_ietf_docs before linkify

Reduces the possibility of generating incorrect HTML

* Undo superfluous change

* Runner fixes

* Consolidate vnu message filtering into vnu_filter_message

* Correctly handle multiple persons with same name

* Minimze diff

* Fix HTML nits

* Print source snippet in vnu_fmt_message

* Only escape if there is something to escape

* Fix snippet

* Skip crufty old IPR declarations

* Only include modal when needed. Add handles.

* Fix wordwrap+linkification

* Update ietf/doc/templatetags/ietf_filters.py

* Update ietf/doc/templatetags/tests_ietf_filters.py

* Don't right-align second column
2022-05-03 13:55:48 -05:00
Lars Eggert 84d6118d9f
test: Also rsync bofreq (#3902) 2022-04-28 11:09:11 -05:00
Nicolas Giard 8ea883cb7e
chore: switch to Yarn 3 (#3819)
* refactor: switch to yarn 3

* chore: add other os+cpu to yarn supported architectures

* chore: add gitattributes

* chore: add missing yarn native modules rebuild step

* chore: replace npx with yarn in test_runner + update readme

* chore: remove bootstrap-datepicker github dependency, use local instead
2022-04-25 15:54:05 -05:00
Lars Eggert f8c06fa5cf
fix: Use unique data-sort attributes (#3836)
* fix: Use unique `data-sort` attributes

So list.js properly sorts columns.

* Address @rjsparks' comments
2022-04-19 10:16:32 -05:00
Nicolas Giard b44fc55b79
docs: add command to disable git info in zsh prompt 2022-04-18 19:23:03 -04:00
Nicolas Giard 05f19daed8
docs: update docker dev instructions 2022-04-07 17:28:57 -04:00
Nicolas Giard 92f0ff6861
chore: add fix-missing to apt update in docker (#3796) 2022-04-07 16:16:39 -05:00
Lars Eggert 3234f1a121
test: Validate HTML rendered during tests (#3782) 2022-04-07 13:30:38 -03:00
Nicolas Giard b65182150f
chore: remove legacy / deprecated files (#3781)
* chore: remove changelog files

* chore: remove data dir from source

* chore: exclude /data completely in gitignore
2022-04-05 15:45:01 -04:00
Nicolas Giard 82cbf05c3f
chore: add release-coverage.json fetch on tests + dev 2022-04-04 16:11:35 -04:00
Jennifer Richards fb41207227
ci: chown npm-related paths to owner of /workspace in app container (#3768) 2022-03-30 18:38:05 -03:00
Nicolas Giard 9a4505dc74
chore: remove svn/trac infrastructure (#3649) (#3739)
* chore: Remove svn/trac related infrastructure

* chore: Remove more svn/trac infrastructure

* fix: remove commented out Trac requirement
2022-03-24 12:24:35 -05:00
Nicolas Giard 54b498fd6a
chore: allow custom port for dev docker run (#3722) 2022-03-23 18:11:09 -04:00
Lars Eggert f516f86a17
ci: Add vnu to dev + test docker image (#3724)
* ci: Add vnu to dev docker image

* Use default-jdk from apt, and just download the vnu JAR blob
2022-03-22 13:13:28 -04:00
Lars Eggert eb5423d084
ci: Also check generated HTML with the "vnu" validator (#3682)
* ci: Also check generated HTML with the "vnu" validator

Because HTML Tidy apparently misses a bunch of errors.

* thead -> tbody

* More fixes

* More fixes

* Start checker in test runner
2022-03-21 12:50:23 -05:00
Nicolas Giard 562742d653
chore: add memcached + docker-cli to dev container (#3691) 2022-03-19 13:05:59 -04:00
Lars Eggert 05c643964b
ci: Run the test suite for PRs and pushes (#3658)
Co-authored-by: Nicolas Giard <github@ngpixel.com>
2022-03-19 07:09:15 -04:00
Nicolas Giard dc51587596
ci: fix app-create-dirs.sh 2022-03-17 00:23:20 -04:00
Nicolas Giard f8c0a95802
ci: extract dev/tests dir creation script 2022-03-17 00:17:05 -04:00
NGPixel 1771d6ea77
chore: improve dev docker for offline + other fixes 2022-03-15 22:22:30 -04:00
Nicolas Giard e6584bb717
chore: bring docker-compose to root level (#3642) 2022-03-14 17:02:53 -05:00
NGPixel 9ae07e44e6
chore: fix node_modules volume for docker dev 2022-03-10 13:03:45 -05:00
NGPixel ee92d8658d
chore: fix docker dev boot for parcel build 2022-03-09 18:04:18 -05:00
Jennifer Richards 3906bbdc4f Merge remote-tracking branch 'origin/main' into personal/jennifer/7.45.1.dev0.bootstrap-merge
# Conflicts:
#	bootstrap/package.json
#	ietf/templates/meeting/session_buttons_include.html
2022-03-07 16:24:30 -04:00
Nicolas Giard dc7e3b9fac
docs: update docker README 2022-03-04 16:50:20 -05:00
Nicolas Giard 0286af342a
chore: point datatracker dev db image to nightly github package
[skip ci]
2022-03-04 15:18:27 -05:00
Jennifer Richards 6c260a5b7e Merge 7.45.1.dev0 into Bootstrap 5 update branch. Made a first pass at reconciling differences.
- Legacy-Id: 19945
2022-02-17 20:09:49 +00:00
Lars Eggert 67ebadeadd A bunch more cosmetic fixes.
- Legacy-Id: 19913
2022-02-09 10:11:03 +00:00
Lars Eggert bbf088e18b Hopefully the final check-ins.
- Legacy-Id: 19909
2022-02-08 17:29:15 +00:00
Lars Eggert 64d2ba2558 Run tidy as part of tests, and fix HTML issues it finds.
- Legacy-Id: 19904
2022-02-01 16:11:34 +00:00
Robert Sparks 877d8800ce Add de-gfm to the docker setup. Fixes #3494. Commit ready for merge.
- Legacy-Id: 19863
2022-01-19 19:44:28 +00:00
Robert Sparks 2a0d54afcd Merged in [19811] from lars@eggert.org:
When using Docker, the runserver isn't being accessed over loopback, so we need
to initialize INTERNAL_IPS based on the current interface configuration.
 - Legacy-Id: 19814
Note: SVN reference [19811] has been migrated to Git commit 46ca676736
2022-01-06 20:54:53 +00:00
Lars Eggert 46ca676736 When using Docker, the runserver isn't being accessed over loopback, so we need
to initialize INTERNAL_IPS based on the current interface configuration.

Commit ready for merge.
 - Legacy-Id: 19811
2022-01-06 11:20:49 +00:00
nick 9e89f33869 fix: missing dependencies in dockerfile from changeset #19767
Commit ready for merge.
 - Legacy-Id: 19801
2022-01-04 18:44:27 +00:00
nick a9fd21ef2a misc: new README.md + docker dir cleanup
Commit ready for merge.
 - Legacy-Id: 19793
2021-12-21 01:55:31 +00:00
Robert Sparks 47aadd0066 Merged in [19761] from nick@staff.ietf.org:
fix: skip chromedriver install if arch is not supported in docker build
 - Legacy-Id: 19764
Note: SVN reference [19761] has been migrated to Git commit 516877d2db
2021-12-09 17:26:38 +00:00
nick 516877d2db fix: skip chromedriver install if arch is not supported in docker build
Commit ready for merge.
 - Legacy-Id: 19761
2021-12-08 20:13:44 +00:00
Robert Sparks c0df2cd300 Merged in [19741] from lars@eggert.org:
Add ghostscript to app image, which is used by some tests.
 - Legacy-Id: 19745
Note: SVN reference [19741] has been migrated to Git commit e3b430d2ec
2021-12-02 20:47:07 +00:00
Lars Eggert e3b430d2ec Add ghostscript to app image, which is used by some tests.
Commit ready for merge.
 - Legacy-Id: 19741
2021-12-02 08:09:08 +00:00
nick db34d83feb feat: cypress JS testing for agenda meetings + weekview swimlane (WIP)
- Legacy-Id: 19693
2021-11-18 23:48:23 +00:00
Lars Eggert 273feec52d No need for bower anymore.
- Legacy-Id: 19650
2021-11-12 12:01:35 +00:00
Robert Sparks 36bf80e9a5 Add a command to clean all datatracker related docker resources (from nick@staff.ietf.org)
- Legacy-Id: 19644
2021-11-11 18:53:36 +00:00
Robert Sparks d7d28a56ad revert docker project name. Will make a more comprehensive change later
- Legacy-Id: 19643
2021-11-11 18:52:34 +00:00
Robert Sparks 536d787ab5 Explicitly specify a docker project for compose
- Legacy-Id: 19641
2021-11-11 18:25:09 +00:00
Robert Sparks 164ee7792c Adjust docker volume mounting strategy.
- Legacy-Id: 19638
2021-11-11 17:20:20 +00:00
Robert Sparks 13d4e636bc Docker related changes: Mark cleandb executable. Clean settings_local and settings_local_sqlitetest of flakes and types issues.
- Legacy-Id: 19637
2021-11-11 16:35:30 +00:00
nick d52ad4fbc2 misc: import docker improvements from 7.39.1.dev2
- Legacy-Id: 19629
2021-11-10 21:51:55 +00:00
Robert Sparks 017da873ce Merged in [19581] from nick@staff.ietf.org:
fix: docker build - cannot change locale warnings
 - Legacy-Id: 19601
Note: SVN reference [19581] has been migrated to Git commit 4b1918b79d
2021-11-09 20:57:08 +00:00