datatracker/ietf/utils
Lars Eggert 5598762608
fix: add more HTML validation & fixes (#3891)
* Update vnu.jar

* Fix py2 -> py3 issue

* Run pyupgrade

* test: Add default-jdk to images

* test: Add option to also validate HTML with vnu.jar

Since it's already installed in bin. Don't do this by default, since it
increases the time needed for tests by ~50%.

* fix: Stop the urlizer from urlizing in linkified mailto: text

* More HTML fixes

* More HTML validation fixes

* And more HTML fixes

* Fix floating badge

* Ignore unicode errors

* Only URLize docs that are existing

* Final fixes

* Don't URLize everything during test-crawl

* Feed HTML into vnu using python rather than Java to speed things up

* Allow test-crawl to start vnu on a different port

* Increase retry count to vnu. Restore batch size to 30.

* More HTML validation fixes

* Use urllib3 to make requests to vnu, since overriding requests_mock is tricky

* Undo commit of unmodified file

* Also urlize ftp links

* Fix matching of file name

* More HTML fixes

* Add `is_valid_url` filter

* weekday -> data-weekday

* urlencode URLs

* Add and use vnu_fmt_message. Bump vnu max buffer.

* Simplify doc_exists

* Don't add tab link to mail archive if the URL is invalid

* Run urlize_ietf_docs before linkify

Reduces the possibility of generating incorrect HTML

* Undo superfluous change

* Runner fixes

* Consolidate vnu message filtering into vnu_filter_message

* Correctly handle multiple persons with same name

* Minimze diff

* Fix HTML nits

* Print source snippet in vnu_fmt_message

* Only escape if there is something to escape

* Fix snippet

* Skip crufty old IPR declarations

* Only include modal when needed. Add handles.

* Fix wordwrap+linkification

* Update ietf/doc/templatetags/ietf_filters.py

* Update ietf/doc/templatetags/tests_ietf_filters.py

* Don't right-align second column
2022-05-03 13:55:48 -05:00
..
management chore: remove svn/trac infrastructure (#3649) (#3739) 2022-03-24 12:24:35 -05:00
migrations Reverted merge of timezone-aware migration efforts. 2021-01-12 16:54:20 +00:00
templatetags fix: Correctly linkify all current TLDs (#3868) 2022-04-26 12:25:18 -05:00
.gitignore * Moved utility functions into utils/ directory, and started breaking out 2007-05-11 15:48:45 +00:00
__init__.py Cleaned out some (arbitrary) submodule name imports into ietf.utils, and made the corresponding import statements import the names directly from the correct submodules. 2014-03-16 07:09:38 +00:00
accesstoken.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
admin.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
aliases.py Log Unicode exception instead of printing them to the console when they occur building the email alias files. 2021-03-09 21:19:11 +00:00
bootstrap.py And more fixes. 2022-02-01 07:47:25 +00:00
crawlurls.txt Merged in [19713] from lars@eggert.org: 2021-12-01 22:50:13 +00:00
db.py Guard against absent 'form_class' kwarg in IETFJSONField.formfield(). Commit ready for merge. 2021-11-18 15:54:46 +00:00
decorators.py Reverted merge of timezone-aware migration efforts. 2021-01-12 16:54:20 +00:00
draft.py Find references from submitted XML instead of rendering to text and parsing. Fixes #3342. Commit ready for merge. 2022-01-07 17:53:23 +00:00
draft_search.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
fields.py More fixes. 2022-01-28 13:00:47 +00:00
hedgedoc.py Add timeouts to requests library calls. Fixes #3498. Commit ready for merge. 2022-01-13 15:06:28 +00:00
history.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
html.py More fixes 2022-01-12 11:54:00 +00:00
jstest.py fix: offset scrollspy so righthand-nav highlights the correct entry (#3820) 2022-04-14 15:35:07 -03:00
log.py Updated log.assertion() to provide an exception object (under Py3, it seems that logging.Logger instances ignore the traceback if there isn't also an exception object). Added a check for unset draft-iesg state to Document.set_state(). 2020-09-18 14:15:02 +00:00
mail.py More select2 and test fixes. 2021-12-14 18:19:12 +00:00
markdown.py Add ability to import session minutes from notes.ietf.org. Mock out calls to the requests library in tests. Call markdown library through a util method. Fixes #3489. Commit ready for merge. 2021-12-09 17:16:19 +00:00
markup_txt.py Many more HTML fixes. 2022-02-03 07:49:34 +00:00
meetecho.py Use correct UTC time when creating Meetecho conferences. Fixes #3565. Commit ready for merge. 2022-02-23 20:51:18 +00:00
mime.py Merged in ^/trunk@17617. 2020-04-14 17:11:51 +00:00
models.py Added a utility function to convert objects to dictionaries (for comparison, for instance) 2020-03-19 22:42:43 +00:00
ordereddict.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
patch.py Made the patch utility return information to distinguish already patched files from successful patch application, and modified our checks extensions to signal when patches have been applied and a ccommand needs to be re-run. 2020-08-20 11:36:46 +00:00
pdf.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
pipe.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
resources.py Added 'from __future__' imports all over the place, to bring code behaviour into closer alignment between python2 and python3 2019-07-15 15:40:51 +00:00
response.py test: Validate HTML rendered during tests (#3782) 2022-04-07 13:30:38 -03:00
serialize.py Reverted merge of timezone-aware migration efforts. 2021-01-12 16:54:20 +00:00
storage.py Added a pylint rc-file, and fixed or silenced a number of issues found by pylint using the settings .pylintrc (which enable only error checking). 2016-09-08 14:48:59 +00:00
test_data.py Allow configuration of group conflict types used for each meeting Fixes #2770. Commit ready for merge. 2021-07-30 17:50:24 +00:00
test_draft_with_references_v2.xml Find references from submitted XML instead of rendering to text and parsing. Fixes #3342. Commit ready for merge. 2022-01-07 17:53:23 +00:00
test_draft_with_references_v3.xml Merged in [19895] from jennifer@painless-security.com: 2022-01-31 16:54:14 +00:00
test_runner.py fix: add more HTML validation & fixes (#3891) 2022-05-03 13:55:48 -05:00
test_smtpserver.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
test_textupload.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
test_utils.py test: Validate HTML rendered during tests (#3782) 2022-04-07 13:30:38 -03:00
tests.py feat: redirect to release information at github (#3746) 2022-03-24 16:38:33 -04:00
tests_hedgedoc.py Add ability to import session minutes from notes.ietf.org. Mock out calls to the requests library in tests. Call markdown library through a util method. Fixes #3489. Commit ready for merge. 2021-12-09 17:16:19 +00:00
tests_meetecho.py Use correct UTC time when creating Meetecho conferences. Fixes #3565. Commit ready for merge. 2022-02-23 20:51:18 +00:00
tests_restapi.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
texescape.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
text.py fix: add more HTML validation & fixes (#3891) 2022-05-03 13:55:48 -05:00
textupload.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
timezone.py Reverted merge of timezone-aware migration efforts. 2021-01-12 16:54:20 +00:00
urls.py Removed all __future__ imports. 2020-03-05 23:53:42 +00:00
validators.py Snapshot of dev work to add session purpose annotation 2021-10-12 17:08:58 +00:00
xmldraft.py Merged in [19895] from jennifer@painless-security.com: 2022-01-31 16:54:14 +00:00