altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 5 Packages Projects Releases Wiki Activity
13413 commits 1 branch 0 tags 2.6 GiB
Commit graph

910 commits

Author SHA1 Message Date
Robert Sparks 99df95d542 Cleaned up created names. Improved validation during migration. Cleaned up migration output. Cleaned the last of the awp includes from secr views. Removed now unused secr templates. Build extresource urls correctly during submission and when creating group wikis. 
- Legacy-Id: 18158
 2020-07-13 16:03:39 +00:00
Henrik Levkowetz 1e1f056053 Changed the subclass of lxml.html.clean.Cleaner() to adapt to changes in the superclass in v4.5.2 
- Legacy-Id: 18146
 2020-07-11 20:20:50 +00:00
Robert Sparks 53f7bc3ce6 migrated forward 
- Legacy-Id: 18144
 2020-07-09 21:07:05 +00:00
Henrik Levkowetz 1654f9319e Reworked the support for remote access urls in the agenda_note and remote_instructions fields of Session objects so as to accept any of a list of conference service domains as remote call-in URLs -- not only webex. 
- Legacy-Id: 18119
 2020-07-01 14:17:01 +00:00
Henrik Levkowetz 0924640676 Removed the command to purge request_profiler entries, given that request_profiler is incompatible with Django 2.2 
- Legacy-Id: 18107
 2020-06-30 14:34:15 +00:00
Henrik Levkowetz cb9006eb26 Changed skip messages from test suites to use print() instead of sys.stderr.write(), to match other output from the test runner. 
- Legacy-Id: 18087
 2020-06-27 17:32:02 +00:00
Henrik Levkowetz dc5ca4eebc Merged in Django 2.1 upgrade changes. 
- Legacy-Id: 18060
 2020-06-24 20:51:00 +00:00
Henrik Levkowetz 6459638fad Adjusted the code to the 2.1 attribute name change from ._size to .size in upload file objects. 
- Legacy-Id: 18054
 2020-06-24 20:42:05 +00:00
Robert Sparks bf53bf1057 Merged forward. Added some missing parts to the XMPPURLValidator. 
- Legacy-Id: 18050
 2020-06-24 19:01:45 +00:00
Henrik Levkowetz 595dcb75e9 Fixed a silly bug in [18040]. 'settings' isn't a dictionary. 
- Legacy-Id: 18043
Note: SVN reference [18040] has been migrated to Git commit e1ed51b0b6
 2020-06-23 21:16:02 +00:00
Henrik Levkowetz e1ed51b0b6 Fixed a logging issue when running the test crawler. 
- Legacy-Id: 18040
 2020-06-23 20:38:33 +00:00
Henrik Levkowetz bf230a738b Added a test suite switch to optionally show logging output. Normally this is suppressed while running tests. In production, it goes to syslog's user facility. With --show-logging, it will go to the console when running tests. 
- Legacy-Id: 18010
 2020-06-17 15:05:57 +00:00
Ole Laursen 8bd9e5de6e Round the debug time sum 
- Legacy-Id: 17998
 2020-06-16 16:48:29 +00:00
Henrik Levkowetz 3589ea2cd9 Fixed two mypy issues with utils.log code to set loggin handlers. 
- Legacy-Id: 17987
 2020-06-14 18:32:45 +00:00
Henrik Levkowetz 0a7648b7de Improved the handling of logger enabling entries in UTILS_LOGGER_LEVELS to set a handler if none exists for a given logger. 
- Legacy-Id: 17981
 2020-06-13 21:31:31 +00:00
Henrik Levkowetz cb0817175e Tweaked the showloggers command help text. 
- Legacy-Id: 17979
 2020-06-13 21:28:32 +00:00
Henrik Levkowetz c5f6883624 Fixed a couple of mypy errors. 
- Legacy-Id: 17977
 2020-06-12 22:05:03 +00:00
Henrik Levkowetz 77524a333b Added a management command to list registered loggers, in order to see which can be configured in settings_local with the UTILS_LOGGER_LEVELS settings. 
- Legacy-Id: 17974
 2020-06-12 15:00:15 +00:00
Henrik Levkowetz 682036321d Reorganized the python logging setup slightly, and added a possibility to configure logging levels for individual loggers in settings_local.py 
- Legacy-Id: 17973
 2020-06-12 14:41:41 +00:00
Henrik Levkowetz 49bf6090d0 Updated the @require_api_key decorator to not check for recent login dates for staff (which would include robots) 
- Legacy-Id: 17937
 2020-06-08 19:24:42 +00:00
Henrik Levkowetz 5a2a255bcb Added django urlconfig namespace support in ietf.utils.test.get_callbacks() (needed when testing the reverse lookups in templates for oidc_provider). 
- Legacy-Id: 17917
 2020-06-06 20:19:54 +00:00
Henrik Levkowetz cd186fa04b Tweaked patch.py for Py3 compatibility. 
- Legacy-Id: 17916
 2020-06-06 20:17:31 +00:00
Henrik Levkowetz 0ca29a80c2 Tweaked log.unreachable() and log.assertion() for Py3 compatibility. 
- Legacy-Id: 17915
 2020-06-06 20:17:04 +00:00
Robert Sparks 324be05151 added an XMPP URL validator 
- Legacy-Id: 17872
 2020-05-21 21:27:36 +00:00
Robert Sparks 38ba0f401d merged forward 
- Legacy-Id: 17868
 2020-05-21 18:30:48 +00:00
Robert Sparks 7e57be2bd3 merged forward ^/personal/rjs/explore-extref 
- Legacy-Id: 17840
 2020-05-19 18:47:47 +00:00
Henrik Levkowetz 3a963eaf29 Removed a future import 
- Legacy-Id: 17818
 2020-05-18 10:59:59 +00:00
Henrik Levkowetz 488ff08352 Merged in ^/personal/henrik/6.129.2-django2.0 which contains an upgrade of Django from 1.11 to 2.0, with the code changes needed. 
- Legacy-Id: 17817
 2020-05-18 06:50:50 +00:00
Henrik Levkowetz d36d717fe5 Removed some debug code. 
- Legacy-Id: 17810
 2020-05-17 19:46:14 +00:00
Henrik Levkowetz bc05e7a8d0 Refactored many instances of msg.get_payload(decode=True).decode('utf-8') and similar to get_payload_text(msg), which uses msg.get_charset() to get the actual charset to do the decoding, in a consistent manner. Also removed some instances of force_str, but more remain. 
- Legacy-Id: 17807
 2020-05-16 20:20:05 +00:00
Henrik Levkowetz 6318d49b40 Added an utility function to get email payload as unicode text. 
- Legacy-Id: 17800
 2020-05-15 14:50:22 +00:00
Henrik Levkowetz 6d7c5b52ee Django 2.0 conversion. Test suite passes, except for javascript tests. 
- Legacy-Id: 17762
 2020-05-08 13:07:07 +00:00
Henrik Levkowetz c5a7cfaf10 Changed the verbosity of the purge_request_profiler_records command to require -v2 to show records deleted. 
- Legacy-Id: 17704
 2020-04-28 18:04:00 +00:00
Henrik Levkowetz 42995fadea Merged in ^/branch/iola/meeting-improvement-r17214@17617, which provides a new meeting schedule editor. 
- Legacy-Id: 17701
 2020-04-28 14:34:34 +00:00
Henrik Levkowetz bd53b197d8 Removed a debug statement 
- Legacy-Id: 17693
 2020-04-27 19:58:28 +00:00
Henrik Levkowetz 20013f28da Removed a debug statement. 
- Legacy-Id: 17690
 2020-04-26 10:44:55 +00:00
Henrik Levkowetz 59df536958 Added a template filter that is a replacement for Django's builtin 'date' filter, with a more polymorphic signature: It accepts either datetime or date input, and ignores time-specific format entries when handling a date. 
- Legacy-Id: 17686
 2020-04-25 11:29:15 +00:00
Robert Sparks 2de9eb93b5 Added validation to the migrations. Added external resources to the draft display page. Built an editor for DocExternalResources. 
- Legacy-Id: 17683
 2020-04-24 16:14:43 +00:00
Henrik Levkowetz 9aeda11a29 Removed some Py2 compatibility decorators. 
- Legacy-Id: 17673
 2020-04-21 13:54:31 +00:00
Henrik Levkowetz 3054b8cf58 Removed usage of maybe_create_svn_symlinks() 
- Legacy-Id: 17668
 2020-04-20 18:03:25 +00:00
Henrik Levkowetz 78963ecdef Added request profiler and a management command to purge profiler records. 
- Legacy-Id: 17648
 2020-04-15 20:48:08 +00:00
Henrik Levkowetz bba2149b5e Added exception handling in the require_api_key() decorator for AttributeError raised by the decorated function. 
- Legacy-Id: 17629
 2020-04-15 11:57:33 +00:00
Henrik Levkowetz 5a0a502ff9 Merged in the py3clean work, which removes usage of six and __future__ imports, along with other py2/3 compatibility code. 
- Legacy-Id: 17619
 2020-04-14 19:06:53 +00:00
Henrik Levkowetz f2b883d2bb Merged in ^/trunk@17617. 
- Legacy-Id: 17618
 2020-04-14 17:11:51 +00:00
Henrik Levkowetz 0df0a87a48 Added a workaround for the current libmagic which quite easily can mischaracterise text/plain documents as text/x-Algol68. Fixes issues #2941 and #2956. 
- Legacy-Id: 17594
 2020-04-07 18:33:24 +00:00
Henrik Levkowetz f10ddadc0e Merged in changes from trunk up to r17584. 
- Legacy-Id: 17593
 2020-04-07 16:02:52 +00:00
Henrik Levkowetz f86b87e2ed Merged in [17555] from rjsparks@nostrum.com: 
Remove the not-quite-working customization widgets from /meeting/upcoming and /meeting/past. Simplify those views. Correct the list of sessions on those pages when one interim has more than one session. Fixes #2938. Partially addresses #2937.
 - Legacy-Id: 17556
Note: SVN reference [17555] has been migrated to Git commit e9756d8987
 2020-03-28 15:38:10 +00:00
Robert Sparks e9756d8987 Remove the not-quite-working customization widgets from /meeting/upcoming and /meeting/past. Simplify those views. Correct the list of sessions on those pages when one interim has more than one session. Fixes #2938. Partially addresses #2937. Commit ready for merge. 
- Legacy-Id: 17555
 2020-03-27 22:47:38 +00:00
Henrik Levkowetz 827ab69705 Merged in [17521] from housley@vigilsec.com: 
Improve performance of log.assertion() and log.unreachable()
 - Legacy-Id: 17535
Note: SVN reference [17521] has been migrated to Git commit 333abcab6d
 2020-03-24 21:47:59 +00:00
Russ Housley 333abcab6d Improve performance of log.assertion() and log.unreachable() 
- Legacy-Id: 17521
 2020-03-23 22:02:58 +00:00
Ole Laursen e5943f814d Add support for displaying constraint hints when scheduling a task and 
for displaying violated constraints in the new schedule editor, with
the old of a new field, ConstraintName.editor_label.

Add support for displaying room capacity violations.

Add support for selecting a session and displaying information about
it similar to the existing scheduling editor.

Add support for sorting unassigned sessions.

Clean up markup and styles a bit, and fix some bugs.

Expand HTML-based test and add JS test that exercises the
Javascript-based functionality.

Switch to using Chrome driver instead of PhantomJS since the HTML
engine in PhantomJS is apparently too old to support the constructs in
the new schema editor.

Add a workaround for LiveServerTestCase clashing with IetfTestRunner
fixture loading.
 - Legacy-Id: 17519
 2020-03-23 17:55:36 +00:00
Henrik Levkowetz a0d1ffa7be Fixed a pyflakes issue. 
- Legacy-Id: 17472
 2020-03-20 18:59:16 +00:00
Henrik Levkowetz ea1d21a45c Added another check to the check_draft_event_revision_integrity management command, and refined it somewhat. 
- Legacy-Id: 17469
 2020-03-19 22:44:08 +00:00
Henrik Levkowetz d2243ba93d Added a utility function to convert objects to dictionaries (for comparison, for instance) 
- Legacy-Id: 17468
 2020-03-19 22:42:43 +00:00
Henrik Levkowetz 480301f020 Refactored and extended check_draft_event_revision_integrity a bit. 
- Legacy-Id: 17445
 2020-03-17 18:11:43 +00:00
Henrik Levkowetz 5211480895 Added code to show a call-in button on the agenda page if the session agenda-note contains and IETF webex URL. 
- Legacy-Id: 17427
 2020-03-13 14:01:54 +00:00
Henrik Levkowetz c10706286b Added a management command to check draft event revision numbers. To be extended for other checks. 
- Legacy-Id: 17423
 2020-03-11 22:02:30 +00:00
Henrik Levkowetz 50e8918a56 Added a progress bar for verbosity=1 of the community list index update command. 
- Legacy-Id: 17414
 2020-03-09 18:03:09 +00:00
Henrik Levkowetz 2669afe69b Tweaked the check_referential_integrity management command verbose output. 
- Legacy-Id: 17397
 2020-03-06 20:37:41 +00:00
Henrik Levkowetz 726fcbf27d Removed all __future__ imports. 
- Legacy-Id: 17391
 2020-03-05 23:53:42 +00:00
Henrik Levkowetz ab173cb2eb Removed further six usage: six.string_types, six.integer_types, six.moves.urllib instances. 
- Legacy-Id: 17390
 2020-03-05 20:46:58 +00:00
Henrik Levkowetz 1c808bf63b Removed further six usage. 
- Legacy-Id: 17387
 2020-03-05 15:54:32 +00:00
Henrik Levkowetz e9a37d8ac8 Removed six.text_type(), changed six.moves.urllib to plain urllib, and removed now unused six imports. 
- Legacy-Id: 17385
 2020-03-05 14:41:41 +00:00
Henrik Levkowetz ab944725d5 Py2/3 compatibility tweaks for pyflakes. 
- Legacy-Id: 17375
 2020-03-02 18:00:41 +00:00
Henrik Levkowetz b6d8bade44 Fixed a Py2/3 issue in the pyflakes management command, and tweaked the verbose output format. 
- Legacy-Id: 17372
 2020-03-02 12:31:02 +00:00
Henrik Levkowetz fc03063e9e Made email Message-ID fields generated by the datatracker more uniform. 
- Legacy-Id: 17360
 2020-02-27 20:23:20 +00:00
Henrik Levkowetz fb740ff6bf Added saving of outgoing emails as Message instances, with accompanying test. 
- Legacy-Id: 17348
 2020-02-26 18:04:44 +00:00
Henrik Levkowetz 2d724427cf Updated patch.py to avoid deprecation and pyflakes warnings. 
- Legacy-Id: 17346
 2020-02-26 17:22:12 +00:00
Henrik Levkowetz 03bd9c0594 Fixed log.log() to hand on the right type (str) to underlying functions. 
- Legacy-Id: 17343
 2020-02-26 17:16:35 +00:00
Henrik Levkowetz 8f2280130b Moved patch.py into project tree -- it's not being maintained any more. 
- Legacy-Id: 17330
 2020-02-23 16:20:43 +00:00
Henrik Levkowetz d2ad86c5df Python 2/3 changes pulled from the production server after the switch to python 3. 
- Legacy-Id: 17327
 2020-02-23 01:34:52 +00:00
Henrik Levkowetz fa9427769a Added cleaning of the session request form's 'comments' field, to convert any html entered to text. Related to [17322]. 
- Legacy-Id: 17324
Note: SVN reference [17322] has been migrated to Git commit eb88abc394
 2020-02-21 21:36:18 +00:00
Henrik Levkowetz aabd237656 Fixed some pyflakes issues. 
- Legacy-Id: 17304
 2020-02-18 19:39:03 +00:00
Henrik Levkowetz 91d5d72a9d Tweaked send_mail_mime() to recognize settings.SERVER_MODE='repair', in order to avoid mail floods when running the 'mergedata' management command. It is assumed that the appropriate mails went out when the data was entered into the system the first time. 
- Legacy-Id: 17301
 2020-02-16 21:42:37 +00:00
Henrik Levkowetz 7b5bebc727 Added a management command to dump data based on table names and primary keys derived from a list of SQL 'INSERT INTO' commands representing the items to be dumped. The output formats are the same as for dumpdata, and are suitable for later use with the loaddata or mergedata management commands. 
- Legacy-Id: 17300
 2020-02-16 21:40:01 +00:00
Henrik Levkowetz e0c6f3abe2 Added a management command to merge data from one of two divergent django databases to the other, taking care to insert or update records as appropriate, and update foreign keys and many-to-many keys appropriately. Accepts the dump formats generated by the dumpdata command. 
- Legacy-Id: 17299
 2020-02-16 21:39:08 +00:00
Henrik Levkowetz 58d8c2fb47 Updated the check_referential_integrity command, adding a --delete command to remove dangling references to removed records, and also adding colorized success/fail indications for each FK and m2m key inspected. 
- Legacy-Id: 17298
 2020-02-16 21:05:12 +00:00
Henrik Levkowetz 8f0eca5032 Added a newline to test run output, to separate dot progress indication from teardown message. 
- Legacy-Id: 17253
 2020-01-22 23:17:44 +00:00
Henrik Levkowetz 288f4135e3 Added (currently inactive) code to trigger exceptions on failure to resolve template variables during tests, and added fixes for a couple of places that triggered such exceptions. 
- Legacy-Id: 17226
 2020-01-13 17:16:43 +00:00
Peter E. Yee bb7e504d14 12/13 merged into 6.113.1.dev0 with migration ordering failure 
- Legacy-Id: 17149
 2019-12-13 19:53:45 +00:00
Henrik Levkowetz fcb6806d17 Merged in work from sasha@dashcare.nl on Review Queue Managemnt: 
This abstracts queue management, making it possible to implement different
policies for each team. It provides two concrete policies:
RotateAlphabeticallyReviewerQueuePolicy, which rotates an alphabetically
ordered reviewer list with consideration for skip indications, and is the
default policy; and LeastRecentlyUsedReviewerQueuePolicy, a simple
least-recently-used policy.  Also see issues #2721 and #2656.
 - Legacy-Id: 17121
 2019-12-04 23:02:52 +00:00
Henrik Levkowetz ac6b664fa5 Added normalization of draft title extracted from submitted XML. 
- Legacy-Id: 17119
 2019-12-02 16:24:51 +00:00
Henrik Levkowetz 2c28cb3eb0 When group secretary email addresses occurred in some mailtrigger To: entries, they were given with both name and address parts, while when occurring in Cc: entries, no names were present. Fixed one case of this, and adjusted a test case for consistency. Also added a more general utility function to exclude selected email addresses from email address lists. 
- Legacy-Id: 17107
 2019-11-27 21:49:22 +00:00
Henrik Levkowetz 6333e7d842 Added an instance of force_text() to ensure non_ascii mail subjects are unicode when used for string interpolation, rather than bytes (which will trigger ascii decode()). 
- Legacy-Id: 17055
 2019-11-19 09:37:55 +00:00
Henrik Levkowetz c233f07b5d Added a management command to generate draft bibxml files, and also a trial version of datatracker draft bibxml pages. 
- Legacy-Id: 16962
 2019-11-05 18:10:29 +00:00
Henrik Levkowetz d5b6292060 Fixed a pyflakes issue. 
- Legacy-Id: 16955
 2019-11-04 18:11:59 +00:00
Henrik Levkowetz feaa5038a0 Rewrote the ietf/bin/fix-ambiguous-timestamps command as a management command (fix_ambiguous_timestamps) and made it look at all instances of DateTimeField by means of model introspection. 
- Legacy-Id: 16954
 2019-11-04 12:56:52 +00:00
Henrik Levkowetz 3c82dc6184 Merged in [16922] from sasha@dashcare.nl: 
Fix #2584 - Add additional content validation for uploaded texts.
Permitted MIME types are now text/plain, text/markdown and text/x-rst.
This applies to all usages of get_cleaned_text_file_content(),
including reviews, but also other similar places where text can either
be written either into a textarea or uploaded.
 - Legacy-Id: 16930
Note: SVN reference [16922] has been migrated to Git commit fd53f98854
 2019-10-26 15:42:58 +00:00
Sasha Romijn fd53f98854 Fix #2584 - Add additional content validation for uploaded texts. 
Permitted MIME types are now text/plain, text/markdown and text/x-rst.
This applies to all usages of get_cleaned_text_file_content(),
including reviews, but also other similar places where text can either
be written either into a textarea or uploaded.

Commit ready for merge.
 - Legacy-Id: 16922
 2019-10-23 20:15:30 +00:00
Henrik Levkowetz 45465f1174 Merged in [16818] from rjsparks@nostrum.com: 
Make hybrid pdfs when converting ppt materials to pdf. Fixes #2769.
 - Legacy-Id: 16880
Note: SVN reference [16818] has been migrated to Git commit 84270a71d0e7373c5e05ddc834e91c445a1296ed
 2019-10-21 13:17:33 +00:00
Henrik Levkowetz 447525de73 Tweaked the output of mypy_test(). 
- Legacy-Id: 16865
 2019-10-15 16:48:23 +00:00
Henrik Levkowetz 24ede9a1ae In wordwrap(), consider lines consisting entirely of some non-alphanumeric characters like ---- or === to be block (paragraph) separators. Fixes issue #2806. 
- Legacy-Id: 16790
 2019-10-01 11:08:41 +00:00
Henrik Levkowetz 902f7769d1 Fixed incorrect type hints for Migration.dependencies. 
- Legacy-Id: 16776
 2019-09-30 16:25:58 +00:00
Henrik Levkowetz 33e8733b91 Fixed up mypy issues or added type:ignore comments as needed for a clean mypy run. 
- Legacy-Id: 16772
 2019-09-30 15:42:18 +00:00
Henrik Levkowetz 2d858f2e0a Added mypy and django-stubs to Py3 requirements, and added a mypy test case. 
- Legacy-Id: 16768
 2019-09-30 15:37:32 +00:00
Henrik Levkowetz 8e313e4ed5 Adjusted migrations for Python2/3 compatibility. 
- Legacy-Id: 16633
 2019-08-08 17:11:14 +00:00
Henrik Levkowetz 2418459afc Prevent login case issues by generating apache permissions file entries for both uppercase and lowercase logins. 
- Legacy-Id: 16597
 2019-07-29 19:20:38 +00:00
Henrik Levkowetz 0a591e4b2e Merged in [16562] from rcross@amsl.com: 
Added encoding='utf-8' parameter to io.open operations in tests that starting failing since adding unicode_literals.
 - Legacy-Id: 16588
Note: SVN reference [16562] has been migrated to Git commit d332bfd91d
 2019-07-24 23:44:36 +00:00
Henrik Levkowetz 07c5e33bc4 Added conditional decoding of bytes subject text, before interpolating into a new unicode string. 
- Legacy-Id: 16577
 2019-07-22 18:19:55 +00:00
Ryan Cross d332bfd91d Added encoding='utf-8' parameter to io.open operations in tests that starting failing since adding unicode_literals. Commit ready to merge 
- Legacy-Id: 16562
 2019-07-20 22:54:14 +00:00