altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 3 Packages Projects Releases Wiki Activity
16633 commits 1 branch 0 tags 2.6 GiB
Commit graph

184 commits

Author SHA1 Message Date
Henrik Levkowetz c5a7cfaf10 Changed the verbosity of the purge_request_profiler_records command to require -v2 to show records deleted. 
- Legacy-Id: 17704
 2020-04-28 18:04:00 +00:00
Henrik Levkowetz 78963ecdef Added request profiler and a management command to purge profiler records. 
- Legacy-Id: 17648
 2020-04-15 20:48:08 +00:00
Henrik Levkowetz 5a0a502ff9 Merged in the py3clean work, which removes usage of six and __future__ imports, along with other py2/3 compatibility code. 
- Legacy-Id: 17619
 2020-04-14 19:06:53 +00:00
Henrik Levkowetz f10ddadc0e Merged in changes from trunk up to r17584. 
- Legacy-Id: 17593
 2020-04-07 16:02:52 +00:00
Henrik Levkowetz a0d1ffa7be Fixed a pyflakes issue. 
- Legacy-Id: 17472
 2020-03-20 18:59:16 +00:00
Henrik Levkowetz ea1d21a45c Added another check to the check_draft_event_revision_integrity management command, and refined it somewhat. 
- Legacy-Id: 17469
 2020-03-19 22:44:08 +00:00
Henrik Levkowetz 480301f020 Refactored and extended check_draft_event_revision_integrity a bit. 
- Legacy-Id: 17445
 2020-03-17 18:11:43 +00:00
Henrik Levkowetz c10706286b Added a management command to check draft event revision numbers. To be extended for other checks. 
- Legacy-Id: 17423
 2020-03-11 22:02:30 +00:00
Henrik Levkowetz 50e8918a56 Added a progress bar for verbosity=1 of the community list index update command. 
- Legacy-Id: 17414
 2020-03-09 18:03:09 +00:00
Henrik Levkowetz 2669afe69b Tweaked the check_referential_integrity management command verbose output. 
- Legacy-Id: 17397
 2020-03-06 20:37:41 +00:00
Henrik Levkowetz 726fcbf27d Removed all __future__ imports. 
- Legacy-Id: 17391
 2020-03-05 23:53:42 +00:00
Henrik Levkowetz ab173cb2eb Removed further six usage: six.string_types, six.integer_types, six.moves.urllib instances. 
- Legacy-Id: 17390
 2020-03-05 20:46:58 +00:00
Henrik Levkowetz ab944725d5 Py2/3 compatibility tweaks for pyflakes. 
- Legacy-Id: 17375
 2020-03-02 18:00:41 +00:00
Henrik Levkowetz b6d8bade44 Fixed a Py2/3 issue in the pyflakes management command, and tweaked the verbose output format. 
- Legacy-Id: 17372
 2020-03-02 12:31:02 +00:00
Henrik Levkowetz d2ad86c5df Python 2/3 changes pulled from the production server after the switch to python 3. 
- Legacy-Id: 17327
 2020-02-23 01:34:52 +00:00
Henrik Levkowetz aabd237656 Fixed some pyflakes issues. 
- Legacy-Id: 17304
 2020-02-18 19:39:03 +00:00
Henrik Levkowetz 7b5bebc727 Added a management command to dump data based on table names and primary keys derived from a list of SQL 'INSERT INTO' commands representing the items to be dumped. The output formats are the same as for dumpdata, and are suitable for later use with the loaddata or mergedata management commands. 
- Legacy-Id: 17300
 2020-02-16 21:40:01 +00:00
Henrik Levkowetz e0c6f3abe2 Added a management command to merge data from one of two divergent django databases to the other, taking care to insert or update records as appropriate, and update foreign keys and many-to-many keys appropriately. Accepts the dump formats generated by the dumpdata command. 
- Legacy-Id: 17299
 2020-02-16 21:39:08 +00:00
Henrik Levkowetz 58d8c2fb47 Updated the check_referential_integrity command, adding a --delete command to remove dangling references to removed records, and also adding colorized success/fail indications for each FK and m2m key inspected. 
- Legacy-Id: 17298
 2020-02-16 21:05:12 +00:00
Henrik Levkowetz d5b6292060 Fixed a pyflakes issue. 
- Legacy-Id: 16955
 2019-11-04 18:11:59 +00:00
Henrik Levkowetz feaa5038a0 Rewrote the ietf/bin/fix-ambiguous-timestamps command as a management command (fix_ambiguous_timestamps) and made it look at all instances of DateTimeField by means of model introspection. 
- Legacy-Id: 16954
 2019-11-04 12:56:52 +00:00
Henrik Levkowetz 33e8733b91 Fixed up mypy issues or added type:ignore comments as needed for a clean mypy run. 
- Legacy-Id: 16772
 2019-09-30 15:42:18 +00:00
Henrik Levkowetz 2418459afc Prevent login case issues by generating apache permissions file entries for both uppercase and lowercase logins. 
- Legacy-Id: 16597
 2019-07-29 19:20:38 +00:00
Henrik Levkowetz b3244242aa Fixed some issues with the Py2/3 changes to the populate_yang_model_dirs management command. 
- Legacy-Id: 16520
 2019-07-18 18:53:14 +00:00
Henrik Levkowetz e03784132d Merged changes from current trunk to Py3 branch. 
- Legacy-Id: 16468
 2019-07-16 15:36:16 +00:00
Henrik Levkowetz 46aec6eb85 Python2/3 compatibility: tentative version of create_group_wikis; may need more work. 
- Legacy-Id: 16459
 2019-07-16 13:17:12 +00:00
Henrik Levkowetz 8c6eb3a30a Python2/3 compatibility: Changed the use of open() and StringIO to io.open() etc. 
- Legacy-Id: 16458
 2019-07-15 19:14:04 +00:00
Henrik Levkowetz 44f51c1d64 The beginning of a dev file download helper. 
- Legacy-Id: 16456
 2019-07-15 19:03:35 +00:00
Henrik Levkowetz 855716e1d5 Py2/3 compatibility: Added __future__ import 
- Legacy-Id: 16448
 2019-07-15 15:46:06 +00:00
Henrik Levkowetz 2d7c9629aa Added 'from __future__' imports all over the place, to bring code behaviour into closer alignment between python2 and python3 
- Legacy-Id: 16446
 2019-07-15 15:40:51 +00:00
Henrik Levkowetz f481f5c3e6 Replaced use of six with the equivalent pure python3 constructs. 
- Legacy-Id: 16428
 2019-07-08 10:43:47 +00:00
Henrik Levkowetz 0679eaa8d4 Removed unused imports. 
- Legacy-Id: 16402
 2019-07-04 21:06:57 +00:00
Henrik Levkowetz f480799af9 Undid unintentional bulk commit 
- Legacy-Id: 16401
 2019-07-04 21:04:46 +00:00
Henrik Levkowetz fc09a59950 Added decode() of command pipe output. 
- Legacy-Id: 16400
 2019-07-04 21:01:39 +00:00
Henrik Levkowetz fb8d12ac3c Fixed a pyflakes issue. 
- Legacy-Id: 16358
 2019-07-01 19:27:08 +00:00
Henrik Levkowetz c8e75c554a Various changes to make yang-related management commands quieter 
- Legacy-Id: 16355
 2019-07-01 18:29:03 +00:00
Henrik Levkowetz 97a555936d Changed a large number of test assertions to use assertContains() and removed separate, now unnecessary,status_code checks. Also changed many assertTrue(... in ...) to use assertIn(). 
- Legacy-Id: 16346
 2019-06-30 21:03:34 +00:00
Henrik Levkowetz 1e86ccb4ee Builtin function file() --> open() 
- Legacy-Id: 16328
 2019-06-28 20:51:13 +00:00
Henrik Levkowetz d7f5c84182 Initial 2to3 patch with added copyright statement updates. 
- Legacy-Id: 16309
 2019-06-27 14:40:54 +00:00
Henrik Levkowetz 0e68f4bb4b Added a management command to update the index table used by some community list search rules. 
- Legacy-Id: 16273
 2019-06-17 13:02:57 +00:00
Henrik Levkowetz 7b93709a3b Tweaked the greate_group_wikis management command to accept trailing fileglob wildcards on adhoc wiki group acronyms. Added a generic NomCom wiki to the list of adhoc wikis to be created and maintained, with admins from active nomcom* groups. 
- Legacy-Id: 16176
 2019-04-29 12:30:36 +00:00
Henrik Levkowetz fc18cd93d4 Tweaked coverage_changes command. I suspect this would benefit from a rewrite. 
- Legacy-Id: 16019
 2019-03-11 16:52:09 +00:00
Henrik Levkowetz 57a4c9f41f Added 9 new group features, and changed list-like char fields to json fields, to get better support for using the values as lists. Modified code to use the group features instead of explicit lists of group types in many places in the code. 
- Legacy-Id: 15908
 2019-01-22 18:11:46 +00:00
Henrik Levkowetz 2d0c503d33 Fixed pyflakes issues 
- Legacy-Id: 15792
 2018-11-30 00:07:49 +00:00
Henrik Levkowetz 0e8f63951e Added two new management commands to make it easier to load back selected objects that have been removed by mistake (providing they are available in a full database dump or backup that can be loaded and worked with): dumprelated and loadrelated. 
- Legacy-Id: 15790
 2018-11-29 15:17:46 +00:00
Henrik Levkowetz e471386cf2 Merged in [15715] from rcross@amsl.com: 
Fix issue where new non-session location field value isn't saved.  Fixes #2625.
 - Legacy-Id: 15756
Note: SVN reference [15715] has been migrated to Git commit a47fba833f
 2018-11-12 13:35:17 +00:00
Ryan Cross a47fba833f Fix issue where new non-session location field value isn't saved. Fixes #2625. Commit ready for merge. 
- Legacy-Id: 15715
 2018-11-05 04:25:20 +00:00
Henrik Levkowetz caeb6fcb87 Added a '--reminder' switch to the GDPR request mailer, for repeat notifications. 
- Legacy-Id: 15530
 2018-10-07 22:05:26 +00:00
Henrik Levkowetz 43dd7d5e90 Tweaked the management command to send GDPR consent request emails to correctly perform exclusion based on the time of previous consent request emails. 
- Legacy-Id: 15504
 2018-09-29 20:08:09 +00:00
Henrik Levkowetz 1dd47e18f5 Whitespace changes only. 
- Legacy-Id: 15499
 2018-09-29 12:46:12 +00:00
Henrik Levkowetz 7ea8a3f431 Tweaked the gdpr reminder command to avoid bounces to RT and copies to gmail. 
- Legacy-Id: 15480
 2018-09-24 18:37:45 +00:00
Henrik Levkowetz 30f456f83a Changed the default minimum response time used by the delete_data_lacking_consent management command from 14 to 7 days. 
- Legacy-Id: 15466
 2018-09-18 13:35:27 +00:00
Henrik Levkowetz 4fba531e9e Merged in the latest GDPR changes. This refines the handling of the consent checkbox on the account page; refines the Consent Needed warning given on login if consent is needed; tweaks several models to set the on_deletion fields for FK to User and Person appropriately; adds a Person.needs_consent() method to capture the logic of which fields require consent; refines the Person.plain_name() method and the user.log.log() function; and adds 2 management commands to send out consent requests and delete non-consent information, respectively. 
- Legacy-Id: 15464
 2018-09-16 23:12:43 +00:00
Henrik Levkowetz b85e1c46d9 Added a delete_data_lacking_consent management command that deletes person records and person information for which we need consent according to GDPR, but have not received it. 
- Legacy-Id: 15461
 2018-09-16 13:54:32 +00:00
Henrik Levkowetz 3f9dbeada8 Expanded the send_gdpr_consent_request command to add support for deletion dates, email reminder interval, email sending rate limiting, and sending to a list of users. 
- Legacy-Id: 15460
 2018-09-16 13:52:29 +00:00
Henrik Levkowetz 97db5f71b5 Added a management command to send out gdpr consent requests. 
- Legacy-Id: 15269
 2018-06-19 19:23:46 +00:00
Henrik Levkowetz fac57c24a7 Tweaked the wording of coverage_changes output. 
- Legacy-Id: 15048
 2018-04-17 11:35:36 +00:00
Henrik Levkowetz 36b5e2ef8e Changed name from .rel to .remote_field for remote accessors. 
- Legacy-Id: 14665
 2018-02-21 23:56:36 +00:00
Henrik Levkowetz a3d1d5595d Added an option to list the slugs that can be used with the generate_apache_perms management command. 
- Legacy-Id: 14576
 2018-01-26 22:40:48 +00:00
Henrik Levkowetz fd01a612b7 Added a management command to generate apache 'Require user ...' stanzas from group:type:role specifications. 
- Legacy-Id: 14574
 2018-01-26 20:43:40 +00:00
Henrik Levkowetz 008eaf7fda Modified the run_yang_model_checks management command to accept document aliases on the command line. 
- Legacy-Id: 14443
 2017-12-19 14:09:40 +00:00
Henrik Levkowetz 6567e707ce Merged in ^/personal/henrik/6.64.2-ballotapi@14426. This provides personal API keys and a ballot position API at /api/iesg/position. Also added an endpoint description at /api/. 
- Legacy-Id: 14430
 2017-12-17 23:43:44 +00:00
Henrik Levkowetz ec4e238185 Added some missing files. 
- Legacy-Id: 14427
 2017-12-16 18:39:26 +00:00
Henrik Levkowetz 3cd3c3526f Tweaked the coverage_changes management comand output. 
- Legacy-Id: 14402
 2017-12-06 13:31:33 +00:00
Henrik Levkowetz 57c18ef3fe Changed settings and handling of adhoc wiki paths to be more testing-friendly. 
- Legacy-Id: 14390
 2017-12-04 15:09:03 +00:00
Henrik Levkowetz 47a0b9d3ce Changed handling of yang modeules from drafts with errors, to not place them in separate directories, due to possible follow-on effects. Added use of IANA-held modules when validating, and regular rsyncing from IANA. 
- Legacy-Id: 14389
 2017-12-04 14:37:15 +00:00
Henrik Levkowetz 3269a696fe Variable naming fix 
- Legacy-Id: 14286
 2017-11-03 10:36:50 +00:00
Henrik Levkowetz 23a3056260 Fixed a typo. 
- Legacy-Id: 14270
 2017-11-01 14:51:08 +00:00
Henrik Levkowetz 6e23f99019 Improved the help message for the run_yang_model_checks management command. 
- Legacy-Id: 14267
 2017-11-01 14:39:53 +00:00
Henrik Levkowetz af64f0e064 Fixed a call parameter list discrepancy. 
- Legacy-Id: 14252
 2017-11-01 05:07:35 +00:00
Henrik Levkowetz 09d8ad1e1b Fixed some pyflakes issues. 
- Legacy-Id: 14238
 2017-10-30 11:47:05 +00:00
Henrik Levkowetz 1a7e9b619a Added support for ad-hoc trac instances, with arbitrary names and filesystem paths, but still bound to a particular group's roles for management of trac admin rights. 
- Legacy-Id: 14232
 2017-10-30 11:10:15 +00:00
Henrik Levkowetz aaccbba6e8 Fixed a bug in coverage_changes. 
- Legacy-Id: 14037
 2017-08-10 10:53:59 +00:00
Henrik Levkowetz 138f3d7382 Fixed a variable initialization issue. 
- Legacy-Id: 14009
 2017-07-30 14:33:34 +00:00
Henrik Levkowetz 2070a4efcf Fixed a pyflakes issue. 
- Legacy-Id: 14008
 2017-07-30 13:55:30 +00:00
Henrik Levkowetz 8a53653682 Added detailed line-by line changes in code coverage to the coverage_changes management command. Use verbosity 2 or higher. 
- Legacy-Id: 14007
 2017-07-30 13:50:06 +00:00
Henrik Levkowetz d00921b94b Added a new release-coverage format which whould make it easier to show line-by-line code test coverage changes in the future. 
- Legacy-Id: 13967
 2017-07-24 17:38:00 +00:00
Henrik Levkowetz d2395f9521 Merged in [13832] from rjsparks@nostrum.com: 
Treat Area Groups similar to Working Groups and Research Groups where it makes sense to do so.
 - Legacy-Id: 13836
Note: SVN reference [13832] has been migrated to Git commit 2c92aa213d
 2017-07-11 21:57:01 +00:00
Robert Sparks 2c92aa213d Treat Area Groups similar to Working Groups and Research Groups where it makes sense to do so. Commit ready for merge. 
- Legacy-Id: 13832
 2017-07-11 19:12:21 +00:00
Henrik Levkowetz 95ddc35eae Added wiki creation for groups in state 'bof' 
- Legacy-Id: 13829
 2017-07-11 16:06:00 +00:00
Henrik Levkowetz 42b1a41227 Added the new format '4' to the list of recognized formats in the coverage_changes management command. 
- Legacy-Id: 13766
 2017-07-03 21:18:46 +00:00
Henrik Levkowetz f6f0278859 Changed the url coverage code to handle deeper chains of url includes, and to handle url includes through url lists in addition to url modules. Added information in the release coverage dictionaries about the view functions coupled to the urls. 
- Legacy-Id: 13706
 2017-06-22 15:07:06 +00:00
Henrik Levkowetz 5e80e00aea Corrected the settings names used in the yang extraction command. 
- Legacy-Id: 13695
 2017-06-20 14:06:42 +00:00
Henrik Levkowetz d98054c103 Added a new yang checker, 'yanglint', to the existing Yang checker class, in 
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13630
 2017-06-15 16:09:28 +00:00
Henrik Levkowetz fe30afdfe7 Updated the check_referential_integrity management command to show progress bars when not in verbose mode. 
- Legacy-Id: 13369
 2017-05-16 15:07:56 +00:00
Henrik Levkowetz b1c4b75fbe Fixed a pyflakes issue. 
- Legacy-Id: 13235
 2017-04-18 20:55:43 +00:00
Henrik Levkowetz 0b730c9554 Updated the referential integrity checking comand. 
- Legacy-Id: 13234
 2017-04-18 20:21:58 +00:00
Henrik Levkowetz 605fa26ec3 Made relative paths work for the create_group_wikis commnand. Added wiki and svn dir patterns to docker/settings_local.py. 
- Legacy-Id: 13150
 2017-03-27 17:07:48 +00:00
Henrik Levkowetz aa5e61d958 Updated all urlpatterns to use ietf.utils.urls.url() instead of django's, 
in order to autogenerate dotted path url pattern names.  Updated a number
of url reverses to use dotted path, and removed explicit url pattern names
as needed.

Changed some imports to prevent import of ietf.urls before django
initialization was complete.


Changed 3 cases of form classes being curried to functions; django 1.10
didn't accept that.

Started converting old-style middleware classes to new-style middleware
functions (incomplete).

Tweaked a nomcom decorator to preserve function names and attributes, like
a good decorator should.

Replaced the removed django templatetag 'removetags' with our own version
which uses bleach, and does sanitizing in addition to removing explicitly
mentionied html tags.

Rewrote the filename argument handling in a management command which had
broken with the upgrade.
 - Legacy-Id: 12818
 2017-02-11 14:43:01 +00:00
Henrik Levkowetz 49a899fe66 Added support for management of trac wikis for explicitly named groups, such as the IESG and IAOC. Tweaked the dummy-run handling of the create_group_wikis management command. 
- Legacy-Id: 12789
 2017-02-08 16:37:31 +00:00
Henrik Levkowetz 40e8380751 Merged django 1.9 work forward to copy of trunk @6.41.0 
- Legacy-Id: 12756
 2017-01-30 23:13:02 +00:00
Henrik Levkowetz 6f5c0fdd23 Added a trac-admin role name, for help in assigning trac-admin rights to trac instances. Extended the create_group_wikis management command to create and update wikis for groups of type 'team','ag' and 'dir', in addition to 'wg','rg' and 'area'; and also add people with role trac-admin in the group or in the secretariat to those given TRAC_ADMIN permissions in a Trac instance. 
- Legacy-Id: 12721
 2017-01-24 17:21:11 +00:00
Henrik Levkowetz a5d1aca525 Save database object before using it. 
- Legacy-Id: 12716
 2017-01-23 19:42:03 +00:00
Henrik Levkowetz 613f0c8233 Pyflakes fixes. 
- Legacy-Id: 12714
 2017-01-23 18:35:58 +00:00
Henrik Levkowetz bdbddc8efd Rewrote a test to provide on-disk files instead of StringIO files to argparse (it seems optparse could handle this, but argparse can't). 
- Legacy-Id: 12713
 2017-01-23 18:23:05 +00:00
Henrik Levkowetz 6eec4c2648 Converted all management commands which set up additional command-line switches to use the argparse approach instead of the deprecated optparse approach. 
- Legacy-Id: 12645
 2017-01-11 18:42:38 +00:00
Henrik Levkowetz bb7d3b476f Tweaked the create_group_wiki management command and its test to show more information on failures. 
- Legacy-Id: 12273
 2016-11-07 17:13:09 +00:00
Henrik Levkowetz 1d6853037e Updated the create_group_wikis management command with additional switches to make it easier to do test deployment of individual wikis. 
- Legacy-Id: 12240
 2016-10-30 18:10:41 +00:00
Henrik Levkowetz c22842a7c4 Made the wiki glue test skippable, in case the python subversion bindings are unavailable. Added creation of temporary directories also for the svn repositores created for wikis during testing. 
- Legacy-Id: 12183
 2016-10-19 21:14:20 +00:00
Henrik Levkowetz f9b4955880 Tweaked the settings a bit, to avoid problems if changing TRAC_WIKI_DIR_ROOT after TRAC_WIKI_DIR_PATTERN has been set. Added a --wiki-dir-pattern switch to the management command. 
- Legacy-Id: 12181
 2016-10-19 14:56:57 +00:00