altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 3 Packages Projects Releases Wiki Activity
16633 commits 1 branch 0 tags 2.6 GiB
Commit graph

184 commits

Author SHA1 Message Date
Henrik Levkowetz 7ea8a3f431 Tweaked the gdpr reminder command to avoid bounces to RT and copies to gmail. 
- Legacy-Id: 15480
 2018-09-24 18:37:45 +00:00
Henrik Levkowetz 30f456f83a Changed the default minimum response time used by the delete_data_lacking_consent management command from 14 to 7 days. 
- Legacy-Id: 15466
 2018-09-18 13:35:27 +00:00
Henrik Levkowetz 4fba531e9e Merged in the latest GDPR changes. This refines the handling of the consent checkbox on the account page; refines the Consent Needed warning given on login if consent is needed; tweaks several models to set the on_deletion fields for FK to User and Person appropriately; adds a Person.needs_consent() method to capture the logic of which fields require consent; refines the Person.plain_name() method and the user.log.log() function; and adds 2 management commands to send out consent requests and delete non-consent information, respectively. 
- Legacy-Id: 15464
 2018-09-16 23:12:43 +00:00
Henrik Levkowetz b85e1c46d9 Added a delete_data_lacking_consent management command that deletes person records and person information for which we need consent according to GDPR, but have not received it. 
- Legacy-Id: 15461
 2018-09-16 13:54:32 +00:00
Henrik Levkowetz 3f9dbeada8 Expanded the send_gdpr_consent_request command to add support for deletion dates, email reminder interval, email sending rate limiting, and sending to a list of users. 
- Legacy-Id: 15460
 2018-09-16 13:52:29 +00:00
Henrik Levkowetz 97db5f71b5 Added a management command to send out gdpr consent requests. 
- Legacy-Id: 15269
 2018-06-19 19:23:46 +00:00
Henrik Levkowetz fac57c24a7 Tweaked the wording of coverage_changes output. 
- Legacy-Id: 15048
 2018-04-17 11:35:36 +00:00
Henrik Levkowetz 36b5e2ef8e Changed name from .rel to .remote_field for remote accessors. 
- Legacy-Id: 14665
 2018-02-21 23:56:36 +00:00
Henrik Levkowetz a3d1d5595d Added an option to list the slugs that can be used with the generate_apache_perms management command. 
- Legacy-Id: 14576
 2018-01-26 22:40:48 +00:00
Henrik Levkowetz fd01a612b7 Added a management command to generate apache 'Require user ...' stanzas from group:type:role specifications. 
- Legacy-Id: 14574
 2018-01-26 20:43:40 +00:00
Henrik Levkowetz 008eaf7fda Modified the run_yang_model_checks management command to accept document aliases on the command line. 
- Legacy-Id: 14443
 2017-12-19 14:09:40 +00:00
Henrik Levkowetz 6567e707ce Merged in ^/personal/henrik/6.64.2-ballotapi@14426. This provides personal API keys and a ballot position API at /api/iesg/position. Also added an endpoint description at /api/. 
- Legacy-Id: 14430
 2017-12-17 23:43:44 +00:00
Henrik Levkowetz ec4e238185 Added some missing files. 
- Legacy-Id: 14427
 2017-12-16 18:39:26 +00:00
Henrik Levkowetz 3cd3c3526f Tweaked the coverage_changes management comand output. 
- Legacy-Id: 14402
 2017-12-06 13:31:33 +00:00
Henrik Levkowetz 57c18ef3fe Changed settings and handling of adhoc wiki paths to be more testing-friendly. 
- Legacy-Id: 14390
 2017-12-04 15:09:03 +00:00
Henrik Levkowetz 47a0b9d3ce Changed handling of yang modeules from drafts with errors, to not place them in separate directories, due to possible follow-on effects. Added use of IANA-held modules when validating, and regular rsyncing from IANA. 
- Legacy-Id: 14389
 2017-12-04 14:37:15 +00:00
Henrik Levkowetz 3269a696fe Variable naming fix 
- Legacy-Id: 14286
 2017-11-03 10:36:50 +00:00
Henrik Levkowetz 23a3056260 Fixed a typo. 
- Legacy-Id: 14270
 2017-11-01 14:51:08 +00:00
Henrik Levkowetz 6e23f99019 Improved the help message for the run_yang_model_checks management command. 
- Legacy-Id: 14267
 2017-11-01 14:39:53 +00:00
Henrik Levkowetz af64f0e064 Fixed a call parameter list discrepancy. 
- Legacy-Id: 14252
 2017-11-01 05:07:35 +00:00
Henrik Levkowetz 09d8ad1e1b Fixed some pyflakes issues. 
- Legacy-Id: 14238
 2017-10-30 11:47:05 +00:00
Henrik Levkowetz 1a7e9b619a Added support for ad-hoc trac instances, with arbitrary names and filesystem paths, but still bound to a particular group's roles for management of trac admin rights. 
- Legacy-Id: 14232
 2017-10-30 11:10:15 +00:00
Henrik Levkowetz aaccbba6e8 Fixed a bug in coverage_changes. 
- Legacy-Id: 14037
 2017-08-10 10:53:59 +00:00
Henrik Levkowetz 138f3d7382 Fixed a variable initialization issue. 
- Legacy-Id: 14009
 2017-07-30 14:33:34 +00:00
Henrik Levkowetz 2070a4efcf Fixed a pyflakes issue. 
- Legacy-Id: 14008
 2017-07-30 13:55:30 +00:00
Henrik Levkowetz 8a53653682 Added detailed line-by line changes in code coverage to the coverage_changes management command. Use verbosity 2 or higher. 
- Legacy-Id: 14007
 2017-07-30 13:50:06 +00:00
Henrik Levkowetz d00921b94b Added a new release-coverage format which whould make it easier to show line-by-line code test coverage changes in the future. 
- Legacy-Id: 13967
 2017-07-24 17:38:00 +00:00
Henrik Levkowetz d2395f9521 Merged in [13832] from rjsparks@nostrum.com: 
Treat Area Groups similar to Working Groups and Research Groups where it makes sense to do so.
 - Legacy-Id: 13836
Note: SVN reference [13832] has been migrated to Git commit 2c92aa213d
 2017-07-11 21:57:01 +00:00
Robert Sparks 2c92aa213d Treat Area Groups similar to Working Groups and Research Groups where it makes sense to do so. Commit ready for merge. 
- Legacy-Id: 13832
 2017-07-11 19:12:21 +00:00
Henrik Levkowetz 95ddc35eae Added wiki creation for groups in state 'bof' 
- Legacy-Id: 13829
 2017-07-11 16:06:00 +00:00
Henrik Levkowetz 42b1a41227 Added the new format '4' to the list of recognized formats in the coverage_changes management command. 
- Legacy-Id: 13766
 2017-07-03 21:18:46 +00:00
Henrik Levkowetz f6f0278859 Changed the url coverage code to handle deeper chains of url includes, and to handle url includes through url lists in addition to url modules. Added information in the release coverage dictionaries about the view functions coupled to the urls. 
- Legacy-Id: 13706
 2017-06-22 15:07:06 +00:00
Henrik Levkowetz 5e80e00aea Corrected the settings names used in the yang extraction command. 
- Legacy-Id: 13695
 2017-06-20 14:06:42 +00:00
Henrik Levkowetz d98054c103 Added a new yang checker, 'yanglint', to the existing Yang checker class, in 
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13630
 2017-06-15 16:09:28 +00:00
Henrik Levkowetz fe30afdfe7 Updated the check_referential_integrity management command to show progress bars when not in verbose mode. 
- Legacy-Id: 13369
 2017-05-16 15:07:56 +00:00
Henrik Levkowetz b1c4b75fbe Fixed a pyflakes issue. 
- Legacy-Id: 13235
 2017-04-18 20:55:43 +00:00
Henrik Levkowetz 0b730c9554 Updated the referential integrity checking comand. 
- Legacy-Id: 13234
 2017-04-18 20:21:58 +00:00
Henrik Levkowetz 605fa26ec3 Made relative paths work for the create_group_wikis commnand. Added wiki and svn dir patterns to docker/settings_local.py. 
- Legacy-Id: 13150
 2017-03-27 17:07:48 +00:00
Henrik Levkowetz aa5e61d958 Updated all urlpatterns to use ietf.utils.urls.url() instead of django's, 
in order to autogenerate dotted path url pattern names.  Updated a number
of url reverses to use dotted path, and removed explicit url pattern names
as needed.

Changed some imports to prevent import of ietf.urls before django
initialization was complete.


Changed 3 cases of form classes being curried to functions; django 1.10
didn't accept that.

Started converting old-style middleware classes to new-style middleware
functions (incomplete).

Tweaked a nomcom decorator to preserve function names and attributes, like
a good decorator should.

Replaced the removed django templatetag 'removetags' with our own version
which uses bleach, and does sanitizing in addition to removing explicitly
mentionied html tags.

Rewrote the filename argument handling in a management command which had
broken with the upgrade.
 - Legacy-Id: 12818
 2017-02-11 14:43:01 +00:00
Henrik Levkowetz 49a899fe66 Added support for management of trac wikis for explicitly named groups, such as the IESG and IAOC. Tweaked the dummy-run handling of the create_group_wikis management command. 
- Legacy-Id: 12789
 2017-02-08 16:37:31 +00:00
Henrik Levkowetz 40e8380751 Merged django 1.9 work forward to copy of trunk @6.41.0 
- Legacy-Id: 12756
 2017-01-30 23:13:02 +00:00
Henrik Levkowetz 6f5c0fdd23 Added a trac-admin role name, for help in assigning trac-admin rights to trac instances. Extended the create_group_wikis management command to create and update wikis for groups of type 'team','ag' and 'dir', in addition to 'wg','rg' and 'area'; and also add people with role trac-admin in the group or in the secretariat to those given TRAC_ADMIN permissions in a Trac instance. 
- Legacy-Id: 12721
 2017-01-24 17:21:11 +00:00
Henrik Levkowetz a5d1aca525 Save database object before using it. 
- Legacy-Id: 12716
 2017-01-23 19:42:03 +00:00
Henrik Levkowetz 613f0c8233 Pyflakes fixes. 
- Legacy-Id: 12714
 2017-01-23 18:35:58 +00:00
Henrik Levkowetz bdbddc8efd Rewrote a test to provide on-disk files instead of StringIO files to argparse (it seems optparse could handle this, but argparse can't). 
- Legacy-Id: 12713
 2017-01-23 18:23:05 +00:00
Henrik Levkowetz 6eec4c2648 Converted all management commands which set up additional command-line switches to use the argparse approach instead of the deprecated optparse approach. 
- Legacy-Id: 12645
 2017-01-11 18:42:38 +00:00
Henrik Levkowetz bb7d3b476f Tweaked the create_group_wiki management command and its test to show more information on failures. 
- Legacy-Id: 12273
 2016-11-07 17:13:09 +00:00
Henrik Levkowetz 1d6853037e Updated the create_group_wikis management command with additional switches to make it easier to do test deployment of individual wikis. 
- Legacy-Id: 12240
 2016-10-30 18:10:41 +00:00
Henrik Levkowetz c22842a7c4 Made the wiki glue test skippable, in case the python subversion bindings are unavailable. Added creation of temporary directories also for the svn repositores created for wikis during testing. 
- Legacy-Id: 12183
 2016-10-19 21:14:20 +00:00
Henrik Levkowetz f9b4955880 Tweaked the settings a bit, to avoid problems if changing TRAC_WIKI_DIR_ROOT after TRAC_WIKI_DIR_PATTERN has been set. Added a --wiki-dir-pattern switch to the management command. 
- Legacy-Id: 12181
 2016-10-19 14:56:57 +00:00
Henrik Levkowetz 41945d5525 Reverted unintended commit 
- Legacy-Id: 12179
 2016-10-19 14:47:17 +00:00
Henrik Levkowetz b2aae7dc35 Ignore the virtualenv-created directories under env/ 
- Legacy-Id: 12178
 2016-10-19 14:44:44 +00:00
Henrik Levkowetz f33eab6770 Install custom wiki pages before default pages, as we refuse to overwrite an existing page. 
- Legacy-Id: 12174
 2016-10-18 19:32:19 +00:00
Henrik Levkowetz 4cd3c484be New management command create_group_wikis. Work in progress. 
- Legacy-Id: 12149
 2016-10-14 15:03:13 +00:00
Henrik Levkowetz ec684e1b4e Added a pylint rc-file, and fixed or silenced a number of issues found by pylint using the settings .pylintrc (which enable only error checking). 
- Legacy-Id: 11941
 2016-09-08 14:48:59 +00:00
Henrik Levkowetz 64070fa3bf Added the ability to list absolute coverage data, not only show relative differences, to the coverage_changes management command. 
- Legacy-Id: 11460
 2016-06-22 22:05:50 +00:00
Henrik Levkowetz 02773059f2 Better usage help for the coverage_changes management command. 
- Legacy-Id: 11193
 2016-05-15 15:01:50 +00:00
Henrik Levkowetz d96f0fe964 Added a django management command to populate yang model libraries from RFCs and drafts. 
- Legacy-Id: 11110
 2016-04-08 17:18:54 +00:00
Henrik Levkowetz 846a02c3f9 Fixed pyflakes complaints introduced with pyflakes 1.1.0 
- Legacy-Id: 10896
 2016-03-04 21:24:26 +00:00
Henrik Levkowetz b19aae788e Tweaked the output of the check_referential_integrity script to specify the through table name for m2m relationships. 
- Legacy-Id: 10838
 2016-02-12 13:50:57 +00:00
Henrik Levkowetz 09e3f4e96d Added a management command to check referential integrity, original code 
conceived and written by rjsparks@nostrum.com, with some additions and
adaptation as a management command by henrik@levkowetz.com.

This integrity checker, when run on the IETF database in November 2015,
seemed to have a factor on the order of 100 better speed and lower memory
consumption than the code in
https://stackoverflow.com/questions/4734645/is-there-a-tool-to-check-database-integrity-in-django

No exact figure is available, as the latter had to be killed when it had
taken all available ram (~14G) on the development machine, and started to
cause heavy swapping.
 - Legacy-Id: 10508
 2015-11-19 21:40:37 +00:00
Henrik Levkowetz c17ea94b08 Updated the code to use version 4.0.1 of coverage.py for code coverage measurements. Moved the code which starts coverage measurement to settings_sqlitetest.py to avoid coverage measurements running when not doing tests. Did some additional coveage measurement refactoring. 
- Legacy-Id: 10238
 2015-10-18 20:01:57 +00:00
Henrik Levkowetz 90b97468a9 Changed to use a gzipped release coverage JSON file, instead of a plain JSON file, if the name given in settings.py ends in .gz. Reduces the current release coverage file size from ~1.6MB to ~200kB. This is a preparation for saving more information in the release coverage file than we currently do. 
- Legacy-Id: 10235
 2015-10-18 14:32:36 +00:00
Henrik Levkowetz a23846c8be Changed the storage format for code coverage in *coverage.json, in order to be able to calculate code coverage percentages for a subset of tested files. 
- Legacy-Id: 9953
 2015-08-01 15:07:21 +00:00
buildbot 70396be450 Updated test 
- Legacy-Id: 9241
 2015-03-17 17:38:15 +00:00
buildbot cedb115038 Added exception capture and error message when the --release switch to coverage_changes specify a release for which there aren't any data. Also tweaked the diff output for code coverage changes. 
- Legacy-Id: 9239
 2015-03-17 16:15:04 +00:00
Henrik Levkowetz 4b80218548 Merged in [9185] from rcross@amsl.com: 
Add DocEvent and SubmissionEvent to merge-person-records.
 - Legacy-Id: 9197
Note: SVN reference [9185] has been migrated to Git commit cadf07fab3
 2015-03-14 15:47:24 +00:00
Henrik Levkowetz d7f44d6e86 Tweaked test to match earlier coverage_changes output format tweak. 
- Legacy-Id: 9168
 2015-03-08 14:32:14 +00:00
Henrik Levkowetz e4c15de834 Tweaked the coverage_changes output slightly. 
- Legacy-Id: 9165
 2015-03-08 13:19:46 +00:00
Henrik Levkowetz b7095b573f Added a managment command to show the difference in coverage data between the latest release and the latest test run, and a test for the same. 
- Legacy-Id: 9162
 2015-03-07 22:27:02 +00:00
Henrik Levkowetz 86997e1e95 Turned the api.py file into a module. Moved the makeresources management command to the api module. Added some api tests. Added crawling of api files to the test-crawler. Adjusted some resource files discovered by the test suite and test-crawler. Removed a bunch of empty model files. 
- Legacy-Id: 9144
 2015-03-03 20:23:36 +00:00
Henrik Levkowetz 9cb2f17f0f Added a refinement to the pyflakes management command, to make it clearer where exceptions while running pyflakes originate. 
- Legacy-Id: 8747
 2014-12-14 20:35:35 +00:00
Henrik Levkowetz 147cc96a51 Added a management command to generate (and update) resource files for tastypie, in order to have to manually maintain the resource files needed by tastypie when models are added (model changes will have to be handled manually, or by removing the old class from the resources and auto-generate it again). 
- Legacy-Id: 8743
 2014-12-14 20:32:12 +00:00
Henrik Levkowetz 8aba7e97fc Provide a better message if pyflakes fails due to syntax errors in a python file. 
- Legacy-Id: 8011
 2014-07-01 21:12:03 +00:00
Henrik Levkowetz 454c9d83cb Fixed support for verbosity and overwrite flags for the import_htpasswd command, which was lost in [7583]. 
- Legacy-Id: 7585
Note: SVN reference [7583] has been migrated to Git commit 4c0d52d9ed
 2014-04-09 18:34:18 +00:00
Henrik Levkowetz 4c0d52d9ed Split out the actual htpasswd import functionality from the BaseCommand subclass, so we can call it from elsewhere. 
- Legacy-Id: 7583
 2014-04-09 18:28:42 +00:00
Henrik Levkowetz 156b0d4e3a Changed the code to use django's own authentication, instead of http basic auth. This will let people log out, and will also use stronger password hashing than basic auth. Added a login page, and logout links, and links from the logged in username (in the upper right corner) to the user's profile page. 
- Legacy-Id: 7580
 2014-04-07 18:56:44 +00:00
Henrik Levkowetz 3a3b386a0e A htpasswd import script, for the transition from basic http auth to Django native authentication. 
- Legacy-Id: 7578
 2014-04-06 17:20:31 +00:00
Henrik Levkowetz b9cbb236dd Renamed flakes.py to pyflakes, and fixed the import setup so it won't try to import itself. Added verbosity control. 
- Legacy-Id: 7502
 2014-03-16 18:16:37 +00:00
Henrik Levkowetz 5bef5d11ae Made doc/ pyflakes-clean. 
- Legacy-Id: 7462
 2014-03-15 16:09:47 +00:00
Henrik Levkowetz 0eefa5760c Added a management command to run pyflakes, with the added feature of being able to mark individual lines with # pyflakes:ignore, which is needed in some cases. 
- Legacy-Id: 7367
 2014-02-25 20:22:20 +00:00
Henrik Levkowetz bc0e4e5614 Tweaked the makefixture command to not recurse on reverse relationships. 
- Legacy-Id: 6446
 2013-10-14 18:36:20 +00:00
Henrik Levkowetz b335ef3b5c Imported a newer version of makefixture from github. It handles reverse relationships in a less hackish way than my hack. 
- Legacy-Id: 6314
 2013-09-30 14:24:14 +00:00
Henrik Levkowetz 6e9e1930e2 Added a makefixture management command, from http://djangosnippets.org/snippets/918/, somewhat hacked. 
- Legacy-Id: 6307
 2013-09-29 20:50:51 +00:00