Commit graph

1187 commits

Author SHA1 Message Date
Robert Sparks f11907b6a0 Improved test coverage for ietf/doc/views_charter.py. Commit ready for merge.
- Legacy-Id: 14896
2018-03-21 21:59:45 +00:00
Adam Roach e7b984dfa7 Adding page count to last call page. Commit ready for merge.
- Legacy-Id: 14884
2018-03-21 09:12:34 +00:00
Ben Campbell cc96709957 Give ADs the red Clear Ballot button
- Legacy-Id: 14848
2018-03-17 16:35:35 +00:00
Henrik Levkowetz a04e187f0f Removed some old debug print statements.
- Legacy-Id: 14823
2018-03-14 22:11:06 +00:00
Henrik Levkowetz 1fd4a4d1a7 Added session ical links to document lists (WG docs, search results, etc.) for documents on upcoming meeting agendas. Reduced the query and rendering times of document lists some more through additional prefetch_related().
- Legacy-Id: 14799
2018-03-14 19:16:50 +00:00
Henrik Levkowetz fdba464808 Added result caching for a couple of Document methods.
- Legacy-Id: 14795
2018-03-14 19:11:18 +00:00
Henrik Levkowetz 6e9bb00f13 Changed html cleaning to differentiate between fragment cleaning and document cleaning. Added an lxml-based cleaner for document cleaning, also permitting <style> tags (but not external style sheets).
- Legacy-Id: 14775
2018-03-13 12:48:22 +00:00
Henrik Levkowetz 2c0348cc7a Found that django's urlize() does not deal well with adjacent parantheses. Replaced it with a filter based on bleach.linkify, which does better.
- Legacy-Id: 14752
2018-03-09 15:07:04 +00:00
Henrik Levkowetz 1df3c715d0 Replaced the use of (at least in Django 1.11) buggy urlize() with bleach.linkify(), to avoid some exceptions caused by malformed urlize output, exposed by the new sanitize_html(). Also removed some dead code.
- Legacy-Id: 14751
2018-03-09 12:00:15 +00:00
Robert Sparks 975522af35 Make a more appropriate review message when a BoF has an initial charter under consideration. Fixes #2458. Commit ready for merge.
- Legacy-Id: 14715
2018-02-28 20:54:56 +00:00
Henrik Levkowetz 6e1d4d45d8 Added some missing migrations
- Legacy-Id: 14697
2018-02-25 20:08:37 +00:00
Henrik Levkowetz 1389775488 Added some missing migrations.
- Legacy-Id: 14696
2018-02-25 20:06:50 +00:00
Henrik Levkowetz 1ed8e967e7 Merged in ^/personal/henrik/6.72.1-django-1.11@14676: Upgrade to Django 1.11
- Legacy-Id: 14695
2018-02-25 19:55:16 +00:00
Henrik Levkowetz dc90fa3940 Changed user.is_authenticated and .is_anonymous from method calls to attribute access.
- Legacy-Id: 14668
2018-02-22 00:03:30 +00:00
Henrik Levkowetz 6184170828 Changed import path from a deprecated path to the kosher one.
- Legacy-Id: 14667
2018-02-22 00:01:01 +00:00
Henrik Levkowetz 26bf387356 Replaced direct assignment to m2m fields with .clear() and .set()
- Legacy-Id: 14666
2018-02-21 23:58:25 +00:00
Henrik Levkowetz 36b5e2ef8e Changed name from .rel to .remote_field for remote accessors.
- Legacy-Id: 14665
2018-02-21 23:56:36 +00:00
Henrik Levkowetz a4768bb514 Removed unused imports. Added some explicit orderings to avoid pagination issues.
- Legacy-Id: 14664
2018-02-21 23:54:31 +00:00
Henrik Levkowetz 06362ec046 Got rid of old migrations and created new initial migrations.
- Legacy-Id: 14662
2018-02-21 23:46:22 +00:00
Henrik Levkowetz 5638cf3da3 Changed all usage of ForeignKey and OneToOneFiled in model.py files to the compatibility versions from ietf.utils.models.
- Legacy-Id: 14661
2018-02-20 15:36:05 +00:00
Henrik Levkowetz cdc295bab8 Merged in [14655] from housley@vigilsec.com:
Strip the HTML tags around the new values in the mail produced by email_iesg_processing_document. Also, provide the previously missing URL at the end of the message. Fixes 2455.
 - Legacy-Id: 14657
Note: SVN reference [14655] has been migrated to Git commit 6ea0881a89
2018-02-19 17:36:09 +00:00
Russ Housley 6ea0881a89 Strip the HTML tags around the new values in the mail produced by email_iesg_processing_document. Also, provide the previously missing URL at the end of the message. Fixes 2455.
- Legacy-Id: 14655
2018-02-18 20:40:49 +00:00
Henrik Levkowetz 3dd66eba65 Fixed an UnboundLocalError (only partial variable initialization) bug.
- Legacy-Id: 14620
2018-02-07 06:13:19 +00:00
Henrik Levkowetz a00532694d Merged in [14549] from rjsparks@nostrum.com:
Allow those people who can make a review request to edit the request deadline. Send mail to other directorate secretaries when one secretary makes a change to a request. Fixes #2233.
 - Legacy-Id: 14555
Note: SVN reference [14549] has been migrated to Git commit ba8b4d3a38
2018-01-23 19:24:39 +00:00
Henrik Levkowetz 535cd0bccf Expanded the fields that the 'author' entry of the document search form is applied to, from just author name, to author name, email addresses, and affiliation. Fixes issue #2415.
- Legacy-Id: 14552
2018-01-23 18:12:10 +00:00
Robert Sparks ba8b4d3a38 Allow those people who can make a review request to edit the request deadline. Send mail to other directorate secretaries when one secretary makes a change to a request. Fixes #2233. Commit ready for merge.
- Legacy-Id: 14549
2018-01-22 21:43:53 +00:00
Henrik Levkowetz 649433874f Merged in [14539] from rjsparks@nostrum.com:
Warn when putting a draft on a telechat that is so close that directorates will probably not have time to complete a review. Fixes #2381.
 - Legacy-Id: 14542
Note: SVN reference [14539] has been migrated to Git commit dfc1d2aa9a
2018-01-19 15:22:16 +00:00
Robert Sparks dfc1d2aa9a Warn when putting a draft on a telechat that is so close that directorates will probably not have time to complete a review. Fixes #2381. Commit ready for merge.
- Legacy-Id: 14539
2018-01-18 22:14:30 +00:00
Henrik Levkowetz 07fd714c88 Refined the URL patterns and handling of alternative meeting material file formats, which were broken by an earlier refactoring (v6.57.0). Fixes issue #2436.
- Legacy-Id: 14521
2018-01-14 21:09:28 +00:00
Henrik Levkowetz 97206c6eeb Added user notification about ballots closed automatically when creating a new ballot.
- Legacy-Id: 14471
2017-12-29 15:24:37 +00:00
Henrik Levkowetz 4488fd82a4 Merged in [14467] from housley@vigilsec.com:
Close any previous ballots when a charter goes to Internal Review or Extrernal Review.  Fixes #2421.
 - Legacy-Id: 14470
Note: SVN reference [14467] has been migrated to Git commit de6121c6c1
2017-12-29 13:40:10 +00:00
Russ Housley de6121c6c1 Close any previous ballots when a charter goes to Internal Review or Extrernal Review. Fixes #2421.
- Legacy-Id: 14467
2017-12-28 20:09:56 +00:00
Robert Sparks 0a9737a5d2 Include information about previous team reviews in assignement emails. Fixes #2392. Commit ready for merge.
- Legacy-Id: 14466
2017-12-26 22:13:13 +00:00
Henrik Levkowetz b12bb3ca3c Guard document replacement following methods against infinite recursion on circular relationships.
- Legacy-Id: 14457
2017-12-22 19:28:59 +00:00
Henrik Levkowetz 7d7b7de54f Fixed an ungarded object attribute access.
- Legacy-Id: 14446
2017-12-19 14:38:02 +00:00
Henrik Levkowetz e1fa3ba381 Limited the iesg ballot position API to ADs (excluding secretariat).
- Legacy-Id: 14444
2017-12-19 14:10:43 +00:00
Henrik Levkowetz 6567e707ce Merged in ^/personal/henrik/6.64.2-ballotapi@14426. This provides personal API keys and a ballot position API at /api/iesg/position. Also added an endpoint description at /api/.
- Legacy-Id: 14430
2017-12-17 23:43:44 +00:00
Henrik Levkowetz a08c8dc76f Added an API endpoint to support automation of IESG ballot position posting, at /api/iesg/position. Added tests for the API endpoint, and updated the apikey validation decorator tests. Tweaked the decorator to handle a weakness found during testing.
- Legacy-Id: 14429
2017-12-17 21:55:27 +00:00
Henrik Levkowetz b0863c8963 Modified some names.
- Legacy-Id: 14428
2017-12-16 18:43:08 +00:00
Henrik Levkowetz e7209c6e50 Added a new personal event table to keep track of personal API key logins, and a management command to send out reports about activity to users with API keys. Added a weekly cronjob script to trigger weekly reports, and a monthly script for future use. Added a @require_api_key decorator to validate API keys for API key views and log in the API key owner. Modified the API key management urls to use create and disable rather than add and delete. Updated the API key list view. Added an API placeholder view function for ballot position setting, for test purposes. Added tests for the decorator and management command.
- Legacy-Id: 14426
2017-12-16 18:37:52 +00:00
Henrik Levkowetz 1f976da5c1 Third part of document read refactoring, after [14406] and [14410]. This replaces all usage of the non-unicode-aware get_document_content() function with unicode-aware Document.text() or Document.text_or_error() methods. This was triggered by yet another report of unicode content not being shown properly, and should fix all instances of document (drafts, agendas, minutes, etc.) display in the datatracker not handling unicode characters properly.
- Legacy-Id: 14411
Note: SVN reference [14406] has been migrated to Git commit 967ece7e7d

Note: SVN reference [14410] has been migrated to Git commit 660c81c272
2017-12-11 16:23:51 +00:00
Henrik Levkowetz 660c81c272 Tweaked the file content read refactoring in [14406] to try latin-1 conversion if unicode doesn't work.
- Legacy-Id: 14410
Note: SVN reference [14406] has been migrated to Git commit 967ece7e7d
2017-12-10 17:48:09 +00:00
Henrik Levkowetz 967ece7e7d Started refactoring of reading text from document files (drafts, charters, etc.) in order to normalise on one way of doing this, and making that return unicode rather than undecoded bytes. This is the first step of two, in order to gauge the possible issues and report on discrepancies.
- Legacy-Id: 14406
2017-12-08 21:51:11 +00:00
Henrik Levkowetz 4b5e354abe Merged in [14386] from rjsparks@nostrum.com:
Add a per-year RFC feed.
 - Legacy-Id: 14391
Note: SVN reference [14386] has been migrated to Git commit 6ab819bdde
2017-12-04 15:29:15 +00:00
Robert Sparks 6ab819bdde Add a per-year RFC feed. Commit ready for merge.
- Legacy-Id: 14386
2017-12-01 17:19:51 +00:00
Henrik Levkowetz ddfddb61ca Made the ballot type representation string more expressive, showing both name and doc_type.
- Legacy-Id: 14383
2017-12-01 09:27:28 +00:00
Henrik Levkowetz abb69338e2 Added a warning message for the user if ballot creation failed due to an already open ballot. This is a bad state, and should prevented by stricter checks before changing state, but is better than the current situation until we decide exactly which checks to implement.
- Legacy-Id: 14382
2017-11-30 16:10:38 +00:00
Henrik Levkowetz 98d234cd86 Refactored the handling of BallotDocEvent in tests, only creating them as needed, in preparation for stricter checks on state transitions to avoid mismatches between state and ballot.
- Legacy-Id: 14380
2017-11-30 16:02:31 +00:00
Henrik Levkowetz 64653b1aa3 Merged in [14374] from kivinen@iki.fi:
If draft name has rfcXXXX-bis or rfcXXXXbis then add rfcXXXX to diff context menu. Fixes #460 (7 years old ticket).
 - Legacy-Id: 14375
Note: SVN reference [14374] has been migrated to Git commit 23d053ea53
2017-11-16 08:16:38 +00:00
Tero Kivinen 23d053ea53 If draft name has rfcXXXX-bis or rfcXXXXbis then add rfcXXXX to diff context menu. Fixes #460 (7 years old ticket). Commit ready for merge
- Legacy-Id: 14374
2017-11-15 11:33:02 +00:00
Henrik Levkowetz b931be0a07 Merged in [14365] from kivinen@iki.fi:
Added closed date column to closed review list. Fixes #2150.
 - Legacy-Id: 14366
Note: SVN reference [14365] has been migrated to Git commit 7b4727541a
2017-11-13 06:58:42 +00:00
Tero Kivinen 7b4727541a Added closed date column to closed review list. Fixes #2150. Commit ready for merge
- Legacy-Id: 14365
2017-11-11 11:30:00 +00:00
Henrik Levkowetz a942bffbc6 Merged in [14355] from suresh@kaloom.com:
Fixes #2109
 - Legacy-Id: 14360
Note: SVN reference [14355] has been migrated to Git commit 51fa1deef2
2017-11-11 08:18:13 +00:00
Henrik Levkowetz 8499beb010 Added a 'Recent documents' to the IESG pages.
- Legacy-Id: 14300
2017-11-04 12:36:13 +00:00
Henrik Levkowetz 8786b5c700 Tweaked the error message for review message URLs which cannot be retrieved.
- Legacy-Id: 14297
2017-11-03 19:52:34 +00:00
Henrik Levkowetz e899ed6e4d Permit ADs to do wg session materials upload.
- Legacy-Id: 14293
2017-11-03 14:38:50 +00:00
Henrik Levkowetz 0d15cb0e14 Permit document urls to be up to 512 bytes, rather than the default 200
- Legacy-Id: 14230
2017-10-30 11:07:45 +00:00
Henrik Levkowetz e79397d6ad Added cleaning of review_url from the review completion form, to make sure it's retrievable.
- Legacy-Id: 14227
2017-10-27 05:54:34 +00:00
Henrik Levkowetz 4f83548b49 Added a new field Meeting.days to capture the length of a meeting. This is necessary now that we have previous meetings officially starting Sunday, lasting to Friday, and future meetings starting Saturday, Lasting to Friday. We use Meeting.days to calculate Meeting.end_date(). Meeting.get_ietf_monday() and two cut_off() methods have also been updated to be instance methods instead of class methods, and to not assume that a meeting starts on Sunday.
- Legacy-Id: 14225
2017-10-25 13:38:15 +00:00
Henrik Levkowetz 53eb7c8ae8 Added migrations for document url model changes. Updated the name fixtures. Added ability for individual draft authors to edit document urls.
- Legacy-Id: 14172
2017-09-27 16:37:13 +00:00
Henrik Levkowetz 92d425fd9b Added 'Additional URLs' for documents, the same way we have them for groups.
This could be used to point to a document source repository, to extracted
  yang module files, document wikis, and other relevant resources.
 - Legacy-Id: 14166
2017-09-27 10:52:32 +00:00
Henrik Levkowetz cbda2679a9 Removed some unreachable code.
- Legacy-Id: 14150
2017-09-22 14:45:21 +00:00
Henrik Levkowetz da23da1e8e Tweaked Document.relations_that_doc() to accept unicode relationship strings, in order to let it be called from modules importing __future__.unicode_literals.
- Legacy-Id: 14124
2017-09-16 09:24:29 +00:00
Henrik Levkowetz 4174196af0 Fixed a problem with missing extensions for external materials URLs, introduced in earlier doc.href() normalization work.
- Legacy-Id: 14077
2017-08-24 19:18:54 +00:00
Henrik Levkowetz 2ad08d6c59 Merged in [14056] from rjsparks@nostrum.com:
Straightened out some DocHistory timestamps that did not align with the respective DocEvent timestamps. Fixes #1972.
 - Legacy-Id: 14063
Note: SVN reference [14056] has been migrated to Git commit cebcd61b08
2017-08-21 21:25:48 +00:00
Henrik Levkowetz 9312b59153 Merged in [14055] from rjsparks@nostrum.com:
Improved what initial states are offered when the IRTF chair or RG personnel manage adoption of a document. Fixes #2319.
 - Legacy-Id: 14061
Note: SVN reference [14055] has been migrated to Git commit 09a7d720a1
2017-08-21 12:45:49 +00:00
Robert Sparks cebcd61b08 Straightened out some DocHistory timestamps that did not align with the respective DocEvent timestamps. Fixes #1972. Commit ready for merge.
- Legacy-Id: 14056
2017-08-14 20:33:24 +00:00
Robert Sparks 09a7d720a1 Improved what initial states are offered when the IRTF chair or RG personnel manage adoption of a document. Fixes #2319. Commit ready for merge.
- Legacy-Id: 14055
2017-08-14 19:35:48 +00:00
Henrik Levkowetz 55003bdf87 Simplified and corrected some code which uses doc.href(), based on the recent updates to href().
- Legacy-Id: 14026
2017-08-03 18:11:46 +00:00
Henrik Levkowetz 4dad8cdf9a Added a test to check for missing admin models, and added the admin models that were currently missing.
- Legacy-Id: 14021
2017-08-01 14:00:29 +00:00
Henrik Levkowetz e54a24b931 Added a couple of missing migrations.
- Legacy-Id: 14010
2017-07-31 12:11:08 +00:00
Henrik Levkowetz b33b62824e Added a document name validator to avoid new documents with unwanted characters in the name.
- Legacy-Id: 13998
2017-07-28 22:48:30 +00:00
Henrik Levkowetz 4295396891 Make Document.href() point at the rfc when doc.is_rfc().
- Legacy-Id: 13988
2017-07-27 15:28:11 +00:00
Henrik Levkowetz 3c88cf822b Replaced some group-specific agenda and minutes urls with session-specific urls, and more consistently pointed at explicitly named meeting materilas. Related to [13964].
- Legacy-Id: 13968
Note: SVN reference [13964] has been migrated to Git commit a5d8cc85d3
2017-07-24 17:41:49 +00:00
Henrik Levkowetz 7751f54742 Make materials links on the ietf materials page visible to group delegates.
- Legacy-Id: 13939
2017-07-19 11:45:35 +00:00
Henrik Levkowetz 39dbf43da4 Merged in [13918] from kivinen@iki.fi:
Unified the review request views to use same template, so they all
show same data, in same format.
 - Legacy-Id: 13936
Note: SVN reference [13918] has been migrated to Git commit b6e036b63e
2017-07-18 12:57:56 +00:00
Henrik Levkowetz c65015c30d Merged in [13916] from alireza.mohammadi@icann.org:
Better punctuation during state change by adding \" before and after
old and new state.  Fixes issue #1545.
 - Legacy-Id: 13931
Note: SVN reference [13916] has been migrated to Git commit 07c3fe97fd
2017-07-17 14:25:29 +00:00
Henrik Levkowetz 391d5e9ec5 Added a guard for the case that slides might be removed from a session while agenda page construction is in flight.
- Legacy-Id: 13926
2017-07-17 09:22:06 +00:00
Alireza Mohammadi d715d82c24 Better punctuation during state change by adding \" before and after old and new state. Fixes issue #1545.
- Legacy-Id: 13913
2017-07-15 16:16:16 +00:00
Robert Sparks fbde311f43 Allow editing of title for agendas, minutes, and bluesheets documents. Fixes #2317. Commit ready for merge.
- Legacy-Id: 13899
2017-07-15 12:24:02 +00:00
Robert Sparks 7a11217f6f Refined the state changed email message per discussion on tools-development. Fixes #2116. Commit ready for merge.
- Legacy-Id: 13888
2017-07-15 09:36:29 +00:00
Henrik Levkowetz e7f3d7ecb1 Added the last call end date to the first line of the last call announcement event description, on request from worley@ariadne.com.
- Legacy-Id: 13845
2017-07-12 15:03:17 +00:00
Henrik Levkowetz d2395f9521 Merged in [13832] from rjsparks@nostrum.com:
Treat Area Groups similar to Working Groups and Research Groups where it makes sense to do so.
 - Legacy-Id: 13836
Note: SVN reference [13832] has been migrated to Git commit 2c92aa213d
2017-07-11 21:57:01 +00:00
Henrik Levkowetz 1ba4350a05 Corrected code for [13834], handling minutes and other non-agenda meeting urls correctly.
- Legacy-Id: 13835
Note: SVN reference [13834] has been migrated to Git commit aba3861b0b
2017-07-11 21:40:15 +00:00
Henrik Levkowetz aba3861b0b Use a datatracker internal url for session agendas and minutes, to avoid X-Frame-Options SAMEORIGIN preventing agenda display in frames.
- Legacy-Id: 13834
2017-07-11 21:01:57 +00:00
Robert Sparks 2c92aa213d Treat Area Groups similar to Working Groups and Research Groups where it makes sense to do so. Commit ready for merge.
- Legacy-Id: 13832
2017-07-11 19:12:21 +00:00
Henrik Levkowetz 2c39de61ab Replaced the local copy of the draft/rfc htmlization code with rfc2html as installed modeule.
- Legacy-Id: 13827
2017-07-11 13:52:08 +00:00
Henrik Levkowetz f8f7815060 Added a slide abstract [Edit] button on slide document pages also for empty abstracts, to provide the ability to add abstracts.
- Legacy-Id: 13825
2017-07-10 21:46:21 +00:00
Henrik Levkowetz 900174ae57 Added log.unreachable() calls to some functions believed to be unused.
- Legacy-Id: 13818
2017-07-09 15:01:21 +00:00
Henrik Levkowetz d481019803 Added reverse relationships from drafts to submissions to submission checks to the Json API, to make it easier to find the yang checks for a given document.
- Legacy-Id: 13785
2017-07-07 12:55:30 +00:00
Henrik Levkowetz 22f181cdbe Modified the text shown on Chairs' 'Manage DOcument Adoption in Group' button and corrected the logic for which text to show.
- Legacy-Id: 13725
2017-06-28 17:39:11 +00:00
Henrik Levkowetz 5e6ecfbaf5 Refined the appearance and wording of the 'Manage document's adoption' button.
- Legacy-Id: 13680
2017-06-19 18:09:33 +00:00
Henrik Levkowetz b42f1cbeb5 Replaced the use of unaccent.asciify(), which has similar functionality to unidecode.unidecode(). Changed the draft parser to work exclusively with unicode text, which both makes the removal of unaccent easier, and takes us closer to Py35 compatibility. Adjusted callers of the draft parser to send in unicode.
- Legacy-Id: 13673
2017-06-18 18:23:18 +00:00
Henrik Levkowetz a18cf20868 Removed code which has been marked as unreachable since February/March 2017 without triggering any usage indications.
- Legacy-Id: 13667
2017-06-17 17:54:40 +00:00
Henrik Levkowetz 1905d25aee Made changes to the can_adopt_draft() logic, to make it possible for a chair of multiple groups to correct the mistake if adoption was made for the wrong group.
- Legacy-Id: 13662
2017-06-17 14:28:13 +00:00
Henrik Levkowetz 4fc2c6f960 Merged in ^/personal/henrik/6.54.2-yang@13630:
Added a new yang checker, 'yanglint', to the existing Yang checker class, in
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13634
2017-06-15 20:16:48 +00:00
Henrik Levkowetz d98054c103 Added a new yang checker, 'yanglint', to the existing Yang checker class, in
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13630
2017-06-15 16:09:28 +00:00
Henrik Levkowetz 1178f9f3ba Removed a debug print statement.
- Legacy-Id: 13570
2017-06-09 19:37:41 +00:00
Henrik Levkowetz 317aac9e55 Fixed a place where a missing document author email address could cause a server 500. There may be additional places needing attention, now that we're not inserting dummy addresses.
- Legacy-Id: 13566
2017-06-08 14:44:54 +00:00
Henrik Levkowetz 023a32715d Merged in ^/branch/iola/author-stats-r13145 from olau@iola.com, with additional features from ^/personal/henrik/6.52.1-authorstats.
- Legacy-Id: 13550
2017-06-06 18:36:59 +00:00
Henrik Levkowetz fb93a8c293 Added dates to unreachable() calls, to make it easier to decide when to remove marked code.
- Legacy-Id: 13538
2017-06-06 07:27:07 +00:00
Henrik Levkowetz 2e20d9df66 Changed all instances of deprecated self.failUnless() unittest method to self.assertTrue().
- Legacy-Id: 13515
2017-06-04 16:24:34 +00:00
Henrik Levkowetz 08f134bf52 Improved review linebreaking tests, based on [13495] from olau@iola.dk.
- Legacy-Id: 13511
Note: SVN reference [13495] has been migrated to Git commit 1a59cf60d3
2017-06-04 15:14:56 +00:00
Henrik Levkowetz 5b2087f910 Eliminated several variations on word wrapping, keeping only what used to be wrap_text(), but renamed as ietf.utils.text.wordwrap(). This performs better than django.utils.text.wrap() when there are indented text parts. Replaced django's default wordwrap filter with one calling ietf.utils.text.wordwrap in templates. Changed to triggered wrapping in some cases, with the maybewordwrap filter, which triggers on lines longer than 100 characters. This fixes the issue with undesired wrapping of reviews.
- Legacy-Id: 13505
2017-06-02 23:13:22 +00:00
Ole Laursen 1a59cf60d3 Introduce a word-wrapping filter that checks if there are lines (containing spaces to not
count URLs) longer than 100 characters, and only wraps the text if that's the case, to 
prevent messing up pre-wrapped text. Use this filter in the review email code.

Branch ready for merge.
 - Legacy-Id: 13495
2017-06-02 13:17:30 +00:00
Henrik Levkowetz a92c2b4ad5 Updated migration numbering to avoid collisions.
- Legacy-Id: 13480
2017-05-31 21:36:08 +00:00
Henrik Levkowetz 76628be3fd Merged in ^/branch/iola/author-stats-r13145 from olau@iola.dk, and fixed some tests in code which moved after the latest merge with trunk. The test suite passes, but the migrations are _not_ ready to run, because of numbering conflicts (again due to code changes on trunk since the latest sync).
- Legacy-Id: 13479
2017-05-31 20:59:26 +00:00
Henrik Levkowetz b81be04f20 Fixed the DOI information for doc/rfc*/bibtex/ temporarily; for a better fix we need to import the DOI values in ietf/sync/rfceditor.py
- Legacy-Id: 13478
2017-05-31 16:29:07 +00:00
Henrik Levkowetz 04e76c9fc9 Added raw_id_fields on DocumentAuthorAdmin to speed up form loading, and added SessionPresentationAdmin to the meeting admin.py
- Legacy-Id: 13395
2017-05-19 14:09:49 +00:00
Henrik Levkowetz 355c5cb626 Updated doc migration 0029 to avoid duplicate actions, and to avoid database referential inconsistency due to case differences in email addresses.
- Legacy-Id: 13370
2017-05-16 15:15:30 +00:00
Henrik Levkowetz 48c275fa64 Merged in [13336] from rcross@amsl.com:
Fix issue where deferring a ballot causes 500 error in Telechat app.  Fixes #1342.
 - Legacy-Id: 13360
Note: SVN reference [13336] has been migrated to Git commit 7542e8daa3
2017-05-15 14:05:25 +00:00
Henrik Levkowetz b7fba37f52 Added a guard to prevent problems with legacy drafts without any draft state.
- Legacy-Id: 13318
2017-05-11 11:47:45 +00:00
Henrik Levkowetz 9635e5e3e4 Fixed some pyflakes issues.
- Legacy-Id: 13313
2017-05-11 09:57:58 +00:00
Henrik Levkowetz 7ed85fa96c Updated doc resources.py with EditedAuthorsDocEventResource
- Legacy-Id: 13311
2017-05-11 05:07:57 +00:00
Henrik Levkowetz 405f76f238 Updated the makeresources command to use the current AppCommand.handle_app_config() interface.
- Legacy-Id: 13306
2017-05-10 20:08:40 +00:00
Robert Sparks 8030fb3965 Created an EditedAuthorsDocEvent to capture the basis or reason for changing a documentauthor set. Mapped a large number of email addresses found from the RFC Editor database and from parsing RFCs to the right Person objects, and creating Person objects as necessary. Updated the documentauthors set for RFCs based on reconciling what the tracker already knew with the RFC Editor database and the parsing the RFCs. Manually inspected the Updates to ensure no author was inappropriately removed from the set. Commit ready for merge.
- Legacy-Id: 13289
2017-05-09 20:16:11 +00:00
Henrik Levkowetz 1e98833863 Removed debug statements.
- Legacy-Id: 13229
2017-04-18 14:12:10 +00:00
Henrik Levkowetz 3d6fed4b5b Removed the 'Document' tab introduced in 6.48.0
- Legacy-Id: 13228
2017-04-17 11:39:36 +00:00
Henrik Levkowetz 7e8aeeefee Moved the caching of htmlized documents into Document.htmlized() in order to avoid caching failed htmliztions (usually because of a missing .txt file).
- Legacy-Id: 13227
2017-04-16 13:17:18 +00:00
Henrik Levkowetz 128be4b2e8 Applied a patch from production to trunk.
- Legacy-Id: 13214
2017-04-14 12:09:46 +00:00
Henrik Levkowetz b4fd2b63a8 Merged in [13205] from housley@vigilsec.com:
Check downref registry when producing Last Call text.  Fixes #2069.
 - Legacy-Id: 13210
Note: SVN reference [13205] has been migrated to Git commit aa7ed23cda
2017-04-12 21:24:33 +00:00
Russ Housley aa7ed23cda Check downref registry when producing Last Call text. Fixes #2069.
- Legacy-Id: 13205
2017-04-12 18:27:05 +00:00
Henrik Levkowetz 902a613250 A migration to match docevent type changes from the downref work.
- Legacy-Id: 13202
2017-04-12 18:21:07 +00:00
Henrik Levkowetz d19179ba44 Merged in [13181] from housley@vigilsec.com:
This completes a good chunk of the downref registry work requested in ticket
#2069. The registry has been imported to the database and can be shown, and
entries can be added to the registry.  Addresses issue #2069.
 - Legacy-Id: 13190
Note: SVN reference [13181] has been migrated to Git commit f0125634f8
2017-04-10 22:47:01 +00:00
Russ Housley f0125634f8 Add downref registry to the datatracker at the request of the IESG. Still need to integrate with Last Call message generation
- Legacy-Id: 13181
2017-04-03 17:36:27 +00:00
Henrik Levkowetz 47463eaa94 Changed a test case to look at the area being tested, rather than the whole page, to avoid test failures due to for instance new menu entries.
- Legacy-Id: 13179
2017-03-31 18:22:08 +00:00
Ole Laursen 5b677dc6ba Merge author stats branch into new branch from trunk
- Legacy-Id: 13159
2017-03-28 14:36:40 +00:00
Henrik Levkowetz 14c748df98 Changed the creation of temporary test dirs to use names which include the test class name, in order to make it possible to run test cases in parallel. Disabled coverage testing when running in parallel (those classes cannot be pickled and distributed to the test runner threads, and also won't pass coverage data back). Tweaked the TestCase.tempdir() method.
- Legacy-Id: 13157
2017-03-27 21:41:18 +00:00
Henrik Levkowetz 487019883f Merged in [13120] from rjsparks@nostrum.com:
Be more explicit on review message subject lines. Fixes #2103.
 - Legacy-Id: 13153
Note: SVN reference [13120] has been migrated to Git commit da5a2363d6
2017-03-27 18:12:22 +00:00
Henrik Levkowetz 6ae137944d Merged in [13115] from mahoney@nostrum.com:
Added draftname to email subject for review request (addresses #2144).
 - Legacy-Id: 13151
Note: SVN reference [13115] has been migrated to Git commit b0cbf9a1c9
2017-03-27 17:09:48 +00:00
Henrik Levkowetz d2c2d80341 Merged in [13112] from lars@netapp.com:
Fix various \'RemovedInDjango20Warning\' warnings.
 - Legacy-Id: 13141
Note: SVN reference [13112] has been migrated to Git commit 8a70e9773d
2017-03-26 22:06:47 +00:00
Henrik Levkowetz 6aee4d4a16 Merged in [13109] from lars@netapp.com:
Rename crawl_history to make_rev_history, which is more descriptive. Fix #2224
(thanks, Robert!) by generating graphs for the entire revision history of a doc,
both forward and backward in time.
 - Legacy-Id: 13140
Note: SVN reference [13109] has been migrated to Git commit e14dcdac8f
2017-03-26 21:42:10 +00:00
Henrik Levkowetz 5afa53a09d Merged in [13108] from lars@netapp.com:
Change \'ID Tracker\' to \'Datatracker\' in various places. Fixes some of #2100.
 - Legacy-Id: 13136
Note: SVN reference [13108] has been migrated to Git commit afdf154e0a
2017-03-25 23:46:18 +00:00
Robert Sparks da5a2363d6 Be more explicit on review message subject lines. Fixes #2103. Commit ready for merge.
- Legacy-Id: 13120
2017-03-25 20:45:08 +00:00
Jean Mahoney b0cbf9a1c9 Added draftname to email subject for review request (addresses #2144). Commit ready for merge.
- Legacy-Id: 13115
2017-03-25 19:52:15 +00:00
Lars Eggert 8a70e9773d Fix various "RemovedInDjango20Warning" warnings. Commit ready for merge.
- Legacy-Id: 13112
2017-03-25 19:16:45 +00:00
Lars Eggert e14dcdac8f Rename crawl_history to make_rev_history, which is more descriptive. Fix #2224
(thanks, Robert!) by generating graphs for the entire revision history of a doc,
both forward and backward in time. Commit ready for merge.
 - Legacy-Id: 13109
2017-03-25 18:52:46 +00:00
Lars Eggert afdf154e0a Change "ID Tracker" to "Datatracker" in various places. Fixes some of #2100.
Commit ready for merge.
 - Legacy-Id: 13108
2017-03-25 18:23:38 +00:00
Henrik Levkowetz d3558524f2 Improved traceback for a logger.error() message.
- Legacy-Id: 13093
2017-03-24 09:03:06 +00:00
Henrik Levkowetz ebef6d06d8 Reverted some links to htmlized draft versions, on request.
- Legacy-Id: 13091
2017-03-23 10:57:19 +00:00
Henrik Levkowetz b603791cae Another fix for get_file_path().
- Legacy-Id: 13088
2017-03-23 10:39:35 +00:00
Henrik Levkowetz eef984202f Better handling of missing documents (such as rfc575)
- Legacy-Id: 13060
2017-03-22 12:07:08 +00:00
Henrik Levkowetz 570ef785d6 Improved Document.get_file_path().
- Legacy-Id: 13059
2017-03-22 12:06:28 +00:00
Henrik Levkowetz 9082b0abe5 Another tweak to the rev pattern, and exception handling when breaking apart name an rev for documents which don't use the charter rev model.
- Legacy-Id: 13057
2017-03-22 09:50:07 +00:00
Henrik Levkowetz 5203118041 Changed one more draft directory reference to use the draft archive setting.
- Legacy-Id: 13056
2017-03-22 09:48:11 +00:00
Henrik Levkowetz 475d18ea8e Changed where to look for the text version of expired drafts.
- Legacy-Id: 13052
2017-03-21 15:12:30 +00:00
Henrik Levkowetz e8043e53fb Made Document.htmlized() be a bit smarter about handling documents which have not been provided in .txt format.
- Legacy-Id: 13050
2017-03-21 14:02:43 +00:00
Henrik Levkowetz 814e1315b5 Added a new document tab for some documents, showing htmlized drafts and RFCs
using the htmlization code previously developed for tools.ietf.org.  As the
generation of the htmlized page is a bit too costly to do on the fly for
often-referenced drafts and RFCs, the part of each page which contains the
htmlized document is cached on file with a cache time of 2 weeks.

Changed all links which pointed to the htmlized version on tools to instead
point at the datatracker htmlized document.

Tweaked some URLs which didn't permit retrieval of intermediate-rev-charters.

Narrowed the pattern for document names to disallow dots in names, and
instead explicitly enumerated the few historical draftw with dots in the
name.

Added a file-system cache for the htmlized documents, and specified a
max_entries value for caches, overriding the default 300 entries.

Tweaked the code for new author email entries to provide a time if missing
in an updated entry.

Changed links in various email templates which pointed at tools.ietf.org
pages to instead point at datatracker pages, where appropriate.

Changed the search result rows to provide links to both the current meta-
information document pages (with a (i) info symbol) and to the new htmlized
document pages.
 - Legacy-Id: 13040
2017-03-20 14:08:52 +00:00
Henrik Levkowetz a67e9dd5c4 Added a number of new methods on DocumentInfo/Document/DocHistory, to support the new htmlized document page. Added caching for some methods.
- Legacy-Id: 13039
2017-03-20 13:51:46 +00:00
Henrik Levkowetz d6d6fd65db Applied a patch rjsparks@nostrum.com to make ballot grids show for statchg documents in ietf last call.
- Legacy-Id: 13015
2017-03-15 14:57:20 +00:00