ietfdb (6.17.0) ietf; urgency=medium **Speedier REST API and Newest-First Search Result Ordering** This is a small combined feature and bugfix release. It introduces better sort capability for document search results which are too large to present all search result items on one page. Since 6.12.0 it has been possible to do both reverse and regular client-side sorts on the various search result columns when all the search results did fit on one page, but for truncated results only ascending sorts has been possible. For the date column in particular, this was mostly less than useful, as it would present the oldest results first, rather than the most recent. This has now been remedied; sorting in both directions is available also for large document search results. This release also contains various speed-related fixes. Of particular note is speed imporvements of heavy REST API queries on the order of a factor 4, by adding caching, and speed improvements of a factor 20 for some heavy legacy pages, by limiting the rendered content to what is actually needed. Details: * Tweaked the test-crawler to give the same log line format for exception failures as for regular log lines. * Merged in [10932] from rjsparks@nostrum.com: Restrict related documents included in the 1wg-charter* views to those that update or obsolete WG produced RFCs. * Fixed some typos. * Introduced caching for the REST API resources by subclassed tastypie's ToOneField in order to provide caching for FK entries. * Removed obsolete Submission.idnits_message field. * Added an admin model class for SubmissionEvent. * Tweaked the mkdevbranch utility script to be able to make a branch for one specific developer on request. * Corrected the path to the wrapper for postconfirm used by the draft- and wg-aliases. * Added a workaround for thread import lock problem, http://bugs.python.org/issue7980. * Renamed a bunch of identically named MainTestCase classes. * Removed unused idnits_message field on Submission model. * Added reverse sort capability to truncated document search views. Aligned the sort direction arrow with that used for the client-side tablesorter for untruncated results. -- Henrik Levkowetz 16 Mar 2016 15:11:45 +0000 ietfdb (6.16.0) ietf; urgency=medium **Yang validation of draft submissions** This release adds Yang validation of submitted drafts which contain Yang code, through a new plug-in architecture which makes it easy to addo other submission-time checkers and validators in the future. It also contains a few unrelated fixes and tweaks, as follows: * Fixed pyflakes complaints introduced with pyflakes 1.1.0 * Refactored draft submission checks so that new checkers can be slotted in through a configuration in settings.py. Refactored the calling of idnits to use the new API, and added a pyang validation check. * Added new entries to requirements.txt: pyang, xym, and jsonfield. Sorted the list. * Merged in [10880] from rjsparks@nostrum.com: Only show the 'Upload new revision' button when the view will actually let you upload a new revision. * Merged in [10862] from rjsparks@nostrum.com: Group concluded working groups by area. Fixes #1670. * Merged in [10839] from housley@vigilsec.com: Added test for proper eneration of the approval message with and without an RFC Editor Note. Tweaked RFC Editor note display template. -- Henrik Levkowetz 05 Mar 2016 15:01:38 +0000 ietfdb (6.15.0) ietf; urgency=medium **Session docs, WG List Archive Tab, RFC Note enhancements** This release provides a number of nice enhancements: - Documents can now be associated with meeting sessions from the document information page by group chairs, secretariat, etc., through an edit button by the 'On Agenda' entry in the Stream info section. - The group pages now provide links to both the new Mailarchive and the old MHonArc list archives (if both exist). - The ability to add RFC Editor notes which will be called out on the IESG agenda which was introduced in release 6.14.0 has now been made available to the IAB, IRTF and Independent streams. Detailed changelog information: * Merged in [10861] from rjsparks@nostrum.com: Data cleanup: place old groups in better states and better areas. Remove a few groups that appear to have never existed (as groups). * Merged in [10857] from rjsparks@nostrum.com: Preserve the assumptions in the secr/proceedings code by isolating it from drafts now appearing in sessionpresentations. * Merged in [10856] from rjsparks@nostrum.com: - Show all sessions associated with a document. - Remove the day/seq urls from the materials tree. - Allow sessionpresentation.rev to be None, meaning 'current version'. - Streamlined workflows to focus on current versions of a draft as a default. - Allow adding and editing sessionpresentations when looking at a specific document. - Allow adding drafts when looking at a specific session. - Add the meeting tab to 'team' groups. - Refactored several utility classes and expanded on factories. Fixes #1908 and #1910. * Since the list-archive tab on group pages can sometimes be a tab and sometimes a link out, positioning it between the always-tab and always link-out entries seems reasonable. * Column text on the archives tab could overlap for some screen sizes. Tweaked the use of bootstrap cell width styles. * Merged in [10848] from rjsparks@nostrum.com: Correct typo in template. Fixes #1914. * Restricted django-bootstrap3 to versions which work with django 1.7. * Merged in [10718] from olau@iola.dk: Set daemon = True on the thread in the SMTP test server running while running tests. This fixes the annoying problem of the python process staying alive after certain bugs in the test invocation or after a plain Ctrl + c. * Merged in [10840] from rjsparks@nostrum.com: Fill in the list archive tab, showing both mailarchive and mhonarc links when they exists. Preserve the immediate link-to-archive behavior for the group pages for lists that are not in mailarchive/mhonarc. Provides a url at the datatracker for the mailman listinfo pages to use that will show both types of archive. * Tweaked the output of the check_referential_integrity script to specify the through table name for m2m relationships. * Merged in [10834] from housley@vigilsec.com: Allow IAB, IRTF, and Independent streams to use new capability for RFC Editor Notes. Do not display of document shepherd and shepherd writeup for non-IETF stream documents. Do not display IESG information for IAB stream documents. * Merged in [10828] from lars@netapp.com: IRTF RGs do not have a review period, the email is generated as a courtesy to the IAB and IESG. -- Henrik Levkowetz 29 Feb 2016 17:00:45 +0000 ietfdb (6.14.1) ietf; urgency=medium This is a small bugfix release. * Merged in [10811] from rjsparks@nostrum.com: Handle expiring the last call of status change documents. Be more robust about errors when expiring last calls. Fixes #1911. * Merged in [10810] from rjsparks@nostrum.com: Removed a bunch of redundant displays of the django messages framework messages from forms. * Merged in [10809] from rjsparks@nostrum.com: Further tweaks to rendering messages from the messaging framework. * Merged in [10806] from rjsparks@nostrum.com: Fix a minor typo in the new rfc_editor_note code. * Merged in [10804] from rjsparks@nostrum.com: Some tweaks to handle rendering django messaging framework messages a little better. * Merged in [10803] from rjsparks@nostrum.com: Create the approval ballot for charters when the charter enters external review (or iesg review if external review is skipped). Fixes #1792. * Moved some production-path checks to the checks module, and fixed up tests which changed some settings without restoring them. * Added caching to the smart document lookup view. -- Henrik Levkowetz 11 Feb 2016 09:33:25 +0000 ietfdb (6.14.0) ietf; urgency=medium **Meetings Tabs on Group Pages** This is a mixed bugfix and feature release. The most notable new features are: - The WG and RG pages now have 'Meetings' tabs, which lists regular and interim meetings with links to agenda, minutes, and materials. - The IESG Telechat Agenda now shows "(Has RFC Editor Note)" after the I-D filename if there is an RFC Editor Note associated with the document. - Improved calculation of 'modified' timestamps for meetings, to make it possible for meeting apps like 'IETFers' to know when to fetch updated meeting data without having to poll all sessions and timeslots regularly in order to catch changes. Here's the full list of fixes and features: * Merged in [10780] from rjsparks@nostrum.com: Stop making active unknown-email- objects. Mark existing such objects as inactive. Tweak exception handling in submit/utils to make it obvious that the utilities will not change the person an existing Email record is pointing to. * Removed previously mandatory but unwanted '.html' suffixes on meeting views. * Merged in [10779] from rjsparks@nostrum.com: Added the ability to associate documents with sessions from the document main page. Integrated the group meetings tab with the secretariat meeting request and meeting materials pages. Made better use of bootstrap styling for the meetings tab and session details view. * Consolidated multiple group contextmenu buttonlist elements into one. Changed button links into plain links for agenda/minutes/materials -- makes the bage less busy, takes up less room, and lessens the conflation between action buttons and links. * Merged in [10770], [10771], [10772], and [10773] from housley@vigilsec.com: The IESG Telechat Agenda now shows "(Has RFC Editor Note)" after the I-D filename if there is an RFC Editor Note associated with the document. This was added to the html and txt versions of the agenda. It was not added to the Secretariat view or the Scribe view of the agenda. For transition, when an AD edits the RFC Editor Note, they need to move the text from the current writeup into the new field. Returning documents on the telechat agenda seems to be the biggest opportunity for something to fall between the cracks. If an event of type "changed_rfc_editor_note' exists, and the string "RFC Editor Note" appears in the text of the most recent 'changed_ballot_writeup_text' event, then a message is shown that tells the AD to remove the RFC Editor Note from the writeup. * Merged in [10765] from lars@netapp.com: Correctly identify group work items in announce_to_lists.txt. Fixes #1901. * Merged in [10764] from lars@netapp.com: Fixed a RemovedInDjango19Warning: The django.forms.util module has been renamed. Use django.forms.utils instead. * Merged in [10763] from lars@netapp.com: Updated some web assets. Also change bower.json so bower can automatically fetch newer minor or patch releases for the assets. * Merged in [10758] from rjsparks@nostrum.com: Provide help-text for the new-status field when editing status change document relations. Fixes #1898. * Merged in [10757] from rjsparks@nostrum.com: Fix from Ole Laursen for the javascript managing status-change document relationships. Fixes #1899. * Merged in [10756] from rjsparks@nostrum.com: Tweak factories to not randomly create keys that violate constraints. * Merged in [10755] from rcross@amsl.com: Change merge-person-records, don't delete User until we handle related objects. * Added a script to disambiguate document timestamps for the last 3 years, in order to avoid AmbiguousTimestamp exceptions and HTTP 500 errors for certain documents and document envents which fell in the autumn PDT-PST duplicate hour. * Changed draft submission confirmation to not fail if the login used is missing an associated person record. * Merged in [10734] from rjsparks@nostrum.com: Excluded concluded bofs from the set of groups for which a person can pre-approve drafts. Restore AD access to preapproval. (Need to consider adding delegate and group secretary access). Fixes #1896. * Merged in [10733] from rjsparks@nostrum.com: Show session details for interims as well as ietf meetings. * Merged in [10732] from rjsparks@nostrum.com: Filter unused document types from the search form. Fixes #1890. * Merged in [10731] from rjsparks@nostrum.com: Addresses issues uncovered by the test-crawler. Adds missing DocAlias records for several document types. Creates DocAlias objects when createing Document objects for those document types. Identifies places in code to touch when we are ready to expose the bluesheets and recording document types at /doc/. (The data rows and the content store need work before doing so). * Merged in [10728] from rjsparks@nostrum.com: Refactored meeting urls file without changing functionality in prepation for extending some views to handle interims. Reduced the level of redundancy in the way the urls lists were constructed. * Merged in [10726] from rjsparks@nostrum.com: Added listing all the area directors back. Related to #1889. * Merged in [10725] from rcross@amsl.com: Modified notification text for merges of multiple Person records for the same person. * Merged in [10723] from rjsparks@nostrum.com: Tweaked the rendering of Area Directors in the charter text used in new-work, internal review, external review, and group action messages to display. Fixes #1889. * Merged [10721] and [10724] from rcross@amsl.com: Removed Test watermark from interim meeting index background. Rewrote merge-person-records utility script to handle all related objects in a generic manner, remove old User records and handle email primary attribute. Fixes #1627. * Merged in [10719] from rjsparks@nostrum.com: Added a meetings tab to the group information page. Links to minutes, agendas, and materials for each session at each meeting. Improves the UI for the session materials page. * Merged in [10701] from rjsparks@nostrum.com: Simplified meeting.session_details. Shows all sessions for a meeting on one page instead of having a page per session. Removes the by-date, by-weekday, by-sequence mechanic. * Changed the calculation of 'modified' time for a meeting, and also changed the 'updated' field for Session, TimeSlot, and SchedTimeSessAssignments to auto-update on any changes to the objects. * Enabled resource sorting by modification time for Sessions, Timeslots, and Assignments. Fixed a bug which left Timeslot.duration null in the resources. -- Henrik Levkowetz 07 Feb 2016 15:42:41 +0000 ietfdb (6.13.0) ietf; urgency=medium **Improved NomCom Support** This release provides a massive refactoring of the NomCom app, fixing a large number of known issues, and adding a long list of refinements, improvements and new features. This whole release is the work of rjsparks@nostrum.com. From the commit log: * Merged in [10629] from rjsparks@nostrum.com: This set of changes focuses on improvements to the nomcom portion of the datatracker. These changes: - Simplify the nomcom form for comments. Make it more obvious who receives mail when a comment is supplied. Fixes #1849. - Simplify the nomcom form for nominations. Provide a primary workflow where nominations choose an existing Person, and a secondary workflow for nominating new people. - Allow nominees to add a comment when accepting or declining a nomination. Fixes #1845. - Organize the list of nominees on the feedback page. Fixes #1786 and #1809. - Simplify the mechanisms used to display feedback message counts. - Regroup the feedback view to make it easier to see where to spend review effort. Fixes #1866. - Capture when nomcom members last reviewed feedback for a given nominee. Add badges when new feedback is avaliable. Improve the layout of the feedback index page. Fixes #1850. - Reorganize the tab navigation on the nomcom private pages. Made it more obvious when the chair is doing something that only the chair gets to see. Fixes #1788 and #1795. - Regroup multiselect options to make classifying pending feedback simpler. Make the control larger and resizable. Fixes #1495. - Simplify the chair's views for editing nominee records. Replace the merge nominee form with a request to the secretariat to merge Person records. Fixes #1847. - Added merging nominees to the secretariat's persson merging script. - Show information for concluded nomcoms. Close feedback and nomination for concluded nomcoms. Fixes #1856. - Improve the questionnaire templates, reminding the nominee that receiving the questionnaire does not imply they have accepted a nomination. Fixes #1807. - Remove the description field from Postion. Simplify the Position list and the Position edit form. Make the nomcom pages more self documenting. Add a page to help nomcom chiars through setting up a new nomcom. Fixes #1867 and #1768. - Remove the type from the template pathname for the requirements templates. Make the requirements views work for both types plain and rst. Changed the default type for new nomcom requirement templates to rst. - Remove 'incumbent' from the models. Fixes #1771. - Adjust the models for Nominee and Nomination to better associate Nominee objects with Person objects. - Remove BaseNomcomForm and the implementation of custom fieldsets. - Replace the custom message framework with the django provided messages framework. - Improve SearchablePersonField to show the primary email address for any search result where a name appears more than once. - Add the use of factory-boy for generating test data. Normalize management of a test directory for test nomcom public keys. Significantly improve test coverage of the nomcom related code. -- Henrik Levkowetz 18 Jan 2016 09:05:42 +0000 ietfdb (6.12.1) ietf; urgency=medium This is a bugfix release, in preparation for the next feature release. * Merged in [10686] from lars@netapp.com: Load the js for the timeline as part of the page header, in order to (hopefully) avoid page re-render after the json loads. Only apply the gradient that signifies document expiration to I-Ds. Suppress duplicate x-axis labels (same month). * Merged in [10685] from lars@netapp.com: Commit r10578 broke search result table display due to the added column. Fixed this. (Also updated vnu.jar. Unrelated, but wasn't careful when committing.) * Merged in [10684] from lars@netapp.com: Added a warning about the accuracy of bibliographic information for Legacy RFCs. * Added listing of Area Directors and TBD indications which was inadvertently dropped from some chartering related emails during refactoring. Also added testing code to verify the email body content of some chartering emails a bit more thoroughly. * Merged in [10674] from lars@netapp.com: More fixes to charter-related emails and some related web templates. Mostly focused on supporting the IRTF better, but also removing some redundancies (i.e., including group_info.txt instead of duplicating something similar.) * Merged in [10673] from lars@netapp.com: Fixed the internal review email template and related code to handle IRTF RGs better. * Merged in [10672] from lars@netapp.com: Fixed a bug that prevented the IRSG from being CC'ed, and correct its email address. * Merged in [10671] from lars@netapp.com: Fixed a 'RemovedInDjango19Warning' warning. -- Henrik Levkowetz 15 Jan 2016 08:46:18 +0000 ietfdb (6.12.0) ietf; urgency=medium **Document timelines, table sorting, iesg agenda page counts, AD position colours** This is a combined feature and bugfix release. New features from lars@netapp.com: - Graphical document timelines at the top of each draft and RFC document page, giving an overall graphical view of the history timeline of the document and its ancestors. - Swift client-side sorting of tables, wherever it makes sense. - Document dependency graphs are now provided in svg format by default. The old pdf format is still available if desired. New features from rjsparks@nostrum.com: - Page counts on the IESG agenda and documents pages New features from henrik@levkowetz.com: - Substantially reworked AD position signal colours, with sidebars, on the AD view of the IESG agenda and document pages. There is also a long list of bugfixes, provided by rjsparks@nostrum.com, lars@netapp.com, housley@vigilsec.com, rcross@amsl.com, and henrik@levkowetz.com. Here are details, extracted from the commit log: * Don't redirect to proceedings for future meetings which exist in the database but don't have a schedule yet. We want to show tne agenda (even if empty) for those. * Merged in [10636] from rjsparks@nostrum.com: Refactored counting telechat pages to do it only in one place. Count more accurately and make it possible to report more granularly. Added page counts to agenda.json. * Merged in [10634] from rjsparks@nostrum.com: Change the text used in conflict review approval messages. Fixes #1877. * Merged in [10633] from housley@vigilsec.com: If the Internet-Draft is not the current revision, set the URLs to settings.IETF_ID_ARCHIVE_URL. Fixes #1876. * Merged in [10632] from housley@vigilsec.com: For documents in the IETF stream, display consensus in the IESG portion of the page. For documents in other streams, disply consensis in the Stream portion of the page. Fixes #1560. * Merged in [10631] from rjsparks@nostrum.com: Added page counts to iesg/agenda/documents and to the edit telechat date form. Fixes #1772. * Merged in [10630] from housley@vigilsec.com: Better handling of consensus for BCPs and standards track documents. Partial fix for ticket 1560. * Merged in [10624] from rcross@amsl.com: ValueError at /ipr/new-specific. Fixes #1873. * Merged in [10623] from lars@netapp.com: Simplify the dependency graph generation, by relying on dot to generate PDF (and now also SVG) directly. Default to showing SVG from the link on a group's page. * Merged in [10621] from lars@netapp.com: Use js tablesort almost everywhere I thought it would make sense. While I touched the pages, I also corrected a few minor HTML nits, capitalization inconsistencies and some other minor things. * Merged in [10605] from lars@netapp.com: Show IDs that expired with a fading gradient and don't extend their box after 185 days. Plus a bunch of cosmetic changes. * Rewrote crawl_history() to be easier to read (renaming multiple 'retval' variables and other naming tweaks) and made it return distinct revisions without the added uniqueness filtering round from /personal/lars/6.11.1.dev0@10604. * Merged in [10591] from housley@vigilsec.com: Added a negative test to ensure the RFC Editor is not included on notifications of manual posts by the Secretariat unless the document is in the RFC Editor Queue. * Added a directory for staging of manually submitted drafts, instead of using hardcoded /tmp/, and added creation and removal of a test directory for this. * Merged in [10586] from housley@vigilsec.com: Added automated tests for the fix for ticket #1751. * Merged in [10569] from housley@vigilsec.com: For manual posting of an I-D by the Secretariat, include the RFC Editor on the email message if the I-D is in the RFC Editor Queue. Fixes #1751. * Changed a helper function meeting_updated() to a method on Meeting, and provided it as a synthetic attribute on the /api/v1/meeting/meeting/ endpoints of the JSON API. * Merged in [10567] from housley@vigilsec.com: For Charters, display the Responsible AD as well as the Charter Edit AD. Fixes #1829. * Moved the timeline colouring css to ietf.less, to pick up the brand colours directly. * Merged in /personal/lars/6.11.1.dev0@10590 from lars@netapp.com, which brings in a timeline view at the top of document pages. * Merged in [10551] and [10553] from lars@netapp.com: Added an .editorconfig file, so we can have some consistency in the project. (I don't care what settings we use, as long as we all use the same.) Use four spaces as default (Python default, as suggested by Henrik). * Tweaked the colours a bit in order to make it easier for ADs to distinguish between the position colours on their personalised versions of iesg/agenda/documents/. * Added a coloured bar at the right-hand side of the ADs' view of iesg/agenda/documents/, in order to make it easier to distinguish between the 'yes' and 'no-objection' colour codes. * Moved definitions for the AD ballot position's background colours (which shows each AD his own positions by colour coding) from ietf.css to ietf.less, to make it easier to adjust the colours while keeping to the hues of the colour palette. * Updated and corrected the description in the README file of of how the contents of the bootstrap/dist/ directory end up in the right place for static serving. * Merged in [10540] from lars@netapp.com: Update vnu HTML5 validator, and fix an HTML nit it found. * Merged in [10539] from lars@netapp.com: Fix CSS/js inclusion of select2 from new static location. (Looks like this file was forgotten when we began to use bower.) * Merged in [10538] from lars@netapp.com: Fixes for displaying IRTF RGs (call them RGs, and don't show IESG state.) * Merged in [10536] from lars@netapp.com: Manage html5shiv and respond.js locally via bower, rather than relying on the CDN. * Merged in [10532] from lars@netapp.com: Move to bootstrap 3.3.6, with a simpler way to maintain our customized version in the future (described in bootstrap/README-DATATRACKER.rst). -- Henrik Levkowetz 13 Jan 2016 10:28:56 +0000 ietfdb (6.11.0) ietf; urgency=medium **Liaison Tool Enhancement** This release introduces a number of requested changes and enhancements to the liaison tool, and a few other fixed: * Merged in^/personal/rcross/v6.7.3.dev0@10465, which included [10382],[10464],[10465], introducing a number of usability fixes to the liaison tool, including a new tab for action needed statements and the ability to add comments to liaison statements' history. * Merged in [10503] from rjsparks@nostrum.com: Allow setting the stream state of a document that has not yet had any stream state set. Fixes #1859. Candidate for patch. * Updated the docker README. * Updated the mkrelease script to send svn checkout links which specify https://, not http. -- Henrik Levkowetz 20 Nov 2015 20:25:07 +0000 ietfdb (6.10.0) ietf; urgency=medium **Prepackaged Development Environment with Docker; Test Speed-Ups** This release provides what is hoped to be a dramatic improvement in the time needed to set up an environment for datatracker development, by providing scripts to use prebuilt docker images and mysql database tarballs. The setup process should now be as easy as: 1. Install Docker: https://docs.docker.com/engine/installation/ 2. Check out datatracker code: svn co https://svn.tools.ietf.org/svn/ietfdb/... 3. In your working copy, pull down the database image: docker/setupdb 4. In your working copy, start the docker container: docker/run A more comprehensive setup description is available on the datatracker development wiki: https://wiki.tools.ietf.org/tools/ietfdb/wiki/Docker This release also introduces two tweaks to the test suite runner, which should reduce the time it takes to run the test suite by around 50%. Commit log details: * Added a utility script docker/updatedb to download and load a new dump into the local database, using 'manage.py dbshell'. * Added a utility model to hold information on when a given database dump has been done. * Applied test speedup fixes to the testcrawler config, too. Looks like ~15% speed-up of the test-crawler. * Added handling for an exception which can occur in bin/mergeready if a branch with merge flags is moved, for example moving it to an attic after merge. * Added support for running different containers mapping internal port 8000 to different external ports. Added additional text explaining why we won't run multiple containers from the same svn branch. Did som default value code refactoring. * Added little script to pull down and unpack a copy of the datatracker's mysql database files. * Added tweaks to the docker setup to make it work nicely to run different docker containers for different SVN branches. * Updated the docker init-script to not re-install MySQL; it can cause more trouble than it might save; added a guard against trying to set up the ietf database if MySQL isn't running; and changed the final working directory to be the same as where the user invoked the 'docker/run' command. If not started via docker/run, drop into the home directory. * Updated docker/run with options to select a non-default docker-repository and docker image tag (which now defaults to the svn branch basename); added handling for missing docker environment variables, and for the docker virtual machine not running. * Disallowed Coverage 4.0.2 in requirements.txt, as it is buggy. * Removed logging through ietf.utils.log.log when running tests -- should shave another 15% off the test suite run time, cutting the testsuite running time in about half compared to earlier. * Merged in [10097] from olau@iola.dk, in order to speed up the test suite. -- Henrik Levkowetz 14 Nov 2015 00:11:45 -0800 ietfdb (6.9.0) ietf; urgency=medium **More IETF-94 Code** The release contains additional code from IETF-94 -- I think this is the first time we have done two substantial releases based on IETF week contributions. This introduces enhancements and bug-fixes in a number of areas, reducing confusion in draft publication-request handling and on several web pages, clarifying a number of email notifications, making unicode names work in more places, and giving improved secretariat pages: * Added a first version of docker image support, with Dockerfile, docker init scripts, a 'docker run' wrapper, and database image generation. * Merged in [10431] from rjsparks@nostrum.com: Reduce confusion around how to send a document from a WG to the IESG through additional, restrictive, validation on the stream state editing form. Fixes bug #1418. * Merged in [10430] from rjsparks@nostrum.com: Reflect the right group type in personnel change messages. Fixes #1746. * Merged in [10429] from rjsparks@nostrum.com: Display the To and (if it exists) Cc correctly on the publication request form. Fixes #1819. * Merged in [10426] from rjsparks@nostrum.com: Fix the links on the state help index page. Fixes #1775. * Merged in [10425] from bartosz.balazinski@interdigital.com: Provide information about who has suggested document replaced-by information in the notification email. Fixes bug #1817. * Added some default aliases files to the repository, and updated the aliases settings accordingly. Appropriate production settings have been added to setting_locals in production. * Merged in [10418] from henrik@levkowetz.com: Modified the test data to use some AD and WG chair names that contain non-ascii characters, and fixed test issues found. * Merged in [10414] from rjsparks@nostrum.com: Put possibly replaces sections in the right columns. Fixes #1802. * Keep draft aliases for 2 years rather than 1 year from posting. * Merged in [10405] from rjsparks@nostrum.com: Addresses an issue where the WG document page would show the same document in more than one section. Fixes #1827. * Merged in [10384] from rjsparks@nostrum.com: When a group gives a document a new group state (particularly for the first time), send a message that says what happened instead of simply 'Adopted'. Fixes #1830. * Merged in [10383] and [10413] from rcross@amsl.com: Updated proceedings permissions. * Merged in [10379] from rjsparks@nostrum.com: Change the acronym link on the html agenda page to go to the group's charter page rather than the charter's document page. * Merged in [10378] from rjsparks@nostrum.com: Make the internal review message reflect whether this is a new chartering effort or a recharter. Fixes #1814. * Added testing of non-ascii unicode names of chairs and area directors. Fixed a series of issues with rendering of non-ascii names. -- Henrik Levkowetz 08 Nov 2015 09:20:24 +0000 ietfdb (6.8.0) ietf; urgency=medium **IETF 94 Code Sprint** This release contains the datatracker bugfixes and enhancements from the IETF-94 Code Sprint. This brings many small but useful bugfixes and enhancements, as described below. Many thanks to everyone who contributed! This release also brings a change which is not a code change, but rather a packaging change which has made the question of what the licence is for the datatracker code more difficult than need be. Starting with this release, we don't handle version control of the Django framework by including it in the repository; we instead version control it throug the requirements.txt file. This lets us be very simple and clear in the LICENSE file which covers the datatracker code. There are additional code sprint changes expected during the week; they will get their own release later in the week. Here are details about the changes, extracted from the commit log: * Added a direct menu link to tutorials under Other. Tweaked a divider visibility. * Merged in [10363] from rjsparks@nostrum.com: email_iana needs to leave address generation to mailtrigger and not try to rewrap the address. This should be patched into production. * Merged in [10349] from rcross@amsl.com: Fixes Ticket #1834. Sorting slides difficult when there are only two of them. * Merged in [10348] from rcross@amsl.com: Add more information to Secretariat session recordings view. * Merged in [10347] from rjsparks@nostrum.com: Allow entering more than one email address in addtional cc on the send ballot comments form. Fixes #1811. * Merged in [10346] from suresh.krishnan@ericsson.com: Changes to unapproved milestones (e.g. attaching a draft) will not trigger a mail to the WG. Fixes #1818. * Fixed an issue with [10344], where the numberless /meeting/agenda/ would redirect to a non-existing proceedings URL. * Fixed a weekday numbering problem in a test. * Merged in [10345] from rjsparks@nostrum.com: Added an RSS feed for RFCs for use with the digital preservation project. * Merged in [10344] from rjsparks@nostrum.com: Return more sensible results for agendas for old meetings. Fixes #1062. * Merged in [10343] from housley@vigilsec.com: Add check to addcomment for WG/RG chair or secretary. * Merged in [10342] from rcross@amsl.com: The session request form validation needs to check that durations have been entered for each requested session. Fixes issue #1794. * Merged in [10341] from housley@vigilsec.com: WG/RG chairs and secretaries can add comments to document history; get non-active I-Ds from www.ietf.org instead of tools.ietf.org. Fixes issues #1702, #1801, #1831. * Merged in [10340] from rcross@amsl.com: Change liaisons ShowAttachmentsWidget to use href(). Fixes issue #1805. * Merged in [10339] from rcross@amsl.com: Secretariat locked out of Session Request Tool. Fixes Ticket #1791. * Merged in [10338] from rcross@amsl.com: Legacy session scheduling view broken. Fixes Ticket #1806. * Removed our local copy of Django, and added it to the requirements instead. Updated the LICENSE to match, as we're not carrying along external components in the repository any more. * Replaced a remaining use of removed function smtp_error_logging(). -- Henrik Levkowetz 03 Nov 2015 03:15:47 +0000 ietfdb (6.7.2) ietf; urgency=medium This is a maintenance release which does a longtime pending model rename, and fixes some other small issues: * Merged in personal/henrik/6.7.2.dev0-schemafix [10297] from henrik@levkowetz.com: Renamed class ScheduledSession to the more correct (but unfortunately also cumbersome) SchedTimeSessAssignment, and renamed reverse relationships involving this class appropriately. Accompanying changes in javascript and templates. Migrations to match. * Changed a field in the nomcom models to not care about the value of NOMCOM_PUBLIC_KEYS_DIR in the settings, as this may change between developers, and will cause warnings when running migrations otherwise. * Fixed a bug in meeting.ajax.constraint_json(). -- Henrik Levkowetz 27 Oct 2015 15:48:14 +0000 ietfdb (6.7.1) ietf; urgency=medium This is a small maintenance release with some bug-fixes and one enhancement, a new machine-readable list of IPR declarations per draft, recursively. Here are details from the commit log: * Changed nomcom.models.Nomcom() to use a FileSystemStorage which doesn't record the file system location in the migration, in order to avoid having model changes detected when switching from one development path to another. * Merged in [10265] from rcross@amsl.com: Fixed IPR notice addresses formatting. * Added a new machine-readable list of IPR declarations per draft, which also searches through related documents. Extended make_test_data() with a replaced document for the test draft. * Added a switch to the 'test' command, to write short test results to file, changing the default which used to be to always write these. * Updated the INSTALL instructions to reflect the new way patch numbers are handled in ietf/__init__.py from the 6.0.0 release. * Updated bin/mergeready to work with svn 1.9, which seems to return an error for properties which aren't found. -- Henrik Levkowetz 24 Oct 2015 20:29:34 +0000 ietfdb (6.7.0) ietf; urgency=low **Smart Document URLs** This release introduces smart document URLs, which lets you type in partial (but unique) document names in the browser url fields, and be taken directly to the matching datatracker document page. As an example, you can type https://datatracker.ietf.org/doc/draft-ietf-core-links and be taken to the draft-ietf-core-links-json page. For drafts, you can snip off the document type prefix, too: https://datatracker.ietf.org/doc/ietf-core-links. If the partial string supplied matches more than one document, you'll instead get a search page for that name string. This works for other document types than drafts, too, but then you need to have a match at the start of the document name: https://datatracker.ietf.org/doc/conflict-review-cheshire does what you'd expect, and so does https://datatracker.ietf.org/doc/status-change- . Extensions are split off if supplied, and revisions redirect to the appropriate historic page. Details from the commit-log: * Enhanced the partial-match URL feature introduced in [10158], merged in [10253], so that it now handles other document types than drafts/rfcs if the partial string has the proper prefix, and also handles partial strings which don't match at the start of the document name. * Added a new field 'prefix' to DocTypeName -- unfortunate, but necessary since the slugs don't match the document prefixes :-( * Merged in [10158] from olau@iola.dk: Add a view for /doc/foo-bar-baz that tries to redirect helpfully instead of just throwing a 404 in case in an inexact match. Right now, it knows how to do prefix matches and handles revisions and extensions. If it can't find a unique match, it redirects to the search page. Branch * Merged in [10111] from olau@iola.dk: This fixes Javascript widgets working with DocAliases, such as the replaces field in draft submission, to work better with Javascript disabled. It also makes sense from a modelling perspective as the name really is a unique key for the alias. -- Henrik Levkowetz 22 Oct 2015 14:50:25 +0000 ietfdb (6.6.1) ietf; urgency=low This is a combined bugfix and feature maintenance release: * Updated the code to use version 4.0.1 of coverage.py for code coverage measurements. Moved the code which starts coverage measurements to settings_sqlitetest.py to avoid coverage measurements running when not doing tests. Did some additional coveage measurement refactoring. * Changed to use a gzipped release coverage JSON file, instead of a plain JSON file, if the name given in settings.py ends in .gz. Reduces the current release coverage file size from ~1.6MB to ~200kB. This is a preparation for saving more information in the release coverage file than we currently do. * Merged in [10220] from rjsparks@nostrum.com: Preserve linefeeds (using class pasted) when viewing nomcom feedback messages. * Merged in [10219] from rjsparks@nostrum.com: Recognize and remove duplicate addresses while gathering. Fixes bug #1815. * Removed support for perma_fixtures, using the global test fixtures instead. * Merged in [10218] from rjsparks@nostrum.com: Fixed an initialization problem for the new work message for recharters. * Merged in [10206] from rcross@amsl.com: Cleaned up bluesheets upload page. Added display of uploaded files. -- Henrik Levkowetz 19 Oct 2015 16:26:34 +0000 ietfdb (6.6.0) ietf; urgency=low **Mail Sending Triggers** This release improves visibility into where and when the datatracker sends email. It makes where the datatracker sends email for a given action data driven, and it shows where email will be sent for actions on documents and groups by adding an 'Email Expansions' tab to group and document pages, which shows which email sending triggers exist. * Merged in [10186] from rjsparks@nostrum.com: This release improves visibility into where and when the datatracker sends email. It makes where the datatracker sends email for a given action data driven, and it shows where email will be sent for actions on documents and groups. -- Henrik Levkowetz 14 Oct 2015 19:09:29 +0000 ietfdb (6.5.1) ietf; urgency=low This is a minor bugfix release to clear the way for the coming email triggers release: * Merged in [10159] from rcross@amsl.com: Improve secretariat rolodex roles section, sort and identify concluded groups. * Merged in [10156] from rcross@amsl.com: Adjust audio file glob pattern. * Added custom style to fix a problem with the navbar search field width on iPads. * Fixed incorrect case of some urls in the ptsans stylesheet. * Tweaked the mkrelease verbose output. -- Henrik Levkowetz 13 Oct 2015 16:53:54 +0000 ietfdb (6.5.0) ietf; urgency=medium **Liaison tool rewrite** This release merges in work from rcross@amsl.com and esanchez@yaco.es which provides a major rewrite of the IETF datatracker liaison support. It introduces a simplified user interface, new improved and reworked data models, liaison statement history, improved handling of liaison-related emails in many ways, generalisations of liaison sender and recipient handling, making the tool much more flexible, improved search, status overview and attachment handling, and a greatly expanded test coverage. This work was funded by the IAOC. The statement of work is available here: http://iaoc.ietf.org/documents/liaison-sow-04.pdf -- Henrik Levkowetz 10 Oct 2015 09:54:56 +0000 ietfdb (6.4.2) ietf; urgency=medium This is a bugfix release, with details as follows: * Merged in [10144] from rcross@amsl.com: Make email address formatting consistent. * Adjusted numerous document action button colours as requested by the secretariat. Fixes issue #1803 * Provided a bit more information in rfc-editor sync warnings. * Added an eyecatching symbol to indicate bug-reporting, starting out very large, with the intention of reducing the size as people get used to it. * Fixed an html issue in the agenda template, and added information to be shown when no WG/RG groups have been scheduled, and the agenda session customization table is empty. * Tweaked the anchor ids for agenda timeslots to avoid identical ids for different slots. * Added information about which the required submission upload format alternatives are (.txt or .xml). * Tweaked the error message for 2 submission form validation errors. * Changed the default settings for the test crawler from ietf.settings to ietf.settings_testcrawl. * In [10079], the inline template was inadvertently changed from unicode to ascii, which breaks a number of pages. Fixed this. * Merged in [10115] from rjsparks@nostrum.com: Remove an extraneous field from the form that lets the nomcom chair paste in a questionnaire response. * Merged in [10109] from rjsparks@nostrum.com: Make it clearer in search results when one IPR disclosure updates another. Fixes #1798. * Fixed a typo in the meeting agenda template. Fixes issue #1793. * Do utf-8 encoding of the fields in the JSON blob for meeting sessions. Fixes issue #1790 * Merged in [10079] from rcross@amsl.com: Fixed message formatting in IPR event history. * Merged in [10078] from rcross@amsl.com: Resolved issue where partially entered IPR related document info causes 500 error. * Added a menu item linking to the session request tool. Fixes issue #1789. * Made some submission form validation errors apply to all uploads, not only to .txt uploads. Tweaked som validation error wordings. * Merged in [10062] from olau@iola.dk: Fixed a problem with timeslot.location = None in agenda_csv. * Added branch/iola to places checked for 'ready for merge' tags in the commit messages. -- Henrik Levkowetz 08 Oct 2015 19:40:04 +0000 ietfdb (6.4.1) ietf; urgency=medium This is a minor release with various enhancements and bugfixes: * Merged in [10026] from rcross@amsl.com: Fixed an issue with the select2-field.js path in templates. * Merged in [10004] from rjsparks@nostrum.com: Return new forms instead of validated forms for nomcom nominations and feedback. Fixes #1703. * Merged in [9996] from olau@iola.dk: Fixed missing save button when deleting milestones. Fixes #1762. * Merged in [10002] from rjsparks@nostrum.com: Added a checkbox to the nomination form to indicate permission to nomcom to share the nominator's name with the nominee. * Added a migration for the Nomination.share_nominator field. * Merged in [9989] from rjsparks@nostrum.com: Restored the color bands to the email-alias page. * Merged in [9966],[9967],[9968],[9969] from lars@netapp.com: Fixed HTML errors. * Fixed the day-of-week agenda links to not pull the agenda up so high that the start of the day is obscured by the top navbar. * Merged in [9669] from olau@iola.dk: Makede the meeting agenda code use the historic info available for groups. In the process, added some select_related/prefetch_related code to cut the number of database queries in the agenda down from 4000-5000 to about 50. Rewritten agenda CSV code to use Python arrays rather than a template for improved readability/reuse. Rewritten week view to assemble its data in Python. Plus a few other minor cleanups, e.g. lame_description is now gone. Fixes #1088. * Added a very simple html version of the json API, to make it easier to explore the api manually. * Makede the selenium tests work with statifiles. * Improved the verification of submitted file extensions and mimetype. -- Henrik Levkowetz 23 Aug 2015 19:41:24 +0000 ietfdb (6.4.0) ietf; urgency=medium **Serve static assets via CDN** This release adds support for serving static files through a CDN, rather than having them served by the datatracker webserver. This will both offload the datatracker webserver and speed up retrieval of static files. By default, all external static assets (such as jquery, bootstrap, font-awesome, qunit, select2) are served via CDN, while the datatracker's own static files are not. It is expected that the more stable datatracker static files will be migrated to be served via CDN also, over time. This release also adds support for easy update of external javascript, font, and css libraries by means of a new management command "bower_install" which makes use of the "bower" package manager. Use of this management command requires that bower be installed on the development platform. When deploying this and following releases, a new action is needed in order to make the appropriate static content available for serving via CDN: After checking out the release, before creating the symlink to the new release in the datatracker deployment directory, it is now also necessary to run the "collectstatic" action:: $ ietf/manage.py collectstatic A note about that has been added to the README file in the datatracker deployment directory. -- Henrik Levkowetz 06 Aug 2015 18:34:36 +0000 ietfdb (6.3.0) ietf; urgency=medium **Active area, directorate, team, and area group pages** This release provides new group overview pages for active areas, area groups, teams, and directorates. It also improves the error reporting when drafts are submitted with invalid XML, providing line numbers and specifics for the issues found. Additionally, there are a few bug fixes. * Merged in [9924] from rjsparks@nostrum.com: Added views of active areas, area groups, teams, and directorates. Added navigation to those views to the base menus. Unified the URL patterns shared between group/urls and group/urls_info, exposing the same view at, e.g., /group/stir and /wg/stir/. Improved testing, primarily of group/info.py * Merged in [9901] from rcross@amsl.com: Fixed matching audio file names with rooms. * Provided a document's rfc number (if any) as part of the document fields exposed in the json api. * Changed the code for meta-data extraction from xml files to not break if a sought-after element is missing. * Updated the meta-data error message to say 'errors ... below' instead of 'errors ... above', to match the relative placement of text and error indications. * Improved the error reporting for invalid xml file submissions. * Improved the handling of failed xml2rfc conversions when no txt document is submitted. -- Henrik Levkowetz 01 Aug 2015 14:52:37 +0000 ietfdb (6.2.0) ietf; urgency=medium **XML-Only Draft Submission** This release adds draft submission metadata extraction from xml files, if they are made part of a draft submission, and it permits submission of only draft XML files without an accompanying text file, as long as conversion of the submitted XML to text format succeeds. The release also contains numerous style, text and bug fixes from Lars Eggert, and improvements to the ability to accept draft replacement information at drafts submission time. * Merged in [9875] from rjsparks@nostrum.com: Improved the form validation for the submission replaces form. Commit ready for merge. * Merged in [9862] from rjsparks@nostrum.com: Ignore suggestions that a draft replaces itself. * Merged in [9849] from lars@netapp.com: Made nav title capitalization consistent with other text. Consistently add arrows for tabs that navigate away from the site. Shorten some text. * Merged in [9857] from lars@netapp.com: Applied more of the styling from the current meta tables. * Merged in [9856] from lars@netapp.com: Styled the metadata tables for groups, documents, etc. like Henrik prefers. * Merged in [9855] from lars@netapp.com: Fixed bugs in adding/removing documents to personal ID list. * Merged in [9852] from lars@netapp.com: Fixed display of AD and shepherd names, and also fix the respective mailto: links. * Merged in [9851] from lars@netapp.com: Fixed the logic, so that if there are no matches and we don't want a warning saying that, there is also no empty table being produced. * Merged in [9850] from lars@netapp.com: Moved state length notification after RFC Editor status (looks better). * Merged in support of xml-source only drafts submissions from personal/henrik/submitxml/. * Merged in [9843] from lars@netapp.com: Converted two remaining protocol-relative URLs to https. -- Henrik Levkowetz 25 Jul 2015 16:32:25 +0000 ietfdb (6.1.0) ietf; urgency=medium **IETF 93 Code Sprint** This release contains the datatracker bugfixes and enhancements from the IETF-93 Code Sprint. It contains a lot of HTML validity fixes which makes our HTML even cleaner, fixes a number of issues, and introduces support for providing information about draft replacements at draft submissions time. Many thanks to everyone who contributed! * Merged in Ole's submit-time draft replacement information work, as tested and updated by Robert and Adam. * Added escaping of changelist content for the /release/ pages. * Merged in [9821] from rcross@amsl.com: Allow Secretariat to submit drafts during blackout period. Fixes #1755. * Merged in [9813] from rjsparks@nostrum.com: Added navigation to the new secretariat agenda tools. Changed the buttons at the top of the agenda.html page to links. * Merged in [9812] from suresh.krishnan@ericsson.com: Added code to inform ADs, chairs and delegates of WG personnel changes. Fixes #1310. * Merged in [9809] from lars@netapp.com: Added some whitespace to make wrapping AD names in ballots a bit easier to read. * Merged in [9806] from lars@netapp.com: Fixed a longstanging formatting issue with the ballot popup. * Merged in [9803] from lars@netapp.com: Converted a few more URLs from http to https. * Reverted some look-and-feel changes that came in with recent document metadata html and python refactoring, which undid fixes related to issues #1659 and #1663. * Merged in [9802] from bartosz.balazinski@interdigital.com: Fixed references (relative to absolute) in template ietf/templates/group/active_areas.html, fixed build failure on unused import in file 0006_auto_20150718_0509.py, * Merged in [9733], [9735], [9737], [9738], [9766], [9774], [9778], [9781], [9783], [9784], [9789] and [9800] from lars@netapp.com: Fixed a bunch of HTML validation issues identified by test-crawl --validator-nu. * Merged in [9796] from suresh.krishnan@ericsson.com: Don't allow submission for drafts that have been replaced. Fixed #1619. * Merged in [9792] from jmh@joelhalpern.com: Removed misleading back buttons from document metadata modification pages. Fixes #1671. * Merged in [9788] from rcross@amsl.com: Have RFC sync change the IESG state of draft to RFC Ed Queue when draft appears in queue. Fixes #1750. * Merged in [9782] from lars@netapp.com: Made title capitalization consistent with other pages. * Merged in [9779] from lars@netapp.com: Removed the code that used to calculate table_rows, now that the HTML doesn't use it anymore. * Merged in [9775] from rcross@amsl.com: Added proposed groups to Blue Dot Report. Fixes #1747. * Merged in [9765] from lars@netapp.com: Added option to crawl as a logged-in user (--user). Add --pedantic option for vnu crawl, which stops the crawl on (most) errors. Randomized the order in which URLs are crawled, so that repeated crawls don't hit the same URLs in the same order. * Merged in [9736] from lars@netapp.com: Updated the README now that the facelift has happened, and removed the outdated TODO. * Merged in [9726] from lars@netapp.com: Added HTML5 validation based on validator.nu to test-crawl, with the --validator-nu option. -- Henrik Levkowetz 21 Jul 2015 10:13:10 +0000 ietfdb (6.0.4) ietf; urgency=medium This is a minor release which provides some style tweaks, the ability to set a user preference to not show the left-hand menu, and a substantial number of bugfixes: * Merged in [9672] from rjsparks@nostrum.com: Restore the hash to the customized ical link. Fixes #1732. * Merged in [9671] from rcross@amsl.com: Convert PPT materials to PDF. Fixes #1724. * Merged in [9668] from rjsparks@nostrum.com: Draw the right number of days in the secretariats room view. * Merged in [9666] from rcross@amsl.com: Area names hardcoded in Proceedings app. Fixes #1723. * Merged in [9663] from rjsparks@nostrum.com: Try a different way of wrapping ballot/comment fields and shepherd writeups. Related to #1673. * Merged in [9662] from rcross@amsl.com: Add Message objects to merge-person-records. * Merged in [9654] from rjsparks@nostrum.com: Add searches across the web-based archive tool to the document's page. Collapse all the searches, including ARO for ADs, under a dropdown. Partially addresses #1701. * Merged in [9652] and [9653] from rjsparks@nostrum.com: Provide color for ART. * Merged in [9651] from rjsparks@nostrum.com: Adds a graphical overview of each day by room for the secretariat to assist with scheduling additional meetings. * Added preference editing support for the left_menu preference setting, and refactored the preference handling code substantially. Related to issues #1659 and #1663. * Merged in [9650] from rjsparks@nostrum.com: Set the parent for newly created RGs. Be more robust if an RG has no parent. Test creation of an RG. Fixes #1718 and #1719. * Merged in [9649] from rjsparks@nostrum.com: Provide a session type for sessions created to say a group is not meeting. Add a test for the no_meeting view. Fixes #1720. * Merged in [9641] from rjsparks@nostrum.com: Make parsing IANA mail for comments more flexible. * Merged in [9639] from rjsparks@nostrum.com: Only show document versions for positions when the position is on an older version. (Reapplying earlier fix). Fixes #1711. * Merged in [9637] from rjsparks@nostrum.com: Color agenda/documents rows with position taken when viewing as an AD. Fixes bug #1679. * Merged in [9626] from rjsparks@nostrum.com: Restore the discuss-box hiding feature when a position is not blocking. Fixes bug #1688. * Additional tweaks to document lists, trying to reduce the number of lines consumed by the status column. * Reduced the submenu line-height somewhat. Related to issue #1708. * Fixed incorrect output of unmatched
closing elements, left after [9643]. * Added a preference to not display the left-hand menubar. Addresses issues #1659 and #1663. * Tweaked the document list display slightly, to sqeeze in a little bit more info on a page. Addresses issue # 1663. * Wrap liaison statements on 78 characters rather than 71. -- Henrik Levkowetz 23 Jun 2015 20:03:08 +0000 ietfdb (6.0.3) ietf; urgency=medium This release provides the capability to manage and graphically schedule additional meeting types, including leadership meetings. It also fixes a number of issues, mostly related to the recent facelift. Details: * If the author of a nomcom nomination is unknown, use 'Anonymous' and no email address in outgoing messages, instead of '$author'. * Merged in [9619] from rjsparks@nostrum.com: Copy the RFC Editor on new version messages for drafts in any stream if the RFC Editor is already working on the draft. Fixes bug #1700. * Merged in [9618] from rcross@amsl.com: Make proceedings generation more robust. * Added a missing html doctype element for a popup page. * Don't show the unused 'author' field in the public nomcom feedback form. Fixes issue #1699. * Removed inappropriate group actions and information from external group info pages. Fixes issue #1651. * Removed a number of action buttons which aren't relevant for RFCs. Fixes issue #1698. * Fixed a wrong row count for stream meta-info when displaying RFCs. Also fixed a 'missing columns' html warning. Fixes issue #1697. * Merged in [9608] from rjsparks@nostrum.com: Show leadership when and where mail was sent at the time it is sent. * Fixed a problem with nomcom classification forms showing too many fields. * Tweaked the missing id submission revision message to work also with non-ascii characters in the draft name. Changed the disallowed character error message to be more useful by providing the found document name and byte codes for the disallowed characters. * Updated the api resources file with new meeting model fields. * Merged in [9604] from rcross@amsl.com: Updated the IAOC email address in Announcement app. * Merged in [9603] from rjsparks@nostrum.com: - Added functionality which allows the secretariat to manage more meeting types, including leadership meetings. - Backfilled those types of meetings from IETF91 and IETF92. - Addressed several facelift issues in the meeting application. * Merged in [9595] from rcross@amsl.com: Fixed an issue where an authorized individual was unable to add an incoming liaison. Fixed a problem with the incoming liaison form requiring a deadline date for information only statements. * Fixed an issue where the https: schema inadvertently had been included in RFCDIFF_PREFIX, causing duplicate schema specifications in some places. Changed name to RFCDIFF_BASE_URL and cleaned out the duplicate schema specifiers. * Added a check for model changes which haven't been captured in migrations to the release script. * Added 5 migrations for changes in model field help-text strings which changed in the facelift. Also fixed the expression of the help text for NomCom.reminder_interval so the text itself doesn't contain quite as much whitespace. * Aligned the table header fields with the table columns in the doc history page. Marked the action text safe so as to make embedded links show up as links. * Reduced the max height of submenus to avoid them extending below the screen bottom edge when used from the top navbar (which won't scroll). The new value works on 1024x768 screens for the current areas. -- Henrik Levkowetz 13 May 2015 17:23:41 +0000 ietfdb (6.0.2) ietf; urgency=medium This is a minor release, containing a few new development support features, HTML cleanup, and good number bugfixes from lars@netapp.com, rjsparks@nostrum.com, rcross@amsl.com and henrik@levkowetz.com * Added html validation to the test crawler; it will now report html which fails validation with 'WARN' indications. Reorganized the code somewhat, collecting functions, globals, etc. in groups. * Fixed all cases of invalid html found by the test crawler. * Reduced the padding for compact tables. This hopefully fixes issue #1689. * Addressed another bug related to using SearchablePersonsField to choose Person objects, rather than Email objects. If one uses this for Person objects, then object.address isn't going to be terribly useful in the form ,,:-). Addresses issue #1684, #1685 and #1686. * Provided the IRTF chair with access to the session request tool. Fixes issue #1687. * Removed emtpy items from the must-be-there list before handing the list to Person.objects.filter(pk__in=...). Fixes issues #1684, #1685 * Merged in [9558] from rcross@amsl.com: Eliminated MultipleObjectsReturned when editing draft. Fixes issue #1678. * Merged in [9554] from rcross@amsl.com: Fixes #1692. Drag-and-Drop slide re-ordering no longer works in secr/proceedings. Consolidate / update JQuery-UI. * Merged in [9548] from rjsparks@nostrum.com: Allow IANA to switch to (BEGIN IANA COMMENTS) at their leisure. Make sure the captured events are obviously from IANA. * Merged in [9546] from rcross@amsl.com: Fixes alignment of ballot position headers in IESG agenda moderator package. * Merged in [9541] and [9542] from rjsparks@nostrum.com: Quit putting the group email list address in the initially generated Notify field. Updated the tests accordingly. * Merged in [9527] from rcross@amsl.com: Made it possible to add minutes / agenda after deleting them. Fixes issue #1680. * Updated a bunch of links from http: to https: based on a patch from lars@netapp.com. * Merged in [9525] from lars@netapp.com: Make the menu bar search field appear on slightly smaller screen widths. * Merged in [9524] from lars@netapp.com: Add some shim js libraries for IE8 and earlier (see http://getbootstrap.com/getting-started/#template) Fix HTML structural errors in the template. Wrap some HTML comments into Django comments, so they don't get sent to the client. * Merged in [9519] from rcross@amsl.com: Fixed an issue where RelatedObjectDoesNotExist would be raised when User has no Person. Fixes issue #1676. * Merged in [9518] from rjsparks@nostrum.com: Allow an AD to jump straight to the ballot editing page by right-clicking any ballot grid. Fixes #1669. * Merged in [9516] from rjsparks@nostrum.com: Don't show needed positions for closed ballots. Fixes #1622. * Merged in [9514] from rjsparks@nostrum.com: If the name attached to an additional-info URL for a group is blank, show the URL instead. Fixes #1523 and #1657. * Merged in [9513] from rjsparks@nostrum.com: Don't show concluded groups in the community list section of the navbar. Fixes bug #1652. * Removed local copies of html5lib and tastypie, and updated requirements.txt to include them. Removed typogrify from the requirements list; it isn't used. * Added pip and setuptools, required in virtualenv, to requirements.txt, in order to simplify buildbot testing of package installation and version testing. * Added copyright lines and template origin to the html templates. * Added support for an 'origin' template tag which will insert the name of the template file (within a html comment) into the page content when TEMPLATE_DEBUG is True; with the purpose of more easily being able to identify the templates from which page content comes. -- Henrik Levkowetz 27 Apr 2015 08:56:36 +0000 ietfdb (6.0.1) ietf; urgency=medium This is a bugfix release which irons out some wrinkles discovered after deployment of 6.0.0. * Merged in [9505] from rjsparks@nostrum.com: Added a checkbox to cc the group list address on ballot positions if a document belongs to a group. Add better tests of the checkboxes on that form. * Provided a different shortcut icon for the datatracker when run in development or test mode. Fixes issue #1667. * Added back the development mode header on the frontpage. * Adapted session_draft_list() code to handle the case when there is multiple agendas for a given group acronym. Fixes some server 500 results when trying to get pdf bundles for the plenary sessions for ietf 71. * Put back the schema specifier for IANA and RFC-editor URLs -- they are needed in parts of the code. * Put back the value attribute for the name/value pair of many input and button elements which lost the value attribute in the conversion, in order to let the backing form code determine which button was pressed. Fixes issue #1668. * Shaved off some more vertical space in the document tables. Builds on [9494], addresses #1660, #1663, #1665. * Introduced a couple of changes to the document list row format to make rows take up less vertical space: Moved the page count in under the date, so it won't add vertical space, and made shepherd email addresses break across lines if needed, instead of squashing the column widths of the other columns. * Made it clearer on the document iesg review page and the ballot popup page which ADs mentioned are ex-ADs, by adding parentheses in addition to the dimmed text. Fixes issue #1664 * Removed all subsection horizontal lines from the document meta tables, on suggestion from mnot@pobox.com. Addresses issue #1659. * Added a missing templatetag library load instruction for bootstrap3. Addresses issue #1662. * Replaced google-served fonts with self-hosted ones. After a testing period with the current 'access plus 4 hours' Cache-Control setting, we should probably increase the cache control for external static files. -- Henrik Levkowetz 15 Apr 2015 19:24:15 +0000 ietfdb (6.0.0) ietf; urgency=medium **Facelift using Bootstrap** During more than a year, from July 2013 to late 2014, Lars Eggert, , has worked intensively on a major facelift to the datatracker, porting the GUI to Bootstrap. The work took 287 separate commits , and comprised changes to 1016 different files. This work has turned the IETF Datatracker website into a responsive website which support use on a much larger variety of devices, from small mobile devices to desktops. The work relies heavily on the capabilities of Bootstrap, and continues to use the Django framework which the datatracker has been build on since version 2.00. Additional page conversion work has been done by Ole Laursen, with final style tweaks, bug-fixes and adaptations by Henrik Levkowetz in order to take care of some remaining rough edges and give it a distinct colour palette and a matching selection of fonts. The fonts, PT Serif for body text, PT Sans Caption for headers, PT Sans for menus, and PT Mono for monospaced documents are from ParaType, and are served by Google Fonts. -- Henrik Levkowetz 13 Apr 2015 20:31:48 +0000 ietfdb (5.13.1) ietf; urgency=medium This is a bugfix release, to have a clean slate before merging in the Bootstrap facelift for 6.0.0. Details: * Merged in [9428] from rjsparks@nostrum.com: Properly mark (and test) older ballot comment and discuss text after a new revision is submitted. Fixes bug #1656. * Merged in [9426] from rcross@amsl.com: Add several 'From' options for IAD user of announcement tool. * Merged in [9375] from rjsparks@nostrum.com: Put old style slides directly into archived. Migrate IETF92 materials to match. * Merged in [9351] from rjsparks@nostrum.com: Removed sessonly, replacing the idea with a separate State. Add tests checking how materials show on agenda views. * Fixed style attributes which resulted in red text on red background for some error messages * Buildbot changes: Separated out the schedulers for trunk, personal/\*and branch/\*. Corrected regex patterns which extract unittest details. Added a first tentative email notifier. Added ForceSchedulers, in order to be able to force builds. * Changed all explicitly set HttpResponse content_types to specify charset. Django sets charset if you don't specify a content_type; if you specify one you also must add a charset specification (if you want one). Fixes issue #1647. * Fixed a typo in the sort key generation for the sort on ipr count in document search results. * Updated release data and mkrelease support, which calculates the release coverage snapshot without invoking tests that developers won't ordinarily be able to run on their laptops/work machines. -- Henrik Levkowetz 10 Apr 2015 13:44:05 +0000 ietfdb (5.13.0) ietf; urgency=medium **IETF 92 Code Sprint** This release contains the datatracker bugfixes and enhancements from the IETF-92 Code Sprint. It improves the coverage of the test suite, and also fixes a number of issues. Many thanks to everyone that contributed! * Merged in [9330] from rcross@amsl.com: Cleanup legacy IPR models. Fixes ticket #1626. * Merged in [9326] from rjsparks@nostrum.com: Test coverage improvement for group material management. * Fixed a problem in Document.meeting_related(), and fixed a number of tests which broke when slide objects started to return True to meeting_related() without being related to a session. * Merged in [9319] from kivinen@iki.fi: Added test cases for cookie code. This will test all the cookie setting code, and also adds test for draft for include_text and full_draft cookie checking. * Merged in [9317] from jmh@joelhalpern.com: Added some nomcom test cases. * Changed the MEDIA_URL to use https instead of http, to be in line with other efforts to move to https in general. * Merged in [9316] from willem@nlnetlabs.nl: Test fetching of wg and rg document dependency graphs. Also added conditional running of these tests, as they depend on the availability of the dot, unflatten and ps2pdf binaries, which may not be available on all developers' systems. * Merged in [9309] from tjw.ietf@gmail.com: Fixed #845. Commit read for merge. * Merged in [9305] from willem@nlnetlabs.nl: Callback API test code paths * Merged in [9307] from rcross@amsl.com: Improved test coverage of secr.drafts. * Merged in [9306] from rjsparks@nostrum.com: Added pre-ads to .ad aliases. Keep draft aliases for drafts that have become RFCs for some time. * Merged in [9303] from rjsparks@nostrum.com: Cached the wg-charter*txt pages for a time since they are very heavy to generate. -- Henrik Levkowetz 25 Mar 2015 19:07:16 +0000 ietfdb (5.12.3) ietf; urgency=medium This is a minor bugfix release which also addresses a number of testing issues, in preparation for the IETF-92 sprint on Saturday. * Merged in [9242] from rjsparks@nostrum.com: Restores add-to-community-list functionality to several pages. Fixes #1601. * Added a --logfile switch to the test crawler, in order to be able to control whether a logfile should be used or not. It's not particularly hepful when running on a buildbot slave, which catches stdout anyway. * Updated the nomcom tests to use temporary test directories for data, instead of the regular production settings in settings.py. * Updated the mergeready script to check if the 'test:unittest' property has been set to 'passed' on a changeset marked 'ready for merge'. * Introduced a more correct implementation of the workaround to skip migrations during test, which also points at the code that makes this work at the moment. * Tweaked the settings_sqlitetest.py file, which normally is used during test suite runs, to avoid a minutes-long stepping through migrations for each test run. This makes it much more workable to run individual tests. * Added the buildbot config file to the repository. Deployment path: trac.tools.ietf.org:/home/buildbot/masters/datatracker/master.cfg * Added exception capture and error message output to the coverage_changes management command when the --release switch to specifies a release for which there isn't any data. Also tweaked the diff output for code coverage changes. -- Henrik Levkowetz 19 Mar 2015 23:55:45 +0000 ietfdb (5.12.2) ietf; urgency=medium * Added test coverage data to the release pages if available for the shown release. Added saving of html pages for the code coverage to a directory in the static files area. If a code coverage report is available, a link to it will be shown on the release page of the current release. Renamed some setting variables related to test coverage to be more explicit and precise. * Changed the handling of some test directory creation and removal code, to be more consistent. Fixed a problem with a test that didn't create and remove a test directory which it used. * Merged in [9185] from rcross@amsl.com: Add DocEvent and SubmissionEvent to merge-person-records. * Added tests for the presence of a VTIMEZONE section in generated agenda iCalendar files. * Started the code coverage measurements earlier, in order to make the apparent code coverage of model files less confusing. * Added a fudge factor to the coverage test, in order to make it easier to do minor code changes without slipping under the coverage of the latest release. * Made the test runner try multiple port numbers for the SMTP server, in order to handle the case where multiple test suites are in progress on the same host (which can happen when multiple buildbot slaves are running tests at the same time). * Fixed a small issue with the filter expression to select ADs for active groups. -- Henrik Levkowetz 15 Mar 2015 22:04:14 +0000 ietfdb (5.12.1) ietf; urgency=medium **Extended test coverage support, active email address fixups** This is a minor release which contains a number of bugfixes, and also introduces additional test coverage measurements and support functionality. It further contains two migrations which fixes a set of inactive email addresses which most likely should have been active, and notifies the owners about the change. This means that when running migrations as part of this release, about 1000 notification emails will be sent out from the datatracker. Detailed changes: * Don't set email addresses which are created when a draft is submitted to inactive any more. We now have a 'primary' field to indicate which email address is the primary one when a person has multiple registered addresses, so we don't have to rely on the timestamps on the email address objects to determine the primary address. * Added a migration which changes the active bit from False to True to all email addresses associated with active drafts, and sends out notification emails about this. * Added a managment command to show the difference in coverage data between the latest release and the latest test run, and a test for the same. * Added a login requirement for the full document and group email alias pages, but kept the individual group and document email-alias pages visible without login. Added testing of login redirects for the full email alias lists, and reordered the test sequence within the test methods appropriately. * Made sure that Email.__unicode__() will return a string even if address is None. Fixes an exception on deleting an email address for a Person object in the admin interface. * Added per-app coverage measurements, to make the numbers shown when not running the full tests suite a bit more meaningful. * Changed the nomcom.forms.FullFeedbackFormSet to use modelformsets_factory() instead of direct subclassing, in order to avoid a crash when using the form, caused by a missing instance attribute. * Clarified the meaning of checked/unchecked boxes in front of the email addresses on the account profile management page. * Merged in [9143] from rcross@amsl.com: Add AG Secretary to Proceedings authorized roles. * Merged in [9142] from rjsparks@nostrum.com: Avoid creating blank line before headers on IPR notification email. Fixes #1609. * Merged in [9141] from rjsparks@nostrum.com: Fix ordering issue on agenda.html. * Added a new field 'primary' to the Email model, added a matching migration, and a data migration to set primary fields to match the way a primary address is chosen today. * Added a migration which captures the changed information for the idsubmission-cutoff-related fields of Meeting. * Removed the obsolete field Group._ad, and added a migration for the change. * Added exception handling in tastypie for a case which can occur if one tries to filter by regex on a FK. * Turned the api.py file into a module. Moved the makeresources management command to the api module. Added some api tests. Added crawling of api files to the test-crawler. Adjusted some resource files discovered by the test suite and test-crawler. Removed a bunch of empty model files. -- Henrik Levkowetz 11 Mar 2015 12:22:03 +0000 ietfdb (5.12.0) ietf; urgency=medium **Test coverage tests** This release provides measurement of how much of the code is being exercised by our test suite, by integrating the 'coverage.py' tool in the test suite itself. The percentage of the code excercised by the test suite is compared with the figure from the latest release, and a lower coverage constitutes a test failure. This way it shouldn't be possible to add new code without also adding tests, without getting a test suite failure. This should encourage gradually increasing levels of test suit coverage :-) Additionally, similar measurements and comparisons have been added for template and URL coverage of the test suite; these also have been implemented as tests, and sinking coverage of templates or URLs in the test suite will result in tests failures, in the same way as for code coverage. The results of the test suit coverage of code, templates, and URLs is saved to disk, in order to make the coverage details available for inspection. Coverage data per source file/template/URL is available in json format in a file 'coverage-latest.json' in the working directory, and more detailed per-line code coverage data is available in a file '.coverage', which is readable by the standalone 'coverage' program from 'coverage.py' from http://nedbatchelder.com/code/coverage/. * Merged in personal/henrik/v5.11.1-dev0@9103, which provides new tests for the test suite's code coverage, template coverage, and URL coverage. -- Henrik Levkowetz 26 Feb 2015 10:08:14 +0000 ietfdb (5.11.2) ietf; urgency=medium This is a minor release with a few additional bugfixes: * Merged in [9121] from rcross@amsl.com: Resolved some issues with the proceedings progress repport. * Merged in [9099] from rcross@amsl.com: Added an ietf/bin script, merge-person-records. * Merged in [9097] from rcross@amsl.com: Editing session request causes KeyError. Fixes #1605. * Changed the handling of the group edit form so as to generate a ChangeStateGroupEvent for state changes, instead of a generic GroupEvent of type 'info_changed'. -- Henrik Levkowetz 25 Feb 2015 09:06:43 +0000 ietfdb (5.11.1) ietf; urgency=medium This is a minor release, providing bugfixes and some enhancements. Worth mentioning is pages which lets one view and search the draft- and wg- email alias lists, the ability to control draft submission cutoff individually per meeting, improved presentation of the submission cutoff times, and release content annotations for major releases back to 2010 on the release overview page. Details below: * Added a slightly tweaked version of timedelta, in order to support handling of TimedeltaFields. * Made the selector for Agenda.groups() match that of Agenda.area_list() by adding parent__isnull=False. Without this, the two won't match if split by area. Fixes issue #1607. * Added 4 new fields to the meeting class, to hold draft submission cutoff information for the meeting. On request, changed the presentation of the cutoff times to show the last submission time, rather than the beginning of the cutoff time. Changed the cutoff hour format to support full timedelta information, not just a given hour (this was necessary in order to be able to set the requested 23:59:59 submission stop time). * Merged in [9083] from rjsparks@nostrum.com: Added dealing with /wg/foo/email-aliases, /wg/email-aliases, and similar for /rg. Added an initial test suite for all invocations of the email_alias views. * Merged in [9070] from rjsparks@nostrum.com: Adds pages to view the draft and group email aliases, either as a whole, or per document or group. * Added newly generated .ics timezone snippets, from http://www.ietf.org/timezones/tzdata-latest.tar.gz. This updates the .ics files to use timezone information current as of 13 Feb 2015. * Modified the vzic makefile to generate new zoneinfo data by fetching the latest tzdata file from ietf.org/timezones/tzdata-latest.tar.gz and running vzic to update the .ics files as needed. * Don't create empty Alias records. Fixes issue #1603. * Added a guard against crashing because of missing timeslot location or time in check_audio_files(), which is called by create_proceedings() after changes to meeting materials. Fixes issue 1604. * Added back a functioning get_fieldsets() method, which was removed instead of corrected in the Django 1.7 upgrade. * Added a missing table column to the WG document page for the case when the user isn't logged in. Addresses issue #1601 (but add links in the column are still missing). * Added title annotations to major release entries in the changelog back to 2010, and changelog parsing and release page support for the same. -- Henrik Levkowetz 23 Feb 2015 20:49:11 +0000 ietfdb (5.11.0) ietf; urgency=medium **Django 1.7** This release upgrades Django from 1.6.4 to 1.7.1, and tastypie from 0.11.1 to 0.12.1. It changes the database migrations infrastructure from that provided by "south", to the builtin replacement newly introduced with Django 1.7. There are also a number of changes which are required by the upgrade, in order to make things work as expected, and some fixes to bugs revealed by the improved infrastructure provided by Django 1.7. Deployment note: When deploying this, migrations need some extra care, as the new-style migrations which are part of the release should not actually be run -- they are there to provide a status snapshot as a basis for future migrations. In order to handle this, please use the --fake option when running migrations for this particular release: $ ietf/manage.py migrate --fake -- Henrik Levkowetz 09 Feb 2015 20:17:05 +0000 ietfdb (5.10.3) ietf; urgency=medium This is a minor bugfix release in preparation for the upcoming upgrade from Django 1.6.0 to 1.7.4 * Merged in [9007] from rjsparks@nostrum.com: Add the csrf_token to the form for editing document titles. Fixes #1597. * Merged in [9005] from rcross@amsl.com: - Fixed the group link on the standalone Interim Meeting Proceedings directory page. Also removed some dead code. * Removed the unnecessary get_and_create() of community.model.DisplayConfiguration on community page GET. * Made the cookie handling for the 'new_enough' and 'expires_soon' cookies insensitive to nonnumeric values. -- Henrik Levkowetz 08 Feb 2015 16:40:01 +0000 ietfdb (5.10.2) ietf; urgency=medium * When draft email aliases are generated, the content of the doc.notify field is used to generate the $draft.notify alias, and is also included in the $draft.all alias. If the notify field contains either the .notify alias or the .all alias, this can create a mail loop. Changed the alias generation code to expand (or ignore, for .notify) aliases found in the notify field, and changed the code which fills in the notify field with a default value to insert the author, ad, and shepherd aliases instead of the .all alias. * Merged in [8970] from olau@iola.dk: Enabled support for a custom settings file for the test crawler and added a simple settings file that enables caching to speed up the crawl (shaves ~35% off most pages, it seems) * Merged in [8961] from rjsparks@nostrum.com: Avoid an issue with python.email breaking To header field values that it has to encode in bad places. Fixes #1589. * Merged in [8949] from rjsparks@nostrum.com: Improvements to the fix to #1592. * Merged in [8948] from rjsparks@nostrum.com: Capture out-of-area ADs in draft and group aliases. Fixes #1592. * Merged in [8924] from rjsparks@nostrum.com: Restrict the gathering of ads for past meetings to groups that are areas. * Merged in [8923] from rjsparks@nostrum.com: Improve the approval mail contents concerning IESG contact members. Fixes #1588. * Merged in [8922] from rjsparks@nostrum.com: Fix needed-to-pas calculation to use new representation of area directors. Fixes #1587. * Merged in [8903] from rcross@amsl.com: Fixed a logging problem in IPR mail handling. -- Henrik Levkowetz 05 Feb 2015 18:33:18 +0000 ietfdb (5.10.1) ietf; urgency=medium This is a release containing a large number of small fixes and enhancements, as follows: * Merged in [8879] from rcross@amsl.com: Grant hte IRTF Chair access to proceedings. Fixes #1580. * Merged in [8870] from rjsparks@nostrum.com: Inform the secretariat when a duplicate Alias.name is created that isn't already a duplicate Person.name. Improve the message that's sent when either duplicate Person or Alias names are detected. * Merged in [8861] from rcross@amsl.com: Changes to allow upload of bluesheets in materials upload page. Primarily for use with Interim meetings. * Merged in [8856] from rjsparks@nostrum.com: Show out-of-area ads on /wg/. Fixes #1555. Related to #1557. * Merged in [8855] from rcross@amsl.com: Fixed the Back and Cancel buttons in recording views. Fixes #1577. * Merged in [8854] from rjsparks@nostrum.com: This is the second step towards ADs out of GroupInfo into Role. The use of group.ad has been scrubbed from the code and templates. - Those places that set group.ad have been directly manipulate Role objects instead - Most places that read group.ad now use a new group.ad_role() that returns a Role object, simplifing some views. Related to #1555 and #1557. * Merged in [8853] from rcross@amsl.com: Fixed audio recordings which weren't showing in the proceedings. * Merged in [8852] from rcross@amsl.com: Fixed the ability to replace minutes and agendas. * Merged in [8851] from rjsparks@nostrum.com: This is the first step towards using Role to represent Area directors. It - Migrates the information captured in GroupInfo.ad to Role objects. - Renames GroupInfo.ad to GroupInfo._ad (retaining the current column name) to prepare for deletion of that field. - Provides ad property accessor and setter methods implemented using the group's role_set (so that the existing view code continues to work with minimal changes) - Improved selection in many querysets that assumed only groups of type 'area' would have area directors. Related to #1557 and #1555. * Merged in [8850] from rjsparks@nostrum.com: Changed the permission guards on edit_notify to reflect the policy that #1517 tried to establish. Fixes #1517 and #1575. * Merged in [8849] from rcross@amsl.com: Fixed several issues with IPR references in iesg templates. * Merged in [8848] from rjsparks@nostrum.com: Don't add the group's ad to the list of people who need to be at a meeting if the group doesn't have an ad. Protects the field formatter from occurances of None in passed in lists. Patch applied to production. * Merged in [8846] from rjsparks@nostrum.com: Added tests for document urls that provide a revision for all the document types the view code currently handles. Refactored parts of Document and DocHistory into DocumentInfo to get the tests to pass. (but careful review is probably warranted). * Merged in [8845] from rcross@amsl.com: Allowed editing of legacy disclosures which don't have required fields (set required=False). * Merged in [8843] from rjsparks@nostrum.com: Reworked the definition of future_presentations and last_presented. Fixes #1571. * Merged in [8842] from rcross@amsl.com: Fixed the document search result row and IESG agenda documents row links to IPR. Fixes #1570. * Merged in [8841] from rcross@amsl.com: Fixed the links to the IPR search from the doc pages. Fixes #1569. * Merged in [8840] from rjsparks@nostrum.com: Automatically ensure Alias records exists when Person records are changed, relieving multiple code locations of that responsibility. Fixes bug #1550. * Merged in [8801] from rjsparks@nostrum.com: Verify that add_state_change_event returned something before trying to use attributes of the return value. Fixes bug #1566. * Merged in [8726] from rjsparks@nostrum.com: Send mail to the secretariat when a Person is created with the same name as some other Person objects in case its a duplicate that needs to be merged. Fixes ticket #1553. * Merged in [8733] from olau@iola.dk: Fixed an old bug in liaison tool - WG discussion lists where being CC'ed with their list_subscribe rather than list_email address, and the former is usually a URL, not an email address so cause a validation error when submitting the statement * Merged in [8723] from rcross@amsl.com: Fixed a problem where trying to add duplicate name in Rolodex causes 500 error. Fixes ticket #1469, * Merged in [8718] from rjsparks@nostrum.com: Copy the secretariat on the message sent to the RFC Editor and IANA when a draft is pulled from the RFC Editor queue. Fixes ticket #1549. * Merged in [8716] from rjsparks@nostrum.com: Highlight need for milestone review and approval in messages to leadership when a milestone edit requires approval. Don't bother the group when the only changes are those needing approval. Fixes ticket #1501. * From rjsparks@nostrum.com: Fixed Room.__unicode__() to handle capacity None. * Made the generated postfix alias/virtual files include the AD emails in the -chairs alias. * Added admin support for meeting.models.ResourceAssociation. -- Henrik Levkowetz 25 Jan 2015 19:36:37 +0000 ietfdb (5.10.0) ietf; urgency=medium **Enhanced IPR Support** This release provides work from rcross@amsl.com which refactors and enhances the IPR support in the datatracker. Here is an overview of the changes: * Updated and streamlined the database models representing IPR disclosures, and migrated existing data to the new models. * Added a new admin interface with better support for listing IPR disclosures and searching them. * Improved the Secretariat's navigation between IPR document views/search results and the administrative pages to edit IPR documents. * Introduced the ability for a disclosure submission to indicate it is updating more than one existing disclosure. * Improved the Secretariat's management interface for the 'Waiting for Approval' queue, and added the ability to park disclosures that are waiting for approval. * Added a Secretariat management interface for rejected and removed disclosures. * Implemented simplified forms for Secretariat updates to a disclosure. * Added support for managing the email communication necessary for processing a submission. The streamlined models and related coding decisions has resulted in a reduction in the LOC (lines of code) count by about 2000 lines, at the same time as the functionality has improved. Cool :-) -- Henrik Levkowetz 21 Dec 2014 21:33:54 +0000 ietfdb (5.9.0) ietf; urgency=medium **Enhanced Team Support** * Merged in [8711] from rjsparks@nostrum.com: Added functionality for management of group materials, focusing on groups of type 'team': - Simplifies managing the Abstract for uploaded group materials. Displays the abstract on the groups materials page - Provides SessionPresentation: a binding between Document and Session objects, that tracks doc version. - Adds helpers for finding upcoming sessions, and the most recent SessionPresentations whose sessions have passed - Generalizes the snippet concept (as a templatetage) used in the history tab for use on other pages - Adds a variant of the snippet that can be styled as an edit link - Provides several ways to address sessions, using sequence, dates, group acronyms, and day of week - Adds a 'Materials Manager' Role -- Henrik Levkowetz 18 Dec 2014 21:29:43 +0000 ietfdb (5.8.1) ietf; urgency=medium This is a bugfix release for 5.8.0; it adds one file which was missing from the repository in the 5.8.0 release -- Henrik Levkowetz 18 Dec 2014 18:40:16 +0000 ietfdb (5.8.0) ietf; urgency=medium **JSON Api** This release introduces a machine-readable API to the datatracker database content, based on Tastypie (https://django-tastypie.readthedocs.org/). Currently the API is set to read-only; but Tastypie does support fine-grained control of create, read, update, and delete permissions, so if we find that it makes sense at some point, we can open up for authenticated access to more than just reading database content. The details of which tables and objects from the database that are exposed in the API are controlled by a series of resources.py files; one per Django app. By default, no data is exposed; in order to expose a table, the resources file must contain a resource specification, in the form of a python class which determines which table fields should be exposed, and how. Since we want to expose almost all the database content, rather than only a few selected tables, there is a lot of code which needs to be specified (more than 200 classes, with almost 2000 lines, at this writing) in order to make data available through the API. Rather than manually type out all of the needed classes, a management command (ietf/manage.py makeresources) has been added which will generate the needed resource classes in the resources.py files automatically. Existing classes will be left intact, though, which makes it feasible to hand tune the classes if needed, but still auto-generate resource classes when new tables are added. In addition to read access to the exposed tables and objects, the Tastypie API provides support for automated discovery of the available tables. Starting at the URL https://datatracker.ietf.org/api/v1/, the returned machine-readable data provides URL information for all available API endpoints, which makes it possible to recurse down to all available data. Data is currently provided in JSON and XML format. Adding new formats is fairly easy, if it should be found desriable. -- Henrik Levkowetz 18 Dec 2014 16:06:05 +0000 ietfdb (5.7.4) ietf; urgency=medium **IETF 91 Code Sprint** This release contains the datatracker bugfixes and enhancements from the IETF-91 Code Sprint. Many thanks to everyone that contributed! * Merged in [8634] from rcross@amsl.com: Removed the 'none selected' option from licensing options of the new IPR form. * Merged in [8624] from rcross@amsl.com: Removed the secauth middleware, replacing it with role_required decorators. * Merged in [8623] from suresh.krishnan@ericsson.com: Added code advising the IESG Secretary of personnel changes in WGs. Fixes issue #1357. * Merged in [8609] from tterriberry@mozilla.com, with minor changes: Allow changing the title of a charter document. Fixes #1334 * Reworked the generation of draft aliases and WG aliases, after trying out the output of the previous version for real. * Merged in [8622] from harald@alvestrand.no: Adding a missing column header to the search results page. * Merged in [8617] from liudapeng@chinamobile.com: Added the possibility of choosing RGs in the search page. Fixes issue #1355. * Merged in [8614] from harald@alvestrand.no: Added validation of the names given to saved meeting schedules. Fixes issue #1425. * Merged in [8611] from rjsparks@nostrum.com: Allow chairs to edit the notification field. Fixes bug #1517. * Merged in [8608] from rjsparks@nostrum.com: Allow chosing the initial state when beginning WG processing of a draft. Fixes bug #1406. * Merged in [8602] from suresh.krishnan@ericsson.com: Retain the currently set of tags when document state is edited. Fixes issue #1295. * Merged in [8585] from rjsparks@nostrum.com: Tests that a message is set when a shepherd is not changed. Related to #1508 and r8504. * Merged in [8584] from rjsparks@nostrum.com: Reworked smtp error warning and logging to not use hard-to-read context_managers. Fixes bug #1390. * Merged in [8573] from rcross@amsl.com: Fixed role_required to permit access to proposed RGs. * Added code to require posting confirmation for some particular draft name prefixes such as 'draft-iesg-', 'draft-iana-', 'draft-rfc-', and some more. * Added a requirements.txt file which can be read by pip in order to install the packages needed to make the datatracker work. Set up a virtualenv, and then run pip install -r requirements.txt in it. * Added settings for the PhantomJS ghostdriver.log and the temporary meeting materials and bluesheets directories used during testing, so that it's possible to place them in other places than the working copy. -- Henrik Levkowetz 13 Nov 2014 03:37:10 +0000 ietfdb (5.7.3) ietf; urgency=medium * Merged in [8634] from rcross@amsl.com: Removed the 'none selected' option from licensing options of new IPR form. * Merged in [8624] from rcross@amsl.com: Removed secauth middleware. Replace with role_required decorators. * Merged in [8623] from suresh.krishnan@ericsson.com: Added email notification to the IESG Secretary about personnel changes in WGs. Fixing issue #1357. * Merged in [8609] from tterriberry@mozilla.com, with minor changes: Allow changing the title of a charter document. Fixes #1334 * Reworked the script which generate draft aliases and WG aliases, after trying out the output of the previous version for real. The new code seems to work better, based on testing on mail.ietf.org. * Merged in [8622] from harald@alvestrand.no: Added a missing column header to search result page * Merged in [8617] from liudapeng@chinamobile.com: Added support for RGs in the search popup. Fixes issue #1355. * Merged in [8614] from harald@alvestrand.no: Added validation of the name when saving a schedule under a new name from the Edit Schedule view. It now returns to the schedule view, and gives the user a message. Builds on [8604]. Fixes issue #1425. * Merged in [8611] from rjsparks@nostrum.com: Allow chairs to edit documents' notification field. Fixes bug #1517. * Merged in [8608] from rjsparks@nostrum.com: Made it possible to choose initial document state when beginning WG processing of a draft. Fixes bug #1406. * Merged in [8602] from suresh.krishnan@ericsson.com: Changed the state change form handling for drafts so that annotation tags aren't lost when changing state. Fixes issue #1295. * Merged in [8585] from rjsparks@nostrum.com: Tests that a message is set when a shepherd is not changed. Related to #1508 and [8504]. * Merged in [8584] from rjsparks@nostrum.com: Reworked smtp error warning and logging to not use hard-to-read context_managers. Fixes bug #1390. * Merged in [8573] from rcross@amsl.com: Fixed role_required to permit access for chairs and secretaries of proposed RGs, in addition to current RGs. * Added some missing admin views. * Added a requirement for posting confirmation for some particular draft name prefixes such as draft-rfc-, draft-rfced-, draft-iana-, and some others. -- Henrik Levkowetz 10 Nov 2014 18:05:57 -0800 ietfdb (5.7.2) ietf; urgency=medium Another bugfix release, containing a number of fixes for issues related to extraction of meta-information from draft submissions, and also fixes for some other blemishes not discovered at the time of 5.2.1. This release also enhances the generation of draft author aliases, providing a {draftname}.shepherd alias which points to the shepherd (if set), and adding the shepherd email address to the {draftname}.all alias. The email alias changes will take effect as soon as the aliases are activated for @ietf.org (as opposed to @tools.ietf.org). Details: * Addedd a temporary patch for an unwanted exception which occurred when trying to generate proceedings for a session which didn't have an assigned timeslot in an official schedule. Happens all the time for interims, for example. * Merged in [8506] from rjsparks@nostrum.com: Changed the default notify address for IRTF stream documents. Fixes bug #1489. * Merged in [8505] from rjsparks@nostrum.com: Added code to allow removing a document shepherd, and test that it works. Fixes bug #1509. * Merged in [8504] from rjsparks@nostrum.com: Added tests that would have caught bug #1508. Added message to edit_shepherd_email to match that added in edit_shepherd. * Merged in [8498] from rjsparks@nostrum.com: Reworked logic flow for editing shepherds. Added message to inform the user when the shepherd is not changed. Fixes bug #1508. * Changed the signature line of the generate-wg-aliases script so as to show the script path instead of a manually maintained string (which had become outdated) in the signature string at the top of the generated files. * Added generation of {draftname}.shepherd aliases for drafts when generating draft email aliases, and also added the shepherd's email address to the {draftname}.all alias. Changed the signature line of the script to give the script path instead of a manually maintained string (which had become outdated). * Fixed a bug in setting the can_edit_shepherd_writeup flag, triggered by the change in what Document.shepherd refers to (now, Email, used to be Person). * Added 'Dr.-Ing.' to the recognised honorifics in the author extraction code. * Did a number of changes to the author extraction method of class Draft in order to make it able to match up names with double-word family names on the first page (A. Foo Bar) with (familyname, given-name) ordering (Foo Bar Any) in the Authors' Addresses section. Regression tested against 200+ known good author extraction results. A number of stronger restrictions in regular expressions had to be introduced to avoid regression, which is probably all to the good. * Added support for ISO-format dates (or RFC 3339 dates, if you will) to the date parsing done for the submission tool. Also refined the regexes a bit to avoid false matches on for instance things like 'Juniper 2014'. * Merged in [8498] from rjsparks@nostrum.com: Reworked the logic flow for editing shepherds. Added a message to inform the user when the shepherd is not changed. Fixes bug #1508. -- Henrik Levkowetz 01 Nov 2014 23:16:20 +0000 ietfdb (5.7.1) ietf; urgency=medium This is a minor bugfix release which empties the merge queue in preparation for the IETF 91 code sprint. Details below: * Merged in [8456] from rcross@amsl.com: Fixed a bug when trying to edit a session request that doesn't exist. Fixed a bug when a submitted session request form does not include conflict input fields. * Merged in [8454] from rcross@amsl.com: Fixed the IRTF proceedings to include Open IRTF Meeting (irtfopen). * Merged in [8452] from rjsparks@nostrum.com: Relax ALLOWED_HOSTS when not running in production. Fixes bug #1373. * Merged in [8444] from rjsparks@nostrum.com: Fixed a condition check problem introduced with adjustments to setting the returning item bit. Fixes bug #1505. * Merged in [8441] from rjsparks@nostrum.com: Removed the X-Frame-Options configuration. * Merged in [8438] from rjsparks@nostrum.com: Better evaluation of whether a document type is diffable. Fixes bug #1504. * Merged in [8305] from rjsparks@nostrum.com: Replaced the return_to_url notion with logic that uses the session object. Related to bug #1430. * Added wgchairs@ietf.org to the release notification email. Split the notification email sending into two, in order to limit the number of addressees for emails going to Mailman lists. * Fixed a 500 error that could occur if someone manually entered a proceedings url so as to to upload materials to a nonexistent meeting/group combination. * Prevented 500 errors caused by a file move race condition on draft submission confirmation. -- Henrik Levkowetz 27 Oct 2014 06:15:18 +0000 ietfdb (5.7.0) ietf; urgency=medium **Enhanced Person-Chooser Widget** This release merges in work from olau@iola.dk which enhances a number of pages in the datatracker where forms contain fields where a person should be chosen, such as for instance when choosing the shepherd of a document, so that they uniformly display choices which show both email address and name. Furthermore, changes have been made so as to make the email address uniformly act as reference to the person record. Autocompletion is now consistently provided when looking for the email address or name of the person to choose. This solves a number of issues where it has been difficult to choose the correct Person/Email combination, and where the correct email address to use for an association has been unavailable previously. -- Henrik Levkowetz 26 Oct 2014 05:51:44 -0700 ietfdb (5.6.5) ietf; urgency=medium This is a minor release which brings in support for 'recording' documents, intended to cover audio and video recordings. This makes it possible to associate links to audio and video recordings with meeting sessions, and will make it possible to also include such links in the proceedings. There is also a database schema migration needed to support the 'recording' documents. * Merged in [8237] from rcross@amsl.com: Changes to support video content in proceedings ('recording' document type). * Normalized the naming of a couple of NameModel subclasses, with a migration and updated fixture. * Added a migration to change foreign keys to NameModel models from 8 to 32 bytes. -- Henrik Levkowetz 25 Oct 2014 09:14:15 -0700 ietfdb (5.6.4) ietf; urgency=medium * Merged in [8359] from rcross@amsl.com: fix get_or_create_nominee() to create Alias for new Person. * Merged in [8156] and [8320] from rcross@amsl.com: Do not allow editing or submitting new session requests when the tool is locked. Fixes Ticket #1443. * Merged in [8308] from rjsparks@nostrum.com: Build the links to about_url for concluded groups correctly. Fixes bug #1487. * Merged in [8303] from rjsparks@nostrum.com: Only show comment/discuss document version on the ballot page when the text is for a version of the document other than the current one. Fixes bug #1482. * Merged in [8377] from rjsparks@nostrum.com: Removes a modify-while-iterating error, and removes a bug where two different bits of code thought they were responsible for deleting things from a global list. Fixes bug #1498. * Merged in [8301] from rcross@amsl.com: Changes to support consensus status. * Merged in [8293] from rjsparks@nostrum.com (Note: Should what is now captured in the STATUSCHANGE_RELATIONS list instead be captured in the database in name_docrelationshipname? ): - Refactored editing the notify field to remove redundant code. - Changed the default notification list to include .all for documents, and the wg list for wg documents. - Allowed recalculating the notification list for all document types. - Improved the calculated notification list value for charters, conflict-reviews, and status-changes. - Adds shepherds to the notification list when they are assigned to a document. - Adds the working group email list to the notification list when a document is adopted. Fixes issue #1438. * Merged in [8285] from rjsparks@nostrum.com: Removed templates that were no longer being used. * Merged in [8271] and [8292] from rjsparks@nostrum.com: Send email when a the telechat date (or returning item bit) changes for a document. Fixes #1452 * Merged in [8262] and [8263] from rjsparks@nostrum.com: - Changes when returning_item is automatically set to match the current IESGs preferences. Removes several chunks of dead code related to editing telechat dates. Improves returning item tests. - Refactored multiple edit_telechat functions into one function in doc_views. Added a helper function for determining if ballots have changed to isolate the implementation. Fixed the issue with update_agenda setting the returning item bit even when the user explicitly said not to. Added prompting to encourage proper setting of the returning item bit to the edit_telechat view. Fixes #1209 * Merged in [8355] from rjsparks@nostrum.com: Add the owners email address to the json path for schedule objects. Fixes ticket #1492. * Merged in [8256] from rjsparks@nostrum.com: Allow defer for status change documents. Fixes bug #1397. * Merged in [8255] from rjsparks@nostrum.com: - Combined defer/undefer tests from doc/tests_ballot and iesg/tests, extending them to demonstrate current reported bugs. - Made doc.active_defer_event() look for the events that are currently being created. This remains brittle. - Added email notifying the IESG of an undefer analagous to the defer email. - Guarded against deferring an already deferred document or undeferring a document that hasn't been deferred. - Guarded against deferring a document that's not scheduled for a telechat. Fixes bugs 1417, 1465, 1417 * Merged in [8254] from rjsparks@nostrum.com: Don't send mail to unknown-email-* addresses. Fixes bug #1471. * Merged in [8249] from rjsparks@nostrum.com: Skip sheme-relative urls. Fixes bug #1466. * Merged in [8239] from rjsparks@nostrum.com: Adds javascript to return to a page a few seconds after successfully logging out. Fixes ticket #1461. * Merged in [8238] from rjsparks@nostrum.com: Look in the right place in the filesystem for the files bits when building reference relations during submit. Fixes bug #1467. * Merged in [8236] from rjsparks@nostrum.com: Log what rebuild_reference_relations returns to diagnose #1467. -- Henrik Levkowetz 13 Oct 2014 13:14:38 -0700 ietfdb (5.6.3) ietf; urgency=medium This is a bugfix and cleanup release, without any major new features. The most notable improvements are to the agenda scheduling code, where a number of bothersome bugs has been slain, but there are also other nice fixes: * Merged in [8229] from rjsparks@nostrum.com, with minor tweaks: From mcr@sandelman.ca: * Refactor to remove dajaxice. * Modified the URLs that address schedules: - urls now always start with /agenda, removing the mix of /agenda and /schedule prefixes - urls to a given schedule include the schedule owner (by email address) * Corrected issue that prevented deleting sessions. * Changed comment mechanism in timeslot_edit.js * Migration to change the email address for (System) Fixes bug #1426 * Merged in [8211] from rjsparks@nostrum.com: Provide a way to get back to the page the user logged out from. Fixes ticket #1461. * Merged in [8210] from rjsparks@nostrum.com: Default the responsible AD for an initial charter or recharter document to the responsible AD for the group. Fixes ticket #1451. * Merged in [8209] from rjsparks@nostrum.com: Fixed several places where files were not being closed. * Merged in [8208] from rjsparks@nostrum.com: Changed the code to use doc.href rather than manually constructing URLs in several templates. Fixes ticket #1459. * Merged in [8207] from rjsparks@nostrum.com: Cleanup commit before changing working HREF contents. * Merged in [8204] from rjsparks@nostrum.com: Improves how many href urls are constructed. Updates ticket #1459. * Merged in [8166] from rcross@amsl.com: Added the 'proposed' WG state to WG role queries for Chair and Secretary -- Henrik Levkowetz 19 Sep 2014 12:28:28 -0700 ietfdb (5.6.2) ietf; urgency=medium **IETF 90 Code Sprint** This release contains the datatracker bugfixes and enhancements from the IETF-90 Code Sprint. Many thanks to everyone that contributed! Contributions that continue to arrive during the week will be merged in to a new release at the end of the week or the beginning of next week. * Merged in [8155] from rcross@amsl.com: Allow Team Chairs access to proceedings. * Merged in [8154] from rcross@amsl.com: Fixed a bug where ScheduledSession objects were still being created without a related session. * Merged in [8150] from rjsparks@nostrum.com: Small cleanup refactor removing redundant configuration line in settings for charter text URLs. * Changed the length of the NameModel slug field from 8 to 32 characters. Added a corresponding migration. * Merged in [8146] from sunqi.csnet.thu@gmail.com: Changed the ietfauth file to allow to change the replaces relationship without setting the doc stream. Fixes ticket #1305. * Merged in [8143] from tterriberry@mozilla.com: Allow IRTF chair to adopt a draft into any RG. Fixes #1082. * Merged in [8137] from rjsparks@nostrum.com: First automated javascript test using PhantomJS and Selenium. * Merged in personal/shane/v5.6.2-dev0@8144 from shane@time-travellers.org: Added untrack to document and search pages. Fixes #1381. * Merged in [8136] from denghui@chinamobile.com: Added display of the relevant draft revision number for ballot comments. Fixes issue #911. * Permit really long sessions, and don't expire sessions on browser close. On request from Pete Resnick. * Merged in [8122] from gnocuil@gmail.com: Force mailing to secretary when a charter state changed to internal or external review. Fixes ticket #1444. * Merged in [8121] from fanpeng@chinamobile.com: Added a 'No Errata' indication for RFCs with no errata. Changed the link to the draft text for expired drafts to use the archive at www.ietf.org/archive/id/ instead of tools.ietf.org/id/. Fixes ticket #1112 and #1432. * Added a meta tag to the base template, to specify a page character set. * Merged in [8114] from gnocuil@gmail.com: Changed the template to highlight groups from different areas instead of the same area. Fixes ticket #1368. * Merged in [8099] from rjsparks@nostrum.com: Use the name field from the materials upload form. Fixes ticket #1445. -- Henrik Levkowetz 22 Jul 2014 14:21:25 -0700 ietfdb (5.6.1) ietf; urgency=medium * Added an x_frame_options setting to permit datatracker pages to be embedded in tools parges, for the tools tutorial. * Merged in [8057] from olau@iola.dk: Changed Document.get_absolute_url to handle case of non-meeting-based group materials, fixes #1440 * Merged in [8045] from rcross@amsl.com: Added code to grant IETF Trust Chair permissions for Announcement Tool. * Merged in [8003],[8004] and [8005] from fanpeng@chinamobile.com: Added email subscription and web-archive links to the datatracker wg summary page. Fixes issue #958. * Rewrote the draft-alias and group-alias generation scripts to generate matching aliases and virtual files for postfix. * Adjusted the permissions checking in has_role to accept bof chairs and secretaries. -- Henrik Levkowetz 15 Jul 2014 02:01:14 -0700 ietfdb (5.6.0) ietf; urgency=medium **Team Pages** This release adds group page support also for non-WG/RG groups, extending and generalising the work done recently to add RG pages. In particular, this provides the Edu team with a place to upload and display educational materials. Changelog: * Merged in branch/iola/team-support from olau@iola.dk. This generalises and extends the group support for WGs and RGs so that also other groups, such as for instance the Edu Team, can have pages. * Miscellaneous other minor changes mostly related to merging, testing and admin. -- Henrik Levkowetz 02 Jul 2014 12:40:19 -0700 ietfdb (5.5.2) ietf; urgency=medium This is a bugfix release which updates the database contents with bindings for breaks and registration timeslots that make the agenda pages come out as intended. Changelog: * Modified the code which adds non-session entries to a schedule so as to bind a Session object also to Break and Registration timeslots, through the Schedule/Timeslot/Session m2m table. This makes the agenda templates work as expected. There's also a migration and a standalone script that fills in this information for existing schedules. * Tweaked the test-crawler to show the complete chain of referrers for a failing URL. * Don't show dash after timeslot names in the ietf agenda if there's no associated location. -- Henrik Levkowetz 30 Jun 2014 10:21:41 -0700 ietfdb (5.5.1) ietf; urgency=medium This is a routine bugfix release. Here is a list of the addressed issues: * Merged in [7935] from liudapeng@chinamobile.com: Added display of both WG conflict and person requirements to the session request page. Fixes issue #1384. * Merged in [7924] from rcross@amsl.com: Now permitting IPR updates to not specify an IPR license selection. * Merged in [7911] from rcross@amsl.com: Fixed a problem which occurs when non-ascii names are used in session request notification emails. * Merged in [7910] from rjsparks@nostrum.com: Now paying attention to group type in all the wginfo functions. Fixes bug #1423. * Merged in [7888] from rjsparks@nostrum.com: Fixed a bug where links in personal document tracking list associated with groups which are not WGs or RGs return 500, by only turning WG and RG groups into links. Fixes bug #1421. * Merged in [7865] from rjsparks@nostrum.com: Addressed an issue with dragging and dropping unscheduled items back into the unscheduled bin (primary fix provided by Matt Miller). Fixes bug #1386. * Merged in [7843] from rcross@amsl.com: Changed the default group type field on the groups search form, from WG to unset. * Changed the code to move drafts from the active draft repository to the draft archive so that all associated files will be moved, not just those with specifically listed extensions. This fixes the problem that .xml files associated with submitted drafts were moved to the unknown_ids subdirectory of the archive, instead of into the archive proper. * Merged in [7879] and [7880] from olau@iola.dk to fix a couple of issues with the 5.5.0 release. * Fixed a bug in the mkrelease script, introduced by changing the naming convention for development tags from X.Y.Z-dev to X.Y.Z-dev0 (etc.). -- Henrik Levkowetz 26 Jun 2014 13:12:50 -0700 ietfdb (5.5.0) ietf; urgency=medium **Research Group Pages** This is a feature release, which introduces pages and workflow support for IRTF RGs, similar to what is available for IETF WGs. You'll find the rg pages under /rg/, for instance https://datatracker.ietf.org/rg/cfrg . Having this new baseline in place, I'm sure we'll get requests for refinements, but this should be a reasonable first pass at providing this functionality. -- Henrik Levkowetz 09 Jun 2014 14:25:51 -0700 ietfdb (5.4.3) ietf; urgency=medium * Merged in [7772] from rjsparks@nostrum.com: Checks that an email address will survive encoding as part of validating a liaison form. Fixes bug 1410. * Merged in [7766] from rjsparks@nostrum.com: Improves the robustness of the SMTP error handling utilities. Fixes bug #1409. * Tweaked mkrelease to add a new development tag matching each new release tag, to make it easier to create personal development branches with development settings. * Merged [7748] from rjsparks@nostrum.com: Adjust when publication request button appears for documents in non-ietf streams. Fixes bug #1402. * Merged [7740] from rjsparks@nostrum.com: Fixed a crash when requesting sessions for groups that do not have ADs. Applied to production as 2014-05-13-sreq-rg.patch . * Merged [7735] from rjsparks@nostrum.com: Fixed coloring rows: The js IETF object needs to exist for the code to work. Fixes bug #1303. * Merged [7734] from rcross@amsl.com: Changes to support IAB group types, including requesting a session and uploading materials. * Merged in [7732] from rjsparks@nostrum.com: Extended ScheduledSession objects were not initialized correctly, so un-extending did not work. Fixes bug #1401. * Added a file used by bin/mergeready to mark certain releases which has earlier been marked as ready to merge with a 'hold' indication, instead. * Replaced a symlink with the real file -- symlink committed by mistake. * Added validation of successful draft title extraction on draft submission upload, to avoid a later exception when trying to store draft information for a draft with a null title. * Merged in [7726] from rcross@amsl.com: Fix secauth middleware to grant access to WG Secretary, RG Chair and Area Director. * Merged [7705] from rjsparks@nostrum.com: Corrected Document vs DocHistory mismatch when working with status-change documents. Corrected creation of BallotDocEvent timestamps. Fixes bug #1396. * Merged [7678] from rcross@amsl.com: Show correct group type and ommit link to tools.ietf.org on BOF proceedings. * Merged [7677] from rjsparks@nostrum.com: Protect against cases where add_state_change_event can return None. Fixes bug # 1383. * Fixed a typo (missing space) in a template. Fixes issue #1398. * Added a utility command 'mergeready' which lists commits marked as 'Commit ready for merge' that have not yet been merged to trunk. -- Henrik Levkowetz 02 Jun 2014 15:10:37 -0700 ietfdb (5.4.2) ietf; urgency=medium * Merged [7673] from rjsparks@nostrum.com: Made several changes to better handle non-ascii UTF-8 in email messages. - Used multipart mime when including the original message in an error message to the secretariat. Modified the way IANA review email is parsed. Added non-ascii UTF-8 tests to the IANA review email parser and to the SMTP Exception handling code. - Changed how edit_mtg() is called, in order to propagate kwargs as kwargs. Removed repeated @check_permissions. * Merged [7653] from rcross@amsl.com: Fixed two issues with proceedings generation. * Merged in [7644] from rjsparks@nostrum.com: From rjsparks@nostrum.com: - Fixed layout issue on schedule editing page in Chrome - Fixed errant display of text in unscheduled group bar on the schedule editing page - Changed the instruction text on the special requests field of the session request form From rcross@amsl.com: - Improved scheduling of non-session items - Fixed issue with layout of the new notifications page - Fixed crash on notifications page -- Henrik Levkowetz 01 May 2014 02:14:27 +0200 ietfdb (5.4.1) ietf; urgency=high This is a minor bugfix release, to fix an issue with the mail handling infrastructure where one bad email recipient address for a notification message (about for instance a state change) could cause some actions related to the state change to be skipped: * Merged in [7635] from rjsparks@nostrum.com: Replumbed how SMTP Exceptions are handled, which involved refactoring several mail functions. * Also fixed a bug in the agenda editing code caused by a change of an attribute name in the python code but not doing the same change in templates using the attribute. * Changed the logic for what is the 'current' ietf meeting to disregard whether there's an agenda for the meeting or not. This lets people see the correct session request page for the current meeting. However, it also makes the /meeting/agenda.html page fail because there's no schedule associated with the meeting; so alternative pages saying 'No agenda available' has been added, too. * We're now showing the login link with a http:// scheme instead of https:// when in debug mode, in order to be able to log in when using 'python manage.py runserver', which only supports http. -- Henrik Levkowetz 25 Apr 2014 17:11:32 +0200 ietfdb (5.4.0) ietf; urgency=medium **Enhanced Agenda Scheduling** This is a feature release which brings in an updated version of the agenda scheduling code. There are still known bugs and rough edges, but this version has many bugfixes and cleaned up issues, and brings essential imporvements to the agenda scheduling tool. * Merged in [7561] from rjsparks@nostrum.com: Updates and bugfixes to the agenda editing features - Removes the pattern of using ScheduledSession m2m objects with one of the relationships left as None - Improves scheduled session state handling - Simplifies sending email to scheduled session requestors - Improved timeslot purpose and room editing - Improved access controls to editing forms - Better test coverage for the meeting views - Improvements to the javascript driven by prototyping automated tests - Better initialization of a new meeting On the session request form: - Allows specifiying room resources (projectors, meetecho) - Allows specifying what people must be present On the schedule editing page: - correctly calculates conflict levels - displays conflicts in and out of each session separately - italicizes BoFs - shows resource and people conflicts Adds automated placement as a management command -- Henrik Levkowetz 22 Apr 2014 23:58:27 +0200 ietfdb (5.3.1) ietf; urgency=medium This is a minor release, with a number of bug-fixes and a few enhancements. Notable enhancements are the ability to set the document consens field back to Unknown after it has been set to Yes or No, and an enhancement to the test infrastructure that lets tests of email handling interact with a real recipient SMTP server, instead of ending in a stub. Details: * Merged in [7591] from rjsparks@nostrum.com: Added a real (if simple) SMTP server to the test framework and tests handling of exceptions and rejected addresses. Fixes ticket #1314. * Merged [7590] from rjsparks@nostrum.com: Changed when the consensus field is displayed and who can edit it for IETF stream documents. Fixes bug #1380. * Merged [7589] from rjsparks@nostrum.com: Functional changes allowing consensus to be set back to Unknown. Fixes ticket #1150. * Merged [7588] from rjsparks@nostrum.com: Schema migration to allow consensus to be set back to unknown. Related to ticket #1150. * Merged in [7587] from rjsparks@nostrum.com: Anyone with a role in a group could preapprove drafts. Changed that to an explicit subset of roles. Fixes ticket 998. * Merged in [7586] from rjsparks@nostrum.com: Fixed calculation of needed ballots for status-change documents. Added needed ballots tests for drafts and status-change docs. Fixes bug 1116. * When we deployed the rewritten public datatracker, we went from django auth to basic http auth. At that time we also changed the session timeout time to 12 hours, from the default 2 weeks. I see no need to use a non-default setting now that we're back to using django auth; changing the session timeout time back to 2 weeks. * Merged in [7519] from olau@iola.dk: Removed uses of gzip middleware - the decorator thing breaks the ETags for some reason, as noted in issue #518, and it seems consensus is that we should do this in Apache instead for the whole site * Merged [7421] from olau@iola.dk: Fixed a crash bug in the redirection logic that occurs when someone posts a draft without an access token from the email confirmation step * Merged [7416] from olau@iola.dk: Redo the quickfix to the "Send and Post" button bug (mentioned in issue #1308) so that we still do the validation correctly, but just always show the button (even if it's unusable) -- Henrik Levkowetz 16 Apr 2014 23:22:41 +0200 ietfdb (5.3.0) ietf; urgency=medium **Django Authentication replaces Basic HTTP Auth** This release changes user authentication for the datatracker from basic http auth to Django's built-in authentication. This has the advantage of making it possible to log out, and log in as a different user, which can be useful, and it also changes the password hash storage for each user to a much stronger hash scheme, upon his or her first successful login after the deployment. The email-verification roundtrip which is required to create a new login, or change the password of an existing login, is retained. For the large majority of users, who either didn't have a password hash in the database before the transition to the Python/Django based database frontend on 16 July 2010, or had a password hash in the database, but have updated their password after 3 July 2012, there should be no impact. Password hashes have been imported as needed from the http auth password hash file. The few who had a password hash in the system before 16 July 2010, and haven't updated their password since 3 July 2012 are encouraged to set a new password using the password reset form at https://datatracker.ietf.org/accounts/reset/ . If there are issues which prevent a password reset, please email henrik@tools.ietf.org for assistance. -- Henrik Levkowetz 12 Apr 2014 20:14:17 +0200 ietfdb (5.2.1) ietf; urgency=medium This is a minor release, with some bugfixes and some enhancements. It also contains some reworked secretariat code, which changes part of the authentication handling in preparation for the next release (5.3.0), which will transition the datatracker from using HTTP basic authentication, to Django's built-in authentication scheme. * Merged in [7568] from rcross@amsl.com: Grant ISOC CEO access to announcement tool, change announcement tool from option 'IAB Executive Director' to 'IAB Executive Administrative Manager' * Merged in [7557] from rjsparks@nostrum.com: Update reference relationships (asyncronously) for new rfcs found when syncing with the rfc index. Fixes ticket #1347. * Added some datatracker development notes from the testing extension (pyflakes etc.) work * Merged in [ 7454] and [7549] from rcross@amsl.com: Changes to the secretariat code, to support Django authentication instead of basic http auth, and fixes to the tests to work with the secauth middleware changes. * Pyflakes cleanup to be compliant with pyflakes 0.8.1, which seems to find things 0.8.0 didn't find. * Changed URLs with explicit scheme from http to https. Emails that are sent out from the datatracker will now specify URLs with https:, rather than http. * Added a fix to exclude empty email addresses from the send list. * The ietf/patches directory doesn't work out as intended, and causes some confusion with the /a/www/ietf-datatracker/patches/ directory on the production server. * Backfilled the changelog file, back to 2.00 * Merged in [7153] from rjsparks@nostrum.com: Fixed a typo in code that looks for the IRTF chair email address while adding replaces relationships. Made that code slightly more robust. Fixes ticket #1253 -- Henrik Levkowetz 06 Apr 2014 17:28:49 +0200 ietfdb (5.2.0) ietf; urgency=low **PyFlakes** This is a code cleanup release. It adds a test and a managemement command to run pyflakes (pyflakes is a bit like 'lint' for Python) over the datatracker code, and provides cleaned-up code so that the new pyflakes test is clean. The number of lines changed is large, but the changes to what the code actually does is limited to fixing bugs discovered by pyflakes during the cleanup. There were around 10 such cases. Most of the changes are related to import statements, as the code otherwise was pretty clean already. In almost all places, bulk imports using '*' has been replaced by explicit imports, for these reasons: * It makes it clear from where an imported name has come, so that a human reader can look for an identifier in the import statements, and see from where it comes, and where he should go to inspect the related code. * It makes it clear to the interpreter exactly which symbol is intended, in cases where the same symbol is defined in multiple modules imported using '*' import. This is not a common case, but it actually turned up a couple of times during the cleanup. If the '*' imports in question hadn't been turned into explicit imports, only the (somewhat arbitrary) order of the import statements would have determine which instance of a function or class would actually be visible to the following code. This situation can make the code do something different from what was intended, in a quite devious way. * It avoids unintended import of generically named variables from other modules. Altough having such variables as module globals is a bad practice, it happens, and sometimes unintentionally importing them through a '*' import will make it appear to the interpreter that a statement intended to use an (by mistake undefined) identically named local variable is in fact a valid statement which uses the imported symbol instead. Without the '*' import, the situation would be correctly flagged by the interpreter. * Finally, importing all symbols explicitly makes it possible for pyflakes to do a better job in identifying unused and undefined symbols -- in the presence of '*' imports, this capability becomes much more limited. Several cases of bad code (use of undefined variables) was discovered during the cleanup only after the '*' imports were replaced by explicit imports. In many places, the import statements have been reordered to consistently list the generic python library imports first, followed by django imports, then local module imports (these typically live on the same level as ietf/ and django/), finally followed by datatracker-specific imports. Some people find that this kind of consistency in importing, both in keeping a consistent order, and in importing in a sequence from the more general down to the more specific, aids in the readability of the code. -- Henrik Levkowetz 19 Mar 2014 21:41:16 +0100 ietfdb (5.1.1) ietf; urgency=medium This is a minor bugfix release, in preparation for merging the pyflakes test branch to trunk. * Fixed the meeting materials page so as to avoid duplicate materials sections for groups with multiple sessions. * Merged [7456] from rjsparks@nostrum.com: Patched meeting/ajax to close permissions vulnerability. Tweaked tests to check the right functionality given the permissions policy currently in trunk. * Merged [7447] from rjsparks@nostrum.com: Cache the dependency graph pdf for an hour. * Merged [7445] from rjsparks@nostrum.com: Adds dependency graphs for drafts belonging to a group. Removes links to Bill's dependency tools. Fixes bug #536. -- Henrik Levkowetz 18 Mar 2014 22:49:58 +0100 ietfdb (5.1.0) ietf; urgency=high **IETF 89 Code Sprint** This release contains the datatracker bugfixes and enhancements from the IETF-89 Code Sprint. Many thanks to everyone that contributed! There are still some contributions from the sprint in the pipeline; they will be included in later releases. * Merged in [7400] from rcross@amsl.com: Fixed bugs with decorators.check_permissions() to allow upload to top level groups, and fixed the plenary upload check. * Merged in [7398] from rcross@amsl.com: Added X-CSRFToken AJAX request header for certain /secr/ pages needing it. * Merged in [7397] from rcross@amsl.com: Fixed a bug where build_nonsession() not creating ScheduledSession objects. * Merged in [7383] from jmh@joelhalpern.com: Changes counting logic in ballots to use actual number of ADs. Causes ballot email to use utility to generate requirements text Fixes ticket #924 * Merged in part of [7375] from jmh@joelhalpern.com: Fixed missing mailto: addresses in the meeting requests page. Fixes issue #1126. * Merged in part of [7375] from jmh@joelhalpern.com: Now sending draft update notices to IRSG for IRTF stream drafts. Fixes issue #1227. * Merged in [7396] and [7378] from rcross@amsl.com: Simplified clean_up_draft_files(). Removed references to old draft-archive subdirectories, and fixed for all RFC file types " Fixes ticket #1164 * Merged in [7386] from tterriberry@mozilla.com: Describe needed positions in document ballot mail. This uses doc.utils.needed_ballot_positions() to calculate what is needed. Fixes #924. * Merged in [7380] from bartosz.balazinski@interdigital.com: Changed the URL for some acoount settings from /cookies to /account/settings. Fixes ticket #806 * Merged in [7368] from rjsparks@nostrum.com: Improves the detail in the messages sent when creating tickets about failed sent email. Changes a locally defined exception name to look less like one already defined in smtplib. This is related to ticket #1208. * Merged in [7365] from rjsparks@nostrum.com: Improve handling of status-change relation form submission when conditions (such as not running javascript) lead to the POST missing required fields. * Merged in [7371] from rjsparks@nostrum.com: Migration to repair missing StateDocEvents from wg chairs using the datatracker to request publication of ietf stream documents. Incremental improvement to the request publication view to create those StateDocEvents going forward. This is related to bug #1312 -- Henrik Levkowetz 05 Mar 2014 18:20:31 +0100 ietfdb (5.0.2) ietf; urgency=medium This is a minor bugfix release. * Merged [7292] from rjsparks@nostrum.com: Allow 1-3 digit RFCs in status change documents. Fixes bug #1321. * Fixed a server failure for person alias creation during draft submissions. * Fixed overflow error for meetings without timeslots, which gave server errors for meeting/64/agenda.html. * Additional tweaks to bin/mergedevbranch. * Merged in [7204] from rjsparks@nostrum.com: Adds the IAB-parented sessions to the set of things returned as \'areas\'. Fixes bug #1288 * Reapplied merge of [7209], which although listed in svn:mergeinfo on . actually doesn't seem to have made it into the repository. * Only show a link to the tools page for a group if the tools page is likely to exist, i.e., the group is a WG and it is or has been active. * Added a logging filter to filter out the 'Invalid HTTP_HOST' emails. * Changed the SECRET_KEY setting to take account of the settings in settings_local. * Merged in [7138] from rjsparks@nostrum.com: Reworked SMTP Exception handling, adding sending a ticket to the secretariat when there are errors handing messages off for delivery. Added SMTP exception handling to send-scheduled-mail. This is related to ticket #1208 * Added a file to hold a list of changesets which are ready for merge, as a manually maintained alternative to 'Ready for merge' annotations in commit messages. * Typo fixes. * Set version info and settings back to development mode -- Henrik Levkowetz 25 Feb 2014 16:53:54 +0100 ietfdb (5.0.1) ietf; urgency=medium This is a bugfix release which collects a series of fixes and usability tweaks from the last months. * Merged [7236] from rcross@amsl.com: Fixed Liaison Add CSRF token error and missing Post and Send button. Fixes ticket #1308. * Added a way to control the output of the url and template coverage tests, so they only will be run for verbosity greater than 1, which is controlled by the --verbosity switch. * Merged [7214] from rcross@amsl.com: Changeed old references to pub.ietf.org, to datatracker.ietf.org/secr/. * Merged [7213] from rcross@amsl.com: Added a missing template for the secretariat apps: unauthorized.html. * Merged [7209] from rcross@amsl.com: Fixed a typo in secretariat drafts add(). * Fixed a probem with wrong URLs in atom feeds, caused by caching. Fixes issue #1307. * Added a blank line before new session group in the text agenda, for readability. * Added a secret key to settings.py for development use. NOT for production use; that needs to go in settings_local.py * Added a warning to the draft submission page about upcoming submission cut-offs. Added a value in settings.py for the number of days before the first cut-off to display the waring. * Updated the caching settings to use memcached in production. * Remove spurious 'yes' in meeting requests page. * Merged [7215] from rjsparks@nostrum.com: Use idnits on www.ietf.org Fixes ticket #1200 * Merged [7215] from rjsparks@nostrum.com: Use idnits on www.ietf.org. Fixes ticket #1200 * Merged [7212] from rjsparks@nostrum.com: Removed the "Reason for (re)chartering" line from the charter main document page. Fixes bug #1294 * Merged [7210] from rjsparks@nostrum.com: Allow the IRTF Chair and the ISE to request a conflict review directly through the tracker. Notify the Secretariat when someone other than the secretariat initiates a conflict review. Notify IANA when anyone initiates a conflict review. Fixes tickets #1287 and #1289 * Merged [7204] from rjsparks@nostrum.com: Adds the IAB-parented sessions to the set of things returned as "areas" Fixes bug #1288 * Merged [7077] from rjsparks@nostrum.com: Returns "there are no ballots to view yet" rather than 404ing when the ballot link is followed for a document that exists. It is typical for last call to be issued (which includes a link to the ballot page) well in advance of creating any ballot for a document. Fixes bug 1233 * Merged [7076] from rjsparks@nostrum.com: Sets the State(type=draft) to Replaced when a document is replaced using views_draft.replaces. Sets the state back to Active or Expired when a document is no longer replaced by another document. Adds tests for the above functionality. Provides a patch to repair the state of documents pointed to by RelatedDocument(relationship__slug='replaces') objects created by views_draft.replaces before this fix. Fixes bug 1234 * Merged [6361] from rjsparks@nostrum.com: Allow the secretariat and ads to change the title of a status change document. Fixes bug 1141. Applied changes to adapt the code from Django 1.2 to 1.6: Provide a quoted string to {% url %} and use request.user.person instead of request.user.get_profile(). * Fixed problem with nomcom RST templates not being rendered under Django 1.6. * Merged [6359] from rjsparks@nostrum.com: Send email to the secretariat when a status change document is put directly into the last-call-requested state. Fixes bug 1139. * Added stream change and state change emails in adopt_draft() -- otherwise we wouldn't have the state change emails assumed in the previous commit. See issue #1246. * Removed the extra (misleading) email about WG adoption which is sent out in addition to the state change emails when a call for addoption (WG) or adoption (RG) is done using the 'Adopt Draft in Group' form. The state change messages should be sufficient, and are not misleading. Fixes issue #1246 (and 1290). * Handled the case in is_downref() where the src file doesn't have a std_level or intended_std_level set. * Modified ALLOWED_HOSTS to permit some (surprising) alternative HTTP_HOST names. Are these a result of queries proxied through other ietf.org domains? The numerical address is the mail server address. We should find out why that appears, and see if it can be made to appear as mail.ietf.org instead. * Added Matt Larson to the release notification email address list. -- Henrik Levkowetz 16 Feb 2014 19:36:41 +0100 ietfdb (5.0.0) ietf; urgency=medium **Database Schema Conversion Complete** With this release, a journey which started in 2008 with a *major* redesign of the IETF database schema has reached its goal. We've now converted the datatracker completely to the schema designed then, swapping out all the models that were changed, converted the database, swapped out all the GUI code that was built against the old models, and polished off a host of minor issues arising from the conversion. All this while completing and integrating 10 major functionality enhancement projects and releasing more than 50 minor releases, with not a single day of downtime. A history of release notes is available here: https://datatracker.ietf.org/release/ In addition to bringing in the last scheduled polish of the conversion, this release also brings in an upgrade of the Django framework from version 1.2 to 1.6, which gives us a number of new tools and possibilities for future work. A particular mention goes to Ole Laursen , an outstanding programmer at the small Danish firm IOLA, who has been doing a lot of the heavy lifting in coding the shim-layer which made it possible to change the database schema without a total re-write in the spring of 2012, followed by the major code re-write which has taken place since then to get rid of all the parts which were written to the old database schema. Thanks also goes to all the IETF code sprint participants who have contributed, and to Robert Sparks in particular who has contributed *a lot* to make it all come together. There are still some parts of the schema that need an overhaul, and plans exist for addressing those, but overall we should be in good shape for the near future, with some room to grow :-) Detailed change information is available at: - http://wiki.tools.ietf.org/tools/ietfdb/browser/trunk - http://wiki.tools.ietf.org/tools/ietfdb/browser/branch/iola/djangoport - http://wiki.tools.ietf.org/tools/ietfdb/browser/branch/iola/shimfree -- Henrik Levkowetz 30 Jan 2014 22:11:28 +0100 ietfdb (4.95) ietf; urgency=medium This release upgrades Django from version 1.2 to version 1.6, including a large number of refactorings and adjustments (about 140 individual changes) to adapt to changes in both interfaces and the style of how things are done between Django 1.2 and 1.6. The full list of changes is available here: http://tools.ietf.org/tools/ietfdb/log/branch/iola/djangoport -- Henrik Levkowetz 13 Jan 2014 19:14:05 +0100 ietfdb (4.90) ietf; urgency=medium **Shim Layer Removal** This release removes almost all parts of the shim-layer code which was used to provide a semblance of the old database schema to user-interface code after we moved to a new database schema in the early part of 2012. There should be no changes in basic functionality changes in this release, even if there are many small optimisations and changes in code details which come in as a result of the shim-layer removal. -- Henrik Levkowetz 20 Dec 2013 18:07:48 +0100 ietfdb (4.84) ietf; urgency=low This is a minor bugfix release, in preparation for merging in the latest shim-removal work. * Merged [6859] from rcross@amsl.com: Fixed calls to reverse() to match new url names since code merge * Merged [6858] from rcross@amsl.com: Use correct URL in new IPR notification email * Merged [6857] from rjsparks@nostrum.com: A script to run from cron to send daily messages to IETF Announce showing the email header field change. his should be run from Jan 6 to Jan 20, after which point we need to deploy analagous changes to the code that constructs last call announcements. This is related to bug #811. * Merged [6701] from rjsparks@nostrum.com: Adds pages to show what a given document refers to and what refers to it. Fixes bug #1194. * Merged [6672] from rjsparks@nostrum.com: Removed requirement to enter a phone number in various places on an IPR disclosure entry form. Fixes bug #1176 * Fixed a typo. Fixes issue #1216. -- Henrik Levkowetz 16 Dec 2013 23:34:37 +0100 ietfdb (4.83) ietf; urgency=high **IETF 88 Code Sprint** This release provides the code from the IETF-88 code sprint, and also a number of fixes to things reported during the IETF. The number of enhancements coming out of the sprint this time is impressive; this may actually have been the most successful sprint till now. Of particular note is the new ability for chairs and others who has the permission to edit a document's state, to edit replaced-by information for documents; and the introduction of information about which documents a given document references, for all documents. Future enhancements will display this information as diagrams and textually, and use it to re-introduce the dependency diagrams originally provide by Bill Fenner in his stand-alone dependency graph application. From rcross@amsl.com: * Changed draft replaces action: move document to archive directory From tterriberry@mozilla.com: * Allow wgchairs to edit document replacement relationships. This actually allows anyone with can_edit_stream_info permission to edit the list. This does draft name completion, but does not currently filter those names for likely replacements. Styling is also basically non-existent. Fixes #1002 * Added 'Track this document' link on drafts. Fixes #1085. * Mark concluded BoFs as BoFs, not Concluded WGs. Fixes #1169. From bartosz.balazinski@interdigital.com: * Added the new version of the shepherd writeup as a comment when it's edited. The new version works like this: - Any shepherd writeups done before the document is submitted for publication are not disclosed in the history. - When the document is submitted for publication the available writeup (if available) is added to history. - Any further writeups after the document has been submitted for publication are disclosed in the history. From suresh.krishnan@ericsson.com: * Refactored the mails sent when state is changed along with annotation tags. Don't send emails for only comment changes, just add a history entry. For state changes and annotation changes, only send one email, containing information about both state changes and annotation tag changes. Fixes issue #1127. From jmh@joelhalpern.com: * Included confirmation addresses in ID-Submission success notice. Fixes issue #1097. * Added document titles to status change request email. Fixes issue #1069. * Added \'Last Call Issued:\' to front of last call atom feed entry subjects. * Fixed conflict review text for irtf docs to reference RFC 5743. * Added the last call expiration date to the document header, and remove duplicate code for producing the iest state summary. From markus.stenberg@iki.fi: * Added .csv export from private community lists. Fixes #1074 * Took care of #841 by moving correctly outside altogether. From adam@nostrum.com: * Fixed #1153: Fixes IPR disclosures being counted multiple times and counting of \'not yet approved\' IPR disclosures. From rjsparks@nostrum.com: Refined Bill Fenner's regex based search through documents for references. This populates RelatedDocument with relations for references for each type draft Document; replaces these reference relationships with updated copies upon draft submission. Note to deployer: There is a script to run in patches/fill_in_references.py that does the work of bringing the database up to date. It takes around 10 minutes to complete on a fast development laptop. Fixes bug #1173 Other changes: * Tweaked the style used on the nomcom feedback pages a bit, to give people a bit more room to write in the feedback field. * It turns out that the get_user_email is called for every nominee listed on a feedback page, which is insane. But until the template can be rewritten to do this in a more sane way, we cache the lookup result. * Changed things so the left-side navbar doesn't jump to full page width in the instant before the main content is loaded. NB: Cleanup action needed: replace all px dimensions with em, consistently. * Included the IAOC update session in the training section of the agenda. * By preference, show the same email for a logged-in user as his login, if it exists; otherwise show the newest active email address. * Many minor fixes to agenda templates and the known-good agenda test files. -- Henrik Levkowetz 06 Nov 2013 20:33:43 +0100 ietfdb (4.82) ietf; urgency=high * Removed the ams_filters template tag file from the meeting app -- it was a copy of the ams_filters under secr/, and masked it. * Added another state to the possible IETFWG states in the group proxy models file, to avoid exceptions. * Changed the 'pipe' utility to work with commands taking input on standard in, also when providing an emtpy string as input. This is now different from providing 'None' as the input argument, or omitting it. * Tweaked the utility script to find missing submission confirmation emails. * Rewrote html and text agenda templates to take schedule as data. * Added the utility program (vzic) used to generate timezone-specific iCalendar information, and the original .ics files generated by the utility program in 2010. * Added some code to vzic to make it output symlinks for all timezone links specified in the Olson database, not only some of them. * Included newly generated .ics files, from http://www.iana.org/time-zones/repository/releases/tzdata2013h.tar.gz. This updates the .ics files to use timezone information current as of 27 Oct 2013. * Added links to the individual nominee fedback pages to the private nomcom index page, in order to make it easier to find and look at the feedback for a filtered set of nominees. * Added a template filter to do required escaping in iCalendar pages. * Changed the path to iCalendar vtimezone information to point into the release directory, so that we can make updated vtimezone information available directly in a release, instead of out-of-band. * Provided new methods Meeting.vtimezone() which return a vtimezone stanza for ical files, based on the timezone setting for a meeting, fetched from a pre- generated file; and Session.ical_status(), which provides a string appropriate for use in ical STATUS: entries. * New view code and templates for agenda pages, updating all agenda templates to take schedule-specific information so that they will work with arbitrary schedules, not just the official schedule for a meeting. * Updated test masters to match the changed (and now more predictable) order of some entries in the agenda pages. * Merged [6486] from rjsparks@nostrum.com: Slightly more than minimal changes to have questionnaire reminders go only to those nominees who have accepted but have not yet sent in a questionnaire for a given position * Marked some instances of code in the meetings app which used variables that don't exist with XXX Fixme. Removed dependency on the logging module, we use syslog by default. Replaced some log.debug() calls with debug.log(). * Removed a lot of dead code and unused imports. * Merged [6580] from rjsparks@nostrum.com: Reverted materials.html and the view that drives it to before the 4.70 merge. Tweaked the view to get (I hope) the right things. * Updated the template and support functions for iPhone agenda page. -- Henrik Levkowetz 31 Oct 2013 19:13:02 +0100 ietfdb (4.81) ietf; urgency=medium * Merged in branch/amsl/1.50@6388 from rcross@amsl.com, with secretariat tool announcement fixes, permission fixes, and agenda database schema fixes. * Required logins to be all-lowercase. This was prompted by repeated trouble with people registering non-lowercase logins, then trying to log in with all-lowercase, or vice versa. * Merged [6465] and [6466] from rjsparks@nostrum.com: Added the ability to send reminders to complete questionnaires to nominees in the accepted state. Changed the send_reminders management command to not take any arguments and run against all active nomcoms. Removed bugs from the send_reminders management command and added tests for it. Adjusted several dbtemplate titles and content. Fixes bug 1157 * Merged [6468] and [6469] from ejimenez@yaco.es: Now a Nomcom incumbent can be set to None for positions. Fixes #1156. * Let Timeslot.session() Return the first session, rather than none, for timeslots with multiple associated sessions for the public schedule. * Made the timeslots sent to the agenda.ics and agenda.txt template distinct, to avoid duplicate agenda items. Fixes issue #1155. * Added caching for the somewhat costly TimeSlot.session() method/property. This speeds up text agenda generation using the legacy template substantially. * Tweaked the strings displayed when a plenary agenda cannot be shown. * Changed the select statement in MeetingProxy.sessions() to produce correct results for the official agenda, and filter out timeslot entries without scheduled sessions. * Remove the AD information from the text agenda until we fix the database so that it displays consistently correctly for past meetings. * Reverted to release 4.72 versions of several functions and methods, starting with agenda_info() and the view functions that use it. Also changed meeting/tests/agenda.py to accept matching return values. Reverted old supporting models and proxy models to 4.72 versions, too, in meeting/proxy.py and proceedings/models.py. Updated the proxy models which rely on TimeSlot to work properly with the m2m sessions field, and adjusted some other functions, such as session_agenda() to also understand the m2m sessions field (and its reverse). Added an understanding of the "bof-conc" state to the code which returns 'BOF' or 'WG' for agenda templates. * Reverted to release 4.72 versions of txt, ics, and csv agendas, with minor tweaks. * Improved the test suite with improved diff tests for retrieved urltest files. A number of other test tweaks and enhancements, including several known-good master files to diff generated pages against. * Cleanup action: replaced the noTable block construct with start/end table_content blocks in order to not have to open and close tables in different blocks, and not have empty tables lying about. * Reinstated the release 4.72 get_agenda_info() as legacy_get_agenda_info(), and tweaked it to work with the new Timeslot model's sessions field. Reverted the html agenda view code to use legacy_get_agenda_info(), based on the release 4.72 code. This is a fix to display the html agenda for now, and will need more cleanup, but this should be done without introducing scheduledsession instances to the template. * Added a property method to return what the 'session' field used to return, but based on the 'sessions' m2m field filtered with the meeting agenda. This is right for the main meeting agenda, but not for personal schedule layouts, so this isn't a final fix. * Reverted html agenda templates to release 4.72 state, except for a jquery version change and moving inline weekview javascript to a separate file. * Changed the WG edit form so that once an acronym has been set, the acronym field is read-only; also changed the form validation to not permit changes to an existing acronym. * Changed NOMCOM_FROM_EMAIL to be the Nomcom chair instead of the secretariat. Fixes issue #1152. * Merged [6413] from rjsparks@nostrum.com: Removed redundant call to not_duplicated from the nomcom/private_index template. It was already applied in the view, and interacted badly with the list comprehension method of filtering for NomineePositions that had associated questionnaire responses. Fixes bug 1151. * Added Ryan to the admin list so he'll get 500 notifications. -- Henrik Levkowetz 21 Oct 2013 22:58:26 +0200 ietfdb (4.80) ietf; urgency=high **Agenda Scheduling Tool** This is a major release which provides the code drop from phase 3 of the Agenda Scheduling Tool. The code has been merged in, and a lot of minor alignments done. Deployment of this will make the phase 3 agenda editing tools available from the main ietf site, will align the database schema with that used in the ongoing development work, and will provide the correct models for secretariat tool adaptations. Other changes: * Reworked the TestCase code and fixture loading substantially, resulting in a substantial speed increase for tests when run on a transaction- capable database engine. * Added an index page for nomcoms, at /nomcom/, with links to nomcom pages and announcements, where they exist. * Fixed some bugs in the EncryptedTextField class. * Fixed the language of the nomination confirmation message. * Changed 'requirement' to 'desired expertise' in user-visible places in the nomcom app. * Fixed a wrong secretariat template extension name. * Provide the missing safe_rep function required in the back-ported assertIsNone() test case method. * Added an explanatory paragraph to the Desired Expertise page. * The exception string for submission upload read errors seems to have changed after we switched to wsgi, from "Client read error" to "request data read error". Now looking for just "read error" to catch both. * Tweaked the introductory text on the Nomcom Desired Expertise page. * Added a makefixture management command, from http://djangosnippets.org/snippets/918/, somewhat hacked. * Updated the test fixtures, built to be more internally consistent in order to be able to pre-load them for the test suite. * Fixed the many times duplicated position names in the position selection drop-down list in the nomcom private index page. Fixes issue #1137. -- Henrik Levkowetz 03 Oct 2013 16:22:39 +0200 ietfdb (4.72) ietf; urgency=medium * Added a migration for a new ConstraintName field: penalty * Fixed 2 issues with the wg document list: Wrong heading for the related docs, and candidate wg docs listed as wg docs, rather than related docs. * Fixed an issue arising when trying to edit a document state when there's no prior state, and removed the link to edit the document state when there's no set state. * Tweaked the template used to generate the various 1wg-charter*.txt files to properly fetch email addresses. * Merged in a fix from rjsparks@nostrum.com for incorrect IANA notification email addresses. * Added Nomcom role suport to role_required() through has_role(). This will let us get rid of the more specialized ad_hoc nomcom_memeber_required() function which can't handle access for multiple roles. * Replaced the ad_hoc nomcom_member_required() decorator with the generic role_required() decorator. Changed access permission for nomcom-chair only pages to also permit nomcom advisor access (this lets the previous nomcom chair explain and assist as needed). Also tweaked some text strings in the email feedback pipe script. * Added a WSGI connector for the datatracker, to let us run under mod_wsgi. * Modified the code which accumulates ipr disclosures associated with a document, shown as an IPR count in search results. The previous code had two deficiencies: it could count some IPR disclosures twice, and it also included withdrawn and pending disclosures. The current count matches the IPR search results better. * Moved the nomcom private key storage out of the source tree, which is a silly place to put it. * Added a dev-specific robots.txt, which blocks all robots. * Merged in the latest secretariat code from rcross@amsl.com, from branch/amsl/trunkmerge@6149. * Added the ability to search for documents from a certain stream to the main document search form. * Added overview pages for non-ietf-stream documents (ise, iab, irtf), and links to them form the sidebar. * Removed the old ad documents page and its view function, and put in a redirect from the temporary /ad2/ url to the /ad/ url. Also replaced the two AD document links in the lefthand menubar with one pointing to the new view (under the old URL). -- Henrik Levkowetz 19 Sep 2013 21:31:42 +0200 ietfdb (4.71) ietf; urgency=medium * Merged in personal/rjs/r6117-pubreq@6119: - Made Publication Request (for documents from IETF working groups) an explicit action rather than a side-effect. - Simplified the working group state edit form. - Added hints to the WG state edit form to use the document's main page to request publication. - If a document is moved into IESG processing directly by the secretariat or an AD (old processing path), set working group state accordingly. * Merged in branch/iola/shimfree@6083. This cleans up and moves relevant code from idrfc/ to doc/. There should now only be a bit of old wrapper code left in idrfc; that will go away when the remaining models which use it are cleaned up. * Fixed the manage.py command so it adds our own import path to the Python path automatically; people won't have to explicitly add pythonpath any more:: $ PYTHONPATH=$PWD ietf/manage.py ... * Applied a patch from rjsparks@nostrum.com to fix a line colouring bug in IPR lists. * Fixed a regression: wrong URL to IESG state diagram in state help. Fixes issue #1119. * Merged personal/rjs/v4.70@6042: - Made reporting IPR consistant across document searches, IPR searches, AD document queues, last calls, and agendas. All these points now report on the document(s) being directly queried, and the documents those transitively replace or obsolete. - Brought search results against WGs and document titles into consistency with results from searching for individual documents - Added the IPR count to the link on the documents main page (when not zero) - Built on Henrik's reimplementation of all_related\_\*, making the \*_related_\* functions return DocAlias? lists consistently, and added corresponding _relations_ functions to get lists of actual RelatedDocument? objects. - Added getting the DocAlias? with the same name to Document - Added getting related IPR disclosures (as described in the first bullet) to Document - Simplified ipr/related.py - Removed the use of DraftLikeDocAlias? and IETFWG from ipr/search.py. Retooled the various search functions and templates to use DocAlias? and IprDocAlias? directly. - Removed dead code from ipr/search.py - Removed the special handling of WG 2000 from ipr/search.py This fixes bug #1071 * Fixed a regression in display of IESG state; added back substate information. Fixes issue #1117. * Added template rendering verification on dbtemplate form submission in order to catch errors in edited templates before they are committed. This should prevent server 500 errors when rendering dbtemplate pages. Fixes issue #1113. * Selectively removed the agenda and minutes warnings from the meeting materials page, for educational sessions where agenda and minutes aren't expected. Fixes issue #1115. * Changed the order of the files diffed in the draft diff links on the history page. Fixes issue #1114. * Added Auto-Submitted and Precedence header fields to outgoing email messages. * Fixed a possible KeyError bug for a missing form field 'by'. * Added code to expire last calls for statechg documents too (in addition to iesg drafts) with the expire-last-call script. Fixes issue #1092. * Added secretaries to those who are authorized to edit stream info for a document. * Added a penalty field to the ConstraintNames, for use in agenda scheduling. * Refactored group membership code, adding advisors and liaisons to the membership list. Needed for the nomcom code. * Fixed the broken WG document list template (regression caused by the shimfree merge). * Fixed the red-on-red error message style which came in with the nomcom code merge. * Fixed the nomcom email pipe command to read from stdin if no file given, and give better error messages. * Added migrations which should have been part of release 4.70. -- Henrik Levkowetz 09 Sep 2013 21:40:25 +0200 ietfdb (4.70) ietf; urgency=high **NomCom Support** This release provides a datatracker nomcom app, ported from the earlier standalone nomcom app written by henrik. It includes public nomcom pages which provides an interface for members of the community to propose and comment on nominees for the positions the nomcom is filling, and private nomcom pages for secure management and browsing of positions, nominees, and comments. -- Henrik Levkowetz 06 Aug 2013 12:15:56 +0200 ietfdb (4.61) ietf; urgency=medium **IETF 87 Code Sprint** This release provides the code from the IETF-87 code sprint, and also a number of fixes to things reported during the IETF, and some enhancements requested. Noticeable enhancements are that document search now permits you to search for all kind of documents, not only for drafts and RFCs (you can searc for charters, slides and whatnot); that Research Group chairs now have the ability to manage their documents in the tracker; and that the tracker now has the ability to generate WG and draft email aliases, which permits us to plan a transition of the email aliases to the main ietf mail server. There are however many other much requested fixes and enhancements :-) From markus.stenberg@iki.fi: * Added support and scripts for generation of wg- and draft-aliases. Fixes issue #713. From adam@nostrum.com: * Added the capability to search for all kinds of documents in the main datatracker search page. Fixes bug #838. * Added tooltip capability to document tabs, and tooltips for disabled IESG Evaluation/Review tab. Fixes bug #448. * Added a document link to the emails sent on discuss/comment changes. Fixes bug #916 From rjsparks@nostrum.com: * Added related documents to the set of documents checked for IPR declarations when building last call text. Partially addresses #1071. From suresh.krishnan@ericsson.com: * When working group chairs added an annotation to a document, the date on the history entry was wrong. It has now been fixed. Fixes issue #1046. * Fixed the last call processing code to identify the new placeholder writeup. Fixes issue #884. Other fixes: * Added group secretaries to those authorise to edit group document meta-information. * Added RG chairs and secretaries to those authorized to edit group document meta-information. * Added a landing page for missing associations between login and Person record. * Tweaked the charter-and-milestones presentation in order to not blow up on bad character encodings in charter file. * Added back the 'Request Publication' action (regression loss) on draft pages for the non-ietf streams. * Fixed a bug in rendering the AD/Shepherd column in document list pages, when no AD is associated with a document. Fixes issue #1079. * Modified the doc stream-change edit form to reset doc.group to None on stream changes. Fixes issue #1078. * Fixed double plural 's' caused by the use of 'pluralize' in the template *and* plural forms for the group headers returned by fill_in_search_attributes(). Fixes issue #1077. * Fixed the incorrect blankline placemnt in the refactored template for id-index and id-abstracts, when generating abstracts. Fixes issue #1076. * Added convenience methods to the Document class to recursively retrieve all forward / reverse relationship of a kind or set of kinds. * Fixed the handling of help pages for doc states. * Added a direct link to the cookie options in use by the datatracker to the lefthand menubar. Fixes issue #1075. * Fixed a regression: restore diff pane in history page for RFCs. * Fixed a regression: display of full draft/rfc text now again obeys the full_draft cookie setting. * Changed the mimetype detection code to only read first 4k block of file, not the whole file. * Made the code which uses the 'magic' module to determine file type and encoding work with both the old and new interface to python-magic. * Added a guard to prevent duplicate RFC-Editor notifications for approved documents, and added logging to the notification routine. -- Henrik Levkowetz 01 Aug 2013 18:26:21 +0200 ietfdb (4.60) ietf; urgency=high **Shimfree Document Pages** This release provides new shimfree code in /doc/ which replaces code mainly from /idrfc/ and /idindex/. It comprises the first two code drops from the shimfree project. There are also some additional functionality, as detailed below. * Added an index page at /help/state, listing the document states that have help information. * On request form the secretariat, added a note to the new I-D announcement messages about there being a couple of minutes delay between submission and the appearance of htmlized document and diff on the tools servers. * Merged in two huge chunks of shim-layer removals from olau@iola.dk, comprising: - Deleted dead code in many places. - Renamed id-something to draft-something, make the "is this eligible for expiration" logic clearer - Added a name for IPR search URL - Revamped the ballot popup view - URL reversed the IPR search link instead of hardcoding it - Cleaned up search views and remove dead code, port them to the new DB schema, hack related views in iesg/ and wginfo/ to use the new search interfaces, avoid camelCase in search GET parameters (with backwards-compat fallback), add some simple search unit tests, remove caching from views_search.py index pages as they're now pretty fast to generate, rewrite ballot popup JS, regularize some CSS classes to use hyphen-notation rather than camelCase, move some of the search templates to doc/. idrfc/ now mostly contains some wrapper code still in use by other subdirs, some ported code not yet moved, and dead code. - Fixed output bug in test crawler and print referrer upon errors so it's easier to figure out where a link came from - Added /doc/in-last-call/ to crawler, report original page as referrer in a redirect chain rather than intermediate URL - Ported idindex to new schema, speed them up, add tests, refactor index page in views_search to share code with the text index file, get rid of some special-case idindex filters from ietf_filters, move "/drafts/" redirects to a file in /doc/ - Ported /idtracker/status/ and /idtracker/status/last-call/ overview of drafts in IESG process to new schema in /doc/iesg/ and /doc/iesg/last-call/ - Added redirects for all of /idtracker/\*, removed all view code and other dead code from idtracker/ - Removed the idtracker sitemap indexing drafts - in its current form, it adds nothing of value to the HTML-based /doc/all/ view, and it's pretty slow - Ported idtracker feeds to new schema, move them to doc/, cleaned up idtracker/ - only templatetags/ietf_filters and proxy code is left - Removed .related many to many relationship, it's not really useful since we always have to restrict on the relationship type anyway, instead add two helpers for doing the necessary queries (in both directions) - Added migration for transforming the .desc on the new_revision events into something more akin to what is actually shown in the history page - Added migration for blanking IESG notes that just consist of "RFC XXXX", these have been superfluous for some time - Grant stream chairs access to changing the stream on a draft - Hacked the format_history_text filter to be less weird, using the same formatting for snippets and full text, also link up legacy ballot set events - Moved the decoraters + utilities to new ietfauth/utils.py file - Added simple helper to Email to identify invalid email addresses (from legacy author entries) - Used new new_revision .desc format for when drafts are submitted - Improved the looks of the button class by adding extra contrast and a linear gradient. Currently the gradient is only visible in fairly recent browsers. - Rewrote draft and RFC tabs in terms of the new schema, porting write-up and history tabs as well - Fixed two bugs in RFC Editor syncing: make sure documents we don't know beforehand get a "draft" type and make sure individually submitted drafts get the type="individ" group instead of NULL - Made the CSS-styled button feel a bit nicer to use by flattening the active state, also introduce some temporary styles until browsers catch up with the standard syntax - Added migrations for fixing 1) a dummy RFC entry, 2) three stand-alone RFCs that didn't get their doc.type set, 3) a big bunch of historic stand-alone RFCs that have doc.group=None - set these to the individual submission "none" group for the time being so the view code doesn't have to deal with a special case. In some cases this is wrong since there actually was a WG associated but unfortunately fixing them properly requires detective work (probably parsing the RFCs) and in at least some cases recreating historic WGs. In case someone ends up doing this, the documents to check can still be found with Document.objects.filter(name__startswith="rfc", group__type="individ") since there are almost no new RFCs that didn't went through the I-D process. - Merged the I-D and RFC views by showing I-D information on RFCs too. I-Ds that have been published as RFCs redirect to the RFC URL. Also support alias URLs so e.g. /doc/bcpXXXX redirects to /doc/rfcXXXX. - Fixed revision augmentation so events after RFC publication gets a "RFC" designation - Fixed a bug with tabs not using provided name but rather doc.name - Displaying draft-iesg state rather than doc.friendly_state as IESG state, also show a notice that the IESG state refers to post-RFC processing if it does, like the old separate RFC page did - Fixed the RFC number doc.note migration to catch combined "RFC XXX; BCP XXX" notes too, use the opportunity to remove inserted HTML tags from notes and rely on linebreaksbr filter instead (the other thing was a left-over from the Perl days), update the various uses of the note to reflect that - Refactored slightly to make views_doc.py independent of other idrfc code - Moveed idrfc/views_doc.py to doc/ with associated templates, replace the somewhat fragile simple URL tests for views_doc.py with ordinary unit tests. The new tests are still fairly basic but at least test more than the URL tests did. - Made sure RFC's (and BCP/STD/FYI) are stored as RFC123 instead of RFC0123 in the alias table with a new migration and a change to the RFC Editor sync, this in turn makes /doc/std1/ do the right thing - Now /doc/std1/ works, we can actually do a local link in urlize_ietf_docs rather than linking to the tools.ietf.org server - Fixed history text formatter: sanitize HTML before adding linebreaks and non-breaking spaces, this cuts the time to render a history page with long comments in half - Added a test crawler that walks through the crawlable part of the site, reporting errors and slow pages - Got rid of initial "No record" positions when showing old positions, it's just noise - Added a .select_related() to the document main tab to reduce the number of DB queries, unfortunately it seems it doesn't really help with Django 1.2.x due to a bug (Document inherits from DocumentInfo which makes things a bit more complicated) - Introduced a simple cache in doc.get_state so repeated reads don't cause a DB query - Cleaned up the search code in preparation for removal of the shim-layer; use a static button and don't send extraneous GET parameters -- Henrik Levkowetz 23 Jul 2013 18:32:52 +0200 ietfdb (4.53) ietf; urgency=low This release provides improvements in the test suite, which nows runs cleanly with test database rollbacks (using InnoDB) in less than half he time it takes to run with a MyISAM test database without rollback support. Most of the time is now spent on the page load tests, not on fixture re-loading. -- Henrik Levkowetz 15 Jul 2013 09:32:18 +0200 ietfdb (4.52) ietf; urgency=medium This is a minor bugfix release, in preparation for the next major merge. * Fixed problem with caching of utc agenda -- use a separate cache name for this. * Permit unicode milestone text (using unicode() instead of str() in comparison when looking for milestone changes). Fixes issue #1065. * Added a list of releases below the release notes at /releases/* * From RjS: Added a case in the render_ballot_icon() filter for statchg documents. * Removed duplicate '.errorlist' style. * Fixed missing name change when moving settings from rfceditor module to settings.py. * Merged [5613] from mcr@sandelman.ca: include a way to dump timedeltafields so that it is possible to save data to fixtures. From olau@iola.dk: * Skip IANA - Review Needed and Version Changed - Review Needed changes from IANA as it turns out that the Datatracker is the authoritative source on these states. Also improve logging so that the raw JSON from IANA is dumped, the parsed JSON on imported changes is dumped and we write to syslog before starting a sync script in the notification view. * Only add charter state change link when chartering, it doesn't make sense for an approved charter. Fixes #861. * Don't display group.comments on the charter document page. Apparently group.comments have been used by the Secretariat in the past for chartering comments, but it's not possible to edit the field and the whole thing doesn't make sense from a modelling perspective - a feature like this should probably use the note field on the charter. Fixes issue #1048. * Don't crash if an attachment has been created already, just reuse it - this case shouldn't actually happen, but apparently sometimes does, probably due to a concurrency issue * Add link to charter pages from the milestones editing page (besides the cancel button), fixes #1044. * Special-case proposed working groups with respect to milestones, they get the charter milestones on the WG charter page rather than the current set * Show approved milestones on /doc/charter-xyz/ page if the charter is approved instead of only showing proposed milestones for proposed charters -- Henrik Levkowetz 14 Jul 2013 16:05:36 +0200 ietfdb (4.51) ietf; urgency=low This is a minor bugfix release, in preparation for the next major merge. Fixes: * Use argument 'draft' for document instead of 'approved_draft_name' when sending sync notifications to the RFC-Editor. * Moved settings for RFC-Editor sync to settings.py. * Don't actually do a post to the rfc-editor's state sync interface for a publication request when not in production mode. * Merged [5770] from rjsparks@nostrum.com: - Added editing last call messages, requesting, issuing and tracking IETF LCs to status-change documents - Added a Cancel button to the form that allows editing the relations for status-change documents - Added instructions to the agenda section 3.3 This adds states to status-change- documents and has a migration that must be applied. Fixes bug #1039 -- Henrik Levkowetz 09 Jun 2013 22:03:29 +0200 ietfdb (4.50) ietf; urgency=medium **Milestone Management** This is a major feature release, which introduces datatracker support for milestone management. WG Chairs will, if they are logged in, see an 'Add or edit milestones' button on the WG's Charter page in the datatracker, just below the charter text, and Area Directors and Secretariat staff will see a new link 'Milestones' in the left-hand menu-bar, leading to a page which lists Milestones Needing Review. -- Henrik Levkowetz 16 May 2013 00:34:16 +0200 ietfdb (4.45) ietf; urgency=medium This release contains bugfixes and some minor features. * Added IAB Chair permission for some IESG agenda links. * Added alternative names for 2 iana states which seems to have changed name since the code was originally deployed. Also added a guard against sending state change emails when the iana state hasn't actually changed. * Don't use non-ascii names in the email lists (at least for now), as the the code doesn't generate proper email header IDN encoding for non-ascii addresses. * Added the secretariat to the recipient list for publication request emails generated by the datatracker. Fixes issue #964. * Fixed a problem with checking shepherd writeup editing permissions for logged-in users with no associated person object. * Reverted a change from [5602], reinstating the explicit To: field for last-call announcements, because removing it caused the copies of the announcements destined for email lists to be held by Mailman for moderation because of implicit destination. Relates to issue #811. * Changed additional places to use IANA sync settings from settings.py * Merged [5645],[5646] and [5647] from olau@iola.dk: - Added support for notifying the RFC Editor upon draft approval - Added action to post to RFC Editor on non-IESG publication requests too - Fixed a bug that the CC on the announcement copy sent to IANA wasn't cleared causing people on the CC to get duplicate emails * Refined the INSTALL instructions for secretariat releases. * Added instructions on updating the release version and date for patch releases. * Added RjS to the ADMINS setting, so he will receive exception emails. -- Henrik Levkowetz 14 May 2013 21:50:09 +0200 ietfdb (4.44) ietf; urgency=medium This is a combined bugfix and feature release. It provides improvements to last-call messages, the display of document shepherd information, the content of AD pages, IESG ballot information, and various forms; and it fixes a number of bugs. From rjsparks@nostrum.com: * Merged [5600] and [5602]: Changed the header to last call messages to IETF Announce and to IANA to make replying to the announcement less likely to create an unnecessary ticket. * Merged [5569] and [5572]: Small fixes in 4.43 and showing the shepherd (when there is one) on search results, documents for this ad, and wg document lists. Fixes bug #972. * Merged [5570]: Moves the interface to edit shepherds and sheperd writeups out of the wgtracker interface and into the doc views (via idrfc). Added a little to the simple authorization code (can_edit) in idrfc. Added a way to reset the writeup to the current templates (leaving extension points to take templates for non-ietf stream documents). Fixes bug #967. (This also fixes tickets #834 and #691 (which were effectively duplicates of #967) * Merged [5595]: Tweaked the grouping code to not break documents of the same type up * Merged [5476]: - Added a document type for changing the publication status of other documents, and the UI for manipulating them. - Added charters, conflict reviews, and status changes to the AD's \'My Documents\' page - Improved the presentation of all document types on the Agenda, Future Telechats, Scribe and Moderator package pages - Made the reverse name for document relationships explicit rather than deriving them from forward names - Added a way to get to the underlying Document (when it exists) from an RfcWrapper - Unified several common forms used by different document types From henrik@levkowetz.com: * Changed which email addresses the submission tool uses for confirmation emails and sending out full submission status URLs from the emails found in the submitted document (which could be empty, broken, or intentionally different than the original authors) to the author emails from the previous version, where a previous version exists. This fixes breakage which can occur when no valid email addresses can be found in a broken submission, and also ensures that at least one of the authors of a previous version signs off on a new version, preventing submission hijacking. * Added a section to the meeting materials page for IAB sessions. Added a link bar at the top to make it easier to find sections like Training and IAB. * Don't list documents replaced by other documents in the IESG Status list at /idtracker/status/. * Fixed a bug which would set the state in the event accompanying a WG activation to 'Proposed', which messes up various views. * Add new tag 'rev-wg' to the list of valid annotation tags for the ietf stream. Note: This list and those on nearby lines needs to be refactored into a table, instead of sitting in the code. * Added instructions on how to patch the production code (if necessary) to the INSTALL description. * Fixed rounding issue in IESG positions neded calculation. Fixes issue #974. * Made agenda views with timezone information work also for earlier meetings (those without timezone data available). -- Henrik Levkowetz 16 Apr 2013 00:49:24 +0200 ietfdb (4.43) ietf; urgency=high **IETF 86 Code Sprint** From Jim Schaad : * Working Group document page now allows for addition of documents to community lists. * Added new rules to the atom tracker for picking up documents in specific states * Added new rules to the atom tracker for picking up RFCs * Changed the header fields on the RFC table so that they reflect RFC descriptions rather than I-D descriptions. * Increased the set of information being returned on the atom viewer to reflect IETF specific information. From housley@vigilsec.com: * Send email to statements@ietf.org when a pending liaison statement gets queued. From jmh@joelhalpern.com: * Fixed the moderator package Conflict review text. * Added the document notification list to the destination email addresses when the document leaves IETF LC. * Repaired the ballot requirements string * Removed the \'Set all to not on agenda\' button, as it is never used. From adam@nostrum.com: * Fixed formatting for history page. Relates to issue #210. * Added links to the session request page * Two changes: (1) searches by substring rather than \'begins with\' (to allow, e.g., searching by last name); and (2) limits results to 10 entries (to limit server load and limit effectiveness of email-scraping attacks) * Fixed agenda oscillation problem (removed scrollbars from iframe) From cabo@tzi.org: * Added javascript functionality to make the UTC agenda convert it's UTC times to Browser local time. From rcross@amsl.com: * Ticket #673: Add the ability for the secretariat to clear a ballot to the tracker From suresh.krishnan@ericsson.com: * Checking for loss of comments when AD enters comments without changing state. Also modified the base css to have an unified errorlist format. From henrik@levkowetz.com * Some additional tweaks to the INSTALL text. * Added a note on secretariat releases. Reformatted to resolve rst markup mistakes -- '$ rst2pdf INSTALL' now works. * Ask people to use their account profile management form to add email addresses, instead of creating new accounts, on the create-account form. * Tweaked mergedevbranch to make the sprint merge/test cycle a little bit easier. * Tweaked the code from [5518] to handle the case where a document doesn't have any state set yet. * Changed the community tool email notification code to not try to send to nobody, and to use individual To: addressing rather bulk Bcc: addressing. -- Henrik Levkowetz 13 Mar 2013 19:26:54 +0100 ietfdb (4.42) ietf; urgency=high This release brings only minor new functionality to the datatracker (timezone indications on the html agenda, and an UTC version of the html agenda), but it's important because it includes the secretariat tools as part of the datatracker release and source repository, and makes the test suite also run secretariat app tests. Details: * Provides the html agenda for IETF meetings with local timezone indications, and adds a new html agenda with UTC timezone indications. * Merged in branch/amsl/trunkmerge@5449 from rcross@amsl.com, with some tweaks. This provides the secretariat apps. * In order that document states (which may be used by old documents) should not need to be removed when state machines change and states go out of use, all document states have a 'used' field. The code which accesses the state fields have not been requiring that used=True for the states returned, which is an error. Fixed this by adding 'used=True' to all State.objects.get() and State.objects.filter() call where it's relevant. * Applied patch from olau@iola.dk for some email problems, see issues #949 and #877. * With RFC6410, there are only two RFC maturity levels, 'Proposed Standard' and 'Internet Standard'. Added a mapping between 'Internet Standard' and slug 'std', to be able to process newer RFC info from the RFC Editor. -- Henrik Levkowetz 06 Mar 2013 20:37:14 +0100 ietfdb (4.41) ietf; urgency=low This release is a minor release, with bugfixes and some enhancements to the community draft-tracking feeds. For detailed commit messages, please see: http://wiki.tools.ietf.org/tools/ietfdb/log/trunk * Added a set of help pages for document states, and dded links from the new IANA states to help pages describing the different states. * From rjsparks@nostrum.com: Fixed a bug in the state change logging which caused the wrong document state log entries in some cases. * Merged [5426] from ietf@augustcellars.com: Make sure that the same rule cannot be entered twice in a community list. * Merged [5425] from ietf@augustcellars.com: Modify atom change feed so that 1. It returns the last 14 days of changes rather than the last 20 2. Change the atom template so that it has correct time offsets rather than saying that PST and UTC are the same 3. Change the atom template so that it uses content rather than summary and return HTML content with line breaks as needed. * Merged [5424] from ietf@augustcellars.com: Close the image tag. An empty image tag displays on IE although it does not display on Firefox. * Added variations on the recognized date formats during submitted draft parsing, such that comma need not be followed by whitespace in the formats using comma as a separator between some of the fields. Added extraction of drafts referenced by a document, in addition to RFCs referenced. * Modified the set of permissible parents for session groups, in order to permit an IAB-sponsored BoF to appear on the agenda. -- Henrik Levkowetz 27 Feb 2013 23:24:53 +0100 ietfdb (4.40) ietf; urgency=high **RFC-Editor and IANA Document State Data Exchange** This release is a major feature release, which provides the means to do state synchronization to and from the RFC-Editor and IANA, so that relevant state changes to drafts and RFCs at any of the 3 organizations can be picked up and reflected automatically in the tracking system used by the others. This release is the last piece of a multi-year effort to make the tracker provide seamless tracking of state information from the very first beginnngs of a document (which is provided through the community tracker part of the IETD datatracker, which lets anyone in the community set up tracking notifications for their specific set of documents) all the way through the working group process, IESG processing, to the final IANA and REF-Editor processing and publication. There isn't a lot of eye-candy associated with the current release, but as we get the RFC-Editor and IANA ends set up to use the notification interfaces provided in this release, the state shown in the datatracker should faithfully and timely reflect the state changes in the RFC-Editor and IANA parts of the process. For detailed commit messages, please see: http://wiki.tools.ietf.org/tools/ietfdb/log/branch/iola/statesync -- Henrik Levkowetz 20 Jan 2013 16:38:22 +0100 ietfdb (4.37) ietf; urgency=low This is a minor bug-fix release of the datatracker. It fixes issues with presentation of IESG discusses and comments, anchor names in the materials list page, details of the 1wg-summary.txt page, and some other minor issues. * Merged in a patch from housley@vigilsec.com to handle different documents better in the agenda JSON output. * Added simple logging of test runs, to make it easier to be sure that tests has been run successfully on the latest code. * Added a new field, #16: draft AD (name and email) to all_id2.txt * Made the IPR country field wider to accomodate IPR disclosures referencing many patent instances in many countries. * Updated draft submission author extraction module to handle dash-separated double given names. * Tweaks and fixes to the IESG scribe template templates. * Added a filter for use in displaying document comments and discusses which unfortunately sometimes use html
markup, which should give line breaks, and sometimes contain which should *not* be interpreted as html, but rendered as <... * Limited the 1wg-summary list and friends to WGs, (excluding the 'iesg' area which lists the areas as subgroups, for instance). * Resolved a naming conflict between the builtin messages framework and a variable named messages in wgcharter.views.change_state. Fixes issue #901. * Tweaked the handling of the syslog module not being available on windows. * Fixed what may have been a regression in the form of the anchors in the materials list page. -- Henrik Levkowetz 16 Dec 2012 19:30:30 +0100 ietfdb (4.36) ietf; urgency=medium **IETF 85 Code Sprint** This release contains the features and bugfixes from the IETF-85 code sprint, providing improved WG chair document handling, improved document and agenda display. The code in this release has been contributed by Robert Sparks, Joel Halpern, Ryan Cross, Adam Roach, and Henrik Levkowetz. From rjsparks@nostrum.com: * Enabled diff on the conflict review history tab. Fixes bug #882 * Made it more obvious when an intended status or shepherding AD is not set Removed an unused template Show reset approval text immediately. Fixes bug #900 From jmh@joelhalpern.com: * Moved the Replaced By: line in docent headers up to main header with Replaces: * Added a link to the Shepherd update page to get back to the document manipulatin page. * Made comments optional on WG adoption and WG state changes. * Corrected the test of final shepherd update flag. From rcross@amsl.com: * Changed CONFLICT_REVIEW_PATH from conflict_reviews to conflict-reviews From adam@nostrum.com: * Fixed '%2C' bug introducted (exposed?) by Apple's iCloud handling of URLs * Fixed time column wrapping problem that exhibits in (at least) Safari. From henrik@levkowetz.com: * Tweaked the changelog presentation to work irrespective of current directory, and give a sensible 404 if the changelog can't be found. * Tweaked the html agenda a little bit by adding a day indication for each timeslot, to make it easier to see which day you're actually seeing when the day separator is outside the window. -- Henrik Levkowetz 07 Nov 2012 20:41:36 +0100 ietfdb (4.35) ietf; urgency=medium This release provides a long list of fixes and minor enhancements, covering more than 50 different items found through feedback from users. Major contributors were Robert Sparks, Adam Roach, and Henrik. The changelog will be available at http://datatracker.ietf.org/release/4.35 after deployment. The commit log is at http://trac.tools.ietf.org/tools/ietfdb/log/trunk Details: * Added an 'email sent' success message after sending out a WG review announcement. Todo: Add equivalent messages in all other situations where email is sent out, for consistency. * Added various things which lets us use Django's messages framework to give feedback to users. This includes adding the messages middleware in settings.py, adding a message display are at the top of the page base template, and adding style setting for message display. * Tweaked test/mergedevbranch in a number of places in order to simplify handling (merging and testing) of multiple merges. * Merged [4909] from rjsparks@nostrum.com: Reimplemented clear_ballot to close the existing ballot and create a new one. Changed the all_positions code to only return synthetic no-positions for current ADs when a ballot is actually open * Merged [4904] from adam@nostrum.com: Fixing conflict list; adding AD column. * Merged [4885] from rjsparks@nostrum.com: Refactored close_open_ballots, creating a way to close one abllot at a time. rewrote the clear ballot code to close each open ballot and open a new one * Modified the format of the changelog to confirm fully to the debian changelog format. * Added a simple page to show release information parsed from a release's changelog file. * Improved the handling of iCalendar timezone information -- instead of simplified VTIMEZONE information generated from a template, the VTIMEZONE information for a meeting's timezone is read from file (where it presumably has been generated from the Olson timezone database, for instance using vzic. * Added an utility script to extract information about the outgoing confirmation request email related to a draft submission. * Added a management command to generate bibxml files for drafts. It's not fully cooked yet, as it needs to differentiate between documents which are currently drafts, and those that have been published as RFCs, but the basics are there. * Add an name utility function to return a name's initials. Handle names with an uppercase surname to the left of the given name correctly. * Added support for reverse-order (i.e., Japanese, Chinese, and other) names with uppercase family name in the draft submission author extraction. * Added an 'agenda_note' field to meeting.models.Meeting, and added display of content (if any) in html and txt agendas. * Fixed a misleading error message given when disallowed character occurs in a draft filename. * Merged [4879] from rjsparks@nostrum.com: Changed 'protocol writeup' to 'shepherd writeup' in several templates. Fixes bug #885 * Merged [4873] from rjsparks@nostrum.com: Includes the conflict-review document contents in the email sent with the results of the conflict review. Fixes bug #883 * Merged [4866] from rjsparks@nostrum.com: Show link to pending liaison statements to approve to the secretariat. This fixes bug #878 * Merged [4836] from housley@vigilsec.com: Add stream to conflict-review documents in the agenda.json object for the IESG telechat agenda * Merged [4825] from rjsparks@nostrum.com: Updated tests to deal with the mandatory state field * Merged [4811] from rjsparks@nostrum.com: Cleaned up setting wg state, leaving events, and facilitated creating an initial charter for an existing unchartered group * Merged [4806] from rjsparks@nostrum.com: Better handling for BoFs, particularly those that won't create WGs * Updated wginfo/tests.py to work with the merged wginfo/edit.py which requires the wg state to be set. * Fixed a problem with the spiffy ajax handling of email fields when test cases submit a textual list of email addresses instead of a python list. * Use decorator.decorator consistenly in debug wrappers. * Updated version of debug.py, which adds timing and profiling support functions. * Added Michele Simionato's decorator module, for use in debug.py * Merged [4805] from rjsparks@nostrum.com: When abandoning a chartering effort, only revert to approved charters if there's a chance one is there. Fixes bug #868 * Merged [4805] from rjsparks@nostrum.com: When abandoning a chartering effort, only revert to approved charters if there's a chance one is there. Fixes bug #868 * Removed debug statements * Added the creation of a WG state change event for WG state changes. * Tweak the GroupHistoryAdmin list_display. * Fixed missing import of Role. * Added a docstring note about the convention for when save_*_in_history() shoudl be called. * Merged [4842] from rjsparks@nostrum.com: Warn when putting a charter in an unusual state onto a telechat agenda * Merged [4841] from rjsparks@nostrum.com: Allows the IESG Note field to be edited even when empty. * Merged [4840] from rjsparks@nostrum.com: Added more information about RFC5742 conflict review documents to the /agenda, moderator, and scribe pages. Fixes bug #874 * Merged [4858] from rcross@amsl.com: The IPR notification email was still referring to the old CGI admin script; fixed. * Merged [4835] from rjsparks@nostrum.com: Improve the robustness of get_wg_section * Merged [4833] from rjsparks@nostrum.com: Send email to IANA and the IESG when entering IESG evaluation of an RFC5742 conflict review * Added a script to create NewRevisionDocEvent entries for charter files. * Fixed an instance of old use of first_name, last_name in submission tool code. * Fix up scribe template to suite John, undoing a number of fixes from the sprint. * Add shepherd field to all_id2.txt * Reverted a number of changes to the scribe template which made life more difficult for the scribe. * Fixed a problem with blocking comments on charter documents pointed out by rjsparks@nostrum.com. * Fixed another typo. * Show ballot positions also for documents without an active ballot. * Fix typo in import. * Fixed a password reset url which didn't work due to a wrong keyword name in the urlpattern. * Don't try to add a ballot's AD email addresses to a new version notification email if there's no ballot. Also did some linguistic fixes, and got rid of a wildcard import. * Make the mergedevbranch script more flexible in accepting different partial repository paths on the command line. * Make .ballot_open() available on DocumentInfo instead of on Document, too. * Fixed a crash for the case where we're looking at a historic charter page and there's no active ballot for the histoic charter. * Make .active_ballot() available on DocumentInfo instead of on Document, to make charter history snapshots work. * Merged [4773] from olau@iola.dk: Encode uploaded charter text with UTF-8 to avoid crashing on Unicode content -- Henrik Levkowetz 30 Oct 2012 15:19:09 +0100 ietfdb (4.34) ietf; urgency=medium * Merged in [4772] from rjsparks@nostrum.com, a big chunk which in itself combines a number of separate fixes: Liasion Manager: * Patch from Yaco to avoid resetting the From field when changing other items on the form * Gave the secretariat the ability to find/approve any unapproved liaisons * Changed all the email code to use ietf.mail.utils (and removed the fake-mail concept) Charter documents and the Agenda pages: * Added charter documents to iesg/agenda and iesg/agenda/documents * Synced the ordering of drafts on iesg/agenda and iesg/agenda/documents * Allow setting a responsible AD for charter documents * Changed the UI of the charter page to use editlink for changing attributes and buttons for actions (to align with drafts and conflict-reviews) Moderator package: * Refactor: Simplified access to the current BallotDocEvent from a Document * Added functions to BallotDocEvents? to faciliate access to BallotPositionDocEvents?, both for all positions, and current AD postions. * Updated the moderator package to use the Documents from _agenda_data. * Added a filter to assist with rendering the moderator package. * Fixed a bug where different functions in idrfc/views_ballot were using log_state_changed expecting different implementations (a cleanup task should reconcile the _three_ implementations in the codebase of that function). Cleanup from codesprint: * Removed some duplication between doc/util and doc/models by moving things into doc/models * Do not show non-empty discuss text when the ballot position is not blocking * Added a migration to update non-blocking ballot positions that have non-empty discuss text DEPLOYMENT NOTES Please be aware that migration step will take a few minutes to complete. Fixes issue #865 * Tweaked the author extraction code to handle company names in the author list on the first page, when the company names contain a comma, such as for instance 'Foo Bar, Inc'. * Added support for get_file_path() for conflrev documents based on branch /personal/rcross/v4.32@4722, but tweaked to return only the directory, not the full directory+name+ext path, in order to behave the same way as for other document types. * Merged in [4746] from adam@nostrum.com: Adding slides to agenda page * Merged in [4738] from adam@nostrum.com: Added a link to the cookie page, at Robert's request * Merged in [4737] from adam@nostrum.com: Fixed profile update page to keep Alias table up to date. Also, roles for inactive groups are no longer displayed on the profile page. * Applied fix from rjsparks@nostrum.com: Remove old document filtering which is now to strict, letting conflict review documents show in the iesg agenda. * Applied fix from adam@nostrum.com: Display meeting materials with correct ordering. * Removed the ValueError exceptions introduced in the previous revision of the draft author extraction code. Fixes issue #858. * Fixed problem with diff links which erroneously included a template variable interpolation. * Fixed problem with displaying ISE stream documents. * Fixed the update password request form to *not* give an error for existing accounts ,:-) * Fixed some parameter names in the ietfauth urlconf which had reverted to an old form in a recent merge. * Used the .plain_name Person attribute in the agenda documents form instead of the full .name attribute. * The call to liaison_manager_sdos() in set_organization_field was missing a Person parameter -- added it. -- Henrik Levkowetz 22 Aug 2012 14:57:33 +0200 ietfdb (4.33) ietf; urgency=medium **IETF 84 Code Sprint** This is the IETF-84 codesprint release: * Changeset [4724] from rbarnes@bbn.com: Adjusted the scribe template to make it XHTML compliant and fix what Robert broke * Changeset [4721] from adam@nostrum.com: Adding an 'href' method to documents. It doesn't work for documents of type 'liai-att' or 'liaison', but it's a good start. * Changeset [4709] from housley@vigilsec.com: Ability to fetch the IESG Telechat Agenda as a JSON object (agenda.json). * Changesets [4720], [4706], and [4705] from adam@nostrum.com: Adding self-management page for user profile information * Changeset [4704] from suresh.krishnan@ericsson.com: - When the state changes from whatever to Publication Requested, the regular state change mail will go out. - The regular state change mail will be sent to the authors and the wg chairs (this is the current behavior). - Now, in addition to this regular state change mail, another mail will be sent with the title 'Publication has been requested for draft ' and this mail will be sent to the AD responsible for the WG. I considered sending the mail to both the ADs but decided not to bother the other AD :-). * Changeset [4701] from rjsparks@nostrum.com: Moved the prefix for the URI to use for rfcdiff into settings.py. Fixes bug #808 -- Henrik Levkowetz 30 Jul 2012 23:54:19 +0200 ietfdb (4.32) ietf; urgency=medium This is a feature release that provides support for a new document type, Conflict Review documents (conflrev-\*.txt). From rjsparks@nostrum.com: * Adds a new document type for conflict reviews, with a ballot for the IESG 5742 response to a review request * Integrated the new document type into the iESG agenda views (including RSS feeds) * Removed the Edit and Add buttons from the document main view. * Replaced Add with actions appropriate for the document type, such as "Begin IESG Processing" or "Begin IETF Conflict Review", and made most data directly editable on the document's main page, depending on access permissions. * Removed a manual editing step that the secretariat had to perform when sending conflict review messages. The view now composes the message correctly given the stream. * Added a pencil icon motif to differentiate fields that are editable. * Generalized several views and helper functions to use Document instead of (e.g.) IdWrapper * Generalized reading documents from the repository * Added a way to get from IdWrapper to the underlying Document to facilitate migrating way from the Wrapper classes * Added many helpers to Document to assist with migrating off IdWrapper * Minor fixes and other changes - Fixes to document main view to avoid (silent) template failures. - Began removing some of the code that is no longer reachable post-migration - Corrected the behavior of the undefer code and added test cases for it - Improved initial population of notification lists and added the ability to regenerate the initial list * Made the test code that scans for template coverage more robust. Deployment notes: * new setting: CONFLICT_REVIEW_PATH. The associated directory will need to be created -- Henrik Levkowetz 28 Jul 2012 18:29:34 +0200 ietfdb (4.31) ietf; urgency=medium This is primarily a bugfix-release, catching a lot of issues related to the most recent few releases. A few features have also been included, liste first: * Added support for IRTF liaisons. * Improved I-D submission author extraction code, adding support for extraction of affiliation, improved date format extraction, support for additional (unusual) name abbreviation patterns, and more. Bugfixes. Not all fixes are mentioned here; for a complete list please see the commitlog. * Fixed a language typo in the registration confirmation page. * Tweaked the community tracker notification email. * Changed and tweaked various I-D submission emails in order to 1) make it less likely that they would be classified as spam (better ratio of English text to hash urls) and 2) provide better consistency in formatting of key/value information. * From adam@nostrum.com: Fixed an URL in the agenda.csv file which hadn't been updated to match current naming conventions and code. * Added new RFC-Editor state tag 'AUTH48-DONE' to the rfc-ed-queue mirror script. * Tweaked the meeting materials list to avoid duplicate rows for WGs with more than one slot, as long as the materials list is the same (which is the only thing supported by other parts of the system at this time). * Applied ballot popup patch from olau@iola.dk. * Made links to other versions available also for expired documents. * Changed community I-D tracking rule update frequency to every hour. * Rewrote the view and template code for the meeting materials list, which was showing nothing. Better to do the rewrite for the new models than trying to dig into why the proxy models doesn't work any more. * Fixed id_abstracts to include drafts assigned directly to areas, not only individual and WG drafts. * Fixed 1wg-charters.txt (and friends) to not list the areas as if they were WGs. * Updated utils/draft.py and modified the submit app code accordingly. * Merged in [4604] from adam@nostrum.com, which fixes problems with the html agenda code related to the schema transition. * Ballot ids are limited to integers, rather than being descriptive as intended at one point. Adjusted the url regexes accordingly. Patch from olau@iola.dk. * Introduced a line break to clean up the state display for tracked drafts a bit. * Make the link to the search form more prominent in the community list explicitly added documents page. * Sorted WGs in the community rules drop-down list by acronym rather than WG name. * Provided a more comprehensive document state indication. May need further refinement. * Tweaked the community tracker links in the lefthand menubar to avoid line breaking for the WG documents link visible to WG chairs. * Enabled the check for existing account, disabled when we started using self-service http password reset, but hadn't started creating accounts yet. * Refactored the two confirm*() methods in ietfauth/views.py; they need the same processing, only the templates to use differ. * Fixed the back-link on personal list email subscription confirmation page -- it just lead to the confirmation page itself, now leads to read-only list view. * When logged in as secretariat, at /iesg/agenda/ or /iesg/agenda/documents/, and clicking on the position matrix for a document, the overlay window would give a code 500 error, because of a missing ballot id in the templates' url lookup. Fix this by providing the ballot id. -- Henrik Levkowetz 28 Jul 2012 01:51:26 +0200 ietfdb (4.30) ietf; urgency=medium **Community Document Tracking Support** This is a feature release which provides the community document tracking functionality defined in RFC 6293. * Merged community tracking branch from esanchez@yaco.es, r3175-3679,3713-3830. Some additional fixes and smaller upgrades have also been included, as follows: From esanchez@yaco.es: * Patch to add a new IETF liaison-sending entity "IESG and IAB". From olau@iola.dk: * Small patch to avoid constant 500 traceback when someone tries to push an invalid cookie. From henrik@levkowetz.com: * Fix a bug which made the community tracking code crash when search results would show an old RFC without an associated draft. * Tweak the menubar listing of community tracking to show when login is needed, some other text tweaks, and fitting the I-D tracking links under Drafts and RFCs where they seem to belon.g * Minor cleanup of test_runner.py. Added guards against settings which can make tests inexplicably fail. Updated check to avoid running tests on production server. * Remove old non-functional "management issues" link from IESG agenda section 6 title. * Add a way to reach charter urls given a wg name rather than the charter document name. * Add some help for chairs which fuss about not being able to clearly see that they need to be logged in in order to handle approvals. * Behave slightly more gracefully if a submission has already been moved into place, and we are asked to do it again. * Disable the reference-to/referenced-by rules of the community app; they will only produce hits after we populate the document relationship table with reference information. * Simplify "document by WG" display name code. * Correct typo in community draft tracking subscription confirmation email. * Changed the group link on the personal doc list page to use the group acronym instead of whole name, and made the acronym a link to the wg documents page. * Tweaked the display of explicitly added documents (saying "explicitly" rather than "manually", and including the active/expired/rfc state of the document. * When adding a rule for I-Ds, only apply the selection to active I-Ds, not those which are expired or published. * Changes to the rule specifications for document tracking lists: Simplify the filter rules, show acronym in wg and area selection lists, list only ADs of active areas. * Fixups to the merged code, to match the code refactoring done to trunk after the split off of the community development branch. * Removed the grep based searches in utils.py; they are too costly. If tracing lists based on word search is needed, another implementation must be found. * Other minor cleanup. -- Henrik Levkowetz 03 Jul 2012 17:01:08 +0200 ietfdb (4.21) ietf; urgency=medium This is a bugfix release for the charter release (4.20) with some extra changes which were pending: Updated via-rfc-editor handling, better /meeting/requests page, added WG document approval page. From olau@iola.dk: * Add approval/pre-approval page for Secretariat and WG Chairs, with subpages for adding and canceling pre-approvals and a set of migrations for replacing the old IdApprovedDetail with a slightly less confusing Preapproval model. * Add listing of recently approved drafts to approval page by request from Barry Leiba. * Replace get_profile() hack with a test on the user instead, this also makes the ballot icon more robust against users without profiles (which shouldn't happen, but apparently we sometimes get one which results in a crash rather than something more graceful) * Give the incoming name to the top renderer so the links are internally consistent, this is needed because we still have different views for /doc/rfcXXXX/ and /doc/draft-foo-bar/ * Fix regexp fix - [.-_] does not mean "dot or dash or underscore", it means all characters between dot and underscore * Include _ in allowed document name regexp, we currently have 7 drafts with _ in the database despite it not being valid - they can be found with: select name from doc_document where name like '%\_%' and type_id = "draft"; * Fix flow of approval of charters/announcement of the WG action based on feedback from Cindy Morgan, now there's a link on the approval page to go to the edit page which sends you back upon saving, and the edit page doesn't provide a button to send the announcement since you should do that on the approve page (instead it provides a link). * Include current milestones in charter action/review announcements, fixes issue #835. * Add CC for group mailing list in action/review emails, fixes issue #837. * Fix link to charter .txt file on agenda page * Apparently, CHARTER_TXT_URL http://www.ietf.org/charters/ is really http://www.ietf.org/charter/, fix this in the settings.py file * Replace get_profile() hack with a test on the user instead, this also makes the ballot icon more robust against users without profiles (which shouldn't happen, but apparently we sometimes get one which results in a crash rather than something more graceful) * Give the incoming name to the top renderer so the links are internally consistent, this is needed because we still have different views for /doc/rfcXXXX/ and /doc/draft-foo-bar/ * Fix regexp fix - [.-_] does not mean "dot or dash or underscore", it means all characters between dot and underscore * Include _ in allowed document name regexp, we currently have 7 drafts with _ in the database despite it not being valid - they can be found with: select name from doc_document where name like '%\_%' and type_id = "draft"; * Fix flow of approval of charters/announcement of the WG action based on feedback from Cindy Morgan, now there's a link on the approval page to go to the edit page which sends you back upon saving, and the edit page doesn't provide a button to send the announcement since you should do that on the approve page (instead it provides a link). * Include current milestones in charter action/review announcements, fixes issue #835. * Add CC for group mailing list in action/review emails, fixes issue #837. * Fix link to charter .txt file on agenda page From rjsparks@nostrum.com: * Expose how many pages each document contains on the docs on future telechats page. Fixes bug #828 * Replaced the concept of a tag (via-rfc) identifying ise or irtf document (previously the idinternal.via_rfc_editor boolean) with looking at the document's stream. Removed the stream editing form - that functionality is on the edit info form. Put the old-ADs back into the list of choices when editing a document's info. This (re) fixes bug #749 * Fixed a bug in determining if a document is on the agenda, leftover from transition to new schema. From adam@nostrum.com: * Fix to the requests data page: - uses native schema for much greater efficiency - Uses meeting ID properly, so it can find future meetings even if their ID does not match the meeting number - Dramatic improvements to layout From henrik@levkowetz.com: * Try to not use explicit .html extensions in the urls. Redirect from those to .html-less urls. * Added a new field 'short' to Session, to help produce file names for agendas, minutes and slides for groups with different named session, such as for instance 'edu'. Generating distinct filenames directly from the name field gives too long names. * Quick fix for extensionless get_absolute_url(). XXX Fixme: needs bigger refactoring. * Quick fix for crash when going to /wg/imapmove/charter/. I'm not happy about the 'charter-ietf-' constant which now appears several places in the code; we need settings which defines the correct name pattern for different document types (or a table or table column, maybe). But this hopefully will make it possible to continue processing proposed WGs ... * Added missing '{{' before 'submission.filename' in draft announcement email templates. * Other minor fixes -- Henrik Levkowetz 11 Jun 2012 18:40:14 +0200 ietfdb (4.20) ietf; urgency=medium **WG Charter Management** This release introduces major new functionality for managing WG charters as documents. A large number of related and unrelated fixes has also been included, an almost complete list is available below, latest first: * Added a debug utility module on the same level as south,html5lib etc. * Don't try to call get_profile() on a user if the method isn't available. * Merged in fixes from Ole, from branch/charter:r4382-4407, and some changes from Henrik (removing the use of pos.blocked in views_ballot.py, and setting a ballot id in idrfc/testsREDESIGN.py) to make idrfc.EditPositionTestCase succeed. * Don't include interim meetings in those considered for the default meeting number for the '/meeting/' url. * Tweaked the error messages for acronym collisions in the create-wg form. * Added quotes around the WG name in the state change text, for better readability. * Applied a fix to missing nomcom chair in [4384] instead of [4385]. * Made arguments to url help_charter_states match the definition in ietf/idrfc/urls.py. * Fixed a bug in picking up blocking text (patch provided by olau@iola.dk). * Added a parameter to make the commitlog script useful for other branches than the current. * Catch exception which is raised if a nomcom NN group has been created, but no nomcom chair has been announced and added yet. Merged in [4364] from rjsparks@nostrum.com: * Expose how many pages each document contains on the docs on future telechats page. Fixes bug #828 Merged in fixes to the charter branch (r4345 - r4353 and r4354 - r4381) from olau@iola.dk.: * Check and sanitize text file upload (code is factored out in a new helper so it can be reused elsewhere in the future). * Move charter state help to /doc/help/state/charter/. * Say "generate" rather than "edit" when there's no text in the boxes * Don't show diff box if there's only 1 entry (and itself). * Say "Charter" rather than "Recharter" on the charter /doc/ page if the group is proposed or a BoF. * Treat BoF as proposed WG. * s/WG/group/ in acronym clash error message. * Add a star to the required fields. * Fix test broken by previous commit. * Fix buggy new group acronym check. * Amend previous commit to generate writeups on entering internal review instead. * Generate action and review text automatically. * Make phrasing sligtly more clear. * Make it move obvious what the change state view actually does by rephrasing the form. * Fix some phrasing bugs. * Fix terminology confusion and say "send ballot" rather than "issue ballot" to clear up that it is not actually created. * Fix wording of send ballot comment, the actual text was still specific to drafts. * Don't show edit button for snapshots. * Fix bug in hiding "external review needed" checkbox. * Create charters in state notrev instead of intrev, as a side effect this fixes a problem with comments not being saved when starting review on charter. * Use revision numbers to identify ballots and put a warning on closed ballots. * Fix bug in event description when copying over the final approved charter file. * Offer text from latest approved revision in case there's no initial text for a recharter submit form. * Reverse direction of revisions on charter /doc/ page to match tools.ietf.org/html/draft-\*. * Change max acronym length to 10 instead of 8 Additional fixes from Henrik: * Fixed the signature of DocEventAdmin method (needs explicit 'self' parameter) * Added various fixes and correction of merge errors. * Merged in fixes to the migration from olau@iola.dk. * Merged in the charter branch from olau@iola.dk. From Adam: * Added a fix for empty .ics files -- Henrik Levkowetz 11 Jun 2012 18:40:14 +0200 ietfdb (4.02) ietf; urgency=medium Merged [4288] from rjsparks@nostrum.com: * Made several changes to correctly use the new (RFC6410) "Internet Standard" level in email that gets sent at various stages in the handling of documents. Fixes bug 821. Merged branch/iola/migration-fixes@4319, containing these changesets from olau@iola.dk: * [4319]: Only query for regular IETF meetings when calculating cut off dates (reported by Ryan Cross). * [4311]: Fix bug in liaison form that prevents Secretariat users from posting statements on behalf of SDO liaison managers in some cases. * [4310]: Fix problem with direct replyto path in liaison form not using role emails (reported by Stephanie McCammon). * [4307]: Fix missing return in liaison proxy, fixes problem with from email on https://datatracker.ietf.org/liaison/1154/ as reported by Stephanie McCammon. * [4260]: Move note about IANA scraping messages, apparently I managed to put it in the wrong place (they're of course scraping draft approvals, not the ballot announcements). * [4253]: Move last call announcement text to last call event rather than stuffing it inside the state change event. * [4252]: Declare coding system to work around annoying problem when the date produced by SVN is localized. -- Henrik Levkowetz 26 Apr 2012 22:27:36 +0200 ietfdb (4.01) ietf; urgency=medium **IETF 83 Code Sprint** * Made various fixes to test cases in order to support the new code and database setup. * Merged [4265] from adam@nostrum.com: Migrated HTML agenda to new data model. This has several improvements, as well, such as clearer marking of BOFs. * Merged [4226] from adam@nostrum.com: Updated agenda.ics to use new data model. Also, tons more efficient. Additionally, the description field now includes links to relevant meeting materials. * Merged [4224] from york@isoc.org: Related to #816 - Modified base.html so that the logo is clickable as well as the text. * Merged [4223] from york@isoc.org: Related to #817 - added a 401.html page for responding to authentication failures * Merged [4212] from rcross@amsl.com: Ticket #673 Add ability to clear ballot * Merged [4214] from york@isoc.org: Fixes #816 - Turns datatracker.ietf.org into a clickable link * Merged [4213] from suresh.krishnan@ericsson.com: Making doc writeup available as read-only text to regular users who are not shepherd/AD/Secretariat etc. Adding a link for viewing a writeup to the main datatracker page. * Merged [4205] from shane@time-travellers.org: Added a link to the datatracker main document page when we announce a new document * Merged [4207] from adam@nostrum.com: Ported week view over to use the new meeting data model * Merged [4204] from shane@time-travellers.org: Adds a link to the datatracker main document page in the new-version notification messages * Added a fix to catch summer/wintertime changes. -- Henrik Levkowetz 22 Apr 2012 20:38:00 +0200 ietfdb (4.00) ietf; urgency=medium **New Database Schema** * This is the official release of the 4.00 series releases, which expects the redesigned database schema, and thus has an all new models layer. For a full changelog, please go tot he commit log for the iola/conversion branch, web accessible at: http://trac.tools.ietf.org/tools/ietfdb/log/branch/iola/conversion/ -- Henrik Levkowetz 24 Mar 2012 10:33:43 +0100 ietfdb (3.64) ietf; urgency=medium **IETF 82 Code Sprint** This release contains the features and bugfixes from the IETF-82 code sprint. From adam@nostrum.com: * Fixed a bug in is_authorized_in_draft_stream: would never return true for WG chairs. From lars.eggert@nokia.com: * Automatically set the recipients of RFC5742 review emails sent by the IESG based on the RFC Stream. * Fixed a typo. From rjsparks@nostrum.com: * Marked area directors who are not on the current IESG with square brackets on the discuss summary page. Fixes bug 666. * Changed the AD status page to group documents by current state. Fixes bug 742. * Changed the edit info form to allow (force) setting the stream when editing or adding a document to the iesg tracker. Fixes bug 743. From henrik@levkowetz.com: * Added a colour indication to the Area/WG overview page showing responsible AD for each WG. Also some html reformatting for better readability. * Be more specific about the submission startup time on meeting Monday. Indicate time and timezone for more cases on the submission form. * Various fixes to test fixtures and admin pages. -- Henrik Levkowetz 16 Nov 2011 07:08:11 +0100 ietfdb (3.63) ietf; urgency=medium This is a feature release which adds support for Alternate Stream draft tracking, similar to the WG Chair draft tracking. Some bug fixes have also been included. From esanchez@yaco.es: * Merged /branch/yaco/wgchairs.r3120:r3154-3558 from esanchez@yaco.es. This adds support for alternate streams document tracking, similar to the WG chairs tracking functionality. * Merged /branch/yaco/wgchairs.r3120/static/media:r3152-3153. Do not show the draft addoption form when editing stream. See #671. * Merged /branch/yaco/wgchairs.r3120/static/media:r3122-3152. Do no try to create an already existing model. See #671. From henrik@levkowetz.com: * Improved handling of a particular IO Error that sometimes occur during draft submission. * Removed some of the bling and unnecessary information from the document WG state display. * Aligned the workflow admin display lists with the current model fields. -- Henrik Levkowetz 03 Nov 2011 13:50:14 +0100 ietfdb (3.62) ietf; urgency=medium This is a minor bugfix release in preparation for merging in the Alternate Streams draft tracker enhancements. * Fixed a problem where server IO failures could be silently discarded resulting in an ID submission upload being quietly ignored, returning the upload form anew. * Changed to a more helpful text on the 500 server error page. * Tweaked various submission cutoff message strings. Also made the cut-off messages use the actual hour defined in settings, rather than a hardcoded string saying '5 PM (PT)' ... * Cleaned up the display of 'Sign In' and version number when rendering the base template without context (which is the case for the 500 server error template). * Fixed a wrong settings variable (introduced when merging code from the yaco idsubmit branch for v3.61). Refine the error report for failures to move files from staging to repository. * Refined the admin list page for submission details a bit. * Change the 'Sign In' link to be https, preventing clear-text passwords over the wire (given the current use of basic http auth, rather than diget auth, on the web server). * Added a 'Report a bug' link in the lefthand column, below the version indication. * The cutoff hour setting is in UTC, not PST or PDT. Adjusted accordingly in the settings file. -- Henrik Levkowetz 26 Oct 2011 15:55:18 +0200 ietfdb (3.61) ietf; urgency=medium From esanchez@yaco.es: * Check for missed files on staging area. Fixes #707 * Validate title extraction. Fixes #706 From henrik@levkowetz.com: * Improved extraction of draft title during submission. * Fixed a problem where the scan for an author's email address was prematurely terminated because another author's affiliation also was part of this author's address information. * Changed the length of the username field from 30 to 64 characters, to avoid datatracker login problems for people with long email addresses. * Speeded up things and increased reliability during submission author information extraction by looking for a recognizable author's address section, and not searching for author names earlier in the document if found. Fixes a known bad case where the author name occurred in the middle of a draft. * Added handling for the case where an author name is followed by parentheses which are not closed on the same line. * Added some columns to the admin interface for WgProceedingsActivities. Fixed breakage in the feeds code caused by table entries for this model containing meeting FKs which don't have an associated meeting entry. The base problem of broken table entries remain, though. -- Henrik Levkowetz 19 Oct 2011 15:46:27 +0200 ietfdb (3.60) ietf; urgency=medium **Self-Service Password Management** * Added basic automated apache password management functionality. -- Henrik Levkowetz 26 Aug 2011 21:43:47 +0200 ietfdb (3.59) ietf; urgency=medium * Merged [3331] from rjsparks@nostrum.com: Make it more likely that one will issue a ballot when it makes sense to do so. Fixes bug 703. * From smccammon@amsl.com: Updated field help for liaison statements, to match the current form. -- Henrik Levkowetz 19 Aug 2011 00:11:00 +0200 ietfdb (3.58) ietf; urgency=medium * Merged [3272] from rjsparks@nostrum.com: Fixed errors with the edit state link, the new ability to set an initial state when adding a document, the status date on the edit state form, and brought several tests up to date. Fixes issues 695, 696, 697, and 698. -- Henrik Levkowetz 12 Aug 2011 22:42:14 +0200 ietfdb (3.57) ietf; urgency=medium **IETF 81 Code Sprint** * Merged [3254] from suresh.krishnan@ericsson.com: Added a link to the ARO search including the IESG lists * Merged [3249] from suresh.krishnan@ericsson.com: Allowing adding documents in AD is watching state in addition to the default Publication Requested state. Fixes issue #684 * Merged [3245] from rjsparks@nostrum.com: Removes the "Change State" button and makes changing state a link further up on the form. This fixes bug 683, but creates a new one that we will need to address later - editing the state of an RFC that is going through the iesg process again (for going to draft in place for example) will need followup once the changes to get an rfc into that state easily are made. * Merged [3246] from adam@nostrum.com: Adding page to allow viewing meeting slot requests as they are made. There's no link to these yet. * Merged [3240] from adam@nostrum.com: Added csv output format for meeting agenda information, to assist external applications (e.g., Android app, iPhone app) in harvesting and displaying meeting agenda info. * Merged [3182] from adam@nostrum.com: Fix for bug 677 -- no longer assume that code sprint will always be scheduled. * Merged [3181] from adam@nostrum.com: Fix for bug 676 * Merged [3166] from rjsparks@nostrum.com: Simple changes to EditInfoForm field initialization * Various bugfixes and admin enhancements from henrik@levkowetz.com: - Some enhancements to the admin for IDInternal - Fix a bug where the wrong text was shown for IPR declarations which specified that licensing terms would be announced later (option d). - Fix a bug where the plenary entries in the html agenda didn't have links to the room map. - Enhance the admin list page for Stream a bit. - Add some debug output utility functions. - Tweak the admin list for WgMeetingSession to show wg acronym instead of group id. -- Henrik Levkowetz 27 Jul 2011 23:13:30 +0200 ietfdb (3.56) ietf; urgency=medium This is a minor release with various bugfixes and minor admin enhancements. The most long-term noticable enhancement is added support for app- and module-specific admin email addresses which will receive stack traces on uncaught exceptions. Details: * Change the cutoff-settings to match what's desired. Move CUTOFF_HOUR to settings. Change the submission page template to not show the form during the down period. * Set up app-specific email addresses so the respective developers will be notified about failures in code they have worked with. Make django pick up app- and module-specific admin email addresses for stack trace messages. * Make admin form lists work a bit better with non-ascii content in non-unicode tables. * Admin support for StreamedID, so one can look at it. * Get person info without limiting hits to iesglogins. WG Chairs will have logins but not IESG logins ... * Tweak ipr search to only look for IPRs in the appropriate state. * Tweak PersonOrOrgName.email() to handle non-ascii names a bit better. * Don't let the linewrapping algorithm churn infinitely. * Some IPR admin tweaks. Provide a __unicode__ method and show a contact even if multiple have been set for an IPR declaration. -- Henrik Levkowetz 23 Jul 2011 15:27:36 +0200 ietfdb (3.55) ietf; urgency=medium This release adds the wgchair tracker functionality, and also contains some bugfixes. Feature: * Merged in branch branch/yaco/wgchairs from esanchez@yaco.es. This provides the WG Chair Tracker functionality. Fixes: * Changed the default initial state for a WG document to 'WG Document', instead of 'Call for Adoption ...'. * Labelled the link to edit a document's WG state 'Change WG State', in order to not confuse it with changing the IESG state. * Reordered the state information for a document into related groups, separated by rulers. Add some indentation to the template code to make it a bit easier to read in some places. * Made the WG a draft belongs to into a link to the WG page. * Corrected an inappropriate use of the idsubmission repository location instead of the ID repository. Reported by Robert Sparks. * Correct the text (add an omitted word 'press'). Reported by Tomas Narten. * Fixed a problem with author extraction when a given name is the same as the surname. * Only try to return a shepherd for a document if one has been assigned to the document. * Merged in changes from esanchez@yaco.es, changeset [3067]. Makes Liaisons' Date field editable. * Added a bit of admin goodness for MeetingSessions. -- Henrik Levkowetz 24 May 2011 22:58:44 +0200 ietfdb (3.54) ietf; urgency=medium From rjsparks@nostrum.com: * Restructured the position editing page to better integrate the defer button. Fixes bug #659 * Copied the jquery-1.5.1.min.js library into /static/js/lib (from /static/js) because that's where the main document template was looking for it. There have probably been several problems since the change that left this dangling that showed up as things not behaving, but not as errors. The one that clued me in was the discuss text-box not being hidden when the position wasn't DISCUSS. They should all behave better now. * Added a django form validator to the discuss text field to not allow actions when the position is Discuss, but the discuss-text is empty. 2 and 3 together fix bug #660 * Added logic to the undefer fuction to put the document back on the previous telechat (if that hasn't already passed). That is, date1 from telechat dates, and not date2. Fixes bug #661 * Changed the last_call_announcement generation function's template to include the abstracts from the document sets (which with modern usage means the abstract of the document) reflecting the IESGs decision of a few months back. Fixes bug #662 * Removed the old tracker link from the document's main page. Fixes bug #663 From henrik@levkowetz.com: * Handle email recipient lists which contain 'None' elements correctly. Fixes an instance of failure to send notifications about a submitted draft where an author email address was missing. * Add an admin interface to the I-D submission app, to make it easier to handle manual tasks related to submissions. * Add the submission hash to initial-revision-approval emails to WG chairs, so their approvals will take effect. Fixes a problem where WG Chair approvals of WG draft submissions didn't take effect * Apply 'autoescape off' to all email templates which don'have it but might need it, to avoid html entity escapes in emails. Fixes another set of instances where this potentially could occur. * We cannot currently assume that BallotInfo entries matching IDInternal.ballot exists. It seems ballot may be set to a value before the actual ballot entry is created, possibly by some old secretariat tool. Very broken, but we need to survive it :-( Fixes a crash in the admin interface. * Reordered entries of submission forms and notification emails to be more appropriate. * Changed wrapping of formatted text to expand tabs during text wrapping, in order to get consistent indentation handling. -- Henrik Levkowetz 10 May 2011 14:57:09 +0200 ietfdb (3.53) ietf; urgency=medium From esanches@yaco.es: * Do not allow cancellation of submissions with GET requests, and Ensure that 'get full url', 'approve' and 'force' views are called via POST request. Insert a button to perform the last step of autopost via POST request. Fixes #650 * Do not assume that the two_pages_field field is not None. Fixes #651 * Allow creation dates that are 3 days after or 3 days before the current date. Fixes #652 * Change substate from Revised ID Needed to AD Followup if needed. Fixes #654 * Fix expected revision for expired drafts. Fixes #656 * Send announcements when posting new version of a draft. Fixes #649 From henrik@levkowetz.com: * Previous IPR information in last call announcements could be incomplete. Use a better search for IPR declarations related to a document, and include the IPR information in the last call preview. Fixes an AD request and a request from the IESG * When extracting meta-information from drafts, it is required that some data reside on the first page. Split unpaginated drafts into chunks so we can adhere better to this. Fixes a bug where submission filename was picked up (incorrectly) later in a document. * Wrap long lines in the 'save and send email' view of AD ballot comments and discusses. Fixes a request from the IESG * Give development and test deployment a /robots.txt which doesn't permit robots. Avoids indexing of development servers by web spiders. -- Henrik Levkowetz 04 May 2011 00:37:33 +0200 ietfdb (3.52) ietf; urgency=medium * A very small bugfix release, providing the ability for secretariat staff to post liaisons on behalf of others, and when doing so assuming the powers of the liaison manager they are posting for. This contains the changes that should have been part of 3.51, but wasn't... -- Henrik Levkowetz 18 Apr 2011 12:27:29 +0200 ietfdb (3.51) ietf; urgency=medium * A very small bugfix release, providing the ability for secretariat staff to post liaisons on behalf of others, and when doing so assuming the powers of the liaison manager they are posting for. -- Henrik Levkowetz 13 Apr 2011 16:20:21 +0200 ietfdb (3.50) ietf; urgency=medium **Submission Tool Rewrite** * For this release, the idsubmit port from esanchez@yaco.es has been merged in, which constitute substantial added functionality. This integrates the draft upload functionality with the python/django datatracker; it improves draft submission handling and security, and fixes problems with database breakage and inconsistency caused by the old implementation. With this also comes a major improvement of author extraction from draft text, provided by the ietf/utils/draft.py module from henrik@levkowetz.com. * Deployment note: Once the new release has been placed in its deployment directory, and the correct settings_local.py has been copied in, a command needs to be run in order to update the database tables to work with the new code. In the directory containing the ietf/ directory, run this command: $ PYTHONPATH=$PWD ietf/manage.py migrate The output should be as follows:: Running migrations for liaisons: - Nothing to migrate. Running migrations for submit: - Migrating forwards to 0003_add_extra_name_fields. > submit: 0001_initial > submit: 0002_add_submission_hash > submit: 0003_add_extra_name_fields - Loading initial data for submit. Once this is done, the regular deployment routine should be continued. -- Henrik Levkowetz 12 Apr 2011 18:23:44 +0200 ietfdb (3.16) ietf; urgency=medium This is a minor bugfix release. * Merged in [3029] from esanchez@yaco.es. Make the Cc: field of new liaisons editable. * Set the 'person' field of the LegacyLiaisonUser in the admin interface to be handled as a raw id field with search button, rather than as a choice list. This should make admin updates involving the LegacyLiaisonUser table much speedier. * Added a new fix for empty query strings to /meeting/agenda/agenda.ics. (The QUERY_STRING in request.META is not set the same way under the builtin server as under Apache; under apache there will be a QUERY_STRING entry wich is explicitly Null. Handles this.) * Included a javascript change not previsously merged in from branch/yaco/liaison/. -- Henrik Levkowetz 07 Apr 2011 17:15:41 +0200 ietfdb (3.15) ietf; urgency=medium This is a minor bugfix release. * Fix the weekday-dependent plenary information in the materials list. * In urls under /wg/, only accept wgnames which adhere to the constraints currently practiced. (Before this change, the URL patterns would match wg names containing non-ascii characters, which later would bomb due to mix of collations when accessing the database. Might as well return a 404 at once instead). * Don't return 500 if the /meeting/agenda/agenda.ics URL is without query part. * Get rid of a print statement used during testing. -- Henrik Levkowetz 06 Apr 2011 15:17:11 +0200 ietfdb (3.14) ietf; urgency=medium **IETF 80 Code Sprint** * From lars.eggert@nokia.com: Update jQuery to 1.5.1 and jQuery UI to 1.8.11. * From adam@nostrum.com: On the agenda page, for the custom agenda display, now only displays groups that are actually meeting. * From lars.eggert@nokia.com: Remove unused images. Convert GIFs to smaller PNGs. Optimize all images with http://www.smushit.com/ysmush.it/ * From lars.eggert@nokia.com: Change default vertical alignment of various datatracker tables for better readability. * From peter.musgrave@magorcorp.com: Fix typo. Fixes #566. * From jelte@nlnetlabs.nl: Make search result table headers clickable; clicking will sort on said column, fixes #484. * From peter.musgrave@magorcorp.com: Don't show AD/Secretariat links for Last Call etc. if they will 404. Fixes #550. * From adam@nostrum.com: Meeting boxes now expand to reveal all text when users hover over them. Fixes ticket #602. * From kivinen@iki.fi: Added an URL to retrieve a text/plain version of the list of drafts for a given WG. Useful for building WG-speific ePub documents of a WG's drafts. * From shane@time-travellers.org: Updated the JavaScript associated with the search page to control whether the 'search' button is enabled or not. It is now enabled if either the main search box has input, or if any of the sub-options have input, or both. * From rjsparks@nostrum.com: Adds a view of documents currently in IETF Last Call. Fixes #630. * From bmheight@gmail.com: Remove explicit URLs in the code, using reverse() and the newly created helper function reverse_lazy(). Fixes #628. * From rjsparks@nostrum.com: Changed the way ballot discuss/comment texts are displayed to put the text from current ADs first, and mark ex-ADs with [] following the convention on the left bar. This fixes issue #608 * From adam@nostrum.com: Added ical-format agenda. Fixes issue #601. * From peter.musgrave@magorcorp.com: Add IPR column to IESG Telechat Agenda. Fixes issue #552. * From rjsparks@nostrum.com: Add a defer/undefer button to the edit_position dialog. Fixes issue #627. * From kivinen@iki.fi: Changed cookie settings to be valid for 10 years, they used to be valid until the end of session. -- Henrik Levkowetz 28 Mar 2011 19:43:25 +0200 ietfdb (3.13) ietf; urgency=medium * Provide a full URL to IPR issues in the last call email, rather than just the local url path. Fixes an issue reported by Russ. * Tweak the admin interface for WGs and Chairs, adding some useful links to the tabular displays. * Add refinements for the liaison admin interface. Show contact link and coloured Login/User links to show broken entries. * Wrap the sdo name query in a try clause to avoid server 500 errors. * Only try to populate the liaison user/email list from the from_entity if it's set. * Make the document announcement default Cc: somewhat configurable. Remove iab@iab.org (on request). * Link to the State help page from the 'State:' label. * Don't use '<' and '>' in text/plain email text. * Don't permit just any characters in the document name; limit this to characters we currently permit in the names, or which has occurred in posted documents. Fixes a problem where non-ascii characters were propagated to the database search and caused collation sequence exceptions, instead of giving 404 errors. * Remove the To/From/Subject headers from extra headers to prevent duplicate headers. -- Henrik Levkowetz 26 Mar 2011 09:27:14 +0100 ietfdb (3.12) ietf; urgency=medium Note: Deploying this release requires a database schema update, see below. From esanches@yaco.es: * Allow an SDO Liason Manager to send outgoing liaison from any IETF Entity to his SDO. * Allow the secretariat to send liaisons on behalf of another user. * On login, retrieve the person record related to the login from the legacy tables of non IESG logins. Provides the link between login name and person listed in the liaison manager table. Fixes #576. * Refined handling of the To: and From: address lists when the Liaison Manager is also a WG Chair or AD. From henrik@levkowetz.com: * Add a clean_whitespace filter in some places to get rid of any newlines embedded in document titles. Fixes a problem with bad email headers in announcements related to documents with newlines embedded in the title. * Don't try to send out mail which has no recipients. Fixes a crash when trying to send announcements related to drafts which have an empty 'email notes to' field. * Fix typo in method calls to send email, fixes a crash when submitting liaison statements. * Renamed 'LiaisonDetail.taken_care' field to 'action_taken'. Miscellaneous associated fixes. Enhanced liaison-related admin pages. Note: Deploying this release requires an additional steps to create a new column in a table. This is done as a South migration (see http://south.aeracode.org/ for more info on South): # 8<---------- # First the regular checkout and prepare: cd /a/www/ietf-datatracker svn co http://svn.tools.ietf.org/svn/tools/ietfdb/tags/3.12 cp web/ietf/settings_local.py 3.12/ietf/ cd 3.12 # Next, apply the migrations: PYTHONPATH=$PWD ietf/manage.py migrate liaisons # Then carry on with the usual actions: cd ../ rm ./web; ln -s 3.12 web sudo /etc/init.d/apache restart # 8<---------- -- Henrik Levkowetz 02 Feb 2011 18:34:58 +0100 ietfdb (3.11) ietf; urgency=medium * Fixed a bug in the IPR Search, where searches against the IPR notice content would fail (Only try to open a legacy url if it leads to a file; not if it leads to a directory). * For a new IESG tracker document, only add a history comment about previous history if some previous history exists (i.e., if the replaced document also existed in the IESG tracker). * Show status of Dead Expired documents appropriately; just 'Expired' is insufficient. * Restore, for the secretariat only, the re-scheduling functionality of the /iesg/agenda/documents/ page which was removed in [2366] as the ADs felt that it made the page too busy. * Propagate all extra fields on to the final email sending function, not only the Cc and Bcc fields. Restores previously missing Reply-To: headers. * Turn autoescaping off for everything in text/plain email templates. Fixes multiple problems with '<' and '>' in emails showing up as '<' and '>', and related problems. * The liaison tool is deployed. Show the links to the new tool. * Prevent things from crashing if some of the email fields are null for a liaison. * It should be possible to edit the area of a draft even if it's been set before. Re-enabled the area list box on the document/edit/info/ page. * Corrected spelling error in list_display specification for the PersonOrOrgInfo Admin page. * Corrected the path to the draft archive in the settings file. (Some of the fixes above has been deployed already before this release by patching the previous release on the server.) -- Henrik Levkowetz 28 Jan 2011 13:15:40 +0100 ietfdb (3.10) ietf; urgency=medium * Fix css for IPR header (status column was included by mistake). Fixes issue #546. * Tweak some GUI strings in the Liaison Manager From adam@nostrum.com: * Added week-at-a-time view to agenda page when viewing selected areas and/or groups. If no groups are selected, the week view is hidden, leaving the base-level functionality unchanged. From peter.musgrave@magorcorp.com: * 548# Link in IPR column should use an absolute, not relative URL. This fixes issue #546. From kivinen@iki.fi: * Added new setting to the /cookies page which enables always showing full document text instead of showing beginning of the document. This fixes issue #551. From rjsparks@nostrum.com: * Refined the email sent when an position changes. -- Henrik Levkowetz 07 Dec 2010 21:39:17 +0100 ietfdb (3.09) ietf; urgency=medium **IETF 79 Code Sprint** From suresh.krishnan@ericsson.com: * Added the last call e-mail event to the draft history page. * Added a search function for drafts on their respective mailing lists. Fixes issue #458. From adam@nostrum.com: * Added tarfile and pdf-composite links and functionality to download working group documents from the agenda page. Fixes #539 From peter.musgrave@magorcorp.com: * Added column 'IPR' to documnet table for WG docs and by AD docs, and also in search results. Fixes issue #497. From kivinen@iki.fi: * Make the idea of what is 'soon' and 'new' in the I-D and RFC lists configurable. From lars.eggert@nokia.com: * Fix for #467: History tab: Avoid HTTP/HTTPS warning for the diff tool form submission. * Fix for #456: Make it possible for an IESG member to add a comment (for the document history) in the 'change document state' dialog * Fix for #537: Remove redundant "by" info from doc history text. * Fix for #525. Adds more information to the document history tab, specifically changes to writeup, announcement and last-call text. * Fix for #372. Makes the position editing form display the name of the document being edited. * Fix for #526 and #530: Change the format of the notification email sent out when an AD posts a ballot position on a draft, it by default CCs that email to the authors and chairs, and adds some explanatory text to the body of those messages. From rjsparks@nostrum.com: * Changed the language used in the last call email to be closer to the language the tracker uses when no IPR declarations are found directly on the draft. Fixes #506 * Retained search results on login. Fixes #482. * Added filename to the subject of Protocol Action and Document Action email messages (and fixed a bug that was preventing CC/BCC from being honored). Fixes issue #528. From fenner@fenron.net: * Split the /doc/ tabs into separate pages. This fixes #533. (Eventually, this will use to ask the tabs to be prefetched when the first tab is loaded, as documented at https://developer.mozilla.org/en/Link_prefetching_FAQ, but as there is some issues with this which haven't been fully resolved, the prefetch part is not part of this release.) * Fill in the X-IETF-IDTracker header with the I-D Tracker version number. This fixes #513 * Added support for admin site documentation From henrik@levkowetz.com: * Updated IESG Agenda Section 3.3 title * Added fix for announcement email multipart bug, in part contributed by glen@amsl.com and tony@att.com. * Other minor fixes -- Henrik Levkowetz 09 Nov 2010 10:42:13 +0100 ietfdb (3.08) ietf; urgency=medium From olau@iola.dk: * Ported scripts for expiration of drafts and last-calls, and sending scheduled announcements. The command-line front-ends are in bin/ as expire-ids, expire-last-calls and send-scheduled-mail. The last one already existed with some code, but it's not certain it actually worked. The new one accepts the same arguments as the Perl script (there's a little bit of help if you run it). All three log to syslog. They need to be started from cron with PYTHONPATH=/a/www/ietf-datatracker/web , in the same manner as other scripts which use the django models to interact with the database. -- Henrik Levkowetz 27 Oct 2010 13:52:26 +0200 ietfdb (3.07) ietf; urgency=medium From esanchez@yaco.es: * Merged in Yaco's Liaison Management Tool Port & Rewrite. Enjoy! Note: Deploying this release requires additional steps; to verify that liaison related settings in settings.py are correct, and to create new tables and update existing tables and table content. The latter is done as South migrations (see http://south.aeracode.org/ for more info on the South app). More extensiive documentation about the actions needed are provided in the user manual (doc/LSMT_user_manual.pdf in the release). The brief version follows:: # 8<---------- # First the regular checkout and prepare: cd /a/www/ietf-datatracker svn co http://svn.tools.ietf.org/svn/tools/ietfdb/tags/3.07 cp web/ietf/settings_local.py 3.07/ietf/ cd 3.07 # Verify that the new variables in settings.py are correct; if not, # add the correct settings in settings_local.py and inform the release # manager of the correct settings so they can be incorporated in the # next release. The variables in question are (as set in the release): # # # The email address from wich all liaison emails come: # LIAISON_UNIVERSAL_FROM = 'Liaison Statement Management Tool ' # # # The filesystem path where the liaison attachments will be saved: # LIAISON_ATTACH_PATH = '/a/www/ietf-datatracker/documents/LIAISON/' # # # The url from where the webserver serves the liaison attachments # LIAISON_ATTACH_URL = '/documents/LIAISON/' # Next, the changes to the MySQL tables will be done. # You can list the table migrations which will be applied if desired, # this should list migrations from 0001_... to 0009_... under liaisons: PYTHONPATH=$PWD ietf/manage.py migrate --list # Apply the migrations: PYTHONPATH=$PWD ietf/manage.py migrate # Add the static/doc location as statically served files to the apache # configuration. Fix line 6 in etc/apache2/vhoosts.d/ietf-datatracker.common # to read: # # (i.e., add '|doc' to the exception list). # Then carry on with the usual actions: cd ../ rm ./web; ln -s 3.07 web sudo /etc/init.d/apache restart # 8<---------- Once the datatracker is up and running with the new liaison tool in place, liaison role assignments have to be done as described in the LSMT user manual (in doc/LSMT_user_manual.pdf) page 14, summarized by Patrik on the yaco-liaison-tool mailing list: 1. Add the IAB and IETF chairs, wg chairs, area directors etc as apropriate (as described in the document). 2. Add the liaisons in the IETF assigned and named on the IAB list of liaisons. -- Henrik Levkowetz 26 Oct 2010 16:11:24 +0200 ietfdb (3.06) ietf; urgency=medium From rjsparks@nostrum.com: * Changed the navigation round editing ballots and sending discuss/email so that the user comes back to the page the edit started from. * Fix for ticket #374 (all in base.js) and removal of a vestigial 'save all changes' button from the iesg/agenda/documents page. * Split the ballot writeups page into three pages, for a more understandable user interface. From henrik@levkowetz.com: * Fix a presentation bug in /iesg/agenda/documents.txt -- Henrik Levkowetz 20 Sep 2010 16:45:37 +0200 ietfdb (3.05) ietf; urgency=medium Bugfix release. Fixes the following issues (for more details, see the release page http://trac.tools.ietf.org/tools/ietfdb/milestone/3.05) From olau@iola.dk: * #354 Document State Change Edit lacks dropdowns in IE 8 * #359 Test cases fail in fresh checkout from iesg-tracker branch * #364 Impossible to move back to No-Position * #366 The popup view of current positions when you left click on the grids needs to be smarter when it doesn't fit on the display. * #369 IDInternal entry with missing information generated * #370 Documents marked for telechat not on the web agenda From Henrik: * #367 Document state age not always shown correctly * #355 tarfile generation fails on production system * #371 When a draft lacks creation date, the all_id* and 1id_* generating script fail -- Henrik Levkowetz 24 Aug 2010 15:42:30 +0200 ietfdb (3.04) ietf; urgency=medium **IETF 78 Code Sprint** * From Adam Roach: Make the selectable WG agenda feature of the datatracker IETF Agenda less resource intensive by not preloading all WG agendas. * From Peter Musgrave: Improve the selection of listed 'related documents' on the WG document pages. * From olau@iola.dk: Fix for issue #351 which caused server error when editing the state of a document (as IESG user). The following features were included already in v3.03, but by mistake weren't listed in the changelog for that revision: * IETF 78 Sprint code from Peter Musgrave: Add related documents section to the wg documents page (e.g., /wg/sipclf/). * IETF 78 Sprint code from Robert Sparks: Relabel the 'Issue Ballot' button (for AD use, on the draft info page). * IETF 78 Sprint code from Robert Sparks: provide a downloadable tarball of the documents on the IESG agenda of a given date. -- Henrik Levkowetz 28 Jul 2010 16:13:23 +0200 ietfdb (3.03) ietf; urgency=medium * IETF 78 Sprint code from Adam Roach: Make the IETF agenda page view user-modifiable, providing a custom bookmarkable agenda view for each user. * Make WG agendas available trough datatracker URLs; this will avoid problems when the text from these pages are incorporated in frames in other datatracker pages. Example: /meeting/78/agenda/sipcore -- Henrik Levkowetz 27 Jul 2010 15:09:56 +0200 ietfdb (3.02) ietf; urgency=medium * Remove the per-document rescheduling dropdown boxes from the future iesg telechat document list (/iesg/agenda/documents/). Fixes issue #346. -- Henrik Levkowetz 21 Jul 2010 15:30:46 +0200 ietfdb (3.01) ietf; urgency=medium * Add a button to issue a ballot for documents which has entered IESG processing but don't have a ballot yet. * Always make idinternal.docstate() return a string -- there are callers that assume this, like the script which generates all_id2. * Don't fail with a server error (500) if a bad draft name (containing for instance newlines) is entered -- just return a 404. * For WG charters under evaluation, show the year too, not only month and day. This will reveal bad date information in the charter files. * If we fail to parse the date of a WG charter under evaluation, use 1 Jan 1900, and carry on. Don't fail with a server error. -- Henrik Levkowetz 20 Jul 2010 18:41:31 +0200 ietfdb (3.00) ietf; urgency=medium **IESG Datatracker Port to Python/Django** * This release adds the IOLA port of the former Perl IESG datatracker to the Python/Django datatracker. This should make most AD actions on drafts available through the Django datatracker, normally from the datatracker.ietf.org/doc// page or from the /doc/ad/.../ page, or expressed UI-wise: from the pages reached from the 'AD Dashboard' menu at the top of the lefthand menubar in the datatracker. This includes actions such as: - Change draft state - Edit draft metadata - Defer ballot, undefer ballot - Handle ballot comments - Handle ballot writeups - Approve ballots - Initiate last call Secretariat staff actions supported through the Django datatracker now includes: - Manage telechat dates - Manage working group descriptions Tweaks to the new interface and capabilities will be releases with a short release cycle, as they are discovered and fixed over the next weeks. -- Henrik Levkowetz 16 Jul 2010 18:14:48 +0200 ietfdb (2.52) ietf; urgency=medium * Added machine-readable ballot information (tsv and json) for drafts with ballots: /doc//ballot.tsv and /doc//ballot.json . Json data for the whole document is available for all drafts at /doc//doc.json . * Added Unicode NFKC normalization of paths. Somebody just tried to access /wg/ipfix/charter/ with 'fi' represented as the unicode ligature \ufb01... * Changed the text emitted during testing to have less noise at the beginning of the line -- only 'OK', 'Fail', and the initial line of coverage reports now starts at the beginning of the line, without whitespace. This makes it easier to scan a test run visually to find reported failures. -- Henrik Levkowetz 16 Jul 2010 13:02:46 +0200 ietfdb (2.51) ietf; urgency=medium * Add an html sanitizer and a sanitize_html template filter. This uses the html5lib, which has also been included in the svn tree. * Provide better handling of both text/plain document comments and document comments which contain html tags. Adds urlization, linebreak-preservation and html sanitization. Html sanitization would be better applied when adding comments, but we're not yet a position to enforce this for all input paths. * Catch an additional exception which can occur during generation of all_id2.txt -- Henrik Levkowetz 07 May 2010 12:26:58 +0200 ietfdb (2.50) ietf; urgency=medium From RjS: * Don't send mail if we don't have any recipients... From Pasi: * /iesg/agenda/: fix bug related to non-existing ballots * Removed old (unused) YUI js/css * /ipr/search/: avoid exception for unexpected search types; comment out debug logging * /doc/active, all: add link to all_id2.txt * /liaison/: add link to liaison statement manager tool From Henrik: * Make version information on the web pages a little less cryptic. * Tweak the IESG agenda page for better placement of IPR information; requested by Russ. Also align the ballot graphics. * Add admin site support for the DocumentComment model. * If replaced-by information exists, display it, even if the document state seems to be incorrect (something else than 'Replaced'). -- Henrik Levkowetz 26 Apr 2010 11:45:24 +0200 ietfdb (2.49) ietf; urgency=medium From Pasi: * New script to generate all_id2.txt. This should be called in www6s/scripts/datatracker-updater: run "python -m ietf.idindex.generate_all_id2_txt" and place its output in $ID/all_id2.txt. * /wg/: link to both www.ietf.org and tools lists of concluded WGs * /doc/: show full responsible AD name for old drafts, too * Eliminated some cases where exceptions could be thrown * Various minor tweaks and fixes From Henrik: * Added commands to the mkrelease script to update the IETF Tools feed with release information. -- Henrik Levkowetz 24 Mar 2010 21:11:27 +0100 ietfdb (2.48) ietf; urgency=medium From Pasi: * Show comments feed link only if it exists (=document is in IDInternal) * Fixed a broken link on main page * Move new look-and-feel base templates from templates/idrfc/ to just templates/ * Remove more unused code * Replaced /idtracker/help/evaluation/ with redirect to www.ietf.org * /wg/: fix mailto links for WG chairs * /doc/: show telechat date in search results list * Show correct version number of expired drafts * /doc/rfcNNNN/: show rfc stream * Use new look for more pages * Replaced most of /idtracker/ (search, document page, ballot page, comment page) with redirects to /doc/ * /doc/\*: Show information about ballot sets * Refactoring /wg/: use redirects instead of redundant URLs; removed old charter pages (not used/linked to); misc. cleaning * Point to /wg// in left navbar and /meeting/agenda/ -- Henrik Levkowetz 22 Mar 2010 00:26:41 +0100 ietfdb (2.47) ietf; urgency=medium **IETF 77 Code Sprint** From Suresh: * Added a link to the draft pages with email address to the draft authors From RjS: * Added STD/FYI/BCP info to the standard RFC display page * Added a link to the comment feed next to the nits link From Bill: * Output a summary of what's needed for the document to be approved in the main and ballot views. From Tony: * Search plugin for Firefox/IE/etc. From Pasi: * Correctly handle entities (like >) in IESG note field * New script for finding database tables with non-ASCII data * /doc/\*: allow direct links to tabs/individual comments * /iesg/agenda/: show management item text if logged in as AD * /wg/acronym/: fix warning for concluded WGs * Support PPTX meeting slides -- Henrik Levkowetz 21 Mar 2010 03:03:42 +0100 ietfdb (2.46) ietf; urgency=medium From Robert: * Add the I-D expiration notification script. \*\*\* Please add the following cron entry:: # Send notifications about pending I-D expirations. 42 4 \* \* 1 /a/www/ietf-datatracker/web/ietf/bin/notify-expirations From Henrik: * Adding the south schema migration app (http://south.aeracode.org/). * Change the text of IPR search result to more correctly reflect the status of the search result when IPR has been found on documents related to a listed document, but not on that document itself. From Pasi: * Use the new look for a bunch of additional pages * /admin/: fix login redirects to work with RemoteUserMiddleware; hide password changing functionality (which doesn't work with RemoteUser anyway) * /ipr/: remove separate list for updating * /wg/acronym/\*: clearer warning about concluded WGs * A lot of various code and deployment cleanup * A lot of minor tweaks and fixes (tooltips, links, and more) * /doc/rfcNNNN/: include link to errata * /doc/rfcNNN/: include links to PDF/PS versions (if they exist); handle RFCs that are not available as .txt * Added meta description tags (to improve search result usability): drafts/RFCs, IPR disclosures, liaison statements * Cache/gzip meeting agenda and materials pages * If draft doesn't exist under /idtracker/, redirect to /doc/ instead of showing error * Show /doc/ad/first.last/ only for ADs, not other folks in IESGLogin table * Fixed bunch of null/unique attributes for model fields * New script to check for violated database constraints (NOT NULL, UNIQUE, FOREIGN KEY) -- Henrik Levkowetz 21 Mar 2010 00:36:05 +0100 ietfdb (2.45) ietf; urgency=medium From Pasi: * Use wg_www_pages table (and removed unused idtracker_areaurl). Requires applying changes to database as follows: cd /a/www/ietf-datatracker/2.45/ietf PYTHONPATH=../ python manage.py dbshell < ../test/sql_fixup.sql * Parse stream/wg/file formats from rfc-index.xml; prepare for parsing auth48 info from queue2.xml * IPR disclosures: Don't include .doc/.html inline; don't fail if file does not exist * Replaced /drafts/* with redirects * Show datatracker version+date in new look, too * IESG discuss page: shade even/odd rows * Use new look for IETF meeting agenda; add color-coding support (like tools has). Also use new look for /iesg/agenda/, /ipr/ and /ipr/NNN/ * Show RFC publication date as YYYY-MM (since we don't currently have the day) * Fix searching for RFCs that are processed by IESG; made 'advanced search' options mutually exclusive * For plain text RFCs, point to www.rfc-editor.org instead of www.ietf.org * Fix page title for 404/500 pages (ticket:298) From Henrik: * Apply django changeset 12634 to our copy, to permit usernames containing '@'. See http://code.djangoproject.com/changeset/12634 . -- Henrik Levkowetz 11 Mar 2010 14:41:47 +0100 ietfdb (2.44) ietf; urgency=medium From Robert: * Moved old (1995-2003) liaison statements from the template file to the database. This requires applying database fixups as follows: cd /a/www/ietf-datatracker/2.44/ietf PYTHONPATH=../ python manage.py dbshell < ../test/liaison_fixup.sql And updating the liaison files as follows: cd /a/www/ietf-datatracker/documents/LIAISON/ # TAKE A BACKUP OF THE WHOLE DIRECTORY, JUST IN CASE . /a/www/ietf-datatracker/2.44/test/liaison_fixup.sh From Pasi: * Use new look for more pages * Make obsoletes/updates/etc. lists links (with new urlize_ietf_docs template filter) * Always show year in /idtracker/status/ dates * /doc/rfcNNNN/: show the internet-draft name (if known) and link to its history; show information about post-RFC IESG processing * Use yellow for 'abstain' also in /iesg/agenda/documents/ * IESG ballot grid icon: show 'abstain' as yellow instead of gray * IESG telechat agenda: include "private" links also if logged in, link from document list * Added /doc/all/ page * Better output if /doc/ search doesn't match anything * Show state-change-notice-to field in /doc/ (to AD/secretariat) * Make IESG telechat agenda feed discoverable * Added IPR/dependency links and edit/add buttons for RFCs, too; some template refactoring * Avoid exceptions from MySQL when searching for non-ASCII draft names/WG acronyms/etc. * Handle non-ASCII characters gracefully in old cgi-bin script redirects * IPR search: handle non-numeric RFC numbers/ID document tags gracefully (instead of uncaught exception) * Change Atom feeds (+couple of other places) to point to /doc/draft-.. instead of /idtracker/draft-.../ From Henrik: * In PersonOrOrgInfo.email(), try harder to find a relevant email address. The new code will eventually fall back to a broad filter which matches that of the perl code which creates WG charter pages, where the old code would sometimes result in django-generated charter pages with missing email addresses. * Serve ipr disclosures which are available on the server directly, instead of through an external http link in an