Commit graph

200 commits

Author SHA1 Message Date
Robert Sparks 3a7d0d6255 script to process the id-archive and add Document objects for drafts that are currently missing from the datatracker. Fixes #1316. Commit ready for merge.
- Legacy-Id: 14138
2017-09-18 20:07:48 +00:00
Henrik Levkowetz 1b09ce419d Tweaked mkrelease
- Legacy-Id: 14020
2017-08-01 10:56:40 +00:00
Henrik Levkowetz 5bcecc7c54 Fixed a bug and added an url exception for some redirected urls in the test crawler.
- Legacy-Id: 13992
2017-07-28 12:50:39 +00:00
Henrik Levkowetz fa408ce7f6 Removed fenner@ from release email list, after Bill's wishes.
- Legacy-Id: 13986
2017-07-27 15:08:13 +00:00
Henrik Levkowetz 65e9a63c8d Fixed a bug in mkdevbranch
- Legacy-Id: 13977
2017-07-26 19:53:14 +00:00
Henrik Levkowetz fe7d484e27 Added the necessary switch argument for the registration importer's --latest switch.
- Legacy-Id: 13960
2017-07-21 12:55:27 +00:00
Henrik Levkowetz 303c3fd911 Fixed a path in bin/mkrelease.
- Legacy-Id: 13840
2017-07-12 12:34:37 +00:00
Henrik Levkowetz 6b69660559 Fixed a wrong virtualenv path in bin/mm_hourly
- Legacy-Id: 13705
2017-06-22 14:59:28 +00:00
Henrik Levkowetz eb610d2d94 Increased the test crawlers verbose output.
- Legacy-Id: 13685
2017-06-19 23:31:53 +00:00
Henrik Levkowetz ad57b107f2 Tweaked count helper.
- Legacy-Id: 13672
2017-06-18 17:21:14 +00:00
Henrik Levkowetz f90a7a721b Reverted coverage data. Tweaked mkrelease.
- Legacy-Id: 13646
2017-06-16 09:19:54 +00:00
Henrik Levkowetz 4fc2c6f960 Merged in ^/personal/henrik/6.54.2-yang@13630:
Added a new yang checker, 'yanglint', to the existing Yang checker class, in
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13634
2017-06-15 20:16:48 +00:00
Henrik Levkowetz d98054c103 Added a new yang checker, 'yanglint', to the existing Yang checker class, in
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13630
2017-06-15 16:09:28 +00:00
Henrik Levkowetz bf6b8d8ca1 Tweaked bin/mergedevbranch
- Legacy-Id: 13590
2017-06-12 22:26:49 +00:00
Henrik Levkowetz 5926f8832c Told svn to ignore some additional files under bin/
- Legacy-Id: 13557
2017-06-07 12:30:04 +00:00
Henrik Levkowetz 023a32715d Merged in ^/branch/iola/author-stats-r13145 from olau@iola.com, with additional features from ^/personal/henrik/6.52.1-authorstats.
- Legacy-Id: 13550
2017-06-06 18:36:59 +00:00
Henrik Levkowetz 4544b0643f Tweaks to count.c
- Legacy-Id: 13537
2017-06-06 07:26:17 +00:00
Henrik Levkowetz b3fe24d76b Merged in [13503] from rjsparks@nostrum.com:
Add usernames to the email sent to the secretariat when a possible duplicate person has been detected. Fixes #2307.
 - Legacy-Id: 13521
Note: SVN reference [13503] has been migrated to Git commit d330b8ded453b61eabc59589d44785d4fc09c767
2017-06-04 21:49:43 +00:00
Henrik Levkowetz d31c58973d Tweaked mergedevbranch to use bin/count
- Legacy-Id: 13516
2017-06-04 16:31:10 +00:00
Henrik Levkowetz 7ae80407db Tweaked version of count.c
- Legacy-Id: 13514
2017-06-04 16:23:23 +00:00
Henrik Levkowetz ed1e9cd8db A tiny utility to count test dots and periodically report the count.
- Legacy-Id: 13512
2017-06-04 15:28:03 +00:00
Henrik Levkowetz 219c3015d7 Added the meeting attendance fetcher to the daily cronjobs
- Legacy-Id: 13491
2017-06-01 20:58:54 +00:00
Henrik Levkowetz 25bb9a1c0f Tweaked bin/mkdevbranch
- Legacy-Id: 13477
2017-05-31 16:26:48 +00:00
Henrik Levkowetz afc932feaa Removed the table-list.json file and support for it; there are better ways of cleaning out extra local tables (see bin/drop-new-tables for a starting point)
- Legacy-Id: 13459
2017-05-30 00:03:26 +00:00
Henrik Levkowetz d8cf039f6a Tweaked the use of the -p otpion of bin/mkrelease. Added sbirkholz@amsl.com to the release email addressees.
- Legacy-Id: 13222
2017-04-14 14:49:05 +00:00
Henrik Levkowetz 02c6692f70 bin/mkrelease bugfix
- Legacy-Id: 13216
2017-04-14 12:35:23 +00:00
Henrik Levkowetz 828cfb89f7 Added a switch to bin/mkrelease to permit mixed data and schema migrations (applicable when the data migrations are as tiny and swift as schema migrations, such as when adding a new entry to a name model).
- Legacy-Id: 13215
2017-04-14 12:33:19 +00:00
Henrik Levkowetz 4c8f47ce73 Trying to re-apply already run migrations after loading a new databases dump runs into the problem that new tables created by the migrations linger, even if the tables loaded from the dump match the non-migrated state. Having lists of the tables matching the latest release available makes it easy to construct an sql command to dump the extra tables, so the migrations can be run. Adding generation and saving of a table list to bin/mkrelease.
- Legacy-Id: 13199
2017-04-12 18:16:19 +00:00
Henrik Levkowetz e557c2113e Merged in [13118] from lars@netapp.com:
Update vnu.jar and fix various HTML5 nits it found during a test crawl.
 - Legacy-Id: 13152
Note: SVN reference [13118] has been migrated to Git commit 76a3c8bdc0
2017-03-27 17:35:38 +00:00
Lars Eggert 76a3c8bdc0 Update vnu.jar and fix various HTML5 nits it found during a test crawl.
Commit ready for merge.
 - Legacy-Id: 13118
2017-03-25 20:21:14 +00:00
Henrik Levkowetz 044b9b8de0 Refined the selection of commit log info lines.
- Legacy-Id: 13110
2017-03-25 18:53:22 +00:00
Henrik Levkowetz 5bb9518b5f Added some new exceptions to the test-crawler; files which are known to not exist, and files with known html character problems.
- Legacy-Id: 13037
2017-03-20 13:46:23 +00:00
Henrik Levkowetz 6f47675f6a Minor tweak
- Legacy-Id: 13029
2017-03-20 11:45:08 +00:00
Henrik Levkowetz 90c61f87ba Added a check to bin/mkrelease, preventing releases with both schema change migrations and data migrations. Data migrations often take some time, which will delay the time between the schema changes and deployment of the matching new code.
- Legacy-Id: 13028
2017-03-20 11:42:50 +00:00
Henrik Levkowetz 7296b951ee Refined the test crawler a bit, to avoid extracting URLs to follow
from html outside the datatracker's control, such as uploaded WG
agendas.  Also excempted some pages with known-bad character issues
from html validation, and refined the error reporting for html
validation failures.
 - Legacy-Id: 13027
2017-03-19 19:34:50 +00:00
Henrik Levkowetz c0bf53101c Tweaked the release script.
- Legacy-Id: 12939
2017-03-01 12:10:15 +00:00
Henrik Levkowetz 135b961b1d Tweaked the release script's bower update part.
- Legacy-Id: 12914
2017-02-24 10:43:17 +00:00
Henrik Levkowetz 3ec322a1b9 Added some cleanup after running bower installs.
- Legacy-Id: 12885
2017-02-20 11:30:00 +00:00
Henrik Levkowetz 927685e029 Added some cleanup after running bower installs.
- Legacy-Id: 12884
2017-02-20 11:29:18 +00:00
Henrik Levkowetz 4e2d7252a6 Added some cleanup after running bower installs.
- Legacy-Id: 12883
2017-02-20 11:28:02 +00:00
Henrik Levkowetz a78c419845 Removed a debug print statement.
- Legacy-Id: 12870
2017-02-17 17:53:26 +00:00
Henrik Levkowetz c344a18bdf Fixed an issue with the test-crawler which could cause false positives for urls containing apostrophe.
- Legacy-Id: 12851
2017-02-16 09:58:34 +00:00
Henrik Levkowetz fed57a629b Added updating of static web assets to the release script.
- Legacy-Id: 12784
2017-02-03 00:03:00 +00:00
Henrik Levkowetz 0a7a4ff213 Ignore annoying collectstatic warnings about duplicate files.
- Legacy-Id: 12770
2017-02-01 17:59:51 +00:00
Henrik Levkowetz 84980e53ba Tweaked mergeready
- Legacy-Id: 12571
2016-12-18 14:11:13 +00:00
Henrik Levkowetz f026a46a79 Simplified the release-coverage script.
- Legacy-Id: 12562
2016-12-16 17:52:20 +00:00
Henrik Levkowetz 00a3392192 Enabled invocation of 3 additional scripts from bin/daily (instead of ../scripts/Night-runner)
- Legacy-Id: 12561
2016-12-16 17:51:12 +00:00
Henrik Levkowetz d6df7fb731 Tweaked mergeready to use modules in working dir, and be slightly more verbose when building the mergeinfo cache.
- Legacy-Id: 12536
2016-12-15 16:09:14 +00:00
Henrik Levkowetz 9a3f6b059b Merged Django-1.8 upgrade work to trunk. Adjusted migration names, and added migrations as necessary. Fixed some instances of broken html.
- Legacy-Id: 12507
2016-12-13 05:55:46 +00:00
Henrik Levkowetz 44269f1d73 Added an URL to skip to the test-crawler
- Legacy-Id: 12500
2016-12-09 13:04:22 +00:00