Commit graph

236 commits

Author SHA1 Message Date
Henrik Levkowetz 5926f8832c Told svn to ignore some additional files under bin/
- Legacy-Id: 13557
2017-06-07 12:30:04 +00:00
Henrik Levkowetz 023a32715d Merged in ^/branch/iola/author-stats-r13145 from olau@iola.com, with additional features from ^/personal/henrik/6.52.1-authorstats.
- Legacy-Id: 13550
2017-06-06 18:36:59 +00:00
Henrik Levkowetz 4544b0643f Tweaks to count.c
- Legacy-Id: 13537
2017-06-06 07:26:17 +00:00
Henrik Levkowetz b3fe24d76b Merged in [13503] from rjsparks@nostrum.com:
Add usernames to the email sent to the secretariat when a possible duplicate person has been detected. Fixes #2307.
 - Legacy-Id: 13521
Note: SVN reference [13503] has been migrated to Git commit d330b8ded453b61eabc59589d44785d4fc09c767
2017-06-04 21:49:43 +00:00
Henrik Levkowetz d31c58973d Tweaked mergedevbranch to use bin/count
- Legacy-Id: 13516
2017-06-04 16:31:10 +00:00
Henrik Levkowetz 7ae80407db Tweaked version of count.c
- Legacy-Id: 13514
2017-06-04 16:23:23 +00:00
Henrik Levkowetz ed1e9cd8db A tiny utility to count test dots and periodically report the count.
- Legacy-Id: 13512
2017-06-04 15:28:03 +00:00
Henrik Levkowetz 219c3015d7 Added the meeting attendance fetcher to the daily cronjobs
- Legacy-Id: 13491
2017-06-01 20:58:54 +00:00
Henrik Levkowetz 25bb9a1c0f Tweaked bin/mkdevbranch
- Legacy-Id: 13477
2017-05-31 16:26:48 +00:00
Henrik Levkowetz afc932feaa Removed the table-list.json file and support for it; there are better ways of cleaning out extra local tables (see bin/drop-new-tables for a starting point)
- Legacy-Id: 13459
2017-05-30 00:03:26 +00:00
Henrik Levkowetz d8cf039f6a Tweaked the use of the -p otpion of bin/mkrelease. Added sbirkholz@amsl.com to the release email addressees.
- Legacy-Id: 13222
2017-04-14 14:49:05 +00:00
Henrik Levkowetz 02c6692f70 bin/mkrelease bugfix
- Legacy-Id: 13216
2017-04-14 12:35:23 +00:00
Henrik Levkowetz 828cfb89f7 Added a switch to bin/mkrelease to permit mixed data and schema migrations (applicable when the data migrations are as tiny and swift as schema migrations, such as when adding a new entry to a name model).
- Legacy-Id: 13215
2017-04-14 12:33:19 +00:00
Henrik Levkowetz 4c8f47ce73 Trying to re-apply already run migrations after loading a new databases dump runs into the problem that new tables created by the migrations linger, even if the tables loaded from the dump match the non-migrated state. Having lists of the tables matching the latest release available makes it easy to construct an sql command to dump the extra tables, so the migrations can be run. Adding generation and saving of a table list to bin/mkrelease.
- Legacy-Id: 13199
2017-04-12 18:16:19 +00:00
Henrik Levkowetz e557c2113e Merged in [13118] from lars@netapp.com:
Update vnu.jar and fix various HTML5 nits it found during a test crawl.
 - Legacy-Id: 13152
Note: SVN reference [13118] has been migrated to Git commit 76a3c8bdc0
2017-03-27 17:35:38 +00:00
Lars Eggert 76a3c8bdc0 Update vnu.jar and fix various HTML5 nits it found during a test crawl.
Commit ready for merge.
 - Legacy-Id: 13118
2017-03-25 20:21:14 +00:00
Henrik Levkowetz 044b9b8de0 Refined the selection of commit log info lines.
- Legacy-Id: 13110
2017-03-25 18:53:22 +00:00
Henrik Levkowetz 5bb9518b5f Added some new exceptions to the test-crawler; files which are known to not exist, and files with known html character problems.
- Legacy-Id: 13037
2017-03-20 13:46:23 +00:00
Henrik Levkowetz 6f47675f6a Minor tweak
- Legacy-Id: 13029
2017-03-20 11:45:08 +00:00
Henrik Levkowetz 90c61f87ba Added a check to bin/mkrelease, preventing releases with both schema change migrations and data migrations. Data migrations often take some time, which will delay the time between the schema changes and deployment of the matching new code.
- Legacy-Id: 13028
2017-03-20 11:42:50 +00:00
Henrik Levkowetz 7296b951ee Refined the test crawler a bit, to avoid extracting URLs to follow
from html outside the datatracker's control, such as uploaded WG
agendas.  Also excempted some pages with known-bad character issues
from html validation, and refined the error reporting for html
validation failures.
 - Legacy-Id: 13027
2017-03-19 19:34:50 +00:00
Henrik Levkowetz c0bf53101c Tweaked the release script.
- Legacy-Id: 12939
2017-03-01 12:10:15 +00:00
Henrik Levkowetz 135b961b1d Tweaked the release script's bower update part.
- Legacy-Id: 12914
2017-02-24 10:43:17 +00:00
Henrik Levkowetz 3ec322a1b9 Added some cleanup after running bower installs.
- Legacy-Id: 12885
2017-02-20 11:30:00 +00:00
Henrik Levkowetz 927685e029 Added some cleanup after running bower installs.
- Legacy-Id: 12884
2017-02-20 11:29:18 +00:00
Henrik Levkowetz 4e2d7252a6 Added some cleanup after running bower installs.
- Legacy-Id: 12883
2017-02-20 11:28:02 +00:00
Henrik Levkowetz a78c419845 Removed a debug print statement.
- Legacy-Id: 12870
2017-02-17 17:53:26 +00:00
Henrik Levkowetz c344a18bdf Fixed an issue with the test-crawler which could cause false positives for urls containing apostrophe.
- Legacy-Id: 12851
2017-02-16 09:58:34 +00:00
Henrik Levkowetz fed57a629b Added updating of static web assets to the release script.
- Legacy-Id: 12784
2017-02-03 00:03:00 +00:00
Henrik Levkowetz 0a7a4ff213 Ignore annoying collectstatic warnings about duplicate files.
- Legacy-Id: 12770
2017-02-01 17:59:51 +00:00
Henrik Levkowetz 84980e53ba Tweaked mergeready
- Legacy-Id: 12571
2016-12-18 14:11:13 +00:00
Henrik Levkowetz f026a46a79 Simplified the release-coverage script.
- Legacy-Id: 12562
2016-12-16 17:52:20 +00:00
Henrik Levkowetz 00a3392192 Enabled invocation of 3 additional scripts from bin/daily (instead of ../scripts/Night-runner)
- Legacy-Id: 12561
2016-12-16 17:51:12 +00:00
Henrik Levkowetz d6df7fb731 Tweaked mergeready to use modules in working dir, and be slightly more verbose when building the mergeinfo cache.
- Legacy-Id: 12536
2016-12-15 16:09:14 +00:00
Henrik Levkowetz 9a3f6b059b Merged Django-1.8 upgrade work to trunk. Adjusted migration names, and added migrations as necessary. Fixed some instances of broken html.
- Legacy-Id: 12507
2016-12-13 05:55:46 +00:00
Henrik Levkowetz 44269f1d73 Added an URL to skip to the test-crawler
- Legacy-Id: 12500
2016-12-09 13:04:22 +00:00
Henrik Levkowetz fde59c1e1e Removed debugging code.
- Legacy-Id: 12420
2016-11-29 22:20:30 +00:00
Henrik Levkowetz bb9741193c Added an url to skip (from an uploaded html agenda).
- Legacy-Id: 12400
2016-11-28 13:38:31 +00:00
Henrik Levkowetz a1bdbaf81e Fixed some issues with mkdevbranch; giving better normalization of the input to uniq, and correctly using the alias list to provide the correct alias for email addresses where localpart should not be used to derive the svn branch name.
- Legacy-Id: 12312
2016-11-08 19:19:45 +00:00
Henrik Levkowetz 927d01fd01 Point at the new virtualenv location in the cron runners.
- Legacy-Id: 12277
2016-11-07 18:39:24 +00:00
Henrik Levkowetz b71c6a022c Removed some actions from bin/mkrelease, as they don't work as intended with the new --system-site-packages virtualenv setup.
- Legacy-Id: 12205
2016-10-21 15:25:02 +00:00
Henrik Levkowetz 831d94e74a Added a code snippet to save the .coverage data for later comparison, if a suitable directory is available.
- Legacy-Id: 12197
2016-10-21 14:28:23 +00:00
Henrik Levkowetz 79e888a755 Fix bug in handling of ghostdriver log path.
- Legacy-Id: 12109
2016-10-08 20:29:09 +00:00
Henrik Levkowetz 2def9f9e67 Added ghostdriver log dir creation
- Legacy-Id: 12108
2016-10-08 20:11:31 +00:00
Henrik Levkowetz 2324254ef0 Fixed typo
- Legacy-Id: 12107
2016-10-08 19:48:24 +00:00
Henrik Levkowetz 23ff0c5d33 Copy settings_local.py from docker dir
- Legacy-Id: 12106
2016-10-08 19:47:29 +00:00
Henrik Levkowetz e0ef65419b First stab at a helper for setting up a minimal test environment on a new host.
- Legacy-Id: 12105
2016-10-08 19:23:20 +00:00
Henrik Levkowetz 8e11c7cb64 Fixed some invalid html, and tweaked the html validation settings in the test crawler.
- Legacy-Id: 12066
2016-09-30 18:47:56 +00:00
Henrik Levkowetz 23d1bc4ed0 Fixed a bug in bin/mkrelease.
- Legacy-Id: 11911
2016-08-31 14:30:14 +00:00
Henrik Levkowetz 24222db8c0 Tweaked mkrelease to place generated release-mail.txt files in their own subdirectory.
- Legacy-Id: 11887
2016-08-26 14:11:45 +00:00
Henrik Levkowetz 1d8fd6ca3d Fixed a bug in the recent bin/mergeready code.
- Legacy-Id: 11870
2016-08-25 11:06:03 +00:00
Henrik Levkowetz e5092bb623 Tweaked the release email text.
- Legacy-Id: 11869
2016-08-25 10:28:48 +00:00
Henrik Levkowetz 4b0a9360f0 Merged in ^/branch/iola/event-saving-refactor-r10291, which refactors document saving to always use doc.save_with_history(events), and requires accompanying events. This branch also provides refactoring of recurring regexes in url patterns into a dictionary. As part of the merge, also refactored new code which didn't use the save_with_history() method.
- Legacy-Id: 11840
2016-08-23 10:52:08 +00:00
Henrik Levkowetz 52c5c0daa0 Merged in [11792] from rcross@amsl.com:
Requests for virtual interim meeting should go directly Scheduled - Waiting for announcement state and an email notification sent to the secretariat.  Fixes issue #1994.
 - Legacy-Id: 11822
Note: SVN reference [11792] has been migrated to Git commit a13b751e1a
2016-08-18 15:03:55 +00:00
Henrik Levkowetz 250af833aa Undid erroneous commit [11820].
- Legacy-Id: 11821
Note: SVN reference [11820] has been migrated to Git commit f497367658
2016-08-18 14:13:06 +00:00
Henrik Levkowetz f497367658 Provide a test materials directory for the bluesheets tests, to avoid dependency on the local directory setup.
- Legacy-Id: 11820
2016-08-18 14:10:28 +00:00
Henrik Levkowetz 446f627164 Tweaked the bin/mergeready logic for showing unmerged commits ahead of commits marked ready to merge.
- Legacy-Id: 11802
2016-08-17 15:22:13 +00:00
Henrik Levkowetz 1dcf7b100b More bin/mergeready bugfixes.
- Legacy-Id: 11790
2016-08-15 19:35:21 +00:00
Henrik Levkowetz 679ec63cf8 Fixed a problem with the latest mergeready enhancement.
- Legacy-Id: 11788
2016-08-15 17:20:20 +00:00
Henrik Levkowetz 36aedda03a Added a check for non-merged commits ahead of commits marked as ready to merge on a branch.
- Legacy-Id: 11776
2016-08-09 20:27:39 +00:00
Henrik Levkowetz 61540ac4bb Carry patches to the production back to trunk.
- Legacy-Id: 11673
2016-07-16 13:33:16 +00:00
Henrik Levkowetz 19fb344082 Updated svn:ignore
- Legacy-Id: 11470
2016-06-24 15:34:11 +00:00
Henrik Levkowetz bb1ef1a447 Tweaked a mkrelease message text.
- Legacy-Id: 11451
2016-06-21 19:24:04 +00:00
Henrik Levkowetz 51779e923f Tweaked the mergedevbranch script.
- Legacy-Id: 11442
2016-06-21 18:55:43 +00:00
Henrik Levkowetz 3d48650c0d Another test-crawler tweak.
- Legacy-Id: 11433
2016-06-20 22:47:04 +00:00
Henrik Levkowetz de0753fa76 Tweaked the test crawler a bit to skip some slow and meaningless checks.
- Legacy-Id: 11431
2016-06-20 22:03:06 +00:00
Henrik Levkowetz dc385ea014 Added a script to be run hourly by cron as user mailman (in order to have permission to access the mailman databases)
- Legacy-Id: 11392
2016-06-16 19:29:24 +00:00
Henrik Levkowetz 6c74ced075 Merged in [11203] from lars@netapp.com:
vnu version 16.5.18.
 - Legacy-Id: 11366
Note: SVN reference [11203] has been migrated to Git commit c91b31cb64
2016-06-14 14:32:39 +00:00
Henrik Levkowetz 5d9ff1de37 Tweaked indentation of inline python in bash script.
- Legacy-Id: 11338
2016-06-13 10:38:37 +00:00
Henrik Levkowetz 802febcc09 Tweaked bin/mkrelease.
- Legacy-Id: 11330
2016-06-12 11:01:02 +00:00
Henrik Levkowetz 22e89a0fb3 Added a tiny script which extracts test coverage figures from the release-coverage.json data.
- Legacy-Id: 11224
2016-05-22 19:29:08 +00:00
Henrik Levkowetz ea4160a709 Applied production patches to trunk.
- Legacy-Id: 11208
2016-05-19 20:03:19 +00:00
Lars Eggert c91b31cb64 vnu version 16.5.18. Commit ready for merge.
- Legacy-Id: 11203
2016-05-18 19:02:42 +00:00
Henrik Levkowetz 32990c027f Make daily and hourly scripts executable
- Legacy-Id: 11194
2016-05-15 16:46:20 +00:00
Henrik Levkowetz 8488d0620f Added a crontab file to be symlinked from /etc/cron.d/, and related scripts to be run from cron. Requires refactoring of CronRunner and NightRunner scripts before activation, to avoid duplicate runs.
- Legacy-Id: 11114
2016-04-08 17:32:18 +00:00
Henrik Levkowetz aab0a565d3 Added a crontab file to be symlinked from /etc/cron.d/, and related scripts to be run from cron. Requires refactoring of CronRunner and NightRunner scripts before activation, to avoid duplicate runs.
- Legacy-Id: 11111
2016-04-08 17:21:50 +00:00
Henrik Levkowetz 87f51a3007 Updated some svn:ignore files.
- Legacy-Id: 10970
2016-03-24 14:03:13 +00:00
Henrik Levkowetz aee36651a5 Tweaked the test-crawler to give the same log line format for exception failures as for regular log lines.
- Legacy-Id: 10936
2016-03-16 13:21:02 +00:00
Henrik Levkowetz 8813bc83fe Tweaked the mkdevbranch utility script to be able to make a branch for one specific developer on request.
- Legacy-Id: 10924
2016-03-15 17:43:04 +00:00
Henrik Levkowetz f1df6a9623 Updated bin/ svn:ignore
- Legacy-Id: 10900
2016-03-05 14:26:59 +00:00
Henrik Levkowetz 1894115c62 Updated svn:ignore list for bin/
- Legacy-Id: 10891
2016-03-04 20:02:47 +00:00
Henrik Levkowetz 1f4f9cc25d Merged in [10685] from lars@netapp.com:
Commit r10578 broke search result table display due to the added column. Fix
this.  (Also update vnu.jar. Unrelated, but wasn't careful when committing.)
 - Legacy-Id: 10689
Note: SVN reference [10685] has been migrated to Git commit 820d406e33
2016-01-14 17:47:27 +00:00
Henrik Levkowetz 41c47b30ad Merged in [10684] from lars@netapp.com:
Add warning about the accuracy of bibliographic information for Legacy RFCs.
 - Legacy-Id: 10688
Note: SVN reference [10684] has been migrated to Git commit 2ca2b92c24
2016-01-14 17:33:50 +00:00
Henrik Levkowetz d0b99b03b5 Merged in [10540] from lars@netapp.com:
Update vnu HTML5 validator, and fix an HTML nit it found.
 - Legacy-Id: 10563
Note: SVN reference [10540] has been migrated to Git commit 5866129176
2015-12-09 22:43:37 +00:00
Henrik Levkowetz 862808c3e5 Too good to be true. I don't know what the svn merge command does with -x -b, but id doesn't merge without whitespace changes. Reverting the previous change to bin/mergedevbranch.
- Legacy-Id: 10549
2015-12-08 00:00:58 +00:00
Henrik Levkowetz afd9b70bbd Added the --ignore-space-change switch to both the svn diff and merge commands in bin/mergedevbranch, to avoid spending time on editors that frivolously changes whitespace. Didn't occur to me earlier that the merge command might be able to do this, but it can. Splendid.
- Legacy-Id: 10547
2015-12-07 18:08:01 +00:00
Henrik Levkowetz 041532dc5e Tweaked (normalized) how branches are expressed by bin/mergeready.
- Legacy-Id: 10509
2015-11-19 22:19:42 +00:00
Henrik Levkowetz 145cc4dd61 Updated the mkrelease script to send svn checkout links which specify https://, not http.
- Legacy-Id: 10498
2015-11-16 17:44:11 +00:00
Henrik Levkowetz 5a368acc13 Updated the svn:ignore settings for bin/
- Legacy-Id: 10479
2015-11-14 20:47:20 +00:00
Henrik Levkowetz cc833efbd9 Added handling for an exception which can occur in bin/mergeready if a branch with merge flags is moved, for example moving it to an attic after merge.
- Legacy-Id: 10473
2015-11-14 08:11:33 +00:00
Henrik Levkowetz d709ca6686 Added a python lib upgrade step to the mkrelease script.
- Legacy-Id: 10457
2015-11-09 11:24:36 +00:00
Henrik Levkowetz 693badfd94 Merged in [10379] from rjsparks@nostrum.com:
Change the acronym link on the html agenda page to go to the group's charter page rather than the charter's document page.
 - Legacy-Id: 10409
Note: SVN reference [10379] has been migrated to Git commit bf0a5e3da4
2015-11-03 14:16:44 +00:00
Henrik Levkowetz 7af6fb58f2 Removed jshaffer@asml.com from the release notification list.
- Legacy-Id: 10330
2015-10-28 11:23:45 +00:00
Ole Laursen 86c3a430d1 Merge in ^/branch/iola/event-saving-refactor-r10076, fixing a few problems
- Legacy-Id: 10298
2015-10-27 10:37:06 +00:00
Henrik Levkowetz 6335cf510c Updated mergeready to work with svn 1.9, which seems to return an error for properties which aren't found.
- Legacy-Id: 10266
2015-10-22 19:41:10 +00:00
Henrik Levkowetz 12bc928e80 Updated mkrelease to commit release-coverage.json.gz instead of the plain json file we used earlier.
- Legacy-Id: 10243
2015-10-19 16:04:17 +00:00
Henrik Levkowetz f41553f3d1 Added 2 new file existence checks to the check framework, since we're now reading email aliases for groups and documents from files. Added a call out to run_checks() in the test-crawler, so we don't see failures due to missing files.
- Legacy-Id: 10204
2015-10-13 19:07:11 +00:00
Henrik Levkowetz 72581e92bf Tweaked the mkrelease verbose output some more.
- Legacy-Id: 10178
2015-10-10 10:48:57 +00:00
Henrik Levkowetz 318572ab1e Tweaked the mkrelease verbose output.
- Legacy-Id: 10175
2015-10-10 10:45:48 +00:00
Henrik Levkowetz cfefc0ae58 Changed the default settings for the test crawler from ietf.settings to ietf.settings_testcrawl.
- Legacy-Id: 10120
2015-10-01 20:54:46 +00:00