altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 3 Packages Projects Releases Wiki Activity
9243 commits 1 branch 0 tags 2.6 GiB
Commit graph

200 commits

Author SHA1 Message Date
Henrik Levkowetz fde59c1e1e Removed debugging code. 
- Legacy-Id: 12420
 2016-11-29 22:20:30 +00:00
Henrik Levkowetz bb9741193c Added an url to skip (from an uploaded html agenda). 
- Legacy-Id: 12400
 2016-11-28 13:38:31 +00:00
Henrik Levkowetz a1bdbaf81e Fixed some issues with mkdevbranch; giving better normalization of the input to uniq, and correctly using the alias list to provide the correct alias for email addresses where localpart should not be used to derive the svn branch name. 
- Legacy-Id: 12312
 2016-11-08 19:19:45 +00:00
Henrik Levkowetz 927d01fd01 Point at the new virtualenv location in the cron runners. 
- Legacy-Id: 12277
 2016-11-07 18:39:24 +00:00
Henrik Levkowetz b71c6a022c Removed some actions from bin/mkrelease, as they don't work as intended with the new --system-site-packages virtualenv setup. 
- Legacy-Id: 12205
 2016-10-21 15:25:02 +00:00
Henrik Levkowetz 831d94e74a Added a code snippet to save the .coverage data for later comparison, if a suitable directory is available. 
- Legacy-Id: 12197
 2016-10-21 14:28:23 +00:00
Henrik Levkowetz 79e888a755 Fix bug in handling of ghostdriver log path. 
- Legacy-Id: 12109
 2016-10-08 20:29:09 +00:00
Henrik Levkowetz 2def9f9e67 Added ghostdriver log dir creation 
- Legacy-Id: 12108
 2016-10-08 20:11:31 +00:00
Henrik Levkowetz 2324254ef0 Fixed typo 
- Legacy-Id: 12107
 2016-10-08 19:48:24 +00:00
Henrik Levkowetz 23ff0c5d33 Copy settings_local.py from docker dir 
- Legacy-Id: 12106
 2016-10-08 19:47:29 +00:00
Henrik Levkowetz e0ef65419b First stab at a helper for setting up a minimal test environment on a new host. 
- Legacy-Id: 12105
 2016-10-08 19:23:20 +00:00
Henrik Levkowetz 8e11c7cb64 Fixed some invalid html, and tweaked the html validation settings in the test crawler. 
- Legacy-Id: 12066
 2016-09-30 18:47:56 +00:00
Henrik Levkowetz 23d1bc4ed0 Fixed a bug in bin/mkrelease. 
- Legacy-Id: 11911
 2016-08-31 14:30:14 +00:00
Henrik Levkowetz 24222db8c0 Tweaked mkrelease to place generated release-mail.txt files in their own subdirectory. 
- Legacy-Id: 11887
 2016-08-26 14:11:45 +00:00
Henrik Levkowetz 1d8fd6ca3d Fixed a bug in the recent bin/mergeready code. 
- Legacy-Id: 11870
 2016-08-25 11:06:03 +00:00
Henrik Levkowetz e5092bb623 Tweaked the release email text. 
- Legacy-Id: 11869
 2016-08-25 10:28:48 +00:00
Henrik Levkowetz 4b0a9360f0 Merged in ^/branch/iola/event-saving-refactor-r10291, which refactors document saving to always use doc.save_with_history(events), and requires accompanying events. This branch also provides refactoring of recurring regexes in url patterns into a dictionary. As part of the merge, also refactored new code which didn't use the save_with_history() method. 
- Legacy-Id: 11840
 2016-08-23 10:52:08 +00:00
Henrik Levkowetz 52c5c0daa0 Merged in [11792] from rcross@amsl.com: 
Requests for virtual interim meeting should go directly Scheduled - Waiting for announcement state and an email notification sent to the secretariat.  Fixes issue #1994.
 - Legacy-Id: 11822
Note: SVN reference [11792] has been migrated to Git commit a13b751e1a
 2016-08-18 15:03:55 +00:00
Henrik Levkowetz 250af833aa Undid erroneous commit [11820]. 
- Legacy-Id: 11821
Note: SVN reference [11820] has been migrated to Git commit f497367658
 2016-08-18 14:13:06 +00:00
Henrik Levkowetz f497367658 Provide a test materials directory for the bluesheets tests, to avoid dependency on the local directory setup. 
- Legacy-Id: 11820
 2016-08-18 14:10:28 +00:00
Henrik Levkowetz 446f627164 Tweaked the bin/mergeready logic for showing unmerged commits ahead of commits marked ready to merge. 
- Legacy-Id: 11802
 2016-08-17 15:22:13 +00:00
Henrik Levkowetz 1dcf7b100b More bin/mergeready bugfixes. 
- Legacy-Id: 11790
 2016-08-15 19:35:21 +00:00
Henrik Levkowetz 679ec63cf8 Fixed a problem with the latest mergeready enhancement. 
- Legacy-Id: 11788
 2016-08-15 17:20:20 +00:00
Henrik Levkowetz 36aedda03a Added a check for non-merged commits ahead of commits marked as ready to merge on a branch. 
- Legacy-Id: 11776
 2016-08-09 20:27:39 +00:00
Henrik Levkowetz 61540ac4bb Carry patches to the production back to trunk. 
- Legacy-Id: 11673
 2016-07-16 13:33:16 +00:00
Henrik Levkowetz 19fb344082 Updated svn:ignore 
- Legacy-Id: 11470
 2016-06-24 15:34:11 +00:00
Henrik Levkowetz bb1ef1a447 Tweaked a mkrelease message text. 
- Legacy-Id: 11451
 2016-06-21 19:24:04 +00:00
Henrik Levkowetz 51779e923f Tweaked the mergedevbranch script. 
- Legacy-Id: 11442
 2016-06-21 18:55:43 +00:00
Henrik Levkowetz 3d48650c0d Another test-crawler tweak. 
- Legacy-Id: 11433
 2016-06-20 22:47:04 +00:00
Henrik Levkowetz de0753fa76 Tweaked the test crawler a bit to skip some slow and meaningless checks. 
- Legacy-Id: 11431
 2016-06-20 22:03:06 +00:00
Henrik Levkowetz dc385ea014 Added a script to be run hourly by cron as user mailman (in order to have permission to access the mailman databases) 
- Legacy-Id: 11392
 2016-06-16 19:29:24 +00:00
Henrik Levkowetz 6c74ced075 Merged in [11203] from lars@netapp.com: 
vnu version 16.5.18.
 - Legacy-Id: 11366
Note: SVN reference [11203] has been migrated to Git commit c91b31cb64
 2016-06-14 14:32:39 +00:00
Henrik Levkowetz 5d9ff1de37 Tweaked indentation of inline python in bash script. 
- Legacy-Id: 11338
 2016-06-13 10:38:37 +00:00
Henrik Levkowetz 802febcc09 Tweaked bin/mkrelease. 
- Legacy-Id: 11330
 2016-06-12 11:01:02 +00:00
Henrik Levkowetz 22e89a0fb3 Added a tiny script which extracts test coverage figures from the release-coverage.json data. 
- Legacy-Id: 11224
 2016-05-22 19:29:08 +00:00
Henrik Levkowetz ea4160a709 Applied production patches to trunk. 
- Legacy-Id: 11208
 2016-05-19 20:03:19 +00:00
Lars Eggert c91b31cb64 vnu version 16.5.18. Commit ready for merge. 
- Legacy-Id: 11203
 2016-05-18 19:02:42 +00:00
Henrik Levkowetz 32990c027f Make daily and hourly scripts executable 
- Legacy-Id: 11194
 2016-05-15 16:46:20 +00:00
Henrik Levkowetz 8488d0620f Added a crontab file to be symlinked from /etc/cron.d/, and related scripts to be run from cron. Requires refactoring of CronRunner and NightRunner scripts before activation, to avoid duplicate runs. 
- Legacy-Id: 11114
 2016-04-08 17:32:18 +00:00
Henrik Levkowetz aab0a565d3 Added a crontab file to be symlinked from /etc/cron.d/, and related scripts to be run from cron. Requires refactoring of CronRunner and NightRunner scripts before activation, to avoid duplicate runs. 
- Legacy-Id: 11111
 2016-04-08 17:21:50 +00:00
Henrik Levkowetz 87f51a3007 Updated some svn:ignore files. 
- Legacy-Id: 10970
 2016-03-24 14:03:13 +00:00
Henrik Levkowetz aee36651a5 Tweaked the test-crawler to give the same log line format for exception failures as for regular log lines. 
- Legacy-Id: 10936
 2016-03-16 13:21:02 +00:00
Henrik Levkowetz 8813bc83fe Tweaked the mkdevbranch utility script to be able to make a branch for one specific developer on request. 
- Legacy-Id: 10924
 2016-03-15 17:43:04 +00:00
Henrik Levkowetz f1df6a9623 Updated bin/ svn:ignore 
- Legacy-Id: 10900
 2016-03-05 14:26:59 +00:00
Henrik Levkowetz 1894115c62 Updated svn:ignore list for bin/ 
- Legacy-Id: 10891
 2016-03-04 20:02:47 +00:00
Henrik Levkowetz 1f4f9cc25d Merged in [10685] from lars@netapp.com: 
Commit r10578 broke search result table display due to the added column. Fix
this.  (Also update vnu.jar. Unrelated, but wasn't careful when committing.)
 - Legacy-Id: 10689
Note: SVN reference [10685] has been migrated to Git commit 820d406e33
 2016-01-14 17:47:27 +00:00
Henrik Levkowetz 41c47b30ad Merged in [10684] from lars@netapp.com: 
Add warning about the accuracy of bibliographic information for Legacy RFCs.
 - Legacy-Id: 10688
Note: SVN reference [10684] has been migrated to Git commit 2ca2b92c24
 2016-01-14 17:33:50 +00:00
Henrik Levkowetz d0b99b03b5 Merged in [10540] from lars@netapp.com: 
Update vnu HTML5 validator, and fix an HTML nit it found.
 - Legacy-Id: 10563
Note: SVN reference [10540] has been migrated to Git commit 5866129176
 2015-12-09 22:43:37 +00:00
Henrik Levkowetz 862808c3e5 Too good to be true. I don't know what the svn merge command does with -x -b, but id doesn't merge without whitespace changes. Reverting the previous change to bin/mergedevbranch. 
- Legacy-Id: 10549
 2015-12-08 00:00:58 +00:00
Henrik Levkowetz afd9b70bbd Added the --ignore-space-change switch to both the svn diff and merge commands in bin/mergedevbranch, to avoid spending time on editors that frivolously changes whitespace. Didn't occur to me earlier that the merge command might be able to do this, but it can. Splendid. 
- Legacy-Id: 10547
 2015-12-07 18:08:01 +00:00
Henrik Levkowetz 041532dc5e Tweaked (normalized) how branches are expressed by bin/mergeready. 
- Legacy-Id: 10509
 2015-11-19 22:19:42 +00:00
Henrik Levkowetz 145cc4dd61 Updated the mkrelease script to send svn checkout links which specify https://, not http. 
- Legacy-Id: 10498
 2015-11-16 17:44:11 +00:00
Henrik Levkowetz 5a368acc13 Updated the svn:ignore settings for bin/ 
- Legacy-Id: 10479
 2015-11-14 20:47:20 +00:00
Henrik Levkowetz cc833efbd9 Added handling for an exception which can occur in bin/mergeready if a branch with merge flags is moved, for example moving it to an attic after merge. 
- Legacy-Id: 10473
 2015-11-14 08:11:33 +00:00
Henrik Levkowetz d709ca6686 Added a python lib upgrade step to the mkrelease script. 
- Legacy-Id: 10457
 2015-11-09 11:24:36 +00:00
Henrik Levkowetz 693badfd94 Merged in [10379] from rjsparks@nostrum.com: 
Change the acronym link on the html agenda page to go to the group's charter page rather than the charter's document page.
 - Legacy-Id: 10409
Note: SVN reference [10379] has been migrated to Git commit bf0a5e3da4
 2015-11-03 14:16:44 +00:00
Henrik Levkowetz 7af6fb58f2 Removed jshaffer@asml.com from the release notification list. 
- Legacy-Id: 10330
 2015-10-28 11:23:45 +00:00
Ole Laursen 86c3a430d1 Merge in ^/branch/iola/event-saving-refactor-r10076, fixing a few problems 
- Legacy-Id: 10298
 2015-10-27 10:37:06 +00:00
Henrik Levkowetz 6335cf510c Updated mergeready to work with svn 1.9, which seems to return an error for properties which aren't found. 
- Legacy-Id: 10266
 2015-10-22 19:41:10 +00:00
Henrik Levkowetz 12bc928e80 Updated mkrelease to commit release-coverage.json.gz instead of the plain json file we used earlier. 
- Legacy-Id: 10243
 2015-10-19 16:04:17 +00:00
Henrik Levkowetz f41553f3d1 Added 2 new file existence checks to the check framework, since we're now reading email aliases for groups and documents from files. Added a call out to run_checks() in the test-crawler, so we don't see failures due to missing files. 
- Legacy-Id: 10204
 2015-10-13 19:07:11 +00:00
Henrik Levkowetz 72581e92bf Tweaked the mkrelease verbose output some more. 
- Legacy-Id: 10178
 2015-10-10 10:48:57 +00:00
Henrik Levkowetz 318572ab1e Tweaked the mkrelease verbose output. 
- Legacy-Id: 10175
 2015-10-10 10:45:48 +00:00
Henrik Levkowetz cfefc0ae58 Changed the default settings for the test crawler from ietf.settings to ietf.settings_testcrawl. 
- Legacy-Id: 10120
 2015-10-01 20:54:46 +00:00
Ole Laursen 5e4645d7d2 Summary: Trim the test-crawl imports 
- Legacy-Id: 10107
 2015-09-29 13:21:24 +00:00
Henrik Levkowetz 9c297767cc Added branch/iola to places checked for 'ready for merge' tags in the commit messages. 
- Legacy-Id: 10065
 2015-08-27 11:55:21 +00:00
Henrik Levkowetz fb66c1856f Merged in [9669] from olau@iola.dk: 
Summary: Make the meeting agenda code use the historic info available
for groups. In the process, added some select_related/prefetch_related
code to cut the number of database queries in the agenda down from
4000-5000 to about 50. Rewritten agenda CSV code to use Python arrays
rather than a template for improved readability/reuse. Rewritten week
view to assemble its data in Python. Plus a few other minor cleanups,
e.g. lame_description is now gone.
Fixes #1088. Branch
 - Legacy-Id: 10005
Note: SVN reference [9669] has been migrated to Git commit acda84208d
 2015-08-10 19:46:11 +00:00
Henrik Levkowetz 6c253ee48b Improved the verification of submitted file extensions and mimetype. 
- Legacy-Id: 9986
 2015-08-07 12:10:26 +00:00
Henrik Levkowetz 11411d2c30 Merged in an update from trunk@9942. 
- Legacy-Id: 9961
 2015-08-03 14:12:38 +00:00
Henrik Levkowetz f48452853f Changed test-crawl to avoid unnecessary repetitions of the blacklisting message. 
- Legacy-Id: 9933
 2015-08-01 12:47:03 +00:00
Henrik Levkowetz 948804f73f Added static javascript and image files to the URLs crawled by the test-crawler. 
- Legacy-Id: 9913
 2015-07-29 17:03:32 +00:00
Henrik Levkowetz 224fef557c Added a --random switch to choose between different test-crawler modes. 
- Legacy-Id: 9893
 2015-07-27 16:52:26 +00:00
Henrik Levkowetz 4c4ff0f0cb Updated mkrelease to support use of the bower_install and collectstatic commands. 
- Legacy-Id: 9890
 2015-07-26 18:16:20 +00:00
Henrik Levkowetz 8612ce92c0 Merged in [9765] from lars@netapp.com: 
Add option to crawl as a logged-in user (--user).
Add --pedantic option for vnu crawl, which stops the crawl on (most) errors.
Randomize the order in which URLs are crawled, so that repeated crawls don't
hit the same URLs in the same order.
 - Legacy-Id: 9785
Note: SVN reference [9765] has been migrated to Git commit 9b4e61049a704127e1200549fcc410326efffddb
 2015-07-18 12:00:37 +00:00
Henrik Levkowetz ed66e24e7c Merged in [9726] from lars@netapp.com: 
Add HTML5 validation based on validator.nu to test-crawl.
 - Legacy-Id: 9763
Note: SVN reference [9726] has been migrated to Git commit 5826bcbf80
 2015-07-18 08:20:35 +00:00
Lars Eggert 5826bcbf80 Add HTML5 validation based on validator.nu to test-crawl. Commit ready for merge. 
- Legacy-Id: 9726
 2015-07-15 12:41:09 +00:00
Henrik Levkowetz 6158832e74 Tweaked bin/mkrelease. 
- Legacy-Id: 9630
 2015-05-13 17:15:03 +00:00
Henrik Levkowetz b55954295d Updated svn:ignore properties 
- Legacy-Id: 9625
 2015-05-12 09:40:45 +00:00
Henrik Levkowetz 0d572316f9 Tweaked bin/mergedevbranch 
- Legacy-Id: 9622
 2015-05-12 04:57:48 +00:00
Henrik Levkowetz a8907c6e28 Added a check for model changes which haven't been captured in migrations to the release script. 
- Legacy-Id: 9590
 2015-04-30 16:31:08 +00:00
Henrik Levkowetz 926b5831d6 Tweaked the test-crawl summary. 
- Legacy-Id: 9574
 2015-04-27 08:33:36 +00:00
Henrik Levkowetz 60738dc8bd Don't use non-zero exit code for test-crawler runs with nonvalidating html warnings. 
- Legacy-Id: 9559
 2015-04-25 06:36:22 +00:00
Henrik Levkowetz eadf421fc1 Added a new url folding operation for the html verification. 
- Legacy-Id: 9557
 2015-04-24 22:11:34 +00:00
Henrik Levkowetz e32af567ef Added html validation to the test crawler; it will now report html which fails validation with 'WARN' indications. Reorganized the code somewhat, collecting functions, globals, etc. in groups. 
- Legacy-Id: 9549
 2015-04-24 20:30:46 +00:00
Henrik Levkowetz bf6408388c Tweaked bin/mkrelease to be less verbose in svn update. 
- Legacy-Id: 9521
 2015-04-17 20:36:53 +00:00
Henrik Levkowetz 04558234cb Updated release data and mkrelease support, which calculates the release coverage snapshot without invoking tests that developers won't ordinarily be able to run on their laptops/work machines. 
- Legacy-Id: 9339
 2015-03-25 20:06:12 +00:00
Henrik Levkowetz 7c67e26fa4 Added a --logfile switch to the test crawler, in order to be able to control whether a logfile should be used or not. It's not particularly hepful when running on a buildbot slave, which catches stdout anyway. 
- Legacy-Id: 9252
 2015-03-19 20:28:25 +00:00
Henrik Levkowetz f8ce949f4c Merged in [9242] from rjsparks@nostrum.com: 
Restores add-to-community-list functionality to several pages. Fixes #1601.
 - Legacy-Id: 9251
Note: SVN reference [9242] has been migrated to Git commit 02d807581a
 2015-03-19 19:45:14 +00:00
Henrik Levkowetz f94b49036a Updated the mergeready script to check if the 'test:unittest' property has been set to 'passed' on a changeset marked 'ready for merge'. 
- Legacy-Id: 9247
 2015-03-19 17:51:06 +00:00
Henrik Levkowetz 009543c39e Fixed a bug in the --dry-run handling of mkrelease. 
- Legacy-Id: 9204
 2015-03-15 17:25:15 +00:00
Henrik Levkowetz e4a1340974 Tweaked the mkrelease script a bit to use standard python development release numbers. 
- Legacy-Id: 9170
 2015-03-10 20:11:41 +00:00
Henrik Levkowetz 86997e1e95 Turned the api.py file into a module. Moved the makeresources management command to the api module. Added some api tests. Added crawling of api files to the test-crawler. Adjusted some resource files discovered by the test suite and test-crawler. Removed a bunch of empty model files. 
- Legacy-Id: 9144
 2015-03-03 20:23:36 +00:00
Henrik Levkowetz dba3db444c Added test code coverage measurements using coverage.py, integrated as a test in the test suite. This test compares the current code coverage of tests with that saved for the latest release. Also converted the URL and template coverage measurements into tests, comparing current with the latest release. The result of this is that the coverage tests will fail if new code is added without sufficient test coverage to at least match that of the latest release. Over time, this should encourage gradually improved test coverage as seen for both code, templates, and urls. Coverage data is also saved to file, and can be read by the 'coverage' shell command to produce html or text reports. 
- Legacy-Id: 9103
 2015-02-19 23:42:34 +00:00
Henrik Levkowetz 63f8de29d7 Tweaked the mkrelease script to work with svn 1.8, (in addition to previous 1.6). 
- Legacy-Id: 9029
 2015-02-09 20:16:40 +00:00
Henrik Levkowetz 7ecfac6308 Merged in personal/henrik/django-1.7@9020 which upgrades Django from 1.6.0 to 1.7.4 and applies the needed changes to the datatracker code to work with release 1.7.x. 
- Legacy-Id: 9028
 2015-02-08 21:16:44 +00:00
Henrik Levkowetz 028b7e315a Reverted to [9025] because commit [9026] failed (it was incomplete with a broken working dir). 
- Legacy-Id: 9027
Note: SVN reference [9026] has been migrated to Git commit 4a3749a66b
 2015-02-08 20:03:16 +00:00
Henrik Levkowetz 4a3749a66b Merged in personal/henrik/django-1.7@9020 which upgrades Django from 1.6.0 to 1.7.4 and applies the needed changes to the datatracker code to work with release 1.7.x. 
- Legacy-Id: 9026
 2015-02-08 19:16:46 +00:00
Henrik Levkowetz 1210f77604 With django 1.7, standalone scripts need to call django.setup() before doing any operations involving models. Modified all scripts in bin/ and ietf/bin/ which seemed to need it. 
- Legacy-Id: 9017
 2015-02-07 21:13:38 +00:00
Henrik Levkowetz bd2cb8baaa Merged in [8970] from olau@iola.dk: 
Summary: Enable support for a custom settings file for the test crawl
- and add a simple settings file that enables caching to speed up the
crawl (shaves ~35% off most pages AFAICT)
 - Legacy-Id: 8984
Note: SVN reference [8970] has been migrated to Git commit 8d4e1a8528
 2015-02-04 23:17:58 +00:00
Henrik Levkowetz a3a6667cd9 Tweaked the mergedevbranch script. 
- Legacy-Id: 8981
 2015-02-04 22:39:25 +00:00