altf4arnold/datatracker
1
0
Fork 0
Code Issues Pull requests Actions 3 Packages Projects Releases Wiki Activity
6075 commits 1 branch 0 tags 2.6 GiB
Commit graph

21 commits

Author SHA1 Message Date
Henrik Levkowetz 11411d2c30 Merged in an update from trunk@9942. 
- Legacy-Id: 9961
 2015-08-03 14:12:38 +00:00
Henrik Levkowetz f48452853f Changed test-crawl to avoid unnecessary repetitions of the blacklisting message. 
- Legacy-Id: 9933
 2015-08-01 12:47:03 +00:00
Henrik Levkowetz 948804f73f Added static javascript and image files to the URLs crawled by the test-crawler. 
- Legacy-Id: 9913
 2015-07-29 17:03:32 +00:00
Henrik Levkowetz 224fef557c Added a --random switch to choose between different test-crawler modes. 
- Legacy-Id: 9893
 2015-07-27 16:52:26 +00:00
Henrik Levkowetz 8612ce92c0 Merged in [9765] from lars@netapp.com: 
Add option to crawl as a logged-in user (--user).
Add --pedantic option for vnu crawl, which stops the crawl on (most) errors.
Randomize the order in which URLs are crawled, so that repeated crawls don't
hit the same URLs in the same order.
 - Legacy-Id: 9785
Note: SVN reference [9765] has been migrated to Git commit 9b4e61049a704127e1200549fcc410326efffddb
 2015-07-18 12:00:37 +00:00
Henrik Levkowetz ed66e24e7c Merged in [9726] from lars@netapp.com: 
Add HTML5 validation based on validator.nu to test-crawl.
 - Legacy-Id: 9763
Note: SVN reference [9726] has been migrated to Git commit 5826bcbf80
 2015-07-18 08:20:35 +00:00
Lars Eggert 5826bcbf80 Add HTML5 validation based on validator.nu to test-crawl. Commit ready for merge. 
- Legacy-Id: 9726
 2015-07-15 12:41:09 +00:00
Henrik Levkowetz 926b5831d6 Tweaked the test-crawl summary. 
- Legacy-Id: 9574
 2015-04-27 08:33:36 +00:00
Henrik Levkowetz 60738dc8bd Don't use non-zero exit code for test-crawler runs with nonvalidating html warnings. 
- Legacy-Id: 9559
 2015-04-25 06:36:22 +00:00
Henrik Levkowetz eadf421fc1 Added a new url folding operation for the html verification. 
- Legacy-Id: 9557
 2015-04-24 22:11:34 +00:00
Henrik Levkowetz e32af567ef Added html validation to the test crawler; it will now report html which fails validation with 'WARN' indications. Reorganized the code somewhat, collecting functions, globals, etc. in groups. 
- Legacy-Id: 9549
 2015-04-24 20:30:46 +00:00
Henrik Levkowetz 7c67e26fa4 Added a --logfile switch to the test crawler, in order to be able to control whether a logfile should be used or not. It's not particularly hepful when running on a buildbot slave, which catches stdout anyway. 
- Legacy-Id: 9252
 2015-03-19 20:28:25 +00:00
Henrik Levkowetz 86997e1e95 Turned the api.py file into a module. Moved the makeresources management command to the api module. Added some api tests. Added crawling of api files to the test-crawler. Adjusted some resource files discovered by the test suite and test-crawler. Removed a bunch of empty model files. 
- Legacy-Id: 9144
 2015-03-03 20:23:36 +00:00
Henrik Levkowetz 7ecfac6308 Merged in personal/henrik/django-1.7@9020 which upgrades Django from 1.6.0 to 1.7.4 and applies the needed changes to the datatracker code to work with release 1.7.x. 
- Legacy-Id: 9028
 2015-02-08 21:16:44 +00:00
Henrik Levkowetz 028b7e315a Reverted to [9025] because commit [9026] failed (it was incomplete with a broken working dir). 
- Legacy-Id: 9027
Note: SVN reference [9026] has been migrated to Git commit 4a3749a66b
 2015-02-08 20:03:16 +00:00
Henrik Levkowetz 4a3749a66b Merged in personal/henrik/django-1.7@9020 which upgrades Django from 1.6.0 to 1.7.4 and applies the needed changes to the datatracker code to work with release 1.7.x. 
- Legacy-Id: 9026
 2015-02-08 19:16:46 +00:00
Henrik Levkowetz 1210f77604 With django 1.7, standalone scripts need to call django.setup() before doing any operations involving models. Modified all scripts in bin/ and ietf/bin/ which seemed to need it. 
- Legacy-Id: 9017
 2015-02-07 21:13:38 +00:00
Henrik Levkowetz bd2cb8baaa Merged in [8970] from olau@iola.dk: 
Summary: Enable support for a custom settings file for the test crawl
- and add a simple settings file that enables caching to speed up the
crawl (shaves ~35% off most pages AFAICT)
 - Legacy-Id: 8984
Note: SVN reference [8970] has been migrated to Git commit 8d4e1a8528
 2015-02-04 23:17:58 +00:00
Henrik Levkowetz 1834a4142f Tweaked the test crawler to put the same information into the log as on screen. 
- Legacy-Id: 8642
 2014-11-11 22:09:55 +00:00
Henrik Levkowetz 7bb5c69828 Updated the path handling in test-crawl to match its new location. 
- Legacy-Id: 8464
 2014-10-24 12:21:57 +00:00
Henrik Levkowetz fd82d280e6 Moved the location of the test-crawler, to co-reside with other code and release management scripts. 
- Legacy-Id: 8463
 2014-10-24 12:20:22 +00:00
Renamed from ietf/bin/test-crawl (Browse further)