Commit graph

35 commits

Author SHA1 Message Date
Jennifer Richards a4e0354090
feat: get tool versions without VersionInfo model (#7418)
* feat: get tool versions without VersionInfo model

* chore: remove update_external_command_info call

* feat: get tool version without VersionInfo

* chore: Remove VersionInfo model

* chore: Migration to remove VersionInfo

* fix: handle errors better; ignore stderr

* fix: type annotation
2024-05-14 18:53:31 -05:00
Jennifer Richards 902ff53040
fix: Disable send-review-reminders from bin/daily (#7221)
* fix: Disable send-review-reminders from bin/daily

* fix: Fix typo

Co-authored-by: Robert Sparks <rjsparks@nostrum.com>

---------

Co-authored-by: Robert Sparks <rjsparks@nostrum.com>
2024-03-18 01:05:11 -05:00
Jennifer Richards faa5f9394e
chore: Drop cron jobs replaced by celery tasks (#7105)
* chore: Remove notify-expirations from bin/weekly

* chore: Remove idindex_update from bin/hourly

* chore: Remove rfc-editor-index-updates from bin/daily

* chore: Remove rfc-editor-index-updates from bin/every15m

* chore: Remove celerized tasks from bin/daily

 * ietf/bin/expire-ids
 * ietf/manage.py send_reminders
 * ietf/manage.py fetch_meeting_attendance

* chore: Remove send-scheduled-mail from every15m

Leaves an empty shell of a script...

* chore: Remove iana-*-updates from bin/hourly
2024-02-26 13:51:32 -06:00
Robert Sparks b65389270e
fix: change sync strategy for yc.o modules (#6959) 2024-01-23 10:05:31 -06:00
Jennifer Richards 8d12071bf5
refactor: Move cron jobs to celery tasks (#6926)
* refactor: Factor out helper from fetch_meeting_attendance.py

* feat: Define fetch_meeting_attendance_task task

Equivalent to the fetch_meeting_attendance management command

* chore: Disable fetch_meeting_attendance in bin/daily

* feat: Log errors in fetch_meeting_attendance_task

* feat: Enable a result backend for celery

Ignore results by default, but enable the backend so we
can manage tasks

* feat: Define daily task in ietf.utils.tasks

* refactor: Make bin/send-review-reminders into a task

* refactor: Make bin/send-scheduled-mail into a task

* chore: Update copyright years

* refactor: Make bin/rfc-editor-index-updates into a task

* refactor: Accept date type in rfc index update fn

* chore: Update comment

* fix: Annotate param as Optional

* fix: Revert treating skip_older_than_date as str

Misunderstood the comment, "fixed" a non-bug. Oops.

* feat: mgmt command to create periodic tasks

* feat: add summary of tasks to mgmt cmd

* style: black

* fix: Remove debug statements

* feat: Enable/disable tasks

* chore: Disable periodic tasks by default

* chore: Revert changes to daily and every15m

* fix: Call intended function

* chore: Add task descriptions
2024-01-22 12:04:16 -06:00
Robert Sparks 40765d878f
chore: adjust to DNS changes for yangcatalog (#5666) 2023-05-22 13:28:58 -05:00
Lars Eggert f8b48f4c43
fix: use Internet-Draft more consistently across the UI (#5104)
* s/Internet Draft/Internet-Draft/i

* s/draft/Internet-Draft/i or s/draft/I-D/i

* s/ID/I-D/

* Fix tests

* a -> an

* Undo case-change to ASCII

* Address code review comments

* Add migrations

* Add merged migration

* fix: straighten out migrations

* fix: finish straightening out migrations

---------

Co-authored-by: Robert Sparks <rjsparks@nostrum.com>
2023-02-11 10:09:28 -06:00
Robert Sparks d4bb116a5b Update bin/daily to adjust for the change in exposing the iana mirror. Commit ready for merge.
- Legacy-Id: 19100
2021-06-09 15:18:02 +00:00
Robert Sparks fce86df3dc Add PersonalApiKeyEvent purge to bin/daily. Commit ready to merge.
- Legacy-Id: 19033
2021-05-25 15:31:10 +00:00
Henrik Levkowetz 25e644d0e2 Added support for pulling yang modules from yangcatalog.org.
- Legacy-Id: 18141
2020-07-08 18:44:56 +00:00
Henrik Levkowetz 0924640676 Removed the command to purge request_profiler entries, given that request_profiler is incompatible with Django 2.2
- Legacy-Id: 18107
2020-06-30 14:34:15 +00:00
Henrik Levkowetz 4da5fd4e7d Changed how long we hang on to request profiler records to 2 days.
- Legacy-Id: 17780
2020-05-12 10:57:21 +00:00
Henrik Levkowetz 6fb2017e96 Moved the call to notify-expirations from bin/daily to bin/weekly
- Legacy-Id: 17778
2020-05-11 14:45:57 +00:00
Henrik Levkowetz 5e6bb4a44f Added missing notify-expirations script to bin/daily
- Legacy-Id: 17777
2020-05-11 14:42:35 +00:00
Henrik Levkowetz 78963ecdef Added request profiler and a management command to purge profiler records.
- Legacy-Id: 17648
2020-04-15 20:48:08 +00:00
Henrik Levkowetz d9b11f31d9 More Py2/3 adaptations fetched from production.
- Legacy-Id: 17333
2020-02-23 16:27:30 +00:00
Henrik Levkowetz cf56beb8cc Cronjob script changes pulled from the production server after the switch to python 3.
- Legacy-Id: 17326
2020-02-23 01:28:16 +00:00
Henrik Levkowetz 293e505bbb Hardcoded an rsync target path, and added a bash trap for errors in hourly and daily cron scripts.
- Legacy-Id: 17264
2020-01-28 15:41:47 +00:00
Henrik Levkowetz 445afbe5c5 Hardcoded an rsync target path, and added a bash trap for errors in hourly and daily cron scripts.
- Legacy-Id: 17263
2020-01-28 15:40:42 +00:00
Sasha Romijn 296b126c70 Ref #2231 - Fix send-review-reminders and add it to daily cron
This fixes a syntax error and a Python 3 incompatibility, and adds
send-review-reminders to the daily cron script.

Important notes:
- I have not tested to what degree the existing reminders work as they
  should, as that's out of scope. It does have tests.
- I can't assess whether the virtualenv activation works in the
  production setup, and it may be obsolete as bin/daily also
  activates the virtualenv.
- The same Python 3 incompatibility (execfile() no longer exists) seems
  to exist in various other scripts.
  
Commit ready for merge.
 - Legacy-Id: 16703
2019-09-05 10:50:39 +00:00
Henrik Levkowetz 310741f2a2 Changes to make the bin/daily cron script quiteter.
- Legacy-Id: 16356
2019-07-01 18:30:00 +00:00
Henrik Levkowetz 6a69551e33 The nomcom send_reminders command was not being run daily. Fixed that.
- Legacy-Id: 15519
2018-10-03 12:22:11 +00:00
Henrik Levkowetz 780c71aed2 Tweaked the rsync arguments for IANA YANG models.
- Legacy-Id: 15284
2018-07-04 20:28:52 +00:00
Henrik Levkowetz 6567e707ce Merged in ^/personal/henrik/6.64.2-ballotapi@14426. This provides personal API keys and a ballot position API at /api/iesg/position. Also added an endpoint description at /api/.
- Legacy-Id: 14430
2017-12-17 23:43:44 +00:00
Henrik Levkowetz 383b8b16b9 Corrected daily and hourly cron script descriptions.
- Legacy-Id: 14425
2017-12-16 18:27:06 +00:00
Henrik Levkowetz 47a0b9d3ce Changed handling of yang modeules from drafts with errors, to not place them in separate directories, due to possible follow-on effects. Added use of IANA-held modules when validating, and regular rsyncing from IANA.
- Legacy-Id: 14389
2017-12-04 14:37:15 +00:00
Henrik Levkowetz fe7d484e27 Added the necessary switch argument for the registration importer's --latest switch.
- Legacy-Id: 13960
2017-07-21 12:55:27 +00:00
Henrik Levkowetz d98054c103 Added a new yang checker, 'yanglint', to the existing Yang checker class, in
addition to the existing 'pyang' checker.

Added modal overlay displays showing the yang check results every place the
yin/yang symbol is shown (red or green) to indicate the presencee and result
of yang checks.  Added a Yang Validation: line in the document
meta-information section on the document's page in the datatracker.

Added the result of the xym extaction to the yang check results, to make
extration failures visible.

Added the version of the used xym, pyang, and yanglint commands to the check
results.

Added an action to move successfully extracted and validated modules to the
module library directories immediately on submission.

Added the xym and pyang repositories as svn:external components, rather than
listing them in requirements.txt, as there has been delays of many months
between essential features in the repositories, and an actual release.  We may
get occasional buildbot failures if broken code is pulled in from the
repository, but better that than the functionality failure of severely
outdated componets.

Added a new management command to re-run yang validation for active drafts for
which yang modules were found at submission time, in order to pick up imported
models which may have arrived in the model libraries after the draft's
submission.  Run daily from bin/daily.

Added a table to hold version information for external commands.  The yang
checker output should include the version information of the used checkers,
but seems unnecessary to run each command with its --version switch every
time we check a module...

Added a new management command to collect version information for external
commands on demand.  To be run daily from bin/daily.

Added tests to verify that xym, pyang and yanglint information is available
on the submission confirmation page, and updated the yang module contained in
the test document to validate under both pyang and yanglint.

Updated admin.py and resource.py files as needed.
 - Legacy-Id: 13630
2017-06-15 16:09:28 +00:00
Henrik Levkowetz 219c3015d7 Added the meeting attendance fetcher to the daily cronjobs
- Legacy-Id: 13491
2017-06-01 20:58:54 +00:00
Henrik Levkowetz 00a3392192 Enabled invocation of 3 additional scripts from bin/daily (instead of ../scripts/Night-runner)
- Legacy-Id: 12561
2016-12-16 17:51:12 +00:00
Henrik Levkowetz 927d01fd01 Point at the new virtualenv location in the cron runners.
- Legacy-Id: 12277
2016-11-07 18:39:24 +00:00
Henrik Levkowetz ea4160a709 Applied production patches to trunk.
- Legacy-Id: 11208
2016-05-19 20:03:19 +00:00
Henrik Levkowetz 32990c027f Make daily and hourly scripts executable
- Legacy-Id: 11194
2016-05-15 16:46:20 +00:00
Henrik Levkowetz 8488d0620f Added a crontab file to be symlinked from /etc/cron.d/, and related scripts to be run from cron. Requires refactoring of CronRunner and NightRunner scripts before activation, to avoid duplicate runs.
- Legacy-Id: 11114
2016-04-08 17:32:18 +00:00
Henrik Levkowetz aab0a565d3 Added a crontab file to be symlinked from /etc/cron.d/, and related scripts to be run from cron. Requires refactoring of CronRunner and NightRunner scripts before activation, to avoid duplicate runs.
- Legacy-Id: 11111
2016-04-08 17:21:50 +00:00