8d12071bf5
* refactor: Factor out helper from fetch_meeting_attendance.py * feat: Define fetch_meeting_attendance_task task Equivalent to the fetch_meeting_attendance management command * chore: Disable fetch_meeting_attendance in bin/daily * feat: Log errors in fetch_meeting_attendance_task * feat: Enable a result backend for celery Ignore results by default, but enable the backend so we can manage tasks * feat: Define daily task in ietf.utils.tasks * refactor: Make bin/send-review-reminders into a task * refactor: Make bin/send-scheduled-mail into a task * chore: Update copyright years * refactor: Make bin/rfc-editor-index-updates into a task * refactor: Accept date type in rfc index update fn * chore: Update comment * fix: Annotate param as Optional * fix: Revert treating skip_older_than_date as str Misunderstood the comment, "fixed" a non-bug. Oops. * feat: mgmt command to create periodic tasks * feat: add summary of tasks to mgmt cmd * style: black * fix: Remove debug statements * feat: Enable/disable tasks * chore: Disable periodic tasks by default * chore: Revert changes to daily and every15m * fix: Call intended function * chore: Add task descriptions
69 lines
2.2 KiB
Bash
Executable file
69 lines
2.2 KiB
Bash
Executable file
#!/bin/bash
|
|
|
|
# Nightly datatracker jobs.
|
|
#
|
|
# This script is expected to be triggered by cron from
|
|
# /etc/cron.d/datatracker
|
|
export LANG=en_US.UTF-8
|
|
export PYTHONIOENCODING=utf-8
|
|
|
|
# Make sure we stop if something goes wrong:
|
|
program=${0##*/}
|
|
trap 'echo "$program($LINENO): Command failed with error code $? ([$$] $0 $*)"; exit 1' ERR
|
|
|
|
# Datatracker directory
|
|
DTDIR=/a/www/ietf-datatracker/web
|
|
cd $DTDIR/
|
|
|
|
logger -p user.info -t cron "Running $DTDIR/bin/daily"
|
|
|
|
# Run the hourly jobs first
|
|
$DTDIR/bin/hourly
|
|
|
|
# Set up the virtual environment
|
|
source $DTDIR/env/bin/activate
|
|
|
|
|
|
# Update our information about the current version of some commands we use
|
|
$DTDIR/ietf/manage.py update_external_command_info
|
|
|
|
# Get IANA-registered yang models
|
|
#YANG_IANA_DIR=$(python -c 'import ietf.settings; print ietf.settings.SUBMIT_YANG_IANA_MODEL_DIR')
|
|
# Hardcode the rsync target to avoid any unwanted deletes:
|
|
# rsync -avzq --delete rsync.ietf.org::iana/yang-parameters/ /a/www/ietf-ftp/yang/ianamod/
|
|
rsync -avzq --delete /a/www/ietf-ftp/iana/yang-parameters/ /a/www/ietf-ftp/yang/ianamod/
|
|
|
|
# Get Yang models from Yangcatalog.
|
|
rsync -avzq rsync://rsync.yangcatalog.org:10873/yangdeps /a/www/ietf-ftp/yang/catalogmod/
|
|
|
|
# Populate the yang repositories
|
|
$DTDIR/ietf/manage.py populate_yang_model_dirs -v0
|
|
|
|
# Re-run yang checks on active documents
|
|
$DTDIR/ietf/manage.py run_yang_model_checks -v0
|
|
|
|
# Expire Internet-Drafts
|
|
# Enable when removed from /a/www/ietf-datatracker/scripts/Cron-runner:
|
|
$DTDIR/ietf/bin/expire-ids
|
|
|
|
# Send nomcom reminders about nomination acceptance and questionnaires
|
|
$DTDIR/ietf/manage.py send_reminders
|
|
|
|
# Expire last calls
|
|
# Enable when removed from /a/www/ietf-datatracker/scripts/Cron-runner:
|
|
$DTDIR/ietf/bin/expire-last-calls
|
|
|
|
# Run an extended version of the rfc editor update, to catch changes
|
|
# with backdated timestamps
|
|
# Enable when removed from /a/www/ietf-datatracker/scripts/Cron-runner:
|
|
$DTDIR/ietf/bin/rfc-editor-index-updates -d 1969-01-01
|
|
|
|
# Fetch meeting attendance data from ietf.org/registration/attendees
|
|
$DTDIR/ietf/manage.py fetch_meeting_attendance --latest 2
|
|
|
|
# Send reminders originating from the review app
|
|
$DTDIR/ietf/bin/send-review-reminders
|
|
|
|
# Purge older PersonApiKeyEvents
|
|
$DTDIR/ietf/manage.py purge_old_personal_api_key_events 14
|