This is an old revision of the document!

Everything to know about CBSNet

CBSNet is the database computer for the Brewer log form, Brewer Data, Straylight processing and etc.

crontab

The list below shows the different sections used in the crontab a crontab jobs are setup so that they runs a command at is specific time. The format for the crontab job are as follows.

m h  dom mon dow   command
m - minutes
h- hours
dom - day of month
mon - month
dow - day of week

a * can be used as a wild card.

Below is a list of crontab jobs setup on cbsnet

Brewer Support

USER

########Brewer Support######## 00,30 0-3,5-23 * * * /home/cbsnet/schedule_task/rsync.sh 00 4 * * * rsync -vhrltp –exclude-from /home/cbsnet/schedule_task/exclude-list-all.txt -e “ssh -i ”/home/cbsnet/schedule_task/id_depot“” remsens_ext@depot.cmc.ec.gc.ca:/incoming/brewer/ /home/cbsnet/brews/brewnet/Brewers 05,35 * * * * /home/cbsnet/schedule_task/rsync-all.sh 29 10 * * * python3 /home/cbsnet/schedule_task/stray_correction.py -a 0 16 * * * python3 /home/cbsnet/schedule_task/year_mover.py 03,33 * * * * bash /home/cbsnet/schedule_task/rsync_ios.sh 191 187 145 109 017 > ~/temp.log 0 4 * * * /home/cbsnet/schedule_task/sync_program.sh

rsync.sh is a script pulling data near real time data (Look at ~/schedule_task/exclude-list.txt to see what is excluded) from remsens_ext@depot.cmc.ec.gc.ca
rsync-all.sh is a script for pulling all data from remsens_ext@depot.cmc.ec.gc.ca
stray_correction.py is a script that processes straylight correction on the b-file. Files are copied into a stray_light corrected folder in each brewer data folder. The constant used for the straylight correction is pulled from the icf from each of the bfile
year_mover.py is a script that moves old bfile to its corresponding year directory for each brewer
rsync_ios.sh pushes triad and IOS instrument data to IOS' server
sync_program.sh pushes the master and test program directory to remsens_ext@depot.cmc.ec.gc.ca for program auto updates

Brewer Log Forms

USER

########Brewer Log forms######## 0,30 * * * * /home/cbsnet/brews/brewnet/imit/brewer-log-form/scripts/server/push-cache.sh 0 23 * * * /home/cbsnet/brews/brewnet/imit/brewer-log-form/scripts/server/push-update.sh 0 23 * * * rsync -rthv /home/cbsnet/brews/brewnet/imit/brewer-log-form-deploy remsens_ext@depot.cmc.ec.gc.ca:/incoming/brewer_log/update/ -e “ssh -i ”/home/cbsnet/schedule_task/id_depot“” 1 * * * * /home/cbsnet/brews/brewnet/imit/brewer_log_form/import_log_form.sh

Brewer Support Addon

USER

########Brewer Support Add-on######## #59,15,29,45 * * * * /home/cbsnet/eubrew_downloader.py rsit Spectrometer2016 183 157 185 03,33 * * * * bash /home/cbsnet/schedule_task/rsync_ios.sh 191 187 145 > ~/temp.log 15 10 * * * fossil sync -R ~/brews/cbsnet/Brewer_Programs/IOS_Program/brewer.fossil 0 8 * * 1-5 /home/cbsnet/schedule_task/station_ip_update.py 30 4 * * 2 /home/cbsnet/schedule_task/db_backup.sh

IDEAs Database

USER

########Ideas Database######## 10,40 0-3,5-23 * * * /var/www/html/dokuwiki/ideas/loadbfiles.sh 15 4 * * * /var/www/html/dokuwiki/ideas/loadbfiles_subs.sh 30 4 * * * curl http://localhost/dokuwiki/ideas/clean_data.php 40 7 * * * curl http://localhost/dokuwiki/ideas/load-bfiles.php?cscan=1 50 0 * * * curl http://localhost/dokuwiki/ideas/update_master_soft_db.php # 5,35 * * * * curl http://localhost/dokuwiki/ideas/load_pid.php #13 3 15 * * curl http://localhost/dokuwiki/ideas/load_uvsys.php 0 9 * * * curl http://localhost/dokuwiki/ideas/get_fx_rates.php?db=brewpart 33 5 * * * sh /home/cbsnet/schedule_task/wiki_sync.sh 10 * * * * mysql < ~/schedule_task/mysql_sloavg

Brewer Log Form

The Brewer log form's back end deals with hosting the admin section adding/removing/editing operators, Brewers and stations.
These can be access via the following links,
Manage Operators
Manage Stations
Manage Instruments

Canadian Brewer Spectrometer Network

Table of Contents

Everything to know about CBSNet

crontab

Brewer Log Form