User Tools

Site Tools


network

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
network [2020/11/12 16:27] – Added exp-studies sitrnetwork [2020/12/03 13:54] (current) – [Data transfer schedule] mbrohart
Line 6: Line 6:
 ===== Station ===== ===== Station =====
  
-At the station each computer computer typically runs one to two (1-2) Brewer Spectrometer.+At the station each computer computer typically runs one to two (1-2) Brewer Spectrometers.
 Brewer files are saved in the following location Brewer files are saved in the following location
   * Windows¹: C:\Br#xxx   * Windows¹: C:\Br#xxx
Line 12: Line 12:
  
 ==== Data transfer schedule ==== ==== Data transfer schedule ====
-At 25 minute and 55 minute of each hour. +At 25 minutes and 55 minutes past each hour. 
-  * All data files up to 75 days old pushed to exp-studies².+  * All data files up to 75 days old are pushed to exp-studies².
   * Update AVG files at exp-studies².   * Update AVG files at exp-studies².
  
 At 04:00 UTC. At 04:00 UTC.
-  * Station directory is sync with the program master at exp-studies². This will create an exact copy and delete any items that does not exist +  * Station directory is synchronized with the program master at exp-studies². This will create an exact copy and delete any items that do not exist 
   * All data is pushed to exp-studies².   * All data is pushed to exp-studies².
-At 16:00 UTC brewnet_year_mover is ran+At 16:00 UTC brewnet_year_mover³ is ran
  
  
 ===== Experimental Studies ===== ===== Experimental Studies =====
-Experimental Studies (exp-studies) is a server used by the Remote Sensing group for data transferring, data processing and data storage. Exp-studies is used as a middle man for data transfer between the station computers through the firewall into brewnet. +Experimental Studies (exp-studies) is a server used by the Remote Sensing group for data transferring, data processing and data storage. The Exp-studies server is used as a conduit for data transfer between the station computersthrough the firewall, onto our brewnet computer within the EcoNet
  
 Brewer data files are kept at ~/brewnet/Br#xxx Brewer data files are kept at ~/brewnet/Br#xxx
Line 29: Line 29:
 ==== Data transfer schedule ==== ==== Data transfer schedule ====
   * All data transfer from and to exp-studies is done on the station computers or brewnet   * All data transfer from and to exp-studies is done on the station computers or brewnet
-  * At 16:00 UTC brewnet_year_mover is ran+  * At 16:00 UTC brewnet_year_mover³ is ran
   * Bulletin updates every 30 minutes on the hour and 30 minute pass the hour.   * Bulletin updates every 30 minutes on the hour and 30 minute pass the hour.
  
 ==== Bulletin==== ==== Bulletin====
-Exp-studies also host and processes the data for the [[hhttps://exp-studies.tor.ec.gc.ca/~ogyua/bulletins.php|bulletin]]. The bulletin gets updated gets updated every xx:00 and xx:30. The bulletin is a versatile tool with different uses. +Exp-studies also hosts and processes the data for the [[hhttps://exp-studies.tor.ec.gc.ca/~ogyua/bulletins.php|bulletin]]. The bulletin gets updated on the hour (xx:00and half hour (xx:30). The bulletin is a versatile tool with different uses. 
-  * Seeing how old the latest data files are (an indication of there might be an issue with the brewer/computer) +  * Indicates data file age (data latency may be an indication of an issue with the brewer/computer) 
-  * Plots different instrument of the same site together (an indication of how well the instrument is calibrated)+  * Provides plots of different instruments at the same site (an indication of data agreement or outliers)
  
  
 ===== Brewnet ===== ===== Brewnet =====
 +Brewnet is the Brewer Spectrometer server that houses the archived data and other associated documents for all CBSN Brewer Spectrometers.
  
 +Brewer files are located: /home/brewer/brews/brewnet/Brewers/Br#xxx
  
-Notes:\\ +==== Data transfer schedule ==== 
-¹ Window computers are to be discounted and to be replaced Linux computers \\ +On the hour and 30 minutes of each hour. 
-² exp-studies: Experiential studies is the server used to process and host data between station and brewnet.+  * All data files up to 75 days old pulled from exp-studies. 
 +  * Update AVG files from exp-studies. 
 + 
 +At 05:00 UTC. 
 +  * The program master directory on brewnet is copied with an exact copy to exp-studies.  
 +  * All data is pulled from exp-studies². 
 + 
 +At 16:00 UTC brewnet_year_mover³ is ran 
 + 
 + 
 +===== Notes: ===== 
 + 
 +¹ Window computers are to be discontinued and to be replaced Linux computers \\ 
 +² exp-studies: Experiential studies is the server used to process and host data between station and brewnet.\\ 
 +³ brewnet_year_mover is a python program that moves any data files older than 75 days into a archived year directory(I.E. 2019, 2020...)
network.1605198448.txt.gz · Last modified: 2020/11/16 13:55 (external edit)