C:\Windows\System32>REM don't have two rsyncs running C:\Windows\System32>REM ************ CLKotnik Remove this so it will run ******* 230125 C:\Windows\System32>REM tasklist | find "rsync.exe">NUL C:\Windows\System32>REM if "0"=="0" exit C:\Windows\System32>REM *********************** C:\Windows\System32>REM bsm_tmo61 C:\Windows\System32>REM ** This script relies on a number of environment variable C:\Windows\System32>REM ** being set to specific directory paths. These are contained C:\Windows\System32>REM ** in environ.bat in this same directory. That script uses C:\Windows\System32>REM ** "setx" instead of "set" so they go into the permanent C:\Windows\System32>REM ** environment and survive a reboot. environ.bat is run C:\Windows\System32>ReM ** manually in a CMD window as needed. NOTE: the environment C:\Windows\System32>REM ** is NOT changed for the CMD window environ.bat is run in. C:\Windows\System32>REM ** It will be changes for all future commands. C:\Windows\System32>echo on C:\Windows\System32>cd c:\Data\Plans\Scripts c:\Data\Plans\Scripts>REM Get the datenite into an environment variable c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\get_datenite.py -1 c:\Data\Plans\Scripts>set /p DATENITE= 0set DATENITE8=20250620 c:\Data\Plans\Scripts>set DATENITE DATENITE=250620 DATENITE8=20250620 c:\Data\Plans\Scripts>REM count images before stacking c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\count_imgs.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSO" -n 20250620 -l b4-stk -f "c:\Users\admin\Documents\ACP Astronomy\Logs\rsync" Counting images in C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSO for 20250620 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\count_imgs.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlat" -n 20250620 -l cals -f "c:\Users\admin\Documents\ACP Astronomy\Logs\rsync" Counting images in C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlat for 20250620 c:\Data\Plans\Scripts>REM ** Copy and compress images c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\image_dir_sync.py "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlat" "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip" Synchronizing from C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlat to C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\gz_all_fts.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip" Compressing images in C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip Elapsed time 0.003988027572631836 c:\Data\Plans\Scripts>REM \Users\admin\anaconda3\python c:\Data\Code\image_dir_sync.py "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSO" "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip" 20250620 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\image_dir_sync.py "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSO" "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip" Synchronizing from C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSO to C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\gz_all_fts.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip" Compressing images in C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip Elapsed time 0.03544950485229492 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\image_dir_sync.py "" "" Synchronizing from to c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\gz_all_fts.py -p "" Compressing images in Elapsed time 0.0 c:\Data\Plans\Scripts>REM count images after compression c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\count_imgs.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip" -n 20250620 -l compressed -f "c:\Users\admin\Documents\ACP Astronomy\Logs\rsync" Counting images in C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip for 20250620 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\count_imgs.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip" -n 20250620 -l cals-comp -f "c:\Users\admin\Documents\ACP Astronomy\Logs\rsync" Counting images in C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip for 20250620 c:\Data\Plans\Scripts>SETLOCAL c:\Data\Plans\Scripts>REM ***************************************************************** c:\Data\Plans\Scripts>REM c:\Data\Plans\Scripts>REM CWRSYNC.CMD - Batch file template to start your rsync command (s). c:\Data\Plans\Scripts>REM c:\Data\Plans\Scripts>REM ***************************************************************** c:\Data\Plans\Scripts>REM Make environment variable changes local to this batch file c:\Data\Plans\Scripts>REM ** CUSTOMIZE ** Specify where to find rsync and related files (C:\CWRSYNC) c:\Data\Plans\Scripts>SET CWRSYNCHOME="C:\Users\admin\Downloads\cwRsync_5.4.1_x86_Free\cwRsync_5.4.1_x86_Free" c:\Data\Plans\Scripts>REM Set CYGWIN variable to 'nontsec'. That makes sure that permissions c:\Data\Plans\Scripts>REM on your windows machine are not updated as a side effect of cygwin c:\Data\Plans\Scripts>REM operations. c:\Data\Plans\Scripts>SET CYGWIN=nontsec c:\Data\Plans\Scripts>REM Set HOME variable to your windows home directory. That makes sure c:\Data\Plans\Scripts>REM that ssh command creates known_hosts in a directory you have access. c:\Data\Plans\Scripts>SET HOME=C:\Users\admin c:\Data\Plans\Scripts>REM Make cwRsync home as a part of system PATH to find required DLLs c:\Data\Plans\Scripts>SET CWOLDPATH=C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;C:\Program Files\TortoiseSVN\bin;C:\Program Files\Git\cmd;C:\Users\admin\AppData\Local\Microsoft\WindowsApps;C:\Users\admin\anaconda3;C:\Users\admin\anaconda3\scripts c:\Data\Plans\Scripts>SET PATH=""C:\Users\admin\Downloads\cwRsync_5.4.1_x86_Free\cwRsync_5.4.1_x86_Free"";C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;C:\Program Files\TortoiseSVN\bin;C:\Program Files\Git\cmd;C:\Users\admin\AppData\Local\Microsoft\WindowsApps;C:\Users\admin\anaconda3;C:\Users\admin\anaconda3\scripts c:\Data\Plans\Scripts>REM Construct a unique rsync log filename containing the current date c:\Data\Plans\Scripts>SET LOGDIR=/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync c:\Data\Plans\Scripts>SET RSYNCLOG="/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" c:\Data\Plans\Scripts>echo RSYNCLOG "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" RSYNCLOG "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" c:\Data\Plans\Scripts>REM ** CUSTOMIZE ** Enter your rsync command(s) here c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\find_mtime.py -s "c:\Users\admin\Documents\ACP Astronomy\Logs" -r "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/" -a 15 -o logfilelist.txt search path: c:\Users\admin\Documents\ACP Astronomy\Logs relative path: /cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/ file age in days: 15 output file: logfilelist.txt files found: 235 c:\Data\Plans\Scripts>\cygwin64\bin\rsync.exe -v -r --stats --archive --files-from=logfilelist.txt --log-file="/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/" tmo61@occam.aavso.org::tmo61-logs sending incremental file list BoltwoodFileTrace.log rsync/ rsync/count_20250620.txt rsync/rsync_20250619.log rsync/sync.log Number of files: 243 (reg: 235, dir: 8) Number of created files: 1 (reg: 1) Number of deleted files: 0 Number of regular files transferred: 4 Total file size: 1,879,597 bytes Total transferred file size: 13,055 bytes Literal data: 7,534 bytes Matched data: 5,600 bytes File list size: 0 File list generation time: 0.039 seconds File list transfer time: 0.000 seconds Total bytes sent: 16,297 Total bytes received: 6,123 sent 16,297 bytes received 6,123 bytes 14,946.67 bytes/sec total size is 1,879,597 speedup is 83.84 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\find_mtime.py -s "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip" -r "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Images/AutoFlatzip/" -a 15 -o calfilelist.txt search path: C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip relative path: /cygdrive/c/Users/admin/Documents/ACP Astronomy/Images/AutoFlatzip/ file age in days: 15 output file: calfilelist.txt files found: 75 c:\Data\Plans\Scripts>\cygwin64\bin\rsync.exe -v -r --stats --archive --files-from=calfilelist.txt --log-file="/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Images/AutoFlatzip/" tmo61@occam.aavso.org::tmo61-flats sending incremental file list Number of files: 78 (reg: 75, dir: 3) Number of created files: 0 Number of deleted files: 0 Number of regular files transferred: 0 Total file size: 2,020,368,313 bytes Total transferred file size: 0 bytes Literal data: 0 bytes Matched data: 0 bytes File list size: 0 File list generation time: 0.010 seconds File list transfer time: 0.000 seconds Total bytes sent: 3,479 Total bytes received: 19 sent 3,479 bytes received 19 bytes 2,332.00 bytes/sec total size is 2,020,368,313 speedup is 577,578.13 c:\Data\Plans\Scripts>REM exit /B c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\find_mtime.py -s "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip" -r "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Images/Scheduler/AAVSO/AAVSOzip/" -a 15 -o imgfilelist.txt search path: C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip relative path: /cygdrive/c/Users/admin/Documents/ACP Astronomy/Images/Scheduler/AAVSO/AAVSOzip/ file age in days: 15 output file: imgfilelist.txt files found: 608 c:\Data\Plans\Scripts>\cygwin64\bin\rsync.exe -v -r --stats --archive --files-from=imgfilelist.txt --log-file="/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Images/Scheduler/AAVSO/AAVSOzip/" tmo61@occam.aavso.org::tmo61-raw sending incremental file list Number of files: 670 (reg: 608, dir: 62) Number of created files: 0 Number of deleted files: 0 Number of regular files transferred: 0 Total file size: 9,483,434,141 bytes Total transferred file size: 0 bytes Literal data: 0 bytes Matched data: 0 bytes File list size: 0 File list generation time: 0.120 seconds File list transfer time: 0.000 seconds Total bytes sent: 22,420 Total bytes received: 82 sent 22,420 bytes received 82 bytes 15,001.33 bytes/sec total size is 9,483,434,141 speedup is 421,448.50 c:\Data\Plans\Scripts>REM Construct a unique purge log filename containing the current date c:\Data\Plans\Scripts>SET LOGDIR=c:\Users\admin\Documents\ACP Astronomy\Logs\rsync c:\Data\Plans\Scripts>SET PURGELOG="c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" c:\Data\Plans\Scripts>echo PURGELOG "c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" PURGELOG "c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlat" -a 31 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\AutoFlatzip" -a 31 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSO" -a 31 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "C:\Users\admin\Documents\ACP Astronomy\Images\Scheduler\AAVSO\AAVSOzip" -a 31 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "" -a 31 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "" -a 31 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\purge_image.py -p "c:\Users\admin\Documents\ACP Astronomy\Logs\Scheduler\AAVSO" -a 366 1>>"c:\Users\admin\Documents\ACP Astronomy\Logs\rsync\purge_20250620.log" 2>&1 c:\Data\Plans\Scripts>\Users\admin\anaconda3\python c:\Data\Code\find_mtime.py -s "c:\Users\admin\Documents\ACP Astronomy\Logs" -r "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/" -a 15 -o logfilelist.txt search path: c:\Users\admin\Documents\ACP Astronomy\Logs relative path: /cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/ file age in days: 15 output file: logfilelist.txt files found: 237 c:\Data\Plans\Scripts>\cygwin64\bin\rsync.exe -v -r --stats --archive --files-from=logfilelist.txt --log-file="/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/rsync/rsync_20250620.log" "/cygdrive/c/Users/admin/Documents/ACP Astronomy/Logs/" tmo61@occam.aavso.org::tmo61-logs sending incremental file list rsync/ rsync/purge_20250620.log rsync/rsync_20250620.log rsync/sync.log Number of files: 245 (reg: 237, dir: 8) Number of created files: 2 (reg: 2) Number of deleted files: 0 Number of regular files transferred: 3 Total file size: 1,890,872 bytes Total transferred file size: 19,403 bytes Literal data: 11,870 bytes Matched data: 7,700 bytes File list size: 0 File list generation time: 0.035 seconds File list transfer time: 0.000 seconds Total bytes sent: 20,635 Total bytes received: 160 sent 20,635 bytes received 160 bytes 41,590.00 bytes/sec total size is 1,890,872 speedup is 90.93