Now that ewms-pilot supports parallelism ("multitasking"), we can enable this for the scanner's workers.
See Observation-Management-Service/ewms-pilot#28 (v0.9.0)
Update (June 2026)
It's important to remember that the skymap scanner image is very large (disk). Enabling parallelization on the pilot could decrease image/container load time (this would be the main advantage). However, the scanner client also loads a lot of physics data into memory. So, when multiple client instances are loaded side by side, the shared pilot (Condor EP) may run out of memory. This could be solved by shared memory between scanner client containers. @dsschult may have more info on this regarding icetray images. That all said, a thorough test analysis (memory/disk/runtime benchmarking) is needed to see if parallelizing on the piot would actually be beneficial.
Now that
ewms-pilotsupports parallelism ("multitasking"), we can enable this for the scanner's workers.See Observation-Management-Service/ewms-pilot#28 (
v0.9.0)Update (June 2026)
It's important to remember that the skymap scanner image is very large (disk). Enabling parallelization on the pilot could decrease image/container load time (this would be the main advantage). However, the scanner client also loads a lot of physics data into memory. So, when multiple client instances are loaded side by side, the shared pilot (Condor EP) may run out of memory. This could be solved by shared memory between scanner client containers. @dsschult may have more info on this regarding icetray images. That all said, a thorough test analysis (memory/disk/runtime benchmarking) is needed to see if parallelizing on the piot would actually be beneficial.