Small vs large jobs priorities in gadi queue

COSIMA
1

Hi! Pitching an idea here to see if it is of interest to others :slight_smile: please feel free to tell me if it won’t be useful.

Sometimes nodes in gadi are “hogged” by large jobs which are usually model runs. This means that smaller jobs, usually notebooks used for analysis, are waiting in the queue for a long time. It is a bit frustrating specially if the analysis was supposed to be the work of the day.

Is there a way to “split” the project in a way that there are always some nodes available for small notebooks?

2

So your notebook isn’t running because there are already a lot of large CPU jobs running on the same project?

You can try running on normalbw or normalsl queues. Usually the models don’t run on them. Have you tried that?