I was recently watching some of the videos regarding multi-variate swarming. One of the suggestions for using multiple inputs is to utilize more than the default of 2048 columns as well as larger data sets. My data set is on the magnitude of millions of rows, so I would like to attempt to swarm utilizing 4 or 5 different fields. I can see in the model_params.py where the number of columns is specified, however I cannot figure out how to change this for swarming purposes. I looked at the schema for the swarm_config.json file and didn’t see that variable anywhere.
Can anyone help shed some light on how to manipulate the number of columns during the swarming process?