@aliostad@MEmambakhsh By default, tensorflow reserves all GPUs for the application, but not necessarily using it. By my experience you have to hardcode which GPUs to use, not sure if the current version automatically uses all gpus effectively. This link provide more details: https://t.co/L1myV45UyD