Starting with Inkscape 1.1 it is possible to give custom optimization settings to specific layers and objects.
This allows much more control over the generated ild file.
Also see ILD Render Layers
To set custom optimization settings for layers/objects first select the desired layer/object.
Reads all optimization settings from ILD Render
Custom optimization settings for objects may get lost when doing the following:
Unfortunately this is a limitation of Inkscape.