It's not as simple as adding a dummy load.
LED dimming is highly complicated. Both due to the extremely non-linear nature of LEDs, and also the extremely hacky nature of triac dimming, for which your Edison LED was designed to work.
The upshot is that your Edison LED "bulb" isn't just a light bulb with 35 LEDs in series inside it with a rectifier. That wouldn't work for dimming, because with LEDs there's only about a 10% difference in voltage between "Full brightness" and "barely observable". As such, LED dimming is either done by adjusting the constant-current driver output, or doing PWM. Suffice it to say there's some real silicon in there doing fairly complex stuff to translate "triac dimming" into "meaningful LED dimming".
Since it's an Edison screw-in, you don't really have access to the LED innards to get to do things like add dummy resistors to divert some LED current.
Convert it back to incandescent so it works the way you expect.
Alternately, you could leave the on/off switch exactly as it is, and re-wire the thing to use low voltage 12V LED lights, with a PWM dimmer. These LEDs are very simple affairs - three LEDs in series with a resistor. PWM dimming is extremely reliable and "designed for LED", with full control. The dimmer module is quite small and you can fit it where you need. I would have the separate knob for dimming. Then have the 120V switch turn on the 12 V DC power supply, have that feed the 12V dimmer and then onward to the lights. These will never burn out and so won't ever need to be replaced, so there's no need for the LEDs to have sockets. . (the 12 volt power supply is the only thing ever likely to give out).