Reduce Docker installation size in the disk

I use yocto build(Kirkstone branch) for creating Kernel and Rootfs images to be used in CM4 module. I use core-image-minimal which produces a nice 30M (Kernel + RFS) image. But when is include docker with:

IMAGE_INSTALL:append = " python3-docker-compose"
IMAGE_INSTALL:append = " docker-ce"

The image size increases by 320M(Kernel + RFS). Is there a way to remove some unnecessary components from docker? I am quite new to docker and its internal components.
I have fixed offsets in by boot loader, so, I am finding it hard to boot the board with the new Kernel and RFS.

Any help will be greatly appreciated. Thanks.

Docker CE has dependencies. I never checked the exact size, but on Ubuntu Linux, when I want to install only the required dependencies but not the optional, I run:

apt-get install --no-install-recommends packagename

I have no idea how it should be done in Yocto and whether it would help at all.

There is also the option to install Docker from binaries, which I wouldn’t do in production, but that is still an option