Use Cloudfront instead of load balancer

If fronting an autoscaled Swarm of workers with Cloudfront it seems wasteful to have a load balancer in between.

Might it be possible to use a Route53 address as the origin and then use this:

https://docs.aws.amazon.com/Route53/latest/APIReference/overview-service-discovery.html

to auto-add/remove worker instances from the round-robin list?