Docker image labels

In the Dockerfile I can define one or more labels for an image. And with docker inspect I can filter images on label. All great. But I would like to do more with labels. In the Docker registry I would like to be able to search on label. And would like get the label via the manifest file somehow (or another way), without the need to pull the image first. How can this be done?