Shared Apache Hop image to be shared within a team of 3-5

General
1

Hi all,

How to share the Apache Hop Docker image within a team of 3-5 people?

The Workflows, pipelines and transforms within should get syncd real time with the changes made by other users.

Thanks
Ganesh

3

In such a case where the original post was not created as a basis for another spam account to shamelessly advertise “SnapTik”

Most registries, Docker Hub and GHCR included, allow you to create private container repositories and control their access permissions

If you prefer not to host it on a public registry, you can host your own container registry

And if you do not want to publish it at all, you can also save the image as a TAR archive and share it privately

1 Like
4

Just out of curiosity: how is something that ends up being pushed into a registry/repository supposed to be synced in real time? That’s always an async task. You build and push, someone else pulls the image.

If you mean something entirely else: please explain.

1 Like
5

Hi @meyay, push and pull like in Git might work. But I was wondering if it could behave like how a shared google sheet get updated with everybody’s edits readily.

Thanks.

6

Thanks for the guidance @deanayalon

7

I am lost. You want a running container that bases on a specific image to be updated real time?
Which part of it? The image? The container? The state of the application inside the container?

At least application state would make sense (~comparable to your google sheet example), though replication of application state is something that must be built-in into the application or service. Docker can only help you to run replicas, but will not take care of state replication, as it’s the responsibility of the application itself.

If you refer to the image than it would be like modifying a desktop app, and expecting that your change replaces the binary and all depending libraries on everyone else’s computer. If you refer to the container, you would expect the running process would be patched on everyone’s computer in real time, after the binary and depending libraries have been changes on everyone’s computer.

1 Like
8

Hi Metin,

Greetings. Apologies for not responding in all this while.
Except, I found that I need to enrich myself a lot to understand your reply.

In layman’s terms, I want the Apache Hop docker image to be usable by a team of 4 people.
Currently I have pulled the docker image of Apache Hop.

image.png
image.png1920×1200 292 KB

This has hogged a lot of RAM and space. Will figure out how to have this on some server.
Besides that I also need to understand what part of my need, this docker image of AH will cater to.

Another concern is that the pipelines created by the team should all be seen in 1 place. Each from the team might even work on a single pipeline and the changes have to be reflected. Will have a repository set on Gitlab for this.

But I’m totally a novice in the world of IT. I’m not even sure if what I’m expecting is even possible. Thanks for your patience and delving deeper to help.

We are working on an integration project using Apache Hop and are having to use metadata injection feature.

Regards
Ganesh

Integration Manager
+91 8451046072