Query regarding ECS FARGATE setup for clickhouse on AWS #89558
Unanswered
rjayaram-godaddy
asked this question in
Q&A
Replies: 1 comment
|
Hey! Did you solve it? I'm also interested in this particular case |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi team
I am trying to setup an Ecs Fargate application that spins up clickhouse by pulling the docker of the application. However, we are facing challenges related to data persistence. ( As container restarts results in loss of table definitions(and data) defined in var/lib/clickhouse/metadata)
I am trying to connect the ecs task with efs volumes( to persist metadata), and for the actual data I configured to use s3 as disk but this is also causing lot of issues as we can’t do blue green deployment/multi node deployment as two fargate tasks cannot reference/mount on the same efs.( It is causing lock conflicts)
Do you have any recommendations on how to go about this. Unfortunately, we cannot used the managed version of clickhouse cloud available in AWS Marketplace and we do not want to set this up on our own ec2 instances since that would be a management overhead.
Can you suggest how we can setup clickhouse as a highly available persistent enterprise level database on ECS+fargate?
If you have any other advice/ alternative approaches to host clickhouse on aws with ease please let me know.
All reactions