What is the proper AWS IAM policy for access to a single bucket that allows...
I am working on a buildout where I am doing the following. Eventually I will need to make this scalable so I am not doing this manually each time.I have several clients dumping data into S3 buckets....
View ArticleHow can I grant access to my cloud storage for clients?
I am developing a webshop for large digital products (multiple .tif image files). These are currently stored in an S3 bucket.What is a recommended way to grant access to my customers once they have...
View ArticleHow do I copy data from docker container out to S3 bucket at container...
I'm newbie to DevOps. Is it possible to copy data generated inside a container to S3 bucket while the container is still running? If yes, what would be the best approach that uses less code or less...
View ArticleHow can I efficiently scale a data lake?
I am running into problems with AWS Athena data lakes. They were initially very quick, but as we've scaled, they're performing poorly and are becoming expensive and inefficient. What can we do to solve...
View ArticleClik here to view.
Add Cache-control: no-cache,no-store metadata to object uploaded via S3...
So i have a jenkins job that builds a project and then uploads specific files to an S3 bucket.I've set up the S3 Publisher plugin shown in the attached image, but the metadata is still not being added...
View ArticleTerraform Aws S3 - deny all users except for a specific user
I have a bucket which I need to restrict to a specific user, I have written the following script but it still seems to allow all users to operate on the bucket.resource "aws_s3_bucket"...
View ArticleUse S3 To Store ConfigMap
I have a ConfigMap which stores Nginx configs and It is getting size exceeded. There are many site configs in there so I can't create multiple ConfigMaps.I thought of using S3 to store ConfigMap, is it...
View ArticleHow to assign an ACL for each S3 Bucket in a tuple/list using Terraform?
I have a terraform file set to create a list of S3 buckets, and I was assigning acl to each bucket the old way:resource "aws_s3_bucket" "this" { count = length(var.s3_bucket_names) bucket =...
View ArticleWhen OnPrem with Kubernetes, what is the recommended way to do file storage...
When you are running kubernetes on GKS, AKS, etc, you use your cloud provider specific storage bucket such as Amazon S3, google cloud storage, azure blob storage, to store your raw binary content in a...
View ArticleIs cross-region replication 100% fool-proof for S3 region outages? [duplicate]
Amazon S3 has an option of cross-region replication which should be pretty fault-tolerant against region/zone outages.Does that mean those who are ranting about the outage did not make use of this...
View Article--- Article Not Found! ---
*** *** *** RSSing Note: Article is missing! We don't know where we put it!!. *** ***
View Article--- Article Not Found! ---
*** *** *** RSSing Note: Article is missing! We don't know where we put it!!. *** ***
View Article--- Article Not Found! ---
*** *** *** RSSing Note: Article is missing! We don't know where we put it!!. *** ***
View Articles3: reading parquet files with a subset of columns as argument; does this...
I have set of large tables stored as parquets on s3.In python, I'm using:pd.read_parquet(...,columns=columns)I'm reading the files directly from s3, without any database engine whatsoever for...
View ArticleDeploying a FE and Lambda on the same AWS CloudFront distribution
I have an S3 bucket thats deployed on a domain trough CloudFront and I also have a lambda function that should also get requests from the same domain as the FE and I have no idea how I can acheave this...
View ArticleUsing two aws cloudfront origins to the same S3 bucket?
Is it possible to have a single Cloudfront distribution with two origins that refer to different folders on the same S3 bucket?I have a simple/small project and to avoid clutter my stack with multiple...
View ArticleContabo's Object Storage - Object Lock Retention (AWS S3 compatible)
I'm having difficulty with Contabo's Object Storage.With a user with permission: "S3 Object Storage Read and Write" I configured a aws profile called 'backup'.With this profile, I ran this shell...
View ArticleClik here to view.
Unexpected response status when fetching server time error in thanos query...
I have installed the "monitoring" app (via rancher UI) which is provided by kubernetes. On top of it, I have deployed thanos-sidecar as 4th container in the prometheus pod running in...
View ArticleHow to assign different authorizations to different AWS Cognito groups for a...
We have implemented the following AWS solution in order to publish a static html site on the internet :https://github.com/aws-samples/cloudfront-authorization-at-edgeHow can we manage to assign...
View ArticleHow can I use S3 as a filesystem
I'm not sure if it's something I'm doing wrong, or if the S3 web interface is just trash. There are a ton of basic capabilities that work in pretty much any other file storage product (Windows...
View Article