this post was submitted on 10 Dec 2023
55 points (98.2% liked)

Selfhosted

40183 readers
690 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

  1. Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.

  2. No spam posting.

  3. Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.

  4. Don't duplicate the full text of your blog or github here. Just post the link for folks to click.

  5. Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).

  6. No trolling.

Resources:

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
55
There's a way to know how much i am spending/going to spend with Amazon S3? (feddit.it)
submitted 11 months ago by [email protected] to c/[email protected]
16 comments fedilink hide all child comments
 

I have several TB of borg backups. Uploaded them on backblaze b2. I could immediately see how much resources i was using, how many api calls, and so on. Very easy to see and predict the next bill. I can see exactly which bucket uses more resource, and which is growing over time.

Because I'm cheap, I want to upload those files on aws glacier, which theoretically costs a quarter of b2 for storage, but API calls are extremely expensive. So I want to know the details. I won't like to get a bill with $5 in storage and $500 in API calls.

Uploaded a backup, but nowhere in AWS I can see how much resources i am using, how much I'm going to pay, how many API calls, how much the user XYZ spent, and so on.

It looks like it's designed for an approach like "just use our product freely, don't worry about pricing, it's a problem for the financial department of your company".

In AWS console I found "s3 storage lens", but it says i need to delegate the access to someone else because reasons. Tried to create another user in my 1-user org, but after wasting 2 hours I wasn't able to find a way to add those permissions.

Tried to create a dashboard in "AWS cost explorer" but all the indicators are null or zero.

So, how can I see how many API calls and storage is used, to predict the final bill? Or the only way is to pray and wait the end of the month and hopefully there everything it's itemized in detail?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 11 months ago

UPDATE: after some days, the bill under https://us-east-1.console.aws.amazon.com/billing/home?region=us-east-1#/bills is populated in much detail. Now it's much clear.

With rclone, my test sending 131 files / 2500 mb, set to don't do upload chunking and don't do HEAD on glacier created:

  • 110 PutObject requests to Glacier Deep Archive
  • 5 InitiateMultipartUpload requests
  • 5 CompleteMultipartUpload requests
  • 5 UploadPart requests
  • 192 PUT, COPY, POST, or LIST requests
  • 111 GET and all other requests

I think now i can safely upload everything and it shouldn't be too expensive