This shows how to access the bucket storage at Linode with the code you normally use for AWS.<\/p>\n\n\n\n\n\n\n\n
More and more cloud providers are rolling out bucket storage solutions similar with S3. The similarity goes to the point that you can merely repoint your application from AWS related urls to the new ones and it works out of the box. <\/p>\n\n\n\n
The only thing needed is to change the configuration. The main points around the new configuration<\/p>\n\n\n\n
The endpoint for the region Newark \/ New Jersey in Linode looks like that:<\/p>\n\n\n\n
https://us-east-1.linodeobjects.com<\/code><\/pre>\n\n\n\nNote that the region name is us-east-1 in our situation. With this new region, provided that we ran AWS configure and set the right key and secret key (yes, AWS cli works as well out of the box with the Linode bucket services) then this would be the required command to list for example the existing buckets under our account<\/p>\n\n\n\n
aws s3 ls --endpoint=https:\/\/us-east-1.linodeobjects.com<\/code><\/pre>\n\n\n\nThis lists the buckets inside our linode bucket storage. <\/p>\n\n\n\n
Example of accessing bucket Linode services from Java<\/h2>\n\n\n\n
Here is the maven dependency needed to get this<\/p>\n\n\n\n
<dependency><\/span>\n <groupId><\/span>com.amazonaws<\/groupId><\/span>\n <artifactId><\/span>aws-java-sdk-s3<\/artifactId><\/span>\n <version><\/span>1.12.470<\/version><\/span>\n <\/dependency><\/span>\n<\/pre><\/div>\n\n\n\nAnd here is the code, including the imports<\/p>\n\n\n\n
package<\/span> org.<\/span>example<\/span>;<\/span>\n\nimport<\/span> com.amazonaws.auth.AWSStaticCredentialsProvider<\/span>;<\/span>\nimport<\/span> com.amazonaws.auth.BasicAWSCredentials<\/span>;<\/span>\nimport<\/span> com.amazonaws.client.builder.AwsClientBuilder<\/span>;<\/span>\nimport<\/span> com.amazonaws.services.s3.AmazonS3<\/span>;<\/span>\nimport<\/span> com.amazonaws.services.s3.AmazonS3ClientBuilder<\/span>;<\/span>\nimport<\/span> com.amazonaws.services.s3.model.Bucket<\/span>;<\/span>\n\nimport<\/span> java.util.List<\/span>;<\/span>\n\npublic<\/span> class<\/span> Main<\/span> {<\/span>\n public<\/span> static<\/span> void<\/span> main<\/span>(<\/span>String[]<\/span> args)<\/span> {<\/span>\n try<\/span> {<\/span>\n new<\/span> Main<\/span>().<\/span>start<\/span>();<\/span>\n }<\/span> catch<\/span> (<\/span>Exception e)<\/span> {<\/span>\n e.<\/span>printStackTrace<\/span>();<\/span>\n }<\/span>\n }<\/span>\n\n private<\/span> void<\/span> start<\/span>()<\/span> throws<\/span> Exception {<\/span>\n String endpoint =<\/span> "https:\/\/us-east-1.linodeobjects.com"<\/span>;<\/span>\n String region =<\/span> "us-east-1"<\/span>;<\/span>\n BasicAWSCredentials credentials =<\/span> new<\/span> BasicAWSCredentials(<\/span>"akey"<\/span>,<\/span> "secret key"<\/span>);<\/span>\n AWSStaticCredentialsProvider credentialsProvider =<\/span> new<\/span> AWSStaticCredentialsProvider(<\/span>credentials);<\/span>\n\n AwsClientBuilder.<\/span>EndpointConfiguration<\/span> configuration =<\/span> new<\/span> AwsClientBuilder.<\/span>EndpointConfiguration<\/span>(<\/span>endpoint,<\/span> region);<\/span>\n AmazonS3ClientBuilder builder =<\/span> AmazonS3ClientBuilder.<\/span>standard<\/span>().<\/span>withCredentials<\/span>(<\/span>credentialsProvider);<\/span>\n AmazonS3 client =<\/span> builder.<\/span>withEndpointConfiguration<\/span>(<\/span>configuration).<\/span>build<\/span>();<\/span>\n\n List<<\/span>Bucket><\/span> buckets =<\/span> client.<\/span>listBuckets<\/span>();<\/span>\n buckets.<\/span>forEach<\/span>(<\/span>bucket -><\/span> System.<\/span>out<\/span>.<\/span>println<\/span>(<\/span>bucket.<\/span>getName<\/span>()));<\/span>\n }<\/span>\n}<\/span>\n<\/pre><\/div>\n\n\n\nExample of accessing bucket Linode services from Python<\/h2>\n\n\n\n
There is a package called boto3 which is advertised on AWS website, so this is the standard, it seems. The calls are very easy to instrument, here is a sample<\/p>\n\n\n\n
import<\/span> boto3<\/span>\n\n\ndef<\/span> starting<\/span>():\n client =<\/span> boto3.<\/span>client('s3'<\/span>, region_name=<\/span>'us-east-1'<\/span>,\n endpoint_url=<\/span>'https:\/\/us-east-1.linodeobjects.com'<\/span>,\n aws_access_key_id=<\/span>'key id'<\/span>,\n aws_secret_access_key=<\/span>'secret access key'<\/span>)\n\n buckets =<\/span> client.<\/span>list_buckets()\n raw_data =<\/span> buckets['Buckets'<\/span>];\n for<\/span> dt in<\/span> raw_data:\n print<\/span>('current name: '<\/span>, dt['Name'<\/span>])\n\n\nif<\/span> __name__ ==<\/span> '__main__'<\/span>:\n starting()\n<\/pre><\/div>\n\n\n\nExample of accessing bucket Linode services from Golang<\/h2>\n\n\n\n
In golang there are a number of libraries recommended to be used to connect to AWS. All of them of course are developed at Amazon. S3, as expected, works everywhere. Here is the program that lists the buckets in a S3 account end to end – including the imports. <\/p>\n\n\n\n
package<\/span> main\n\nimport<\/span> (\n"fmt"<\/span>\n"github.com\/aws\/aws-sdk-go\/aws"<\/span>\n"github.com\/aws\/aws-sdk-go\/aws\/credentials"<\/span>\n"github.com\/aws\/aws-sdk-go\/aws\/session"<\/span>\n"github.com\/aws\/aws-sdk-go\/service\/s3"<\/span>\n)\n\nfunc<\/span> main() {\nerr :=<\/span> proceed()\nif<\/span> err !=<\/span> nil<\/span> {\nfmt.Println("there was an error: "<\/span>, err.Error())\n}\n}\n\nfunc<\/span> proceed() error<\/span> {\ncreds :=<\/span> credentials.NewCredentials(&<\/span>credentials.StaticProvider{Value: credentials.Value{\nAccessKeyID: "access key"<\/span>,\nSecretAccessKey: "secret access key"<\/span>,\n}})\n\nsess, err :=<\/span> session.NewSession(&<\/span>aws.Config{\nCredentials: creds,\nEndpoint: aws.String("https:\/\/us-east-1.linodeobjects.com"<\/span>),\nRegion: aws.String("us-east-1"<\/span>),\n})\n\nif<\/span> err !=<\/span> nil<\/span> {\nreturn<\/span> err\n}\n\nsvc :=<\/span> s3.New(sess)\nout, err :=<\/span> svc.ListBuckets(nil<\/span>)\nif<\/span> err !=<\/span> nil<\/span> {\nreturn<\/span> err\n}\n\nbuckets :=<\/span> out.Buckets\nfor<\/span> _, bucket :=<\/span> range<\/span> buckets {\nfmt.Println(*<\/span>bucket.Name)\n}\n\nreturn<\/span> nil<\/span>\n}\n<\/pre><\/div>\n\n\n\nNote a couple of things<\/p>\n\n\n\n
\n- Endpoint must be mentioned if you do not connect to AWS but to another provider<\/li>\n\n\n\n
- It is possible to omit the credentials in which case will take them from .aws folder, however in a containerized Docker or Kubernetes solution this is not at all recommended, typically the credentials come from an adjacent artifact like Cyber Ark or similar <\/li>\n<\/ul>\n\n\n\n
The above is just an idea of how to connect. Of course there are a gazillion of methods and packages that support the S3 access in Go but all of them go through this connectivity step. <\/p>\n","protected":false},"excerpt":{"rendered":"
This shows how to access the bucket storage at Linode with the code you normally use for AWS.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-33","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/coding101.xyz\/index.php?rest_route=\/wp\/v2\/posts\/33","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/coding101.xyz\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/coding101.xyz\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/coding101.xyz\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/coding101.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=33"}],"version-history":[{"count":7,"href":"https:\/\/coding101.xyz\/index.php?rest_route=\/wp\/v2\/posts\/33\/revisions"}],"predecessor-version":[{"id":97,"href":"https:\/\/coding101.xyz\/index.php?rest_route=\/wp\/v2\/posts\/33\/revisions\/97"}],"wp:attachment":[{"href":"https:\/\/coding101.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=33"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/coding101.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=33"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/coding101.xyz\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=33"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}