Head for the Cloud

Keeping the Cloud simple.

Validating Python code with a CodeCatalyst pipeline

2024-01-18 12 min read AWS CI/CD CodeCatalyst Python Simon Hanmer
The YouTube player can not be loaded with disabled JavaScript. The following video is embedded here: https://youtube.com/watch?v=eg7nlpwEpnA CodeCatalyst is a unified development environment created by AWS. It has many features such as blueprints to assist in writing code, integrated Git repositories, dev environments which can be pre-defined and now AI integration. However, for myself, one of the most useful things is being able to define and use pipelines stored in the code repository. Continue reading
CodeCatalyst Python ci/cd devops Walkthroughs

Generating cloudwatch alarms using 'metric math' via CloudFormation and Terraform.

2023-11-27 7 min read AWS Terraform CloudFormation IaC Simon Hanmer
I spend a lot of time working as a consultant with GlobalLogic UK&I with different client teams to deploy AWS infrastructure, and not surprisingly, I see differing levels of maturity and experience within these teams. While we work with teams with a lot of knowledge, often they concentrate on deploying the applications and infrastructure, but they won’t think about how they can understand how well an application is working. This is an important aspect of working within the Cloud, usually termed monitoring or observability. Continue reading
Terraform CloudFormation Observability

Use VSCode to write Terraform? AWS AI can now help you write your code!

2023-11-27 5 min read AWS Terraform Simon Hanmer
As I sit here writing this article, AWS’s annual re:Invent is just starting in Las Vegas. This huge event pulls together cloud enthusiasts from around the world to learn about the largest cloud providers offerings. Not surprisingly, AWS use this time to announce new and improved services, and we’ll see hundreds of articles over the next week - in fact, there are so many announcements, they have to start drip-feeding them out in advance of the main event. Continue reading
Terraform VSCode CodeWhisperer AI reInvent

Handling partial batch failures with the SQS Lambda Poller

2023-10-02 7 min read AWS Simon Hanmer
In my previous post, I described how I’d been asked to help a developer who was having some issues. His team was logging all S3 accesses to a central log bucket and then using Athena to analyse the data. They needed to partition this data to allow Athena to process the data more efficiently. However, a small number of the entries they were trying to process seemed to be missing when they used the architecture below: Continue reading
sqs lambda event-driven

Now You See Me, Now You Don't - the Mystery of the Vanishing S3 Objects

2023-10-02 9 min read AWS Simon Hanmer
One of the great things about my role as a consultant at GlobalLogic is that sometimes I’ll be asked to help out on what at first glance can be a simple problem, but as I investigate, I get a chance to uncover some unusual or forgotten features. Recently, I was working on a project and was asked if I could help solve an issue that had been puzzling a developer. They had deployed a system where some objects uploaded to an S3 bucket seemed to disappear and then reappear; it was time to start digging. Continue reading
Storage S3 sqs lambda event-driven eda
Older posts
© 2024 by Head for the Cloud (Simon Hanmer) - RSS
Bilberry Hugo Theme