This article details the whole migration process on moving away from self hosted airflow to Composer, a managed service offered by GCP. But why? * Workloads are hosted in different region. * Moving towards a containerized environment. * Sunset redundant tools and features like Jenkins and ssh operators based DAGs. * To secure by…
3 posts by author
Amarnath N
DevOps Engineer, Wego.
Using Secrets manager in pipeline
One of the major challenges in a multi-team organisation is securing and managing secrets. In this blog, we will see how we use the secrets from AWS Secrets manager in configuration management tools. -------------------------------------------------------------------------------- Why migrate to AWS Secrets Manager? * Our pipeline relies on ansible vault and shared among teams.…
NocoDB - Turning Tables into spreadsheets
NocoDB is an open source Airtable alternative. This works by connecting to any relational database and transforming them into a smart spreadsheet interface and allows you to build no-code applications collaboratively with teams. Currently, it works with MySQL, PostgreSQL, Microsoft SQL Server, SQLite, Amazon Aurora & MariaDB databases. -------------------------------------------------------------------------------- Salient…