Over the years we have made improvement to our analytics data collection and optimising data upload over our AWS to BQ via GCS since we added our streaming ELT based pipeline. We have over 2 dozen types of events that are captured to provide data to be analysed to generate…
11 posts by author
Ahsan Nabi Dar
Lead Engineer @ Wego. Leading dev team's for infrastructure implementation, business development and data platform . Programming , travel and sports 3 constants in life.
rake task:do_not_all
Rake is popular utility in Ruby's extensive tool set. It has over time become a standard to run repeatable tasks, be it from migrations in Rails to data processing/migration/manipultaion. In short if you have a task to automate, rake it. We use ruby extensively in our services and…
204: No Content
Analytics are an integral part of any application and in modern day data is the most valuable thing. We rely on analytics to not only provide better user experience to our user but also better reporting for our business division and to partners. In June 2017, we rewrote our analytics…
ELT, our Data Pipeline
Yes our pipeline is ELT and not ETL, Extract, Load and Transform is the new Extract, Transform and Load and this post ETL vs ELT: The Difference is in the How on Dzone makes a good case of which to use when, to know the difference at a glance, below…
Nginx; if is evil, but Lua rocks
Nginx is a web server that is designed on asynchronous, non-blocking, event-driven connection handling algorithm. As of this writing according to W3Techs Nginx serves around 32.2% websites known to them. At Wego we use Nginx as our primary web server. Recently Wego launched its mobile website as a Progressive…