Data Engineer
JoãoBorges
Transforming data into actionable insights through scalable pipelines and high-performance analytics solutions.
Yes, this layout was designed during a nice chat with an AI.DATA_STREAM: ACTIVE
STENCIL_V.1.0
ISO_400 // F.1.4
SOURCE: /ME.JPEG
Scroll
↓
About
Data engineer with experience in migrating data from legacy systems to modern data warehouses, such as Amazon Redshift. Experience in data modeling with DBT, data visualization on platforms such as Power BI and Metabase, and optimization of ELT pipelines. Ability to overcome business logic challenges and lead process transformation, ensuring the adaptation of teams to new tools and the delivery of value insights. Graduated in Database and Big Data.
Migration from legacy systems (DB2) to modern data warehouses (Amazon Redshift)
Data modeling and transformation with DBT using medallion architecture
Data visualization with Power BI, Metabase, and ClickView
ELT pipeline optimization and cost control in AWS
Tech Stack
Data Engineering
Cloud Platforms
Languages
Tools
Experience
Data Engineer
Cognitivo AI
Working on data engineering projects with focus on AI and machine learning pipelines.
Data Engineer
Escola DNC
Development of new Go API for CRM data ingestion. Complete database restructuring. Led DBT architecture refactoring, organizing the project with medallion architecture to unify product versions and business rules.
Data Engineer
Grupo OSCAR
Responsible for migrating data from a legacy database (DB2) to a Data Warehouse on Amazon Redshift. Used DBT and Power BI for data modeling, transformation, and visualization. Migrated multiple dashboards from ClickView to Metabase.
Junior Data Engineer
Quero Educação
Promoted to Junior Data Engineer, taking on greater autonomy and responsibility in project execution and delivery. Development and maintenance of data pipelines with Apache Airflow and Databricks.
Data Engineer Intern
Quero Educação
Development and maintenance of data pipelines with Apache Airflow and Databricks. Data analysis with Spark and Python. Building dashboards in Metabase and Power BI. Implementation of query monitoring with Grafana and AWS cost control.
Data Engineer Intern
3778
Development of data pipelines and work with SQL, Amazon S3, and other data engineering tools.
Projects
DB2 to Redshift Migration
Complete data migration from legacy DB2 system to Amazon Redshift, including dimensional modeling and query optimization.
DBT Medallion Architecture
Complete DBT architecture refactoring implementing medallion pattern (bronze, silver, gold) to unify business rules.
CRM Ingestion API
Development of Go API for CRM data ingestion, ensuring performance and scalability.
Metabase Dashboards
Migration of dashboards from ClickView to Metabase, improving accessibility and visualization performance.
Airflow + Databricks Pipelines
Development and maintenance of data pipelines with Apache Airflow and Databricks, including monitoring with Grafana.
AWS Cost Control
Implementation of monitoring and cost control system for Databricks jobs on AWS.
Contact
I'm always open to discuss new projects, opportunities, or partnerships. Let's chat!