Data Engineer with over 6 years of experience in Python development and 5 years as a Data Engineer and Python Developer, specializing in AWS, Linux, and popular cloud tools for data engineering, such as the Apache family. A proven track record of working in financial institutions, oil companies, and multicultural, high-pressure big data environments that constantly evolve.
As a self-motivated, confident, and creative professional, I possess strong analytical and problem-solving abilities. My experience in setting and achieving goals both independently and as a team player allows me to meet deadlines without compromising on efficiency. I am skilled in prioritizing and accomplishing multiple tasks and boast excellent communication, analytical, and leadership skills.
Azure
Kubernetes
Python
AWS
Designing and implementing multiple pipeline ETL focused on customer behavior and geolocation. Extracting data from multiple local and external sources to build customer social and geolocation credit interest, assessing business stakeholders and using multiple Cloud tools and services.
Skills: Python · Amazon Web Services (AWS) · Software Development · Data Processing · Data Pipelines
Designed and implemented robust real-time ETL pipelines for diverse big data datasets for blockchains. Increase in 100% the amount of API NFTs availables
Skills: Artificial Intelligence (AI) · AWS Glue · Python (Programming Language) · Airflow · Amazon Redshift
Lead the architecture and built Data Marts to provide data about debt and financial products outputs. Coaching Jr to Sr professionals, to grow and unlock soft/hard skills issues in runtime. Increase NPS by 20% (quality of service).
Lead the architecture while building a Human Resources Data Lake, gathering dozens of inputs and creating the needed pipelines to output data for the analytical team. Worked in a squad and made the HR data driven.
Skills: Apache Spark · Apache Avro · PostgreSQL · Amazon EC2 · Python (Programming Language)
Created an index that forecasts the price of sugar in the Brazilian market, giving managers enough information to drive decisions between holding or selling sugar commodities.
Skills: PySpark · Kubernetes · Azure Data Lake · Bloomberg · Airflow