Luan Moreno Medeiros Maciel

CEO

Federal District, Brazil16 yrs 4 mos experience
Most Likely To SwitchHighly Stable

Key Highlights

  • Founder of Brazil's first Data Engineering community.
  • Delivered 100+ courses impacting over 800,000 lives.
  • Microsoft MVP for over 10 years, recognized for contributions.
Stackforce AI infers this person is a Data Engineering expert with a strong focus on cloud solutions and community building.

Contact

LinkedIn

Skills

Core Skills

Data EngineeringCloud ComputingBig DataDatabase AdministrationTraining

Other Skills

AWSApache AirflowApache KafkaApache SparkAzureAzure SQL DBBig Data SolutionsBusiness AnalysisBusiness IntelligenceCoachingColumnStore IndexCommunity BuildingData AnalysisData AnalyticsData Architecture

About

I’m proud to be a recognized Authority in Data Engineering, helping professionals and companies unlock the power of data to drive success. Over the past decade, I’ve worked on the global stage, solving complex data challenges, mentoring aspiring engineers, and building communities that thrive on collaboration and innovation. Highlights of My Journey: • Creator of Brazil’s First Data Engineering Community: Empowering thousands to master data technologies. • 10+ Years in the International Market: Delivering solutions and expertise worldwide. • Founder of the First Data Engineering YouTube Channel in Portuguese: Making knowledge accessible to everyone. • Microsoft MVP (10+ Years): Recognized for my contributions to the data platform community. • First and Only Brazilian MVP for Apache Airflow & Databricks: Leading innovation in modern data solutions. • Global Speaker: Presented at events in Mexico, the USA, Canada, Europe, and Japan. • 100+ Courses Delivered: Sharing practical, real-world knowledge. • 20,000+ Training Hours: Educating and inspiring data professionals. • 800,000+ Lives Impacted: Through training, talks, and mentoring. • 70+ Students Working Internationally: Helping others achieve their dreams. What Drives Me: I founded Engenharia de Dados Academy to provide top-notch training in Big Data and Analytics, making advanced technologies accessible and practical. I also lead The Plumbers, a community where Data Engineers come together to grow, share, and tackle modern data challenges with confidence. As a Lead Data Engineer, Cloud Architect, and passionate problem-solver, I focus on creating impactful solutions with tools like Kubernetes, Apache Spark, Kafka, and the major cloud platforms (Azure, GCP, AWS). For me, it’s not just about delivering results—it’s about empowering others to do the same. Let’s Connect: Whether you’re here to talk about data, explore training opportunities, or collaborate on a big idea, let’s connect and build something extraordinary together.

Experience

16 yrs 4 mos
Total Experience
5 yrs 8 mos
Average Tenure
14 yrs 1 mo
Current Experience

Pythian

7 roles

Lead Data Engineer

Promoted

Dec 2024 – Present · 1 yr 6 mos

  • As a Lead Data Engineer, I focus on building and delivering enterprise data platforms that help businesses innovate and succeed. My work revolves around cloud technologies, where I take ownership of the entire process—from understanding customer needs to designing scalable architectures and implementing optimized systems—ensuring everything aligns with strategic goals and high-quality standards.
  • Key Responsibilities:
  • Solution Leadership: Work closely with customers to understand their needs, design innovative solutions, and take charge of the technical architecture to ensure smooth project delivery.
  • Technical Excellence: Build and optimize high-performance data pipelines for both batch and real-time processing, troubleshoot challenges, and enhance system observability.
  • DevOps & Automation: Set up CI/CD pipelines, automate infrastructure using Infrastructure as Code (IaC), and enforce strong security practices to keep systems robust and efficient.
  • Thought Leadership: Share insights with the broader data engineering community through whitepapers, conferences, and podcasts.
  • Collaboration & Mentorship: Collaborate with architects and cross-functional teams while mentoring engineers to encourage growth and innovation.
  • Business Impact: Connect technical decisions to business goals, ensuring solutions deliver tangible value.
  • Core Expertise:
  • Building cloud-native data platforms and advanced pipelines for analytics and AI.
  • Enhancing system observability, data quality, and performance.
  • Implementing security and compliance for enterprise systems.
  • Driving efficiency with automation, standardization, and innovation.
  • This role combines strategic leadership with hands-on technical expertise, turning complex challenges into effective solutions that empower businesses to unlock the full potential of their data.
Cloud ComputingData EngineeringData ArchitectureKubernetesApache SparkKafka+3

Sr. Cloud Consultant

Aug 2022 – Dec 2024 · 2 yrs 4 mos

  • In this role, I worked at the intersection of leadership, technical expertise, and strategic planning to deliver impactful cloud solutions for global enterprises. My responsibilities included:
  • Azure EDP Solutions: Designed, deployed, and implemented Azure Enterprise Data Platform (EDP) solutions tailored to business needs.
  • Customer Collaboration: Partnered with Azure and Google Cloud Platform (GCP) clients to architect and deliver scalable, efficient cloud solutions.
  • Technical Leadership: Created Enterprise Architecture Diagrams (EADs) and strategic plans to guide implementation and growth.
  • Team Leadership: Mentored and led teams of Data Engineers, fostering professional development and ensuring project success.
  • Complex Solutions: Managed intricate customer requirements and developed innovative solutions to address unique challenges.
  • This role was pivotal in shaping my ability to deliver large-scale, impactful data platforms while building strong relationships with both customers and team members.
Cloud ComputingAzureGCPEnterprise ArchitectureTechnical LeadershipData Engineering

Big Data Project Engineer

Apr 2020 – Aug 2022 · 2 yrs 4 mos

  • Focused on delivering Big Data solutions while creating crash courses and demonstrations to support the practice and enhance client engagement.
  • Business-Centric Solutions: Analyzed business requirements to design and implement tailored Big Data solutions, with a focus on Microsoft Azure and Google Cloud Platform (GCP).
  • Technology Evaluation: Assessed and recommended optimal technologies based on customer scenarios to ensure the most effective outcomes.
  • Proof of Concepts (PoCs): Developed and presented PoCs and evaluation materials to demonstrate solution value and feasibility to customers.
  • Architectural Design: Designed Enterprise Architecture Diagrams (EADs) and documentation to recommend scalable, high-performance architectures.
  • Innovative Architectures: Built Lambda and Kappa architectures to address both real-time and batch processing needs.
  • This role allowed me to merge technical expertise with customer-focused strategies, driving innovation and delivering impactful Big Data solutions.
Big DataMicrosoft AzureGCPApache SparkProof of ConceptsData Engineering

Big Data Engineer

Jan 2019 – Apr 2020 · 1 yr 3 mos

  • Focused on designing and delivering cutting-edge Big Data solutions by closely collaborating with customers and leveraging multi-cloud environments to build robust, scalable systems.
  • Customer Collaboration: Worked directly with customers to understand their needs and gather critical artifacts for building complex Big Data solutions.
  • Architectural Design: Created detailed Enterprise Architecture Diagrams (EADs) and reviewed technical documentation to ensure precision and clarity.
  • Data Pipeline Expertise: Architected and implemented complex data pipelines using leading-edge technologies tailored to customer requirements.
  • Multi-Cloud Management: Designed, deployed, and managed solutions across Google Cloud Platform (GCP), Microsoft Azure, and Amazon AWS.
  • Architecture Recommendations: Identified and recommended optimal environments for deploying Lambda and Kappa architectures based on use cases.
  • Cloud-Native Pipelines: Built pipelines on GCP, Azure, and AWS using native PaaS and SaaS products to streamline and enhance data processing workflows.
  • Technologies Used:
  • Event Streaming & Processing: Apache Kafka (Confluent & Confluent Cloud), Apache Spark (Databricks), Apache Airflow
  • Microsoft Azure: Azure Data Factory, Blob Storage, Event Hubs, Stream Analytics, HDInsight, Databricks, Delta, SQL DW, Synapse Analytics
  • Google Cloud Platform: Pub/Sub, Cloud Storage, DataFlow, DataProc, Cloud Functions, BigQuery
  • Amazon AWS: Kinesis, S3, EMR, Glue, Athena, Databricks, Redshift
  • This role enabled me to combine technical expertise with cloud versatility, creating impactful solutions that drive business success while navigating the complexities of modern data environments.
Big DataMulti-Cloud ManagementData Pipeline ExpertiseApache KafkaApache AirflowData Engineering

Big Data Consultant

Mar 2018 – Jan 2019 · 10 mos

  • At Pythian, a global leader in data consulting and managed services, I specialized in planning, deploying, and managing business-critical data systems for large and mid-market enterprises. My role focused on delivering robust, scalable solutions tailored to client needs, leveraging cutting-edge Big Data technologies and platforms.
  • Key Contributions:
  • Designed and implemented data solutions using Hive, Pig, PolyBase, and Spark-SQL to handle complex data processing and analytics requirements.
  • Deployed and managed database solutions such as Azure SQL DB, Azure SQL DW, HBase, and CosmosDB to support diverse workloads.
  • Architected real-time data processing systems with Spark, Azure Stream Analytics, and Azure Event Hubs for streaming use cases.
  • Built and optimized data lakes with Azure Data Lake Store and Analytics, ensuring efficient storage and query performance.
  • Developed workflows and data pipelines using Sqoop, Oozie, and Azure Data Factory for seamless data ingestion, transformation, and integration.
  • This role allowed me to work on a variety of challenging projects, combining deep technical expertise with strategic consulting to deliver impactful solutions for global enterprises.
Big DataHiveSpark-SQLAzure SQL DBETLData Engineering

Lead Database Consultant [LDBC]

Oct 2016 – Mar 2018 · 1 yr 5 mos

  • As a Lead Database Consultant at Pythian, I worked closely with clients to design, optimize, and maintain high-performing database environments while mentoring a team of DBAs to deliver exceptional results.
  • Strategic Planning: Helped clients define critical objectives like RTO, RPO, and MTTR, creating and executing detailed plans to meet these targets.
  • Scalable Architecture: Designed and implemented changes to ensure client systems were scalable, reliable, and performed at optimal levels.
  • Major System Changes: Planned, tested, and executed large-scale system updates, including those impacting mission-critical environments.
  • Project Oversight: Reviewed and advised on projects like instance upgrades, database migrations, and the implementation of new SQL Server features.
  • Proactive Monitoring: Assisted in defining monitoring strategies and alert thresholds to minimize noise while ensuring early detection of potential issues.
  • Technical Escalation: Acted as the go-to technical resource for resolving urgent issues and answering project-related questions.
  • Team Leadership: Mentored a team of DBAs, sharing knowledge on SQL Server’s new and existing features to enhance team capabilities.
  • This role gave me the opportunity to combine hands-on technical expertise with leadership, ensuring the success of critical database projects and fostering the growth of the team.
Database AdministrationSQL ServerHigh AvailabilityPerformance TuningData Engineering

Sr. Database Consultant [SQL Server]

Jul 2014 – Oct 2016 · 2 yrs 3 mos

  • As a Senior Database Consultant at Pythian, I provided expert-level SQL Server support and solutions for over 20 clients, delivering tailored improvements and ensuring optimal database performance.
  • Client Collaboration: Worked directly with clients to identify areas for improvement and implement solutions aligned with their needs and feedback.
  • Performance Optimization: Conducted in-depth tuning analyses to diagnose root causes of performance issues and establish baselines for future scalability.
  • Configuration Management: Managed database server configurations, guiding environments toward best practices for stability and efficiency.
  • High Availability & Disaster Recovery: Implemented and upgraded solutions such as database mirroring, transactional and merge replication, log shipping, and SQL Server clustering.
  • Solution Design: Analyzed, designed, and deployed database solutions to address complex challenges and support evolving client requirements.
  • This role enabled me to combine technical expertise with a client-focused approach, ensuring scalable and efficient database systems for diverse environments.
SQL ServerPerformance OptimizationHigh AvailabilityDisaster RecoveryDatabase AdministrationData Engineering

Engenharia de dados academy

CEO | Engenharia de Dados Academy & The Plumbers

Mar 2022 – Present · 4 yrs 3 mos

  • I’m the founder and CEO of Engenharia de Dados Academy, Brazil’s first EdTech platform focused on data engineering, and The Plumbers, an elite community for data professionals. My goal is to transform how people learn, work, and grow in the field of data, combining cutting-edge technical training with real-world skills and a strong sense of community.
  • Engenharia de Dados Academy offers hands-on training that’s designed to make complex concepts practical and accessible. We’re shaping the next generation of data professionals by focusing on real-world scenarios and tools that deliver immediate value to careers and businesses.
  • The Plumbers is a community built to foster collaboration, growth, and innovation in data engineering. Here, professionals connect, share knowledge, and take their skills to the next level through live workshops, challenges, and mentorship.
  • What We’ve Achieved:
  • 20,000+ hours of training delivered, impacting over 800,000 professionals globally.
  • 70+ students now working internationally in data roles.
  • Partnerships with industry giants like Rockstar Games, NatGeo, XP Inc., and iFood.
  • Brazil’s first certified Data Engineering Academy.
  • My role is all about helping others succeed—whether it’s through teaching, mentoring, or creating opportunities for growth. I believe in building a culture of learning and innovation, where technical excellence meets personal development.
  • If you’re looking to take your skills to the next level or join a thriving community of data professionals, let’s connect. Together, we can unlock the future of data.
Data EngineeringCommunity BuildingTrainingMentoring

Meetup

Meetup Organizer of BSB AI, Data Science, Big Data & Analytics

May 2018 – Present · 8 yrs 1 mo · Brasília

  • The organizer of BSB AI, Data Science, Big Data & Analytics
  • Big Data
  • Data Science
  • ML & DP

Youtube

Youtube Content Creator {Luan Moreno & Academy}

Jan 2016 – Present · 10 yrs 5 mos · Brasília, Distrito Federal, Brasil · Remote

  • Creating educational videos about Data Engineering.

Open web application security project [owasp]

Speaker

Apr 2014 – Apr 2014 · 0 mo

  • Presentation that I have performed in OWASP

One way solution

CEO | One Way Solution

Oct 2013 – Present · 12 yrs 8 mos · Águas Claras

  • At One Way Solution, I lead an EdTech company dedicated to empowering professionals and organizations through cutting-edge training and consulting services focused on solving modern data challenges. My mission is to understand the unique needs of each client and transform them into impactful, end-to-end solutions.
  • Areas of Expertise:
  • Data Architecture & Analytics: SQL Server (OLTP & OLAP), Business Intelligence, and in-memory technologies.
  • Big Data Solutions: Expertise in Apache Kafka, Spark, Druid, Pinot, and YugaByteDB.
  • Cloud Computing: Advanced solutions on AWS, GCP, and Azure.
  • Modern Architectures: Design and implementation of Lambda, Kappa, and Big Data architectures, including Kubernetes-based deployments.
  • Performance Optimization: Tuning, troubleshooting, and scaling enterprise systems.
  • Focused On:
  • Understanding client challenges and tailoring solutions that fit their strategic goals.
  • Delivering robust, scalable, and actionable data solutions while ensuring no compromise in quality or process.
  • Mentoring teams and empowering professionals through training programs designed for real-world impact.
  • Building solutions that are practical, future-proof, and aligned with business needs.
  • As CEO, I ensure that One Way Solution remains at the forefront of data and technology, delivering value through innovative approaches in data training and consulting. Whether designing complex data architectures or mentoring the next generation of data professionals, my goal is to help clients unlock their full potential in the ever-evolving data landscape.
Data ArchitectureBig Data SolutionsCloud ComputingPerformance OptimizationData Engineering

Bfbiz | business for business

Instructor - [MCT]

Aug 2013 – Feb 2014 · 6 mos

  • Executing Microsoft Official Course (MOC) in Microsoft SQL Server.
  • See here some of the courses that I'm teaching nowadays...
  • MOC: 10777 - Implementing a Data Warehouse with Microsoft SQL Server 2012
  • MOC: 10778 - Implementing Data Models and Reports SQL Server Databases 2012
  • MOC: 20467B - Designing Business Intelligence Solutions with SQL Server Databases 2012

Microsoft

Microsoft Most Valuable Professional [MVP] - Data Platform

Jun 2013 – Present · 13 yrs

  • Microsoft Most Valuable Professionals, or MVPs, are technology experts who passionately share their knowledge with the community. They are always on the "bleeding edge" and have an unstoppable urge to get their hands on new, exciting technologies.
  • They have very deep knowledge of Microsoft products and services, while also being able to bring together diverse platforms, products and solutions, to solve real world problems. MVPs make up a global community of over 4,000 technical experts and community leaders across 90 countries/regions and are driven by their passion, community spirit, and quest for knowledge. Above all and in addition to their amazing technical abilities, MVPs are always willing to help others - that's what sets them apart.

B2t - business to technology

2 roles

Lead & Data Architect - [SQL Server]

Feb 2013 – Sep 2013 · 7 mos

  • Field in the configuration, implementation and administration of the database SQL Server 2005, 2008, 2008 R2, 2012 and 2014.
  • Administration of all databases and instances of the company and external customers. Implementation of High Availability, developing BI projects, stored procedures, triggers and advanced view 's programming. Consulting and gathering requirements from customers all over Brazil and the United States too.
  • Support to the BI team of a company, implementing Data Loads in SSIS and tuning OLAP queries.
  • Architecture of servers and proper storage
  • Disaster Recovery Planning
  • Policy for backups and recovery
  • Database Tuning
  • Dashboards of all databases and instances of a more than 10 servers
  • Using System Center to Monitoring and Managing - SCOM and SCVMM
  • Evaluation of queries for performance improvement, reading execution plan
  • Creating maintenance plans
  • Setup DataBaseMail
  • ETL with Integration Services, Data Loads to Data Warehouse, Data Mart
  • Creating policies using the Policy Management
  • Full implementation of audit database and instance level
  • High Availability with Live Migration, Mirroring, Log Shipping and Clustering
  • Centralization and Information Analysis with Data Collector
  • T-SQL ( TCL, DCL, DML and DDL )
  • Managing users and permissions, creating complex stored procedures with dynamic operation
  • Creating and Configuring Linked Server
  • Dimensional Modeling - Star Schema and Data Warehouse
  • Management, monitoring and management of all customers databases
  • Installation and Management of a Hyper-V Host with more than 15 machines inside it
  • Implementation of Capacity Planning
  • Configuration and best practices of MDW ( Management Data Warehouse )
  • Implementation and management of ColumnStore Index
  • Using Table Partitioning for large tables
  • Full -Text Search and FileTables
  • Migration Strategy Servers from Brazil to the United States
  • Implementation of Resource Governor for load balancing

SQL Server Specialist Consultant

Jul 2012 – Jan 2013 · 6 mos

  • Optimization of servers, troubleshooting, best practices, implementation of high availability as: Database Mirroring and Log Shipping with TDE than the administration and management of larger databases with 1.5 TB. Implementation and indexing partitioning also columnstore in SQL Server 2012 to provide scalability and performance to a Data Warehouse Scenarios.

Hepta informatica ltda

Instructor - [MCT]

Feb 2013 – Oct 2016 · 3 yrs 8 mos · CPLS

  • Executing Microsoft Official Course (MOC) for technologies such as Microsoft as SQL Server, Windows Server & System Center.
  • See here some of the courses that I am teaching nowadays...
  • MOC: 10774 – Querying Microsoft SQL Server 2012
  • MOC: 10775 – Administering Microsoft SQL Server 2012
  • MOC: 10777 – Implementing a Data Warehouse with Microsoft SQL Server 2012
  • MOC: 10747C – Administering System Center 2012 Configuration Manager

Professional association for sql server [pass]

Speaker

May 2012 – Present · 14 yrs 1 mo

  • Here are some presentations that I have performed in PASS during the years.

Conselho federal da oab

Data Architect - [SQL Server]

Jan 2011 – May 2012 · 1 yr 4 mos · Saus, Quadra 5, Lote 1, Bloco M, Asa Sul, Brasília - DF, 70070-939

  • Field in the Configuration, Implementation and Administration of SQL Server 2005, 2008, 2008 R2 & 2012.
  • Administration of all databases and instances of the 27 states of Brazil. Implementing High Availability, Develop BI Projects, but also everywhere Development in T-SQL code. Work in a big integration about all the states of Brazil to provide information about all lawyers data - http://cna.oab.org.br/
  • Architecture of servers and proper storage
  • Disaster Recovery Planning
  • Policy for backups and recovery
  • Database Tuning
  • Evaluation of queries for performance improvement, reading execution plan and more
  • Creating maintenance plans
  • Creating policies using the Policy Based Management
  • Control the allocation of resources and scalability with Resource Governor 2008/2008 R2
  • Full implementation of audit database and instance level
  • High Availability with Live Migration, Mirroring, Log Shipping and Clustering
  • Centralization and Information Analysis with Data Collector - MDW
  • Field monitoring capabilities with SQL Profiler, System Monitor, Analyze of Logs, Event Viewer
  • Create Alerts, Dynamic Management Views [DMVs] and PAL - Performance Analysis of Log
  • T-SQL ( TCL, DCL, DML and DDL )
  • Managing users and permissions
  • Creating complex stored procedures, functions, constraints, triggers and views
  • Design Indexes, tables and CLR assemblies [C #] creations
  • Creating and Configuring Linked Server
  • Setup DataBaseMail
  • Creating EndPoint - WebServices
  • ETL with Integration Services

Grupo aliança

Jr. SQL Server DBA

Jan 2010 – Dec 2010 · 11 mos

  • Domain in the configuration, implementation and administration of SQL Server 2005 and 2008 databases.
  • Administration Server and SQL Server. Implementation and processing information for import into the ProCenter Database (System that holds calls to Call Center), Importing and processing of .txt files.
  • Verification of Database Servers
  • Writing Queries and Reports
  • Using SSAS, SSRS and SSIS Reporting and BI
  • Programming: Stored Procedures, Views, Functions
  • Implementation of High Availability - Database Mirroring
  • Scripting for Server Monitoring Database
  • Construction of a Data Warehouse using SSIS 2008

Stackforce found 100+ more professionals with Data Engineering & Cloud Computing

Explore similar profiles based on matching skills and experience

Tushar Kanhere

Tushar Kanhere

Assistant Administration Manager

at Chellaram Hospital Diabetes Care & Multispeciality

Pune, India7 yrs 2 mos exp
Clinical ResearchBiomedicalTeam LeadershipOffice AdministrationClinical Data Management
Pooja Suresh

Pooja Suresh

Founding Product Designer

at Bentley University - McCallum Graduate School of Business

United States5 yrs 6 mos exp
Product DesignUser Experience (UX)UX Research
Shree Mundade

Shree Mundade

Director & CEO

at Supagigs

Mumbai, India5 yrs 2 mos exp
New Business DevelopmentYardiFull Stack DevelopmentCloud Computing
Atharv Potpelwar

Atharv Potpelwar

Deputy Manager

at _VOIS

Pune, India5 yrs 8 mos exp
PostgreSQLDatabase Administration
Suman Kumari

Suman Kumari

Senior Human Resources Manager

at ALPHA PRO SERVICES

New Delhi, India1 yr 11 mos exp
RecruitingTalent ManagementHR Strategy
Yash Songire

Yash Songire

Full Stack Developer

at Renocrew Solutions

Pune, India5 yrs 2 mos exp
Full-Stack DevelopmentJavaSpring Boot
Naren Parashar

Naren Parashar

AI Product Manager

at GreyLabs AI

Bengaluru, India7 yrs 5 mos exp
Product ManagementAI Product DevelopmentData AnalysisProduct DesignUser Experience
Vaibhav Vishal

Vaibhav Vishal

Product Designer

at Emoha

Delhi, India3 yrs 10 mos exp
Product DesignUser Experience Design (UED)User Experience (UX)User Research