Hi, I'm Kuldeep Pal Data Engineer
Transforming complex data challenges into elegant solutions. Specializing in building robust data pipelines and analytics infrastructure.
About Me
Data Engineer with expertise in building scalable data pipelines and analytics solutions
Technical Expertise
Professional Journey
With over 5 years of experience in data engineering, I've worked with leading companies to build and optimize data infrastructure, implement ETL pipelines, and deliver valuable insights through data analytics.
Data Pipeline Development
Building scalable and efficient ETL processes
Performance Optimization
Enhancing data processing efficiency
Technical Skills
Expertise in modern data engineering tools and technologies
Python
Airflow
Apache Spark
PostgreSQL
Databricks
Tableau
Featured Projects
Showcasing my expertise in data engineering and analytics
Data Pipeline Architecture
Built using Apache Airflow & Spark
Analytics Dashboard
Developed with Tableau & PostgreSQL
ETL Framework
Implemented with Python & Databricks
Data Lake Architecture
Built on Cloud Infrastructure
Real-time Analytics
Using Spark Streaming
Professional Experience
Building data solutions at industry-leading companies
Senior Data Engineer
Walmart Global Tech | 2022 - Present
- • Led development of scalable data pipelines processing 100TB+ data daily
- • Implemented real-time analytics solutions using Spark Streaming
- • Optimized ETL workflows reducing processing time by 40%
Data Engineer
ZS Associates | 2020 - 2022
- • Designed and maintained data warehouse architecture
- • Built automated data quality monitoring systems
- • Developed dashboards for business intelligence reporting
System Engineer
Tata Consultancy Services | 2018 - 2020
- • Developed ETL pipelines using Python and Apache Airflow
- • Implemented data integration solutions for client projects
- • Collaborated with cross-functional teams for data analysis
Technologies Worked With
Client Testimonials
What colleagues and clients say about my work