About
About Me
I’m passionate about building data-driven systems that solve real-world problems. My work spans developing data pipelines, transforming datasets, and creating automated solutions using tools like Azure, Databricks, and SQL. I also have experience in software development with Java, Python, and Kotlin, delivering applications that are both functional and scalable.
My academic foundation includes postgraduate studies in Artificial Intelligence and Data Analytics from Durham College, complemented by a Bachelor’s in Computer Engineering. I’ve earned certifications such as Databricks Certified Data Engineer Associate, Azure Data Fundamentals,
continuously sharpening my skills in modern data platforms.
Outside the technical realm, I lead The Executors’ Club, a community focused on personal growth and productivity. I enjoy sharing knowledge, creating digital content, and connecting with others. In my free time, you’ll find me reading, playing the keyboard, or exploring nature — always seeking creativity and balance.
Experience
My Experience
- Developed and optimized ETL pipelines using SSIS and SQL Server, streamlining healthcare data integration and improving processing efficiency across clinical and administrative systems.
- Designed automated reports using SSRS, reducing manual reporting time by 15+ hours per week and enabling faster, data-driven decision-making in healthcare operations.
- Collaborated with cross-functional teams to gather requirements, implement logic validations, and ensure compliance with healthcare data standards, enhancing data accuracy and reliability.
- Collaborated with Business Analysts, QA, and Project Managers to translate business requirements into functional data workflows, improving project efficiency by 20%.
- Developed and maintained ETL pipelines to integrate and transform large datasets, ensuring high data quality and supporting scalable reporting solutions.
- Implemented data validation and transformation logic using SQL and Java, ensuring consistency and accuracy across integrated datasets, which improved end-user confidence in reporting outputs.
- Utilized LSTM neural networks to significantly enhance financial forecasting accuracy for Bitcoin, aiding in the formulation of informed trading strategies.
- Created and tested a quantitative trading algorithm that improved investment returns by strategically analyzing historical price data to generate precise buy/sell signals.
- Conducted exploratory data analysis with Python tools to deepen understanding of market trends and volatility, refining data-driven strategies.
- Built secure data storage solutions on Azure Data Lake Storage Gen2 and optimized data partitioning strategies, reducing storage costs and improving query performance.
- Developed and deployed analytical solutions using Azure Synapse Analytics, enabling faster and more reliable reporting for business stakeholders.
- Developed SQL-based transformation logic, quality checks, and cleansing rules to ensure accurate and trusted data for downstream reporting.
Blog
My Blog
Explore my latest blogs by clicking the button below and dive into a range of topics on my Medium account. Stay informed, inspired, and connected!
Contact
Get In Touch With Me.
Interested in learning more about me, my work or how we can collaborate on an upcoming project? Feel free to reach out anytime via email, I would be more than happy to chat.
- hello@harpalvaghela.com
- https://topmate.io/harpal_vaghela
- https://beacons.ai/harpalvaghela