Contact Work Experience: Data Engineer
Contact Work Experience: Data Engineer
+91-8209466923
[email protected] Big Data Spark | Scala | PySpark | Hive based Module Developer
LinkedIn
Demonstrated expertise in Big data technologies stack. Sound base in designing,
Development and maintaining Big Data solutions, data pipelines and processing
EDUCATION framework. Experience in development on Big Data/Hadoop technologies of over 4 years
with overall 6.5 years of IT Experience.
B.Tech
Computer Science and Engg,
Uttarakhand technical University Data Engineer
Dehradun IBM / March 2020 – Present
2010-2014 Project: BASELIII DDEP
Tech Stack: Spark, Hive, PySpark, Azure DevOps, Control-M, Hbase
SKILLS
Big Data stack ● Building the Data Pipeline based on the transformed legacy models
Big Data Hadoop (Cloudera ● Data Processing with Spark Modules and Shell scripts used for execution
distribution) ● Transformations and Join modules written in PySpark
Spark ● Maintaining end to end documentation for data flow and transformations
Scala on Spark ● Workflow automation and job execution using Control-M
Hive ● Following Agile methodology and CI-CD pipeline for version control and code
Sqoop deployment
Hbase ● Analyzing and translating business requirements to technical requirements and
Unix-Shell Scripting architecture
Databases
MySql Big Data Developer
Oracle XORIANT / Oct 2019 – March 2020
Teradata Project: AI-EXIT
Schedulers Tech Stack: Hive, Spark SQL, Shell Script, Autosys, Oracle, Ab Initio -M,
Oozie
Control-M The AI Exit Project aims at developing an In-house ETL tool based on Spark and Hive for our
Autosys client. Currently the Client uses Ab-Initio for it’s ETL operations The AI-Exit team aims at
Code Repo/Version Control replacing this client dependency with this new tool.
Git
Bitbucket ● Building the Data flow according to the existing ETL Jobs.
Azure DevOps ● Data Processing with Spark Modules
● ETL Modules like Filter, transformation, Enrichment, Target Load are run at Back end
● Handling the Configuration entries and Metadata
Certifications ● Jobs Execution monitoring and Jobs automation using Autosys
Microsoft Certified: Azure ● Communication with onsite coordinators and clients on a regular basis.
Fundamentals
● Analyzing and translating business requirements to technical requirements and
Docker Essentials: A Developer
architecture
Introduction
Containers, K8s and Istio on IBM
Cloud Technology Engineer
Amdocs / May 2016 – Oct 2020
Project: Big Data Analytics (BDA) & Amdocs Data Hub (ADH)
Tech Stack: Oracle, MySQL, HDFS, Hive, Spark SQL, Shell Script, Oozie
Programmer Analyst
Cognizant / Sep 2014 – May 2016
Project: IPB Regulatory Reporting (IPB)
Achievements
● Received “ACE” Award twice for Delivering High and Consistent Performance
● Received “Pat on the Back” award for 4 Sprints out of 6 total Sprints.
● Received “SPOT” Award by Project Manager for analyzing and fixing critical issues
● Received many appreciations from Client side.