Functional Skills
Data Modeling
Data Collection / Research
Data Mining
Data Transformation
Crisis Management
Cryptocurrency
Revenue Cycle Optimization
Tax Advisory
Software Skills
Scala
Java
SQL
BigData
UNIX
Python
Apache Spark
Snowflake
AWS
Azure
C
GitHub
JavaScript
Machine Learning
Mapreduce
Certifications
AWS Certified Cloud Practitioner
CDCertified Drafter
Sector Experience
Financial Services
Technology
Languages
English
Hindi
Big 4 Accounting
Fortune 500
Top Consulting Firms
Experience
Shopify
Data Science / Analytics
Data Engineer
1/2022 - Present
Tech: Databricks, python
● pyspark
● Spark
● Data Integration,Git, Spark streaming, Lambda functions,golang,java
● AWS Job Details
● Worked on some exciting in-house products (EDMs) that will enable the store owners to query the store data.
● pyspark
● Spark
● Data Integration,Git, Spark streaming, Lambda functions,golang,java
● AWS Job Details
● Worked on some exciting in-house products (EDMs) that will enable the store owners to query the store data.
Expedia Group
Data Science / Analytics
Machine Learning Engineer
5/2021 - 12/2021
Tech: Databricks, scala, python, java
● pyspark
● Spark
● Data Integration,Git,Spark streaming Job Details
● Responsible to creating various ETL pipelines for the sorting Models used by Expedia. Also have been involved in feature engineering and exploratory data analysis of the raw data
●
● pyspark
● Spark
● Data Integration,Git,Spark streaming Job Details
● Responsible to creating various ETL pipelines for the sorting Models used by Expedia. Also have been involved in feature engineering and exploratory data analysis of the raw data
●
Canadian National Railway
Design
Specialist Data Designer
5/2019 - 5/2021
Tech: Nifi, Hive, Spark, Azure Data Factory, java
● ooze
● Databricks
● REST Api
● Data Integration
● Data Ingestion Job Details
● Created Various data pipelines for streaming as well as batch data. Also designed complex projects like ATIP(automatic track inspection).
● ooze
● Databricks
● REST Api
● Data Integration
● Data Ingestion Job Details
● Created Various data pipelines for streaming as well as batch data. Also designed complex projects like ATIP(automatic track inspection).
Ernst & Young (EY)
Information Technology
Manager
2/2016 - 3/2019
Tech
● Solr, Talend, Python, Hive, Nifi, Talend, Databricks
● pySpark
● Data Integration Job Details: Worked as a Hadoop Architect and helped EY in designing the Hadoop platform for Great Eastern. Also implemented few POC in Hadoop to showcase the ability of Hadoop and related technologies
●
● Solr, Talend, Python, Hive, Nifi, Talend, Databricks
● pySpark
● Data Integration Job Details: Worked as a Hadoop Architect and helped EY in designing the Hadoop platform for Great Eastern. Also implemented few POC in Hadoop to showcase the ability of Hadoop and related technologies
●
Optimum Solution
Information Technology
Senior Hadoop Consultant
3/2016 - 2/2019
Tech
● Hive, Spark, Hbase, Zeppelin, Java, Unix, Kafka, Solr, Banana, Python, Scala, Control M, AWS
● Databricks
● pyspark
● REST api
● Data Integration Job Details: Worked on various project for Standard Chartered Bank, helped the bank in implementing the banking data model (FSLDM) on Hadoop, we had used Hive primarily for this project. Also implemented a project for indexing all the customers and their respective transactions across the globe for implementing a single window search application.Used python and spark to automate all the redundant processes which drastically improved the performance of the overall project.
● Hive, Spark, Hbase, Zeppelin, Java, Unix, Kafka, Solr, Banana, Python, Scala, Control M, AWS
● Databricks
● pyspark
● REST api
● Data Integration Job Details: Worked on various project for Standard Chartered Bank, helped the bank in implementing the banking data model (FSLDM) on Hadoop, we had used Hive primarily for this project. Also implemented a project for indexing all the customers and their respective transactions across the globe for implementing a single window search application.Used python and spark to automate all the redundant processes which drastically improved the performance of the overall project.
WIPRO TECHNOLOGIES,BANGALORE
Information Technology
Hadoop Lead
10/2014 - 3/2016
Tech
● Spark, Java, Mapreduce, QlickView, SSRS, SSIS, HBase, MS SQL Job Details: helped Hewlett-Packard in migrating various data pipelines from traditional systems to big data platform. This involved integrating various RDBMS with Hive and HBase .For this project we had to reengineer various data pipelines and recreate them using Spark, Hive and mapreduce jobs. The various jobs required for the pipeline were integrated using apache oozie.
● Spark, Java, Mapreduce, QlickView, SSRS, SSIS, HBase, MS SQL Job Details: helped Hewlett-Packard in migrating various data pipelines from traditional systems to big data platform. This involved integrating various RDBMS with Hive and HBase .For this project we had to reengineer various data pipelines and recreate them using Spark, Hive and mapreduce jobs. The various jobs required for the pipeline were integrated using apache oozie.
Steria
Information Technology
Senior Software Engineer
6/2013 - 10/2014
Tech
● Hadoop, Mapreduce
● Java
● .net, JavaScript, MSSQL, Hive, Flume, sqoop Job Details:Got trained in Hadoop and implemented a project for Boots the chemist which was responsible to ingest streaming data using Flume and structured data from RDBMS using Sqoop and finally create a dashboard once the data was processed in Hadoop using Mapreduce jobs
● Also was involved in creating a self service portal for the client's customers.
● Hadoop, Mapreduce
● Java
● .net, JavaScript, MSSQL, Hive, Flume, sqoop Job Details:Got trained in Hadoop and implemented a project for Boots the chemist which was responsible to ingest streaming data using Flume and structured data from RDBMS using Sqoop and finally create a dashboard once the data was processed in Hadoop using Mapreduce jobs
● Also was involved in creating a self service portal for the client's customers.
Fiserv
Information Technology
Senior Software Engineer
11/2011 - 6/2013
Tech
● .net 3.5, Java
● Jquery, mySQL
● TFS Job Details: Was the developer for the Automatic clearing House(ACH) product. Developed various new features and enhancements for the product.
● .net 3.5, Java
● Jquery, mySQL
● TFS Job Details: Was the developer for the Automatic clearing House(ACH) product. Developed various new features and enhancements for the product.
Infosys
Information Technology
Software Engineer
9/2008 - 10/2011
Tech
● .net 3.5, Java
● WCF ,WPF, MS SQL
● TFS Job Details: Got trained in asp.net and developed a customer self service portal for united utilities using .net and related technologies.
● .net 3.5, Java
● WCF ,WPF, MS SQL
● TFS Job Details: Got trained in asp.net and developed a customer self service portal for united utilities using .net and related technologies.