Big Data Engineer - Resume Example & Template

Resume of Big Data Engineer in Text Format

DIVYANSHI GROVER

Phone Number:  9953776253 | Email : info@getsetresumes.com | LinkedIn: linkedin.com/company/getsetresumes

BIG DATA ENGINEER-leveraging +5 years of experience

Highly skilled Big Data Engineer with 5+ years of hands on experience in installing, configuring, monitoring, and using Hadoop ecosystem components like Hadoop Map-Reduce, HDFS, HBase, Hive, Sqoop, Pig, Zookeeper, Horton works, Flume. Worked on developing ETL processes to load data from multiple data sources to HDFS using SQOOP , Pig & Oozie. Extensive experience in working with Cloudera (CDH4 & 5), and Hortonworks Hadoop distros and AWS Amazon EMR, to fully leverage and implement new Hadoop features. Proven developer in core Java, Scala, SQL, PL/SQL and Restful web services. 

PROFILE SUMMARY

• Highly experienced in importing and exporting data between HDFS and Relational Database Management systems using Sqoop.
• Proficient in Creating Vizboards for data visualization in Plat fora for real - time dashboard on Hadoop.
• Highly skilled in installation, configuration, administration, troubleshooting, tuning, security, backup, recovery and upgrades of Cent OS, Red Hat Enterprise Linux (RHEL) operating systems in a large environment
• Hands on experience in installing, configuring, monitoring, and using Hadoop ecosystem components like Hadoop Map-Reduce, HDFS, HBase, Hive, Sqoop, Pig, Zookeeper, Horton works, Flume 

CORE COMPETENCIES

• Data Optimization
• Machine Learning Algorithms
• Big Data
• Cloud Platforms
• Data Pipelines
• Data Science

PROFESSIONAL EXPERIENCE

Bellurbis LLC, Greater Noida Jan. 2019 – Oct. 2021

Big Data Engineer

• Involved in gathering requirements from client and estimating time line for developing complex queries using Hive for logistics application.
• Developed data pipeline using Flume, Pig, Sqoop to ingest cargo data and customer histories into HDFS for analysis.
• Worked on importing data from MySQL DB to HDFS and vice-versa using Sqoop to configure Hive metastore with MySQL , which stores the metadata for Hive tables
• Operated NoSQL databases like HBase and imported data from MySQL and processed data using Hadoop Tools and exported to Cassandra NoSQL database.
• Developed workflows in Oozie and scheduling jobs in Mainframes by preparing data refresh strategy document & Capacity planning documents required for project development and support.
• Installed and configured Hive, Pig, Sqoop, Oozie on the Hadoop cluster by setting up and benchmarked Hadoop clusters for internal use.

Clarivate, Greater Noida Sept. 2016 – Dec 2018

Big Data Engineer 

• Evaluated suitability of Hadoop and its ecosystem to the above project and implementing with various proof of concept (POC) applications to eventually adopt them to benefit from the Big Data Hadoop initiative.
• Estimated the Software & Hardware requirements for the Name Node and Data Node & planning the cluster.
• Extracted the needed data from the server into HDFS and Bulk Loaded the cleaned data into Hbase.
• Lead role in NoSQL column family design, client access software, Cassandra tuning; during migration from Oracle based data stores.
• Designed, implemented and deployed within a customer’s existing Hadoop & Cassandra cluster a series of custom parallel algorithms for various customer defined metrics and unsupervised learning models.

ACADEMIC CREDENTIALS 

Bachelor’s Degree in Computer Science | Amity University , Lucknow | 2016

Certificates : Certified Data Management Professional (CDMP) | Cloudera Certified Data Engineer | IBM Certified Data Engineer - Big Data

Databases: Oracle, Teradata, DB2, MS-SQL Server, MySQL, MS-Access

Programming Languages: Scala, Python, SQL, Java, PL/SQL, Linux shell scripts

PERSONAL DOSSIER

Languages Known : English, Hindi, German

~References and other document’s available~