Roles Responsibilities

<ul>
<li>Create Scala/Spark/Pyspark jobs for data transformation and aggregation</li>
</ul>

<ul>
<li>Produce unit tests for Spark transformations and helper methods</li>
</ul>

<ul>
<li>Used Spark and Spark-SQL to read the parquet data and create the tables in hive using the Scala API</li>
</ul>

<ul>
<li>Work closely with Business Analysts team to review the test results and obtain sign offPrepare necessary design/operations documentation for future usage</li>
</ul>

<ul>
<li>Perform peers Code quality review and be gatekeeper for quality checks</li>
</ul>

<ul>
<li>Hands-on coding, usually in a pair programming environment</li>
</ul>

<ul>
<li>Working in highly collaborative teams and building quality code</li>
</ul>

<ul>
<li>The candidate must exhibit a good understanding of data structures, data manipulation, distributed processing, application development, and automation</li>
</ul>

<ul>
<li>Familiar with Oracle, Spark streaming, Kafka, ML</li>
</ul>

<ul>
<li>To develop an application by using Hadoop tech stack and delivered effectively, efficiently, on-time, in-specification and in a cost-effective manner</li>
</ul>

<ul>
<li>Ensure smooth production deployments as per plan and post-production deployment verification</li>
</ul>

<ul>
<li>This Hadoop Developer will play a hands-on role to develop quality applications within the desired timeframes and resolving team queries</li>
</ul>

Requirements

<ul>
<li>Hadoop data engineer with total 4 - 7 years of experience and should have strong experience in Hadoop, Spark, Scala, Java, Hive, Impala, CI/CD, Git, Jenkins, Agile Methodologies, DevOps, Cloudera Distribution</li>
</ul>

<ul>
<li>Strong Knowledge in data warehousing Methodology</li>
</ul>

<ul>
<li>Relevant 4+ years of Hadoop Spark/Pyspark experience is mandatory</li>
</ul>

<ul>
<li>Strong in enterprise data architectures and data models</li>
</ul>

<ul>
<li>Good experience in Core Banking, Finance domain</li>
</ul>

<ul>
<li>Good to have Cloud experience on AWS</li>
</ul>

Data Engineer in New Delhi (UID-8467)

Job Description

Job Details

Skills Required for Data Engineer

Job Description for Data Engineer

Explore More Opportunities