Key Responsibilities:

<ul>
<li style="margin-left:0px;">Design and implement robust, scalable, and high-performance data pipelines using PySpark and Big Data tools.</li>
</ul>

<ul>
<li style="margin-left:0px;">Develop and maintain workflows using Airflow and Oozie for data ingestion, transformation, and orchestration.</li>
</ul>

<ul>
<li style="margin-left:0px;">Work with HBase and Hive for structured and semi-structured data storage and querying.</li>
</ul>

<ul>
<li style="margin-left:0px;">Collaborate with data analysts, architects, and stakeholders to gather requirements and deliver solutions.</li>
</ul>

<ul>
<li style="margin-left:0px;">Deploy and manage data solutions in Azure Cloud environment.</li>
</ul>

<ul>
<li style="margin-left:0px;">Ensure data quality, integrity, and governance across all pipelines.</li>
</ul>

<ul>
<li style="margin-left:0px;">Develop scripts and automation using Python and Unix shell scripting.</li>
</ul>

<ul>
<li style="margin-left:0px;">Support CI/CD practices for automated deployment and testing.</li>
</ul>

<ul>
<li style="margin-left:0px;">Monitor performance and troubleshoot issues in large-scale data environments.</li>
</ul>

Required Skills &amp; Qualifications:

<ul>
<li style="margin-left:0px;">5+ years of experience in Big Data engineering or a related field.</li>
</ul>

<ul>
<li style="margin-left:0px;">Strong expertise in PySpark, Python, and Java.</li>
</ul>

<ul>
<li style="margin-left:0px;">Hands-on experience with Big Data tools: HBase, Hive, Airflow, Oozie.</li>
</ul>

<ul>
<li style="margin-left:0px;">Proficiency in Azure Cloud services related to data (Data Lake, Data Factory, Synapse, etc.).</li>
</ul>

<ul>
<li style="margin-left:0px;">Solid understanding of Unix/Linux environments.</li>
</ul>

<ul>
<li style="margin-left:0px;">Experience with CI/CD tools like Jenkins, Git, or Azure DevOps.</li>
</ul>

<ul>
<li style="margin-left:0px;">Excellent problem-solving and analytical skills.</li>
</ul>

<ul>
<li style="margin-left:0px;">Strong communication and collaboration abilities. </li>
</ul>

Big Data Developer in New Delhi (UID-8986)

Job Description

Job Details

Skills Required for Big Data Developer

Job Description for Big Data Developer

Explore More Opportunities