Position Summary 
<ul>
<li>Design and implement scalable data lake architectures using Azure Data Lake services.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Develop and maintain data pipelines to ingest data from various sources.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Optimize data storage and retrieval processes for efficiency and performance.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Ensure data security and compliance with industry standards.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Collaborate with data scientists and analysts to facilitate data accessibility.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Monitor and troubleshoot data pipeline issues to ensure reliability.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Document data lake designs, processes, and best practices.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Experience with SQL and NoSQL databases, as well as familiarity with big data file formats like Parquet and Avro. </li>
</ul>
Essential 
Roles and Responsibilities 
Must Have Skills 
<ul>
<li style="margin-left:1.6rem;">Azure Data Lake</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Azure Synapse Analytics</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Azure Data Factory</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Azure DataBricks</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Python (PySpark, Numpy etc)</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">SQL</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">ETL</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Data warehousing</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Azure Devops</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Experience in developing streaming pipeline using Azure Event Hub, Azure Stream analytics, Spark streaming</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Experience in integration with business intelligence tools such as Power BI </li>
</ul>
Good To Have Skills 
<ul>
<li style="margin-left:1.6rem;">Big Data technologies (e.g., Hadoop, Spark)</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Data security </li>
</ul>
General Skills 
<ul>
<li style="margin-left:1.6rem;">Experience with Agile and DevOps methodologies and the software development lifecycle.</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Proactive and responsible for deliverables </li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Escalates dependencies and risks</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Works with most DevOps tools, with limited supervision</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Completion of assigned tasks on time and regular status reporting </li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Should be able to train new team members </li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Desired to have knowledge on any of the cloud solutions such as Azure or AWS with DevOps/Cloud certifications. </li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Should be able to work with a multi culture global teams and team virtually</li>
</ul>

<ul>
<li style="margin-left:1.6rem;">Should be able to build strong relationship with project stakeholders </li>
</ul>

Data Engineering in Gurugram (UID-9496)

Job Description

Job Details

Skills Required for Data Engineering

Job Description for Data Engineering

Explore More Opportunities