Responsibilities:

<ul>
<li style="margin-left:0px;">Architect and implement enterprise-grade data migration solutions using Java and Python, enabling seamless data transfers from on-premises to GCP (Cloud Storage, Big Query, Pub/Sub) using Apache Airflow and Google Cloud Composer.</li>
</ul>

<ul>
<li style="margin-left:0px;">Build secure, scalable, and optimized data architectures leveraging GCP services such as Cloud Storage, Pub/Sub, Dataproc, Dataflow, and Big Query.</li>
</ul>

<ul>
<li style="margin-left:0px;">Design and implement automated frameworks for data delivery, monitoring, and troubleshooting.</li>
</ul>

<ul>
<li style="margin-left:0px;">Develop data observability frameworks to ensure quality, lineage, and reliability across pipelines.</li>
</ul>

<ul>
<li style="margin-left:0px;">Proactively monitor system performance, identify bottlenecks, and optimize pipelines for efficiency, scalability, and cost.</li>
</ul>

<ul>
<li style="margin-left:0px;">Troubleshoot and resolve complex technical issues in distributed systems and cloud environments.</li>
</ul>

<ul>
<li style="margin-left:0px;">Drive best practices in documentation of tools, architecture, processes, and solutions.</li>
</ul>

<ul>
<li style="margin-left:0px;">Mentor junior engineers, conduct design/code reviews, and influence engineering standards.</li>
</ul>

<ul>
<li style="margin-left:0px;">Collaborate with cross-functional teams to enable AI/ML and GenAI-driven use cases on LUMI.</li>
</ul>

Minimum Qualifications:

<ul>
<li style="margin-left:0px;">8+ years of experience in data engineering, software engineering, or platform development.</li>
</ul>

<ul>
<li style="margin-left:0px;">Strong programming expertise in Java, Python, and Shell scripting.</li>
</ul>

<ul>
<li style="margin-left:0px;">Advanced knowledge of SQL, data modeling, and performance optimization.</li>
</ul>

<ul>
<li style="margin-left:0px;">Deep expertise in Google Cloud Platform services: Cloud Storage, Big Query, Pub/Sub, Dataproc, Dataflow.</li>
</ul>

<ul>
<li style="margin-left:0px;">Strong background in RDBMS (Oracle, Postgres, MySQL) and exposure to NoSQL DBs (Cassandra, MongoDB, or similar).</li>
</ul>

<ul>
<li style="margin-left:0px;">Proven track record in CI/CD pipelines, Git workflows, and Agile development.</li>
</ul>

<ul>
<li style="margin-left:0px;">Demonstrated experience in building and scaling production-grade data pipelines.</li>
</ul>

<ul>
<li style="margin-left:0px;">Strong problem-solving and troubleshooting skills in distributed and cloud-native systems.</li>
</ul>

Preferred Qualifications:

<ul>
<li>Hands-on experience with DevOps best practices, automation, and infrastructure as code.</li>
</ul>

<ul>
<li style="margin-left:0px;">Exposure to platform engineering (networking, security, IAM, firewalls).</li>
</ul>

<ul>
<li style="margin-left:0px;">Experience designing and implementing data observability frameworks (monitoring, lineage, anomaly detection).</li>
</ul>

<ul>
<li style="margin-left:0px;">Hands-on or exposure to GenAI integrations (LLMs, RAG, AI-driven data engineering workflows).</li>
</ul>

<ul>
<li style="margin-left:0px;">Proven ability to mentor, influence, and lead engineering discussions.</li>
</ul>

Sr Data Engineer in New Delhi (UID-11753)

Job Description

Job Details

Skills Required for Sr Data Engineer

Job Description for Sr Data Engineer

Explore More Opportunities