Qualifications:

<ul>
<li style="margin-left:0px;">4 to 7 years of experience in ETL &amp; Data Warehousing</li>
</ul>

<ul>
<li style="margin-left:0px;">Should Have mid level experience in Teradata Coding</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have excellent leadership &amp; communication skills</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have experience in developing Data Engineering solutions Airflow, GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, etc.</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have built solution automations in any of the above ETL tools</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have executed at least 2 GCP Cloud Data Warehousing projects</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have worked at least 2 projects using Agile/SAFe methodology</li>
</ul>

<ul>
<li style="margin-left:0px;">Should Have mid level experience in Pyspark and Teradata</li>
</ul>

<ul>
<li style="margin-left:0px;">Should Have mid level experience in</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have working experience on any DevOps tools like GitHub, Jenkins, Cloud Native, etc &amp; on semi-structured data formats like JSON, Parquet and/or XML files &amp; written complex SQL queries for data analysis and extraction</li>
</ul>

<ul>
<li style="margin-left:0px;">Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality &amp; Data Mapping</li>
</ul>

Responsibilities:

<ul>
<li style="margin-left:0px;">Analyze the different source systems, profile data, understand, document &amp; fix Data Quality issues</li>
</ul>

<ul>
<li style="margin-left:0px;">Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users</li>
</ul>

<ul>
<li style="margin-left:0px;">Write complex SQLs to extract &amp; format source data for ETL/data pipeline</li>
</ul>

<ul>
<li style="margin-left:0px;">Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration</li>
</ul>

<ul>
<li style="margin-left:0px;">Design, Develop and Test ETL/Data pipelines</li>
</ul>

<ul>
<li style="margin-left:0px;">Design &amp; build metadata-based frameworks needs for data pipelines</li>
</ul>

<ul>
<li style="margin-left:0px;">Write Unit Test cases, execute Unit Testing and document Unit Test results</li>
</ul>

<ul>
<li style="margin-left:0px;">Deploy ETL/Data pipelines</li>
</ul>

<ul>
<li style="margin-left:0px;">Use DevOps tools to version, push/pull code and deploy across environments</li>
</ul>

<ul>
<li style="margin-left:0px;">Support team during troubleshooting &amp; debugging defects &amp; bug fixes, business requests, environment migrations &amp; other adhoc requests</li>
</ul>

<ul>
<li style="margin-left:0px;">Do production support, enhancements and bug fixes</li>
</ul>

<ul>
<li style="margin-left:0px;">Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations</li>
</ul>

<ul>
<li style="margin-left:0px;">Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge</li>
</ul>

<ul>
<li style="margin-left:0px;">Perform data cleaning, transformation, and validation to ensure accuracy and consistency across various data sources</li>
</ul>

<ul>
<li style="margin-left:0px;">Stay current on industry best practices and emerging technologies in data analysis and cloud computing, particularly within the GCP ecosystem</li>
</ul>

Data Engineer in Bengaluru (UID-8411)

Job Description

Job Details

Skills Required for Data Engineer

Job Description for Data Engineer

Explore More Opportunities