Key Responsibilities:

<ul>
<li>Data Integration:Lead the integration of data from FLEXCUBE core banking systems into our Hadoop-based data infrastructure. Develop and maintain efficient data ingestion processes.</li>
</ul>

<ul>
<li>Hadoop Ecosystem:Design, build, and optimize data pipelines within the Hadoop ecosystem, including HDFS, Sqoop, Unix shell scripting, Python coding and Spark.</li>
</ul>

<ul>
<li>Data Modelling:Create and maintain data models, schemas, and structures to support data analysis and reporting requirements.</li>
</ul>

<ul>
<li>ETL Processes:Develop Extract, Transform, Load (ETL) processes to cleanse, enrich, and transform data for downstream consumption.</li>
</ul>

<ul>
<li>Data Quality:Implement data quality checks and monitoring processes to ensure the accuracy, completeness, and consistency of data.</li>
</ul>

<ul>
<li>Performance Optimization:Optimize data processing and query performance within the Hadoop ecosystem.</li>
</ul>

<ul>
<li>Data Security:Ensure data security and compliance with data privacy regulations during data handling and processing.</li>
</ul>

<ul>
<li>Documentation:Maintain thorough documentation of data pipelines, transformations, and data flow processes.</li>
</ul>

<ul>
<li>Collaboration:Collaborate with cross-functional teams, including FLEXCUBE consulting, data scientists, analysts, and business stakeholders, to understand data requirements and deliver actionable insights.</li>
</ul>

<ul>
<li>Mastery of the FLEXCUBE 14.7 backend tables and data model is essential.</li>
</ul>

Qualifications:

<ul>
<li>Bachelor's degree in Computer Science, Information Technology, or a related field.</li>
</ul>

<ul>
<li>5 to 8 Years of proven experience in designing and implementing data solutions within the Hadoop ecosystem.</li>
</ul>

<ul>
<li>Strong expertise in Hadoop components such as HDFS, Sqoop, Unix shell scripting, Python coding and Spark</li>
</ul>

<ul>
<li>Experience with FLEXCUBE integration and data extraction.</li>
</ul>

<ul>
<li>Proficiency in SQL and database systems.</li>
</ul>

<ul>
<li>Knowledge of data modelling and ETL processes.</li>
</ul>

<ul>
<li>Strong problem-solving and analytical skills.</li>
</ul>

<ul>
<li>Excellent communication and teamwork abilities.</li>
</ul>

<ul>
<li>Banking or financial industry experience is a plus.</li>
</ul>

<ul>
<li>Certifications in Hadoop or related technologies are beneficial.</li>
</ul>

Senior Data Engineer

Job Details & Overview

Skills Required for Senior Data Engineer

Job Description for Senior Data Engineer