<ul>
<li>General Skills : Must have experience deploying and working with big data technologies like Hadoop, Spark, and Sqoop</li>
</ul>

<ul>
<li>Experience with streaming frameworks like Kafka.</li>
</ul>

<ul>
<li>Experience designing and building ETL pipeline using NiFi</li>
</ul>

<ul>
<li>Highly proficient in OO programming (Python, PySpark Java, and Scala)</li>
</ul>

<ul>
<li>Experience with the Hadoop Ecosystem (HDFS, Yarn, MapReduce, Spark, Hive, Impala)</li>
</ul>

<ul>
<li>Proficiency on Linux, Unix command line, Unix Shell Scripting, SQL and any Scripting language</li>
</ul>

<ul>
<li>Experience designing and implementing large, scalable distributed systems</li>
</ul>

<ul>
<li>Ability to debug production issues using standard command line tools</li>
</ul>

<ul>
<li>Create design documentation and maintain process documents</li>
</ul>

<ul>
<li>Ability to debug Hadoop / Hive job failures</li>
</ul>

<ul>
<li>Ability to use Cloudera in administering Hadoop</li>
</ul>

<ul>
<li>MUST have skills : Pyspark, Python, Hadoop, Kafka, Linux/Unix, SQL.</li>
</ul>

<ul>
<li>Nice to have skills : Cloud technologies like Databricks, AWS, Azure and GCP.</li>
</ul>

<ul>
<li>Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. </li>
</ul>

<ul>
<li>These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. </li>
</ul>

<ul>
<li>DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here .</li>
</ul>

Big Data Engineer in Chennai (UID-8099)

Job Description

Job Details

Skills Required for Big Data Engineer

Job Description for Big Data Engineer

Explore More Opportunities