Hadoop Data Engineer

Greetings Everyone,

We are Photon, one of the world's largest Digital Platform Engineering companies providing a unique combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers.

We are a high growth organization serving over 40% of Fortune 100 companies and truly believe that our people make the world of difference for our clients and our business. With Photon, you get the opportunity to learn and grow, build deep digital/technical expertise, and achieve your professional and personal aspirations.

Check out our introduction video -

Designation: Hadoop Data Engineer

Location: Plano TX

Job Type: Fulltime on W2

Job Description:

Required Skills:

• Experience with multiple large-scale Enterprise Hadoop or Big Data, Data Bricks, Cloudera, HD Insights, or other environments focused on operations, design, capacity planning, cluster set up, security, performance tuning and monitoring
• Experience with the full Cloudera CDH/CDP distribution to install, configure and monitor all services in the Cloudera stack
• Strong understanding of core Hadoop services such as HDFS, MapReduce, Kafka, Spark and Spark-Streaming, Hive, Impala, HBASE, Kudu, Sqoop, and Oozie
• Experience in administering, and supporting RHEL Linux operating systems, databases, and hardware in an enterprise environment
• Expertise in typical system administration and programming skills such as storage capacity management, debugging, performance tuning
• Proficient in shell scripting (e.g. Bash,ksh,etc)
• Experience in setup, configuration and management of security for Hadoop clusters using Kerberos with integration with LDAP/AD at an Enterprise level
• Experience with large enterprise scale, separation of resource concepts and the physical nature for those environments to operate (storage, memory, network, and compute)

Desired Skills:

• Experience in version control systems (Git)
• Experience with Spectrum Conductor or Databricks with Apache Spark
• Experience in different programming languages (Python, Java, R)
• Enterprise Database Administration Platform Experience
• Experience In Large Analytic Tools including SAS, Search, Machine Learning, Log Aggregation
• Experience with Hadoop distributions in the Cloud is a plus, AWS, Azure, Google
• Experience with the full Cloudera CDH distribution to install, configure and monitor all services in the CDH stack