Senior Data Engineer, Python / Spark

My client is an innovative leader in the cybersecurity industry. Their systems consume and process huge volumes (multi-terabytes) of data from a variety of sources every day. They utilize a home-grown Spark based big data analytics platform to execute analytics and data mining on the data sets. They are currently looking for a talented Data Engineer to work in their Data Team building and scaling the next generation data analytics platform.

As a member of the team, you will work in an intimate, collaborative environment along with other Engineers to create systems that organize, analyze, and maintain the data. The required skills for the position include the following:

• Python experience (Scala or Java are okay too)
• Spark , Hive, MapReduce, NoSQL and related technologies (exposure okay)
• SQL , ETL
• Amazon AWS or Google Cloud (could architecture experience with a major cloud provider)
• Any additional experience with distributed data storage systems that use parallel processing or columnar data stores (Snowflake, Redshift, Cassandra, Druid, HBase, etc.) are all plusses.

The team is looking for the right combination of technical skills, intelligence, curiosity, drive, and grit. They are an innovative startup-like environment that thrives on creative and elegant solutions to complex technical problems. You have experience improving performance, scalability, and availability of large systems and have proven industry experience. You communicate effectively and enjoy collaboration.

This position features a competitive compensation package complete with equity and comprehensive benefits. If you are qualified and interested, please send a resume to for immediate consideration.