Software Engineer -Big Data

Title: Software Engineer – Big Data @ Dallas, TX / Washington, DC

Terms of Hire: Full Time.

Salary: $120-135 K/YR + Benefits.

Role Description

As a Software Engineer supporting the Climate Impact Team, you will use your expertise in Big Data to analyze, optimize, and visualize data in support of the team’s efforts. You will work within a cross-functional team including Data Scientists, Software Engineers, Product Owners, and DevOps Engineers.

THE IMPACT YOU WILL MAKE

The Software Engineer role will offer you the flexibility to make each day your own, while working alongside people who care so that you can deliver on the following responsibilities:

1. Work with product owners and other development team members to determine new features and user stories needed in new/revised applications or large/complex development projects.
2. Contribute to creative solutions to the organization and transformation of large scale spatial and property attribute datasets.
3. Design and execute preprocessing automation for efficient mapping and visualization.
4. Categorize and index large, unstructured data, particularly images.
5. Build out and maintain a streaming data platform as part of the dev team integrating with public and vendor data sources.
6. Create or Update documentation in support of development efforts. Documents may include detailed specifications, implementation guides, QC procedures, architecture diagrams or design documents.
7. Participate in code reviews with peers and managers to ensure that each increment adheres to original vision as described in the user story and all standard resource libraries and architecture patterns as appropriate.
8. Respond to trouble/support calls or management requests for ad hoc data pulls for applications in production.
9. Serve as a technical lead for an Agile team and actively participate in all Agile ceremonies. Participate in all team ceremonies including planning, grooming, product demonstration and team retrospectives.
10. Mentor less experienced technical staff; may use high-end development tools to assist or facilitate the development process.
11. Demonstrate ability to adapt to new technologies and learn quickly.

Qualifications: THE EXPERIENCE YOU BRING TO THE TEAM

Basic Qualifications:

1. Bachelor’s Degree or Equivalent (required)
2. 4-6 years of related experience
3. 3 or more years of experience with Spark and Amazon EMR/Hadoop, Scala, Python, SQL and NoSQL
4. ETL experience and data process automation on large datasets

Preferred Qualifications:

1. Experience with PostGIS and Livy
2. Experience with GIS Tools
3. Proven track record of:
1. Creative problem solving, working with modelers or data scientists
2. Performance optimization for large unstructured data
3. Indexing and working with image files, especially aerial images
4. Build out and maintenance of a streaming data platform
5. Experience with Provenance standard or other lineage frameworks
6. Data visualization and mapping
7. Navigating uncertainties and problem solving
8. 1+ years of experience with Amazon Neptune with Gremlin or Neo4J with Cypher query language

You Will Enjoy:

1. An opportunity to be a part of a great culture, an awesome team, a challenging work environment, and some fun along the way!
2. Apply today to learn more and be part of our Growth story.

All applications will be kept strictly confidential and once shortlisted, our team will be in touch with you for further discussions.