TechnoSmarts has a Global Client, located in O'Fallon, MO seeking a Senior Engineer.
This is a 6 month contract with potential for extension. Local candidates are desired as this is a Hybrid position requiring on-site presence.
Seeking a Software Engineer who thrives on designing, coding, and maintaining large data processing systems, primarily in the Spark framework using Scala. Our ideal candidate will understand the challenges of working with data at scale and have a firm knowledge of algorithms and processing complexity.
Our team is a mix of software engineers and data analysts working to ensure our inputs, algorithms, and publishing artifacts are of the highest quality and efficiency. Our output is critical to the accuracy of our Risk Analysis APIs which power top e-commerce sites.
Responsibilities include:
- Develop big data processing systems using Scala, Apache Spark, Airflow, Databricks, AWS and related technologies
- Run our ingestion and publishing processes and debug problems when they occur
- Follow SDLC and best practices for clean code and architecture
- Impact system architecture and improve overall system efficiency with growing business needs
- Deliver assigned work with guidance from experienced team members
- Understand and follow standard branching (e.g., Gitflow) and peer review practices
- Understand the big picture and end-to-end logical architecture of systems in ownership areas
- Provide feedback and suggestions on areas to improve
- Understand requirement analysis being essential part of delivering value to our customers and partners and participate in elaboration, prioritization, and effort estimation
- Understand Continuous Integration (CI) and Delivery (CD) concepts, and capabilities to support automation, pipelines, virtualization, and containerization
- Understands the use of Client technology policies in everyday work
- Demonstrate active learning and sharing of software practices via Guild/Engineering community initiatives
Qualifications include:
- Self-motivated learner willing to take on challenging problems
- Aptitude to learn new languages and technologies as necessary
- Ability to write clean, readable, and maintainable code that follows best practices
- Passion for diving deep in data and insights
- In-depth knowledge of one or more Internet protocols
- Experience with one or more strongly typed programming languages
- BS degree in Computer Science, related degree, or equivalent
- Understand Continuous Integration (CI) and Delivery (CD) concepts, and capabilities to support automation, pipelines, virtualization, and containerization
- Fluency in one or more languages like Scala, Java, Python etc.
- Understanding/experience in Apache Spark, Airflow, Databricks, AWS and related technologies
Desired Skills/Certifications:
- Data engineer/SDET
- Knowledge of Microservices and scaling techniques
- Experience using web service APIs
- Ability to create good acceptance and integration test automation scripts and integrate with Continuous integration (Jenkins/Bamboo) and code coverage tools (Sonar)
- Certified Associate in Software Testing (CAST)
- AWS Certified