Job Title - Software Development Engineer
Duration - 6 months Contract (high chances of extension)
Project Location - Bellevue, WA
Job Description:
In this role, you will be responsible for building services and infrastructure to support data-driven insights across the organization. As a Software Development Engineer on the client team, your role will revolve around designing and building robust infrastructure to drive data-driven insights. Core responsibilities include architecting scalable and fault-tolerant services to ingest data from various sources into data warehouses or lakes. Leveraging cutting-edge tools and technologies, you'll implement ingestion, transformation, and integration processes, ensuring stringent data quality through validation, cleansing, and deduplication.
You'll design and implement high-performance, scalable, and cost-efficient data storage solutions. Utilizing CI/CD principles, you'll automate infrastructure deployment and maintenance processes, ensuring a streamlined data ecosystem. Data modeling and engineering will be crucial, involving designing and implementing optimized data models, developing and maintaining ETL processes, and collaborating with analysts and functional managers to understand data needs and provide tailored data structures. Continuous improvement and automation will be woven into your daily activities, continuously evaluating and optimizing processes, pipelines, and infrastructure, implementing automation and monitoring tools.
Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
Familiarity with data ingestion techniques, data processing frameworks, and data lake architectures.
Experience with data standardization, cleansing, and transformation techniques.
Strong proficiency in programming languages such as Python, Java, or Scala, and experience with big data technologies like Apache Spark, Hadoop, and AWS services (e.g., S3, Athena, Glue).
Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
Strong problem-solving and analytical skills, with the ability to translate business requirements into technical solutions.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Experience with agile software development methodologies, version control systems (e.g., Git), and continuous integration/continuous deployment (CI/CD) practices.
Top skills:
Building data lake using all AWS cloud services and must be comfortable working in AWS cloud and comfortable in writing business code, basically he must be comfortable in writing business logic into code.
Mainly he must have experience in writing code in AWS cloud
Python is the topmost skills
SQL and Spark
candidate must have experience withing 3+ years’ experience
Day to Day - No operations its pure building from scratch