Python Data Engineer

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Kaizer Software Solutions, is seeking the following. Apply via Dice today!

We are currently seeking an experienced Python Data Engineer to join the Big Data and Advanced Analytics department. As part of the Data Engineering team, the Lead Python Data Engineer will work closely with Business domain experts and Data Scientists to solve real-world oil and gas midstream problems using advanced analytics, machine learning, and artificial intelligence. This individual will provide analytical and technical leadership to the team to advance the data engineering practice within the organization.

Responsibilities include:

1. Work directly with Business domain experts and Data Scientists to develop high quality, reliable, scalable, machine learning systems
2. Design and implement frameworks and tools to streamline the machine learning process
3. Automate manual data collection and processing tasks to improve efficiency
4. Leverage software architecture and design patterns to develop fault tolerant microservices
5. Convert research-based machine learning models into production-ready software
6. Implement processes to ensure coding standards, code quality, documentation, and test coverage

The successful candidate will meet the following qualifications:

1. 10+ years in IT and 7+ years of programming experience in Python
2. Expertise in developing and maintaining data pipelines
3. Experience in testing, packaging, and deploying machine learning models
4. Experience in software engineering practices such as Design Principles and Patterns, Unit Testing, Refactoring, CI/CD, and version control
5. Expertise in Object-Oriented Design Principles and Functional Programming Principles
6. Experience with common Python Data Engineering packages including Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3
7. Experience in storage technologies including SQL relational databases and Object Storage such as AWS S3
8. Experience in implementing distributed computing systems
9. Experience in designing modular, reusable software components
10. Experience in developing API endpoints and microservices
11. Knowledgeable of MLOps Principles
12. Knowledgeable of ML platform technologies including Apache Airflow, Kubernetes, Dask, Ray, and MLFlow