Senior Python Software Engineer

Project Description:
Responsible for driving the design and implementation of specific data models to drive better business decisions through insights from a combination of 3rd party and 1st party data assets. Accountable for developing the necessary enablers and data platform in a cloud environment and maintaining its integrity during the life cycle phases. Define data requirements, gather and mine large scale structured and unstructured data, and validate data by running various data tools.

Responsibilities:
Support the standardization, customization, and ad-hoc data analysis, and develop mechanisms to ingest, analyze, validate, normalize, and clean data. Develop and maintain data engineering best practices and contribute to insights on data analytics and visualization concepts, methods, and techniques.

1. Design and develop data applications using selected tools and frameworks as required and requested.
2. Collaborate with Engineers and Business to build intuitive products that address the needs of our customers.
3. Read, extract, transform, stage, and load data to selected tools and frameworks as required and requested.
4. Gather and process raw data at scale.
5. Perform tasks such as writing scripts, web scraping, calling-writing APIs, and writing SQL queries.
6. Work closely with the engineering team to integrate your work into our production systems.
7. Process unstructured data into a form suitable for analysis and analyze processed data.
8. Participate in design and code reviews to ensure the quality of the products we deliver.
9. Establish a good working rapport with Development group, System Engineers, Quality Assurance/Testers, and Business users.
10. Develop scripts or workflows to facilitate complex ingress processes.

Mandatory Skills Description:

1. Python: Boto3, Multiprocessing, Classes
2. Java Script (Snowflake SP)
3. AWS: Lambda, Triggers, EC2, S3, CloudWatch, Security
4. Snowflake: SQL & Stored Procedures
5. Airflow: Celery, MQRabbit, Postgress
6. Unix-Linux: Shell Scripting, admin experience
7. Experience building APIs

Nice-to-Have Skills Description:

1. Looker
2. Data Science
3. AI