Lead Full Stack Engineer -AI Data Engineer
Location - Cary NC (Hybrid)
Key Responsibilities:
• Hands on development and setup of data pipelines, databases, and data sources to build Client and AI apps.
• Develop architecture and solution designs to deliver capabilities and features.
• Develop iterative plans and strategies. Estimate as part of release plan and iteration planning
• Mentor, motivate, influence, drive innovation, and coach broader technical team. Provide technical and solution guidance to the team. Conduct design and code reviews for the team delivery.
• Oversight of junior developer and vendor development work
• Key participant in user story breakdowns, user story elaboration, and user story reviews
• Help drive broader understanding of AI tools and technologies
• Serve as an escalation point for deployments, and change oversight, enabling highly visible business priorities.
• Responsible for developing and maintaining SRE runbooks, and being available to diagnose and resolve production issues.
Required Experience
• 8+ years hands on development of realtime and batch data pipelines.
• Data pipeline development using ETL tools to collect, process and transform raw data
• Database setup on Azure or AWS for structured and unstructured data- PostgreSQL, MongoDB, CosmosDB, etc.
• Use of tools to store, process, and retrieve data - Hadoop, Spark, Kafka, API's, data lakes
• Expertise in programming languages and libraries - Python, Scala, PyTorch, NumPy, Pandas
• 5+ years hands on DevOps skills. Prefer Azure DevOps otherwise similar alternate technologies is a must.
• Hands on experimentation with prompt engineering, semantic search and GenAI
• Advanced knowledge of the principles in software engineering.
• 10+ years related work experience successfully delivered on large, complex projects with demonstrated technical leadership in delivery.
Preferred Experience
• BS/MS in Comp Science/IS.
• Development of Semantic search using vector databases or similar solutions
• Experience in structuring and creating training datasets for GenAI
• Experience working in cross-functional, multi-location teams.
Experience in SAFe, Agile methodology, tools, and Agile integration with Waterfall.