Senior Prompt Engineer

Are you a talented developer with a passion for cutting-edge technology? Doran Jones Inc. is seeking skilled Prompt Engineers to join a newly formed GenAI Technology team that supports the Operational Risk Management division of a leading financial services company.

This team is pioneering the use of artificial intelligence to transform how risks are identified, managed, and mitigated, with a focus on automating the Risk and Control Self-Assessment (RCSA) process.

As part of this dynamic team, you’ll have the opportunity to work on high-impact projects that will directly enhance the company’s operational risk management capabilities. If you're excited by the challenge of building innovative solutions and automating critical processes, we want to hear from you!

Locations: Charlotte, Tampa or NYC

Responsibilities

• Craft and optimize prompts to improve AI model outputs for a variety of use cases, including text generation, question answering, summarization, and more.
• Experiment with different prompt structures, wording, and context to maximize the relevance and accuracy of AI-generated responses.
• Work closely with machine learning engineers and data scientists to understand model behavior and performance.
• Provide feedback and suggestions to improve AI model training based on prompt performance.
• Conduct A/B testing and other evaluation methods to assess the effectiveness of different prompts.
• Analyze AI responses to identify areas for improvement and implement iterative changes to prompts.
• Document successful prompts and techniques, creating a repository of best practices for prompt engineering.
• Collaborate with product and design teams to ensure that AI interactions are user-friendly and aligned with the product’s goals.
• Gather and incorporate user feedback to refine prompts and improve the overall user experience.
• Stay updated with the latest advancements in AI, NLP, and prompt engineering techniques.
• Explore new methods and tools to enhance prompt effectiveness and AI performance.

Required Experience

• Proven experience in prompt engineering, NLP, or a related field.
• Experience working with large language models (e.g., GPT, BERT) is highly desirable.
• 5+ years of experience in Python programming language.
• Familiarity with machine learning frameworks and tools (e.g., TensorFlow, PyTorch).
• Working experience with Vector databases.
• Strong understanding of natural language processing and AI model behavior.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment and communicate complex ideas effectively.
• Creativity in crafting prompts that yield desired AI outcomes.
• Bachelor’s degree in Computer Science, MIS, or a related field.

Preferred Experience

• Consulting experience
• Financial services experience

Visit Doran Jones to learn more!