Our Company
Changing the world through digital experiences is what Adobe's all about. We give everyone - from emerging artists to global brands - everything they need to design and deliver exceptional digital experiences! We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
We're on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
Adobe Sign is a market-leading, global digital signature service for individuals, small businesses, and enterprises. We run a large-scale, high-volume, transactional system in seven geographically dispersed shards. Adobe Sign is one of the most secure services at Adobe, complying with SOC 2, PCI-DSS, GDPR, and even HIPAA controls for security, privacy, and availability. We have a globally distributed team both building and supporting Sign.
What you'll do:
Work as part of the product and infrastructure team to assist with construction and testing of the Sign Application foundation using state-of-art cloud technologies, including AWS and Azure.
Support and develop customer-driven features on a variety of platforms, including mobile and web, within agile development cycles.
Work closely with feature developers to identify test cases and develop efficient and scalable testing processes.
Create and maintain unit tests for every feature. Draft test plans, complete functional testing, and fix problems before delivering features for final testing.
Define product performance metrics and conduct system performance and load testing as part of infrastructure delivery requirements.
Help the team oversee the quality of the Sign Application and assist the release process.
Contribute to QA automation testing framework and manage QA Continuous Integration environments.
Identify, propose, and implement process improvements to continuously increase the team's productivity and efficiency.
Design, develop, and implement automated test frameworks and test suites for evaluating generative AI models and systems.
Develop and execute test plans, test cases, and test scripts for functional, performance, and stress testing of AI models and systems.
Implement continuous integration and continuous deployment (CI/CD) pipelines to ensure the efficient and reliable delivery of AI models and systems.
Conduct code reviews and provide feedback to ensure the quality and maintainability of the test codebase.
Stay updated with the latest advancements in AI, machine learning, and testing methodologies to continuously improve the evaluation framework.
Qualifications:
Bachelor's with 10 years or Master's degree with 7 years in Computer Science, Engineering, or a related field.
Proven experience as an SDET, software engineer, or similar role, with a focus on testing and quality assurance.
Strong programming skills in languages such as Python and Java.
Experience with test automation frameworks and tools (e.g., Selenium, JUnit, TestNG).
Working knowledge of AI and machine learning concepts, particularly generative models.
Knowledge of CI/CD tools and practices (e.g., Jenkins, GitLab CI).
Familiarity with databases in general, VectorBD experience is a plus.
Experience in testing AI agents is a plus.
Excellent problem-solving skills and attention to detail.
Preferred Qualifications:
Experience with cloud platforms and services (e.g., AWS, Azure).
Knowledge of LLM models (Azure OpenAI, OpenAI, etc.)