Gen AI Test Lead - Remote / Telecommute
Job title: Gen AI Test Lead - Remote / Telecommute in Reston, VA at CYNET SYSTEMS
Company: CYNET SYSTEMS
Job description: Job Description:Essential Functions:
- 50% Experienced the PMLC/SDLC to provide established and defined processes.
- Conduct tool analysis to determine which tools compliment the process.
- Review with designated Subject Matter Experts on a routine basis to validate alignment to needs.
- Create a tailoring guidance to projects of small to medium complexity and size, to provide a process inline with budget and delivery timeframes.
- CollaboXX with Agile and Waterfall project teams to mature current processes.
- Plans, designs, implements and maintains system-wide audit program.
- Monitor programs/projects in the organization to ensure the practices, procedures and policies being practiced comply with implemented and approved standards, policies, processes and regulations.
- Identify procedural, system and training issues based upon audit findings and initiate resolution to these problems through recommending alternate procedures/processes.
- Develop and provide training.
- Act as a mentor and Subject Matter Expert (SME) on methodology-based quality plans, processes, procedures, and templates.
- Communicate with internal audit management regarding status, audit issues and deadlines.
- Collect objective evidence of quality and analyze quality-related data and/or trends and analyze results
- 30% Provides risk assessment services that are designed to add value and are consistent with the corpoXX mission and vision.
- Lead reviews, walkthroughs, assessments, and inspections to evaluate the effectiveness of current processes/procedures, techniques, systems and associates.
- Lead projects, workgroups, including those from senior leadership.
- Monitor and track quality action items and/or quality issues through resolution.
- Provide guidance to the program/project to help ensure deliverable products fulfill contractual requirements, satisfy the customer and internal project standards, and meet the internal and industry standards for quality.
- 20% Conducts internal consistency checks ensuring uniform and fair auditing practices throughout the department, across all lines of business.
- Preparation of QA reports.
- Prepare and present senior level presentations.
- Identify creative solutions and provides operational advice regarding modeXXly complex audit issues.
- Bachelor's Degree, Computer Science or related technical field.
- 8 years Experience in Software Development Life Cycle (SDLC) from initiation to completion with focus on process improvements, assessments, audits and quality controls.
- Functional knowledge of Agile, Spiral and Waterfall methodologies.
- Proven experience with the execution and administration of Quality/Process Improvement best practices.
- Experience working with Program/Project Quality Assurance/Process Improvement Plans.
- Experience working with Quality Gates or Quality Checkpoints as part of the SDLC.
- Gen AI Testing experience including but not limited to LLMs, Amazon Frameworks (eg. Sagemaker, Lamda, S3, Kendra), and Contextual Comparison Methodologies.
- Automation.
- Python.
- Ability to gather information and resolve issues independently.
- Ability to identify, manage and track progress of small to medium complexity projects to support organizational long range business objectives.
- Experience with quality assurance and process improvement, and methodologies and practices in an IT project development, custom software solutions and maintenance environment.