Back to Portfolio
Download CV

Ismail Isleem

Senior SDET · Test Automation Frameworks & AI/LLM Testing
Amman, Jordan+962 78 010 6088 contact@ismailisleem.com linkedin.com/in/ismailisleem github.com/ismailisleem ismailisleem.com
Open to remote opportunities globally · Based in Jordan

Professional Summary

Senior SDET with 13+ years building test automation frameworks, internal QA tools, and test infrastructure across web, API, mobile, desktop, and AI products. I specialize in designing maintainable frameworks from scratch, integrating them into CI/CD, and helping teams turn fragile testing into reliable release gates. Recent work focuses on AI/LLM testing, including synthetic test-data generation, RAG evaluation, hallucination checks, and LLM-as-a-judge pipelines.

Technical Skills

Programming LanguagesJava, Python, JavaScript, TypeScript, C#, Groovy
Software DevelopmentREST APIs, ASP.NET, Entity Framework, service-oriented architecture, full-stack internal tools, web scraping pipelines
Test Frameworks & ToolsSelenium, Appium, Playwright, Cypress, Robot Framework, RestAssured, Postman, AutoIt, JUnit, TestNG, Cucumber (BDD)
AI/LLM TestingPrompt testing, hallucination detection, RAG faithfulness, context relevance, semantic similarity, embeddings, LLM-as-a-judge evaluation
AI/ML Libraries & APIsLocal LLMs, Hugging Face Transformers, embeddings, RAG evaluation, model evaluation utilities
Architecture & DesignPage Object Model, Factory, Singleton, DTO/POJO, BDD, framework architecture, parallel execution, fault isolation
CI/CD & DevOpsJenkins, Docker, GitHub Actions, Bitbucket Pipelines, Maven, Gradle
CollaborationJira, Azure DevOps, Confluence, Git, Agile/Scrum, code review at scale
DatabasesSQL (MySQL, PostgreSQL, SQL Server), NoSQL basics

Professional Experience

QPros — Senior SDET | Technical Lead
Feb 2023 – Aug 2026
Amman, Jordan (Fully Remote)
  • Build AI-powered test-data generation systems using LLMs and dual-agent validation workflows to produce deterministic positive and negative datasets with structured quality feedback.
  • Build internal Python QA tools, reusable libraries, and CLI utilities consumed by automation engineers across the organization.
  • Design internal QA service APIs for test-data generation and dataset retrieval, with clean DTO/POJO contracts consumed by web and mobile automation pipelines.
  • Engineer LLM evaluation pipelines covering prompt testing, hallucination detection, RAG faithfulness, semantic similarity, and LLM-as-a-judge scoring.
  • Architect open-source automation frameworks for enterprise clients across web, mobile, API, and desktop, with reusable reporting, CI integration, and maintainable design patterns.
  • Lead in-house automation tools and QA platforms, guiding architecture, sprint planning, code reviews, mentoring, and release readiness.
  • Conduct code audits for internal teams and client engagements, reviewing framework design, design-pattern usage, maintainability, and test reliability.
Mawdoo3 — Senior SDET | Team Lead
Sep 2018 – Nov 2022
Amman, Jordan
  • Built the Quality Engineering function inside the AI/NLP department, defining testing strategy, frameworks, and tooling for Arabic language models and conversational AI.
  • Designed and built a full-stack ML model evaluation platform with a C#/.NET backend, service-oriented APIs, and a no-code frontend used by manual QA engineers.
  • Architected an NLP evaluation engine for embeddings, POS tagging, NER, classification, categorization, and normalization, with Jenkins-based parallel execution and model-quality metrics.
  • Engineered web scraping and data-processing pipelines to generate internal training datasets and reduce reliance on third-party data sources.
  • Built a rule-based Arabic text normalization and categorization engine used as a preprocessing layer for NLP models and as a standalone data-science service.
  • Extended the evaluation platform to test fine-tuned chatbots and conversational agents, including a production banking chatbot.
  • Owned code review for the shared automation repository, approved production merges, trained QA engineers, and mentored manual testers on model evaluation workflows.
Winfooz — Senior Quality Assurance Engineer
Jul 2017 – Jun 2018
Amman, Jordan
  • Owned QA coverage for a US and Canada vehicle-auction platform across manual testing, web automation, mobile automation, and release validation.
  • Rebuilt automation infrastructure across web, mobile, and JavaScript-based testing, applying reusable design patterns and maintainable test structure.
  • Migrated the web suite from Cypress to Playwright with Python, improving stability, execution speed, and maintainability.
  • Built an in-house testing lab with dedicated servers and physical mobile devices, reducing cloud-testing dependency while improving reliability and control.
Fetcher — Senior Quality Assurance Engineer
Sep 2016 – Jun 2017
Amman, Jordan
  • Owned QA for a logistics platform covering warehouse operations, slot management, inventory workflows, and inter-service REST integrations.
  • Designed API automation in two layers: lightweight Postman collections for fast feedback and a Java RestAssured framework for functional, regression, and smoke coverage.
  • Architected a cross-platform Appium framework with Java, Maven, and TestNG for unified Android and iOS execution.
7AWI — Quality Assurance Engineer
Mar 2015 – Aug 2016
Amman, Jordan
  • Owned end-to-end QA for a high-traffic classifieds platform, covering core web flows, user journeys, regression cycles, and release reporting.
  • Built the company's first Selenium + Java web automation framework, establishing reusable components and structured regression suites.
AnnabSoft — Quality Assurance Engineer
May 2013 – Feb 2015
Amman, Jordan
  • Tested a US-based e-commerce platform and custom ERP covering warehouse management, inventory, and DHL shipping integrations.
  • Introduced the company's first Selenium + Java automation initiative for regression-heavy flows while owning manual test cases and release regression cycles in Mantis.

Selected Projects

Local-first AI test-data tool that generates schema-valid positive and negative datasets through a dual-agent workflow, with validation feedback designed for repeatable QA use.

Python · FastAPI · Local LLMs · JSON Schema
Automation Framework Suite
github.com/ismailisleem

Suite of reusable automation frameworks for web, mobile, and API testing, powered by a shared Python core for reporting, artifacts, events, helpers, and consistent execution patterns.

Python · Playwright · Appium · httpx · Pytest · Allure

Cross-platform E2E orchestrator for running API, web, and mobile automation as one end-to-end journey, with shared scenario state, CLI execution, and unified reporting.

Python · Pytest · YAML · CLI · Reporting

Education & Certifications

B.S. in Software Engineering — Al-Zaytoonah University, Jordan
Feb 2008 – Jul 2012
ISTQB Certified Tester, Foundation Level (CTFL) — Cert No. CTFL-JOR-54-2014

Languages

Arabic — Native  ·  English — Professional Working Proficiency