Overview
Quality Assurance Technical Lead Jobs in Bengaluru, Karnataka, India at Mobileum
Title: Quality Assurance Technical Lead
Company: Mobileum
Location: Bengaluru, Karnataka, India
About Us:
Mobileum is a leading provider of Telecom analytics solutions for roaming, core network, security, risk management, domestic and international connectivity testing, and customer intelligence. More than 1,000 customers rely on its Active Intelligence platform, which provides advanced analytics solutions, allowing customers to connect deep network and operational intelligence with real-time actions that increase revenue, improve customer experience, and reduce costs. Know our story: https://www.mobileum.com/
Headquartered in Silicon Valley, Mobileum has global offices in Australia, Dubai, Germany, Greece, India, Portugal, Singapore and UK with global HC of over 1800+.
Join Mobileum Team
At Mobileum we recognize that our team is the main reason for our success. What does work with us mean? Opportunities!
Role: Technical QA Lead
Key Responsibilities
- Design and execute test plans for single-agent and multi-agent systems, including tool/function calling, planning, and multi-step task execution.
- Validate agent trajectories — verify the agent takes the right steps, calls the right tools with the right arguments, and recovers gracefully from errors, not just whether the final answer looks right.
- Validate groundedness/faithfulness of RAG responses against source documents and detect hallucinated or unsupported claims.
- Design automated evaluation pipelines using LLM-as-a-judge and rule-based/programmatic checks, with human-in-the-loop review where needed.
- Design and run load, stress, scalability, and soak tests against agents and GenAI endpoints. Measure and report on AI-specific performance metrics: latency, time-to-first-token (TTFT), tokens/second, throughput, concurrency limits, and end-to-end task completion time.
- Experience with GenAI evaluation and observability tooling, e.g. DeepEval, RAGAS, Promptfoo, LangSmith, Langfuse, Arize Phoenix, TruLens, Braintrust, OpenAI Evals.
- Experience with AI red-teaming / security tools, e.g. Garak, PyRIT, Giskard, or similar.
- Familiarity with agent frameworks such as LangChain / LangGraph, LlamaIndex, AutoGen, CrewAI, or equivalents.
- Performance testing tools: Locust, k6, JMeter.
- Set up specialized test environments in Linux/Kubernetes environments.
- Having good leadership and mentoring skills.
- Understand Mobileum products and release requirements; prepare detailed test plans.
- Develop automation test suites using Python, Java, or Shell scripting.
- Perform GUI, functional, non-functional, database, regression, performance, and security testing as needed.
- Deliver high-quality outputs within project timelines.
- Debug test case failures and issues thoroughly.
- Report issues using tools like JIRA and manage bugs through to closure.
- Take full ownership of assigned tasks and share test results with leads/managers/dev teams.
- Support customer support/delivery teams in executing UAT test cases and debugging issues on-site.
- Fulfil End to End responsibilities in a timely manner.
Desired Profile
- 7 to 12 years of experience in the telecom testing domain.
- Having technical hands-on experience in Manual or Automation testing.
- Proficiency in programming/scripting languages: Python, Java, Perl, Shell.
- Experience with SQL/NoSQL databases such as PostgreSQL and Couchbase.
- Solid understanding of testing concepts and methodologies.
- A passion for testing: ability to identify complex issues, spot requirement/code logic gaps, think creatively, and solve problems effectively.
- Good understanding of 3GPP specifications.
- Strong experience in API testing (HTTP/HTTP2).
- Proficient in protocol generation tools like Spirent, IXIA, EAST.
- Good mentoring and technical skills.
Good to Have:
- Strong working knowledge of telecom protocols: ITU-T/ANSI SS7, GSM, SCCP, TCAP, MAP, Diameter, SIP, GTP.
- Familiarity with attach call flows for 2G, 3G, 4G, VoLTE, and 5G.
- Good command of complex Unix/Linux commands.
- Familiarity with CI/CD pipelines and tools such as Selenium, Robot Framework, or other open-source tools supporting Java or Python.
- Experience with Telesoft/Dialogic stack.
Work Experience: 7 – 12 Years
Educational Qualification:
BE. / B.Tech., M.E./M. Tech. or M. Sc. in Computer Science or any related qualification.
