Senior Product Manager, Multilingual AI and Evals
Singapore, Singapore·Posted 4d ago
web3aillmblockchainfintechsaasgo
<div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="JAF7dFJcWoUusRx7RKkuM14BsYc" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-OqGZdUPi6oJlXzxlmNiu3gAmsVg"> <div data-page-id="V6OedkjJzouK9jxNIfuuhjt9sDc" data-docx-has-block-data="false"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div data-page-id="JAF7dFJcWoUusRx7RKkuM14BsYc" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-OqGZdUPi6oJlXzxlmNiu3gAmsVg"><em>OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.<br><br></em></div> </div> <h2 class="heading-2 ace-line old-record-id-doxuslsyQOGHoiYb47TiA1n51Th"><strong>Who We Are</strong></h2> <div class="ace-line ace-line old-record-id-doxustOiFVk8C3Uy4rotl5Nem5f"> <div data-page-id="PNNZdiw4Yo1ZOmx8btbucw8qsLG" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-Q479dQIlZozY6cxcPNFuoY1rsxe"> <div class="rich-text-paragraph" data-eleid="27"> <div class="ace-line ace-line old-record-id-RKOAdw3kVoh5EQxcr2juP3i0sTb"> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom.</div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb"> </div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. </div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb"> </div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">Across our multiple offices globally, we are united by our core principles: <em>We Before Me</em>, <em>Do the Right Thing</em>, and <em>Get Things Done</em>. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er.<br><br> <div data-page-id="Kpucdjv7JoAcSZxSf7PuRl5Yscb" data-lark-html-role="root" data-docx-has-block-data="false"> <div class=" old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.</div> </div> </div> </div> </div> </div> </div> </div> <div class="ace-line ace-line old-record-id-doxusq2WnfR822THsuqUosdSzFu"> </div> <h2 class="heading-2 ace-line old-record-id-doxus9qcafz8J9vhi3nwZgrckWg"><strong>About The Opportunity</strong></h2> <div data-lark-html-role="root"> <div class="rich-text-paragraph" data-eleid="15"> <div data-page-id="ARBYdqJryo2IE5xeJX2lk6KVgrg" data-lark-html-role="root" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxlg2R5zO1tUycAoeDsfe4tw8f">We are building an AI-native localization stack: agentic translation workflows that already publish content with minimal human touch, and a quality system that keeps that automation trustworthy at scale. As automation grows, quality assurance becomes the product. We are hiring a Senior PM to own QA and Evals for our multilingual AI agents — the evaluation, testing, and feedback infrastructure that decides whether an AI output is good enough to auto-publish, catches localization defects inside the live product, and continuously feeds signal back to improve our agents.</div> <div class="ace-line ace-line old-record-id-doxlgADdyr0aYTE6IPCtYlhgVWg">This role sits at the intersection of platform/product building, AI agent evaluation, and global product delivery. It requires sharp judgement and instinct to turn fuzzy, subjective quality problems into measurable, automatable systems, as well as strong product execution to ship the tooling that runs them at scale.</div> </div> </div> </div> <h2 class="heading-2 ace-line old-record-id-doxushHxPgvpIV0pJrijghkWDWe"><strong>What You’ll Be Doing</strong></h2> <div data-page-id="ARBYdqJryo2IE5xeJX2lk6KVgrg" data-lark-html-role="root" data-docx-has-block-data="false"> <p><strong>Multilingual AI Quality Evaluation</strong></p> <ul> <li>Enhance the quality gate of the agentic pipeline — the evaluation agent that decides whether a translation is good enough to auto-publish.</li> <li>Own the trade-off between automation coverage and risk across content tiers. When the gate gets something wrong systematically rather than as a one-off, diagnose the root cause and drive the fix back into the agent.</li> </ul> <p><strong>AI Driven Localization Testing</strong></p> <ul> <li>Build an AI-driven product testing tool that automatically detects localization defects that translation review cannot catch — truncation, layout breakage, hardcoded strings, unlocalized images, wrong number/date/currency formats.</li> <li>Ship the MVP that scans mobile/web apps to accelerate localization auditing, then drive the long-term vision of integrating localization tests into internal product testing infrastructure, so they run automatically before features go live.</li> </ul> <p><strong>Evaluation & Annotation Infrastructure</strong></p> <ul> <li>Build the backbone that makes quality measurable and improvable: golden datasets, annotation tooling with error classification, automated evaluation, a metrics/dashboard layer, and the feedback loop that turns human evaluations into agent fine-tuning.</li> <li>Own annotation workflow integration so linguists can annotate in a standardized, real-time way.</li> </ul> </div> <h2 class="heading-2 ace-line old-record-id-doxushHxPgvpIV0pJrijghkWDWe"><strong>What We Look For In You </strong> </h2> <div data-lark-html-role="root"> <div data-page-id="ARBYdqJryo2IE5xeJX2lk6KVgrg" data-lark-html-role="root" data-docx-has-block-data="false"> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-RX4YdvJPtoRhMuxETeMl4cGagVb" data-list="bullet"> <div>Bachelor's degree or higher with 3+ years in product management. Hands-on experience building or evaluating AI agent systems (not just using AI tools) may substitute for part of the PM tenure requirement.</div> </li> <li class="ace-line ace-line old-record-id-DoMgd5PvxoJ9yFxl5HvlqmbOg2c" data-list="bullet"> <div>Platform-building experience: You've built content platforms, testing platforms, or SaaS products — you know how to take a fuzzy internal workflow and turn it into a system others rely on. Experience with CMSes, testing infrastructure, or internal tooling counts.</div> </li> <li class="ace-line ace-line old-record-id-P6ZSdf1wfolyAzx5MULlm8kugJf" data-list="bullet"> <div>AI agent / evaluation: You've worked hands-on with AI agents, agent harnesses, and evals — especially for subjective, hard-to-measure quality problems (not just accuracy against a clean label). You can design eval harnesses and golden datasets, and read failure modes (hallucination, prompt drift, edge-case regressions) well enough to know whether a bad output is a prompt problem, a data problem, or a model problem.</div> </li> <li class="ace-line ace-line old-record-id-TYVadE7vPoNm4DxmGNJlf2XHg2d" data-list="bullet"> <div>Multi-market shipping experience: You've shipped products across multiple markets or languages — you understand what breaks when a single-market assumption meets a global user base, and you're comfortable working cross-culturally with distributed teams.</div> </li> <li class="ace-line ace-line old-record-id-P35Wd4LxCof68KxrgBUl4i3GgXg" data-list="bullet"> <div>Excellent cross-functional leadership across engineering, AI teams, linguists, design, and external partners</div> </li> </ul> </div> </div> <h2 class="heading-2 ace-line old-record-id-doxusWnZPeJsdMU53QGew90VQeh"><strong>Nice-To-Haves</strong></h2> <div data-page-id="ARBYdqJryo2IE5xeJX2lk6KVgrg" data-lark-html-role="root" data-docx-has-block-data="false"> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlgzw193a3FCEmhlRCTdr1FGg" data-list="bullet"> <div>Localization/translation domain background — terminology & glossary management, TMS tools (Phrase, Smartling), internationalization (ICU/CLDR)</div> </li> <li class="ace-line ace-line old-record-id-doxlgjxtU2hN680SETPF8Abz0fd" data-list="bullet"> <div>Bilingual or multilingual (Chinese and/or European languages)</div> </li> <li class="ace-line ace-line old-record-id-doxlgSxseOIAQ1EWgUcWrpHlVjb" data-list="bullet"> <div>Crypto, fintech, or other high-compliance / regulated domain experience</div> </li> </ul> </div> <h2 class="heading-2 ace-line old-record-id-doxusWnZPeJsdMU53QGew90VQeh"><strong>Perks & Benefits </strong></h2> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-Gb04dtjtMoHmldxfAjXuI6P4snC" data-list="bullet"> <div>Competitive total compensation package</div> </li> <li class="ace-line ace-line old-record-id-Gb04dtjtMoHmldxfAjXuI6P4snC" data-list="bullet">L&D programs and education subsidy for employees' growth and development</li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet"> <div>Various team building programs and company events</div> </li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet">Wellness and meal allowances</li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet">Comprehensive healthcare schemes for employees and dependants</li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet">More that we love to tell you along the process!</li> </ul> <p> </p> <p><span style="color: rgb(255, 255, 255);">#LI-WWW</span><br><span style="color: rgb(255, 255, 255);">#LI-ONSITE</span></p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div><div class="content-conclusion"><div data-lark-html-role="root"><span class="text-only" data-eleid="18"><span class="text-only"><span class="text-only" data-eleid="6">Notice:<br></span></span></span> <div data-lark-html-role="root"><span class="text-only" data-eleid="26"><span class="text-only">All official </span><span class="text-only text-with-abbreviation text-with-abbreviation-bottomline">OKX</span><span class="text-only"> vacancies are published on this website.</span></span> <span class="text-only" data-eleid="28"><span class="text-only">While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. </span></span><strong><span class="text-only" data-eleid="29"><span class="text-only">If in doubt, please apply directly through our official careers website.</span></span></strong></div> </div> <div data-lark-html-role="root"><span class="text-only" data-eleid="18"><span class="text-only">Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to </span><span class="text-only text-with-abbreviation text-with-abbreviation-bottomline">OKX</span><span class="text-only">'s </span></span><a class="link rich-text-anchor __anchor-intercept-flag__ text-content-link" href="https://www.okx.com/en-eu/help/okx-candidate-privacy-notice" target="_blank" data-eleid="19" data-lark-is-custom="true" data-lark-link="true">Candidate Privacy Notice</a><span class="text-only" data-eleid="20"><span class="text-only">.</span></span></div></div>