Big Data Engineer, Web3

Singapore, Singapore·Posted 2mo ago
web3blockchaindeveloper-toolsdata-platformspythonsparkragllm
<div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="JAF7dFJcWoUusRx7RKkuM14BsYc" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-OqGZdUPi6oJlXzxlmNiu3gAmsVg"> <div data-page-id="V6OedkjJzouK9jxNIfuuhjt9sDc" data-docx-has-block-data="false"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxuseysYUio6Qia64JLLAwE7dh"> <div data-page-id="doxusokjWsaOkSCIjzixAfRM3sd" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxusaUYeCmu82WSkkm5KDd00db"> <div data-page-id="AEW3d0Y2noLuIcxROuFubTLpsZd" data-docx-has-block-data="false"> <div data-page-id="JAF7dFJcWoUusRx7RKkuM14BsYc" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-OqGZdUPi6oJlXzxlmNiu3gAmsVg"><em>OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.<br><br></em></div> </div> <h2 class="heading-2 ace-line old-record-id-doxuslsyQOGHoiYb47TiA1n51Th"><strong>Who We Are</strong></h2> <div class="ace-line ace-line old-record-id-doxustOiFVk8C3Uy4rotl5Nem5f"> <div data-page-id="PNNZdiw4Yo1ZOmx8btbucw8qsLG" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-Q479dQIlZozY6cxcPNFuoY1rsxe"> <div class="rich-text-paragraph" data-eleid="27"> <div class="ace-line ace-line old-record-id-RKOAdw3kVoh5EQxcr2juP3i0sTb"> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom.</div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">&nbsp;</div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves.&nbsp;</div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">&nbsp;</div> <div class="ace-line ace-line old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">Across our multiple offices globally, we are united by our core principles: <em>We Before Me</em>, <em>Do the Right Thing</em>, and <em>Get Things Done</em>. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er.<br><br> <div data-page-id="Kpucdjv7JoAcSZxSf7PuRl5Yscb" data-lark-html-role="root" data-docx-has-block-data="false"> <div class=" old-record-id-Cfb8dvi9voxFkWxhNcmuJX50sZb">OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.</div> </div> </div> </div> </div> </div> </div> </div> <div class="ace-line ace-line old-record-id-doxusq2WnfR822THsuqUosdSzFu">&nbsp;</div> <h2 class="heading-2 ace-line old-record-id-doxus9qcafz8J9vhi3nwZgrckWg"><strong>About The Opportunity</strong></h2> <div data-page-id="CjU9dCRUToF6owx1ZqZl03YhgCg" data-lark-html-role="root" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-QPx1dZouOoIPFax7VEblPmZUgjd"> <div data-page-id="Hpu2dmwMRoWymMx47jkluBYDg4c" data-lark-html-role="root" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxlgqDz04PJyQlgP2MO6P06DIe">We are building the foundational data infrastructure that powers one of the world's leading crypto exchanges. As a <strong>Big Data Platform Engineer</strong>, you will design, build, and evolve the core platform services that enable hundreds of data engineers and analysts to move fast and ship reliable pipelines. You will be at the forefront of our AI agent initiative — embedding LLM-driven capabilities directly into the platform layer so that scheduling, cost optimization, and incident response increasingly run autonomously.</div> </div> </div> </div> <h2 class="heading-2 ace-line old-record-id-doxushHxPgvpIV0pJrijghkWDWe"><strong>What You’ll Be Doing&nbsp;</strong></h2> <div data-page-id="Hpu2dmwMRoWymMx47jkluBYDg4c" data-lark-html-role="root" data-docx-has-block-data="false"> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlgQ29G68ypX8J9vtXlQItxLh" data-list="bullet"> <div><strong>Platform Core: </strong>Design and operate large-scale distributed data systems</div> </li> <li class="ace-line ace-line old-record-id-doxlgVgsBuDNFwMV2EYvOzXMpXf" data-list="bullet"> <div>Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark)</div> </li> <li class="ace-line ace-line old-record-id-doxlgX45ElEQzyr2uSIeKYQveRb" data-list="bullet"> <div>Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy</div> </li> <li class="ace-line ace-line old-record-id-doxlgLCP4s5snEYMaArGyeslg0c" data-list="bullet"> <div>Drive reliability and performance improvements across batch and real-time pipelines</div> </li> </ul> <p>&nbsp;</p> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlgPgFwXvkCwFJZErHqujKjof" data-list="bullet"> <div><strong>AI Integration: </strong>Build the AI-native platform layer</div> </li> <li class="ace-line ace-line old-record-id-doxlg2tYuTMBIYp4E8lGZ0uBESg" data-list="bullet"> <div>Develop and expose MCP (Model Context Protocol) tool interfaces so AI agents can interact with platform APIs</div> </li> <li class="ace-line ace-line old-record-id-doxlgF5mbJ9U608XzeXNweMBmAb" data-list="bullet"> <div>Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity</div> </li> <li class="ace-line ace-line old-record-id-doxlgtEIHwDwgweyktEHLKHYTBW" data-list="bullet"> <div>Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection</div> </li> <li class="ace-line ace-line old-record-id-doxlg5SR8LItTj9hQlFWFD5ezCe" data-list="bullet"> <div>Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases</div> </li> </ul> <p>&nbsp;</p> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlg8YTwt9s0hDLuXIh8cLtFVA" data-list="bullet"> <div><strong>Tooling &amp; DX: </strong>Evolve the developer experience</div> </li> <li class="ace-line ace-line old-record-id-doxlgoRcnaOPGO2AwiRfCYpbTNI" data-list="bullet"> <div>Own the internal data development platform — IDE integrations, code review automation, deployment tooling</div> </li> <li class="ace-line ace-line old-record-id-doxlg5RzzQ3zi1bSiMSehxEz0DL" data-list="bullet"> <div>Build APIs-first tools (backfill, ingestion automation) designed for future MCP integration</div> </li> <li class="ace-line ace-line old-record-id-doxlgWESCdJESH0Rp3S15ytddbf" data-list="bullet"> <div>Collaborate with data warehouse and service teams to define platform contracts</div> </li> </ul> <p>&nbsp;</p> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlgZeGkdeJk5TeY9gRO2kVCNc" data-list="bullet"> <div><strong>Ops</strong><strong> &amp; Governance: </strong>Drive operational excellence</div> </li> <li class="ace-line ace-line old-record-id-doxlghARWaUEmSnMOp91bMhQGrd" data-list="bullet"> <div>Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets</div> </li> <li class="ace-line ace-line old-record-id-doxlg7K4o6XdJLTRnEGtpdccFEe" data-list="bullet"> <div>Build automated incident response and root-cause analysis pipelines</div> </li> <li class="ace-line ace-line old-record-id-doxlglu5fSXeEthKVYY2h9zjOZf" data-list="bullet"> <div>Define and enforce infrastructure policies across multi-cloud environments</div> </li> </ul> </div> <div data-page-id="Hpu2dmwMRoWymMx47jkluBYDg4c" data-lark-html-role="root" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-doxlgmyQ1B72cunrmG0BG2Ymurd"><strong>AI Agent Ownership — Platform Tier</strong></div> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlgq0L0xiqcYMHeIz6dk6lhee" data-list="bullet"> <div>Scheduling Agent: auto-configure task dependencies, engine selection, cost/performance trade-offs, and alert tiers</div> </li> <li class="ace-line ace-line old-record-id-doxlgL1Ls5JDABGQkO9yb5p0Tff" data-list="bullet"> <div>Operations Agent: detect pipeline latency, performance degradation, and schema drift; trigger remediation</div> </li> <li class="ace-line ace-line old-record-id-doxlgiPwLya0ct7HSI2hPDCRLPe" data-list="bullet"> <div>Incident Response Agent: trace SLA breaches to root cause, assign accountability, generate post-mortems</div> </li> <li class="ace-line ace-line old-record-id-doxlgRV20D6APDfTXVx9yvw4Kpe" data-list="bullet"> <div>MCP Tool Layer: design and maintain the cross-platform tool interfaces that all agents call into</div> </li> </ul> </div> <h2 class="heading-2 ace-line old-record-id-doxusWnZPeJsdMU53QGew90VQeh"><strong>What We Look For In You&nbsp;</strong></h2> <div data-page-id="Hpu2dmwMRoWymMx47jkluBYDg4c" data-lark-html-role="root" data-docx-has-block-data="false"> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-doxlgFeSm142MMqpnhVI4u1Yggg" data-list="bullet"> <div>5+ years of experience building large-scale data platforms (Hadoop/Spark/Flink or equivalent)</div> </li> <li class="ace-line ace-line old-record-id-doxlgrbsV6E9hgPO87lVe3uA6lh" data-list="bullet"> <div>Deep expertise in distributed storage and compute systems (MaxCompute, Hologres, ClickHouse, Hive)</div> </li> <li class="ace-line ace-line old-record-id-doxlgm6I6oOcm3T9j9gTIJgYvf4" data-list="bullet"> <div>Strong software engineering skills in Java, Scala, or Python; experience with API-first design</div> </li> <li class="ace-line ace-line old-record-id-doxlguxO7jmG1FYXNjc1Spp5WSh" data-list="bullet"> <div>Hands-on experience with task scheduling systems (Airflow, DolphinScheduler, or in-house equivalents)</div> </li> <li class="ace-line ace-line old-record-id-doxlgF1CdTXViDcT7NwftRrsIhb" data-list="bullet"> <div>Solid understanding of multi-cloud architectures and cost governance</div> </li> <li class="ace-line ace-line old-record-id-doxlg2aSJIR6wu88r7RhomUOfxb" data-list="bullet"> <div>Familiarity with LLM integration patterns: tool calling, RAG pipelines, context management</div> </li> <li class="ace-line ace-line old-record-id-doxlge2X7jHXNfoqoAKjSGequ1d" data-list="bullet"> <div>Experience with MCP or similar agent-tool frameworks is a strong plus</div> </li> <li class="ace-line ace-line old-record-id-doxlgiCF0DovpgnXdKgZd1jxSSe" data-list="bullet"> <div>Passion for building systems that make other engineers 10x more productive</div> </li> </ul> </div> <h2><strong>Perks &amp; Benefits&nbsp;</strong></h2> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-Gb04dtjtMoHmldxfAjXuI6P4snC" data-list="bullet"> <div>Competitive total compensation package</div> </li> <li class="ace-line ace-line old-record-id-Gb04dtjtMoHmldxfAjXuI6P4snC" data-list="bullet">L&amp;D programs and education subsidy for employees' growth and development</li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet"> <div>Various team building programs and company events</div> </li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet">Wellness and meal allowances</li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet">Comprehensive healthcare schemes for employees and dependants</li> <li class="ace-line ace-line old-record-id-doxusfCPfNQIPMLDddcFHLcCJRC" data-list="bullet">More that we love to tell you along the process!</li> </ul> <p>&nbsp;</p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div><div class="content-conclusion"><div data-lark-html-role="root"><span class="text-only" data-eleid="18"><span class="text-only"><span class="text-only" data-eleid="6">Notice:<br></span></span></span> <div data-lark-html-role="root"><span class="text-only" data-eleid="26"><span class="text-only">All official </span><span class="text-only text-with-abbreviation text-with-abbreviation-bottomline">OKX</span><span class="text-only"> vacancies are published on this website.</span></span> <span class="text-only" data-eleid="28"><span class="text-only">While roles may appear on selected third-party platforms from time to time, information on other sites may be inaccurate or outdated. </span></span><strong><span class="text-only" data-eleid="29"><span class="text-only">If in doubt, please apply directly through our official careers website.</span></span></strong></div> </div> <div data-lark-html-role="root"><span class="text-only" data-eleid="18"><span class="text-only">Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to&nbsp;</span><span class="text-only text-with-abbreviation text-with-abbreviation-bottomline">OKX</span><span class="text-only">'s </span></span><a class="link rich-text-anchor __anchor-intercept-flag__ text-content-link" href="https://www.okx.com/en-eu/help/okx-candidate-privacy-notice" target="_blank" data-eleid="19" data-lark-is-custom="true" data-lark-link="true">Candidate Privacy Notice</a><span class="text-only" data-eleid="20"><span class="text-only">.</span></span></div></div>