[Intern] Big Data Development Engineer Intern
Hong Kong SAR·Posted 11d ago
llmcryptoweb3data-platformspythonsparklangchainllamaindexrag
<div class="content-intro"><p><strong>About Us</strong></p> <div data-page-id="HladdPLXIoNz4nxkqkCuk4rAs8v" data-lark-html-role="root" data-docx-has-block-data="false"> <div class="ace-line ace-line old-record-id-XCikdRR2xoZIjdxtCKcuOflrs8d">Established in 2018, Bybit is one of the world’s leading cryptocurrency exchanges and digital financial platforms, serving over 80 million users across more than 200 countries and regions. Powered by world-class technology and a user-first mindset, Bybit delivers a seamless ecosystem across trading, payments, wealth management, custody, institutional services, and Web3 — connecting users to the future of digital finance.</div> <div class="ace-line ace-line old-record-id-IF06dI0MPoBwYfxbZ4zui13HsoC"> </div> <div class="ace-line ace-line old-record-id-X5EbdOwvMoYuOmxQBbuueUEDsDd">Our core values define how we build. We listen, care and improve to create products and experiences that put users first. Backed by a global team of ambitious builders, problem-solvers, and innovators, we foster a high-performance and fast-moving environment where talent is empowered to drive real impact at the global scale. Supported by 24/7 multilingual customer service and a strong commitment to innovation, we are shaping the future of finance through technology, collaboration, and bold execution.</div> <div class="ace-line ace-line old-record-id-LtVud2dO7oglqJxxZoOucqjJsPc"> </div> <div class="ace-line ace-line old-record-id-RMHkdm4bPo66l3xMVO8ui1o8sle">Today, Bybit is recognized as one of the most trusted and transparent platforms in the digital asset industry, continuing to expand its global presence while building the infrastructure for the next generation of financial services.</div> </div></div><div data-lark-html-role="root"> <div class="universal-card-markdown universal-card-element-shell"> <div class="universal-card-markdown__children_wrapper"><span class="universal-card-text universal-card-text--bold">Key Responsibilities:</span><br> <div class="universal-card-markdown-list"> <ol class="universal-card-markdown-list__ol"> <li data-marker="1."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Research & Benchmarking</span><span class="universal-card-text"> — Survey industry and open-source approaches in AI + data governance (metadata & lineage platforms, semantic layers, data quality frameworks, NL2SQL / NL2Metric); produce a best-practice proposal adapted to our tech stack.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="2."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Data Model Governance</span><span class="universal-card-text"> — Build AI-assisted model review capabilities: naming convention and layering (ODS/DWD/DWS/ADS) validation, duplicate and redundant model detection, lineage-based identification of unused / low-value / high-cost assets, and automated refactoring recommendations.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="3."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Metric Semantic Automation</span><span class="universal-card-text"> — Automatically extract and standardize metric definitions from SQL, lineage, and documentation; detect definition conflicts and redundant builds of the same metric across different reports; maintain a machine-readable semantic layer to support natural language metric queries.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="4."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Data Quality Automation</span><span class="universal-card-text"> — Auto-generate quality rules based on data profiling and lineage (replacing hand-written rules); perform anomaly detection on data volume, distribution, timeliness, and schema drift; conduct root cause analysis along lineage; implement automated alert grading and remediation recommendations (or auto-remediation).</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="5."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">MVP Delivery</span><span class="universal-card-text"> — Run at least one end-to-end implementation across the three areas: problem definition → solution design → prototype → deployment on a real data domain → quantified results (coverage, precision/recall of issue detection, manual effort saved) → iteration.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="6."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Documentation & Communication</span><span class="universal-card-text"> — Produce solution designs, evaluation methodologies, and results; present findings to platform and data stakeholders; deliver a reusable framework rather than one-off scripts.</span></div> </li> </ol> </div> <span class="universal-card-text universal-card-text--bold">Requirements:</span><br> <div class="universal-card-markdown-list"> <ol class="universal-card-markdown-list__ol"> <li data-marker="1."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Undergraduate or graduate student in Computer Science, Data Science, Statistics, or a related field.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="2."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Solid proficiency in SQL and Python. Understanding of data warehouse fundamentals — dimensional modeling, layered architecture, metadata, and lineage. Experience with Spark / Flink / Hive / StarRocks is a plus.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="3."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Hands-on experience with LLM application development: prompt engineering, RAG, Agent / tool-calling frameworks (e.g., LangChain, LlamaIndex, MCP), with the ability to evaluate whether an LLM system is actually effective.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="4."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Structured thinking: able to distill a vague governance pain point into a well-defined problem with quantifiable success criteria, and honestly articulate what the MVP validated and what it did not.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="5."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Self-driven and comfortable with ambiguity — this is an exploratory project with no predetermined answers.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="6."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Bonus: experience with DataHub / OpenMetadata / Atlas, dbt, Great Expectations / Deequ, or any metrics / semantic layer tooling.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="7."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text">Able to read technical materials in English; clear written communication skills.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="8."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Minimum 3-month internship commitment, 5 days per week on-site.</span></div> </li> </ol> <ol class="universal-card-markdown-list__ol"> <li data-marker="9."> <div class="universal-card-markdown-list__li-content"><span class="universal-card-text universal-card-text--bold">Fluent in Mandarin is required; fluent English is a plus.</span></div> </li> </ol> </div> </div> </div> <div class="universal-card-markdown universal-card-element-shell"> <div class="universal-card-markdown__children_wrapper"> </div> </div> </div><div class="content-conclusion"><p><strong>Why Join Us</strong><br>At Bybit, we are committed to fostering a supportive and enriching work environment. <br>Our benefits include:<br>- Study Growth Fund: We support your professional development and continuous learning.<br>- Internal Events: Participate in regular team-building activities, workshops, and events designed to promote collaboration and innovation.<br>- Global Collaboration: Be part of a diverse, international team, working alongside colleagues from around the world.<br>- Career Advancement: Access opportunities for growth and advancement within a rapidly expanding global company.<br>- Internal Mobility: Grow with us- Your long-term development is important to us. We offer internal job opportunities to help build your career path.</p></div>