← Back to main page

Software Engineer, Platform Engineering - AI/GPU Infra (On-Prem) - Mercari

Salary not provided

AWSPythonBashGoKubernetesGCP
Japanese only
English: IntermediateJapanese: Fluent
Mercari

Software Engineer, Platform Engineering - AI/GPU Infra (On-Prem) - Mercari

Location: Minato City, Tokyo, Japan
Work Style: Hybrid, Full Flextime (no core time), Full time

Description

Mercari is launching a new on-premises GPU infrastructure to support AI/LLM initiatives. This role will own the on-premises side: building and maintaining data-center facilities and the high-performance network foundation enabling GPU compute, including connection and secure integration with cloud and platform networks. The position requires close collaboration with the Corporate IT team and frequent hands-on work at the data center.

Work Responsibilities

  • Design, build, and operate Mercari's on-prem DC/GPU infrastructure, including data-center facilities (racks, power, cooling) and the supporting network.
  • Design and build the network foundation for GPU workloads: compute fabric (InfiniBand/RoCE), storage/in-band, service network, and isolated OOB management.
  • Design, configure, and operate routing for the on-prem GPU fabric and its cloud/platform interconnects using BGP (and OSPF/IS-IS, VLAN/VRF as needed), including ASN planning, route summarization, and routing policy.
  • Coordinate with data-center providers and SI partners on facility readiness, equipment procurement, lead times, and remote-hands/installation work.
  • Manage Mercari's internal data center end to end, including vendor/SI discussions, commercial negotiations, and contract & procurement handling.
  • Perform hands-on, on-site data-center networking work — running and changing cabling, and configuring routers, switches, firewalls, and other network devices (this role requires regular physical visits to our data center).
  • Integrate the on-prem DC/GPU environment securely with existing corporate, cloud (GCP/AWS), and platform networks.
  • Establish monitoring, alerting, logging, and operational handoff for GPU systems and network devices.
  • Support GPU PoC execution and help define the path from PoC to production.
  • Automate provisioning and operations, and manage configuration as code (IaC).
  • Collaborate closely with the Corporate IT team on data-center facilities, connectivity, and on-site operations (required for the role).
  • Collaborate with ML Platform, Infrastructure, Security, and Procurement stakeholders.
  • Own data-center facility readiness (rack, power, cooling, carry-in routes), including NVIDIA pre-delivery site survey confirmation for DGX B200/B300-class nodes.
  • Drive RFP, quotation, and vendor selection cycles with partners, and own NDA, R&R/RACI, contract, and PO handling together with Procurement.
  • Prepare technical and cost materials for internal approval gates (JB Engineering board, investment committee, Procurement Team), including TCO/ROI comparison against cloud GPU/TPU.
  • Build and operate storage and dataset paths for models and checkpoints, and keep the stack portable between on-prem and GCP/GKE so workloads can fall back to cloud.
  • Define and operate SLOs, on-call, incident response, runbooks, and BCP/DR for the on-prem inference environment, aligned with Mercari SRE practices.
  • Bring on-prem GPU and compute nodes to parity with Mercari's cloud security posture (asset visibility, endpoint/posture tooling, audited bastion, isolated OOB access) together with Enterprise Security.
  • Track and report GPU utilization, power, and token-cost savings with FinOps from the first node to multi-node scale.

Qualifications

Required Experience/Skills

  • Strong networking fundamentals (TCP/IP, IP address management, OSI layers 2–7, routing, DNS, TLS, HTTP)
  • Hands-on experience designing, configuring, and troubleshooting data-center routing and switching, especially BGP (ASN planning, route summarization, and routing policy), as well as OSPF, VLAN/VRF
  • Hands-on experience designing and operating physical/data-center networking (switches, routers, firewalls, structured cabling)
  • Production experience operating Linux servers
  • Hands-on data-center experience, including for GPU/high-density systems: physically installing and changing cabling and configuring routers, switches, and firewalls on-site (this role requires regular in-person visits to our data center)
  • Experience with data-center operations: racks, power, cooling, cross-connects, and coordinating remote-hands / installation work
  • Hands-on experience with data-center physical/facility operations, including power equipment and circuit switching (PDUs, breakers, circuit changes), and responding to outages and production incidents
  • Experience managing data-center vendors and SI partners, including commercial discussions and contract/procurement handling
  • Experience integrating on-prem and cloud networks (GCP or AWS), including VPN, proxies, and routing
  • Security mindset in network design and operations: firewall rule design and management, egress/outbound policies, and network segmentation/isolation
  • Ability to automate workflows using Python or Bash and to manage configuration using Infrastructure as Code (IaC)
  • Experience writing design documents and working with internal stakeholders and external vendors/SIers
  • Experience running production infrastructure in Japanese data centers, including carry-in planning, site surveys, and facility coordination conducted in Japanese
  • Experience operating Linux/GPU nodes as a fleet: provisioning, firmware and driver lifecycle, monitoring, and incident response
  • Experience defining SLOs and participating in on-call for a production platform
  • Experience producing internal approval and procurement documentation (cost model, ROI, risks) for executive-level review
  • Empathy with Mercari's mission and values

求める経験・スキル（日本語原文）

  • ネットワークに関する強固な基礎知識（TCP/IP、IPアドレス管理、OSIレイヤー2〜7、ルーティング、DNS、TLS、HTTP）
  • データセンターのルーティング／スイッチング、特にBGP（ASN設計、経路集約、ルーティングポリシー）の設計・構成・トラブルシュートの実務経験（OSPF、VLAN／VRFを含む）
  • 物理／データセンターネットワーク（スイッチ、ルーター、ファイアウォール、構造化配線）の設計・運用の実務経験
  • 本番環境におけるLinuxサーバーの運用経験
  • GPU／高密度システムを含むデータセンターでの実地経験：現地でのケーブルの敷設・交換、ルーター・スイッチ・ファイアウォールの設定（本ポジションではデータセンターへの定期的な現地訪問が必要です）
  • ラック・電源・冷却・クロスコネクトなどのデータセンター運用、およびリモートハンズ／設置作業の調整経験
  • データセンターの物理・設備運用の実務経験（電源設備の取り扱い、回路切り替え（PDU・ブレーカー・回路変更）を含む）、および障害対応・本番トラブル対応の経験
  • データセンターのベンダーやSIパートナーの管理経験（商談・交渉、契約・調達対応を含む）
  • オンプレとクラウド（GCPまたはAWS）のネットワーク統合（VPN、プロキシ、ルーティングを含む）の経験
  • ネットワーク設計・運用におけるセキュリティマインド：ファイアウォールのルール設計・管理、Egress（外向き通信）ポリシー、ネットワークのセグメンテーション／分離
  • PythonやBashを用いたワークフローの自動化、およびInfrastructure as Code（IaC）による構成管理の能力
  • デザインドキュメントの作成、社内ステークホルダーや社外ベンダー／SIerとの連携経験
  • 国内データセンターでの本番インフラ運用経験（搬入計画、サイトサーベイ、日本語での設備調整を含む）
  • Linux／GPUノードをフリートとして運用した経験（プロビジョニング、ファームウェア・ドライバのライフサイクル管理、監視、障害対応）
  • 本番プラットフォームにおけるSLOの定義およびオンコール対応の経験
  • コストモデル・ROI・リスクを含む社内承認／調達ドキュメントを作成し、経営層レビューを通した経験
  • メルカリのミッションやバリューに対する共感

Preferred Experience/Skills

  • Experience with GPU/HPC infrastructure and high-performance fabrics such as InfiniBand or RoCE
  • Experience designing modern data-center fabrics: spine/leaf and border-leaf architectures, and EVPN-VXLAN (GPU environments preferred, CPU/general-purpose environments also welcome)
  • Experience with networking for bare-metal provisioning, such as DHCP-relay and PXE boot design
  • Hands-on experience installing and maintaining GPU systems/servers in a data center — physical installation, cabling, and ongoing maintenance (strongly preferred)
  • Experience operating NVIDIA DGX or similar GPU appliances
  • Experience with out-of-band management (BMC/Redfish/IPMI) and PDU management
  • Experience designing high-density data-center environments (high kW/rack, cooling strategy)
  • Knowledge of ML/LLM serving infrastructure and GPU scheduling
  • Experience working with SI partners and procurement processes
  • Experience developing infrastructure or middleware using Go or Python
  • Experience operating LLM inference in production with vLLM, NVIDIA NIM/Triton, or similar, using OSS models such as Qwen, Gemma, or Llama
  • Experience with GPU scheduling and orchestration: Kubernetes with GPU Operator, Run:ai, or Slurm
  • Experience with hybrid GCP integration: GKE, Workload Identity Federation, split-horizon DNS, and cloud fallback paths
  • Familiarity with NVIDIA AI Enterprise licensing and support contracts, and with Japanese vendor/SI management
  • Experience extending security posture tooling (asset inventory, EDR, CSPM) from a cloud estate to on-prem nodes
  • Knowledge of PCI-DSS or ISMS requirements as they apply to in-scope network and data-center environments
  • Experience with high-performance storage for AI workloads (Lustre, VAST, WEKA) and object-storage/GCS dataset pipelines

歓迎する経験・スキル（日本語原文）

  • GPU／HPCインフラ、およびInfiniBandやRoCEなどの高性能ファブリックの経験
  • モダンなデータセンターファブリックの設計経験：Spine／Leaf・Border Leaf構成、EVPN-VXLAN（GPU環境の経験を歓迎、CPU／汎用環境の経験も可）
  • ベアメタルプロビジョニングに関わるネットワーク（DHCPリレー、PXEブート）の設計経験
  • データセンターにおけるGPUシステム／サーバーの設置・保守の実務経験（物理設置、配線、継続的なメンテナンス）※特に歓迎
  • NVIDIA DGXまたは同等のGPUアプライアンスの運用経験
  • アウトオブバンド管理（BMC／Redfish／IPMI）やPDU管理の経験
  • 高密度データセンター環境（高kW／ラック、冷却戦略）の設計経験
  • ML／LLMサービング基盤やGPUスケジューリングに関する知識
  • SIパートナーや調達プロセスとの協働経験
  • GoやPythonを用いたインフラやミドルウェアの開発経験
  • 本番環境でのLLM推論運用経験（vLLM、NVIDIA NIM／Triton等、およびQwen・Gemma・Llama等のOSSモデル）
  • GPUスケジューリング／オーケストレーションの経験（Kubernetes＋GPU Operator、Run:ai、Slurm）
  • GCPとのハイブリッド統合の経験（GKE、Workload Identity Federation、DNSの内外分離、クラウドフォールバック）
  • NVIDIA AI Enterpriseのライセンス・サポート契約、および国内ベンダー／SI管理に関する知見
  • クラウドで運用しているセキュリティポスチャ管理ツール（資産インベントリ、EDR、CSPM）をオンプレノードへ拡張した経験
  • PCI-DSSやISMSの対象となるネットワーク／データセンター環境における要件の知識
  • AIワークロード向け高性能ストレージ（Lustre、VAST、WEKA）およびGCS等オブジェクトストレージを用いたデータパイプラインの経験

Language

  • Japanese: Proficient (CEFR – C1) — required for this role (frequent communication with domestic data-center and vendor partners)
  • English: Independent (CEFR-B1) — Business communication level is sufficient (fluency is not required)

Learn More

reco経由で応募する