Backend Engineer, Data Pipeline Group - Data Platform Department (DPD)

Salary not provided

Rakuten

Job Description: Business Overview The Technology Platforms Division (TPD) drives the growth of Rakuten's ecosystem by delivering innovative, high-quality technology platforms characterized by integrated control and strategic partnerships. Within TPD, the Cloud Platform Supervisory Department (CPSD) develops and manages Rakuten's state-of-the-art cloud platform, empowering global scalability and accelerating innovation across its diverse business units. Department Overview The Data Platform Department (DPD) at Rakuten Group develops and maintains a comprehensive data platform, empowering over 70 Rakuten services with solutions for data ingestion, discovery, governance, analytics, and querying. We support data-driven decision-making across one of Japan's largest data ecosystems, providing the tools and infrastructure to support key domains such as Data Lakes, Data Warehouses, and Business Intelligence. Position: Position Details We are looking for backend engineers that are interested building and running a data platform for data processing applications. The platform integrates latest solutions including On-Premise/On-Cloud computing resources, application frameworks for running new data processing applications. You will have many opportunities to use the cutting-edge technology and choose the best platform solutions based on good design thinking. You will work with a multi-location and quick moving teams, and with other data engineers as the platform customers. Key Responsibilities - Design and implement application architecture - Work along with engineers and promote collaboration between teams - Validate and improve the code quality in Rakuten - Participate in the mid and long term product vision - R&D activity for new technologies Mandatory Qualifications: - 5+ years’ experience in software development, especially using Java/Golang as a programming language. - In-depth understanding of the entire web development process (design, development and deployment). - Experience with designing and building tools based on specific requirements. - Experience with microservice architecture like Spring Boot/Spring Cloud. - Experience with RESTful design/Unit Test/Integration Test. - Experience with SQL and some of the modern relational databases. - Experience with Caching with Redis/Memcache. - Experience with CI/CD tools like Jenkins/Github actions/ArgoCD. - Experience with Kubernetes and public cloud environment. - Experience with performance optimization. - Able to work in a team-oriented environment. Desired Qualifications: - Experience with bulding tool with Python. - Experience with Airflow, Airflow operators and DAGs. - Experience with designing, building, and maintaining robust ETL/ELT pipelines. - Experience with building and maintein data platforms. - Experience with large-scale data processing using such as BigQuery, Starburst Trino, Apache Spark, Hive, etc. - Experience with Data Governance, Security. - Experience with Throttling/QoS/Stress Test/etc. - Experience with message queue like RabbitMQ/Kafka. - Experience with service mesh architecture like Istio. #engineer #applicationsengineer #technologyplatformdiv Languages: English (Overall - 3 - Advanced) In Japanese, Rakuten stands for ‘optimism.’ It means we believe in the future. It’s an understanding that, with the right mind-set, we can make the future better by what we do today. So we challenge ourselves to evolve, innovate and experiment, to create a better, brighter future for everyone. Today, our 70+ businesses span e-commerce, digital content, communications and fintech, bringing the joy of discovery to almost 1.3 billion members across the world. If you have any trouble logging in, please contact us here Rakuten Group, Inc.: rakuten-recruiting-info@mail.rakuten.com Please read the Application Requirements(EN) / 募集要項(JP) before applying. Our Diversity & Inclusion Policy and Application Documents Rakuten’s corporate mission is to “contribute to society by creating value through innovation and entrepreneurship.” We foster a culture that provides equal opportunities to those who share this founding philosophy and take on the challenge to transform society, regardless of age, gender, nationality, or any other status. Diversity is one of Rakuten's core strategies and a driving force for innovation. Because of this, you are not required to submit any of the following information in order to apply for our job positions. - Gender - Age - Photo - Nationality - Information not related to business, such as ideological beliefs, family structure, etc. * For legal compliance, we may ask you about your work eligibility. See the details