DevOps Engineer, Data Service Group - Data Platform Department (DPD)

Salary not provided

Rakuten

Job Description: Department Overview Data Platform Department (DPD) is building enterprise data platform for Rakuten. The platform not only looks to automate the processes involved with ingesting, discovering, governing and querying data but also support Rakuten’s drive to become completely data-driven across more than 70 services. Position: Why We Hire We are looking for DevOps Engineers that are interested building and running a platform for data pipeline operations. The platform integrates latest solutions including on-premise and public cloud computing resources, application frameworks for running new data platform applications for data processing. You will have many opportunities to use the latest technology, and choose the best platform solutions based on good design thinking. You will work with small and quick moving teams, and also with other data engineer and data analyst as the platform customers. Position Details - Design, implement and operate distributed system infrastructure - Development for infrastructure automation and tool creation - Collect infrastructure related metrics to create KPI dashboard - Build and maintain monitoring system - Provide 24/7 high availability for stable platform Mandatory Qualifications: - Minimum 5+ years of experience in UNIX/Linux and networking operation - Minimum 3+ years of experience in infrastructure automation technologies, such as Docker, Kubernetes, Terraform and Ansible - Experience in operating public cloud platform such as Google Cloud, Microsoft Azure, etc. - Experience in building logging, monitoring solution for web application, middleware, batch jobs - Experience with designing and building tools based on specific requirements - Experience in using Jenkins or other CI solutions - Ability to talk with Product Manager and our internal users to gather the requirements Desired Qualifications: - Bachelor or Master degree in Computer Science or Engineering - Experience with Big Data querying tools, such as BigQuery, Trino, Hive, etc. - Experience with building and maintaining data platform - Experience with building data pipeline using Airflow #engineer #applicationsengineer #technologyplatformdiv Languages: English (Overall - 4 - Fluent) In Japanese, Rakuten stands for ‘optimism.’ It means we believe in the future. It’s an understanding that, with the right mind-set, we can make the future better by what we do today. So we challenge ourselves to evolve, innovate and experiment, to create a better, brighter future for everyone. Today, our 70+ businesses span e-commerce, digital content, communications and fintech, bringing the joy of discovery to almost 1.3 billion members across the world. If you have any trouble logging in, please contact us here Rakuten Group, Inc.: rakuten-recruiting-info@mail.rakuten.com Please read the Application Requirements(EN) / 募集要項(JP) before applying. Our Diversity & Inclusion Policy and Application Documents Rakuten’s corporate mission is to “contribute to society by creating value through innovation and entrepreneurship.” We foster a culture that provides equal opportunities to those who share this founding philosophy and take on the challenge to transform society, regardless of age, gender, nationality, or any other status. Diversity is one of Rakuten's core strategies and a driving force for innovation. Because of this, you are not required to submit any of the following information in order to apply for our job positions. - Gender - Age - Photo - Nationality - Information not related to business, such as ideological beliefs, family structure, etc. * For legal compliance, we may ask you about your work eligibility. See the details