Data Engineer (Full-Time)
Contract Type: Full-time Employee
Salary Range: 6,000,000 ~ 12,000,000 JPY
The Role
You will be responsible for building data collection pipelines and infrastructure, focusing on collecting, cleansing, and modeling unstructured data from the internet. Systems are built as frameworks to enable automated execution of data cleansing and modeling by matching inputs and outputs.
As data volume increases, the team is also building data platforms and introducing distributed systems for analysis. There are opportunities to get involved in data analytics and data science, especially with a focus on utilizing LLMs to process complex unstructured data.
What We're Looking For
Required
- Experience with web scraping
- Experience in data cleansing
- Experience in data modeling
- Experience with ETL processes
- Experience using databases (e.g., MySQL, MongoDB)
- Experience extracting data from unstructured sources
- Business-level English and reading/writing proficiency in Japanese
Nice to Haves
- Experience with Natural Language Processing (NLP) or Machine Learning
- Experience with stream processing
- Experience building and operating data platforms
- Development experience outside of work (e.g., OSS contributions)
- Native-level Japanese
- Experience using data visualization tools (e.g., Tableau, Power BI, D3.js)
- Experience using LLMs in products (e.g., OpenAI)
Tech Stack
Front End
- Languages: TypeScript, React
- Libraries: Storybook, jest
- Hosting: Amplify
Server Side
- Infrastructure: AWS, ElasticBeanstalk
- DB: Aurora, ElasticSearch
- Languages: Node.js, Python
- Framework: Express
- Observability: DataDog
- Other: AWS Lambda, AWS Batch, AWS API Gateway, AWS Glue
Data Analysis
- OpenAI
- Amazon Bedrock
- OpenSearch
- SageMaker
- Athena
- Glue
Why Join?
- Fast-growing SaaS startup with exceptional financial growth
- Opportunities to build new products from scratch and drive innovation
- Clear career development and leadership opportunities
- Flexible working hours and hybrid working style (remote possible)
- Highly diverse, global team (English as a working language)
- Attractive perks: Resort Worx, free weekly lunch, book purchasing support, offsites, and more
Working Style
-
Hybrid Work
- Combination of office and remote work. Collaboration through Zoom, Google Meet, Gather.
-
Flex Work
- Customize your working hours to match your day; business/client-facing teams arrange schedules around clients.
-
Global Environment
- Team members from over 20 countries, diverse perspectives, and daily communication in both English and Japanese.
Read More
**Reference:** DEV-002