Big Data Engineer for AI Training

About OpenTrain OpenTrain AI is the hiring and contracting organization for this role. OpenTrain is the #1 platform for finding and building careers in AI training and data labeling, helping people discover projects, build their profiles, and apply in minutes. Creating an OpenTrain account is free. Through this opportunity, you can contribute your technical expertise to work that supports the development of advanced AI systems. • Remote contractor opportunity • Part-time schedule of less than 20 hours per week • Expected project duration of 1 to 3 months • Candidates must be based in an eligible country About AI Training and Data Engineering AI training is the human side of building artificial intelligence. People with technical expertise help prepare, structure, review, and evaluate the data that AI models use to learn, reason, and perform. Data engineers play a critical role in this process by building reliable pipelines, maintaining data quality, and transforming large-scale inputs into useful datasets and systems for AI development. • Work on data infrastructure connected to next-generation AI systems • Apply big data engineering skills to real-world AI inputs • Contribute to a fast-growing field shaping how AI is built The Big Data Engineer Role OpenTrain AI is seeking an intermediate-level Big Data Engineer for a project focused on AI systems, large-scale data engineering, and model-training data solutions. You will design, refine, and optimize complex datasets and pipelines that support high-quality AI inputs. The role requires hands-on experience building and maintaining large-scale ETL pipelines, advanced Python skills, knowledge of distributed data technologies, and strong technical communication. • Subject matter focus: AI systems and big data engineering • Experience level: Intermediate • Role type: Contractor • Work arrangement: Remote What You'll Do You will help build and maintain scalable data infrastructure while collaborating with cross-functional teams on technical requirements and project goals. The work includes data integration, transformation, processing, database optimization, and ongoing infrastructure improvement. You will also be expected to document technical solutions clearly and communicate complex concepts effectively in written and verbal settings. • Design, build, and maintain scalable big data pipelines and architectures • Implement data integration, transformation, and processing workflows with Python and distributed data technologies • Manage, tune, and optimize distributed databases and storage systems • Monitor, troubleshoot, and improve data infrastructure for availability and accuracy • Enforce data quality, governance, and security standards across data assets • Collaborate with cross-functional teams to deliver against technical requirements • Document technical solutions and communicate complex concepts clearly Required Qualifications and Skills Applicants should have a proven track record in big data engineering and hands-on experience building and maintaining large-scale ETL pipelines. The role also requires advanced Python proficiency for data processing, script automation, and pipeline integration. You should have a deep understanding of relational and NoSQL databases, including indexing, query optimization, and schema design. Practical experience with distributed computing frameworks and a strong foundation in data modeling, warehousing, and distributed storage are required. • Advanced Python for data processing and automation • Experience with Hadoop, Apache Spark, or Flink • Relational and NoSQL database optimization experience • Knowledge of indexing, query optimization, and schema design • Experience with data engineering and ETL pipeline architecture • Understanding of data modeling and data warehousing principles • Knowledge of distributed storage systems • Excellent technical writing and verbal communication skills • Self-motivated and able to work autonomously in a remote setup • Experience with computer code programming labeling workflows • Experience with evaluation rating tasks • Fluent English proficiency Preferred Qualifications The following experience is preferred but is not listed as required. It may help you contribute effectively in a fast-paced, globally distributed technical environment. • Experience in fast-paced technology environments • Experience working with agile global teams • Hands-on expertise with AWS, GCP, or Azure cloud-native big data suites • Familiarity with MLOps concepts • Familiarity with data science workflows Schedule, Location, and Compensation This is a remote, part-time contractor opportunity with an expected commitment of less than 20 hours per week. The project is expected to run for 1 to 3 months. Compensation is between $30 and $80 per hour, depending on the applicable project terms and qualifications. • Pay: $30-$80 per hour • Expected commitment: Less than 20 hours per week • Expected duration: 1 to 3 months • Employment type: Contractor and part-time • Location: Remote Eligible Locations and How to Apply Candidates must be based in the United Kingdom, United States, Canada, India, Germany, Australia, New Zealand, Ireland, Iceland, Greenland, or Japan. Fluent English proficiency is required. Create a free OpenTrain account, build your profile around your big data engineering experience, and apply through OpenTrain for consideration. • Eligible countries: United Kingdom, United States, Canada, India, Germany, Australia, New Zealand, Ireland, Iceland, Greenland, and Japan • Apply through OpenTrain AI • Highlight Python, ETL, distributed computing, database, and data pipeline experience