We are seeking a highly skilled Data Engineer with proven expertise in managing large-scale data engineering projects. The ideal candidate will have a strong foundation in SQL, Machine Learning (ML) or Large Language Models (LLM), programming in Python or Java, and experience with big data technologies such as Hadoop and Spark. You will be responsible for designing, developing, and optimizing data pipelines, working closely with data scientists and analysts to ensure data availability, accuracy, and accessibility.
Key Responsibilities
- Develop, optimize, and maintain robust data pipelines and ETL workflows.
- Write efficient SQL queries to extract, transform, and load data from a variety of sources into centralized data systems.
- Work with big data technologies (Hadoop, Spark) to manage, process, and analyze large datasets.
- Implement Machine Learning (ML) models or leverage LLMs for data-driven insights and predictions.
- Collaborate with cross-functional teams to understand data needs and provide solutions.
- Ensure data quality, consistency, and integrity by applying best practices in data engineering.
- Stay current with industry trends and new technologies to continuously improve systems and processes.
Required Skills and Qualifications
- Experience. 3 to 8 years of experience in data engineering roles.
- Technical Skills. Strong proficiency in SQL, Python or Java.
- Big Data Technologies. Hands-on experience with Hadoop, Spark, and related tools.
- Machine Learning/LLM. Familiarity with applying ML models or using Large Language Models (LLMs) to extract insights from data.
- ETL Tools. Experience with ETL tools for data transformation and loading into data lakes or warehouses.
- Problem-Solving. Strong analytical skills with the ability to solve complex data challenges.
- Communication. Excellent communication and collaboration skills to work across teams.
Preferred Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Experience with cloud platforms (AWS, Azure, GCP) is a plus.
- Knowledge of Data Warehousing concepts and tools like Snowflake, Redshift, or BigQuery.
What We Offer
- Competitive salary and benefits.
- Opportunity to work with cutting-edge technologies in a dynamic and innovative environment.
- Collaborative and inclusive company culture.
- Opportunities for professional development and career growth.
If you're passionate about working with big data and modern technologies, we would love to hear from you. Apply now to join our team and help shape the future of data engineering!