Solarsystek is seeking a seasoned PYSPARK Data Architect/Engineer who will take on a pivotal role in the design, development, and management of large-scale data solutions. This position emphasizes collaboration and technical expertise in data storage, modeling, ETL, querying, and reporting within a scalable, high-performance environment.
As a Data Architect/Engineer, you will work closely with agile teams to innovate data architecture and drive data engineering projects forward, ensuring each solution meets the highest standards of quality and functionality.
Key Responsibilities
- Collaborate with Agile Teams to design and manage large-scale data solutions focused on data storage, ETL, querying, and reporting.
- Develop and Integrate Solutions with a focus on cloud-based infrastructures, utilizing advanced technologies and best practices.
- Lead Migration Initiatives from SQL Server to AWS-based architectures.
- Guide and Mentor other data engineers while fostering a culture of continuous learning and technical excellence.
- Research and Evaluate the latest relational and non-SQL technologies to keep solutions current and efficient.
Must-Have Skills
- Programming Proficiency. Expertise in Python, PySpark, .Net, Scala, Java, and SQL.
- AWS Experience. Familiarity with AWS Glue, Firehouse, Lake Formation, Redshift, and other AWS tools.
- Data Engineering Expertise. Solid experience in data architecture, data modeling, and ETL solutions.
- Agile Mindset. At least 2 years of experience in Agile methodologies.
- Open Source Knowledge. 2+ years working with open-source frameworks.
Preferred Skills
- AWS Redshift, Athena, and S3. Advanced skills with these AWS tools will be highly advantageous.
- SQL Server Experience. Knowledge of SQL Server in migration projects is a plus.
- Educational Qualification. Bachelor's degree in Computer Science or equivalent experience.
Why Join Solarsystek via Uplers?
- Dedicated Support. Access to a dedicated Talent Success Coach throughout your contract.
- Career Growth. Opportunity to apply for multiple roles on our platform based on your skillset.
- Streamlined Hiring Process. Simple application steps, including a video screening and interview, to fast-track your placement.
If you're ready to make a significant impact, work in a collaborative and supportive environment, and take your career to the next level, apply today! Your next opportunity is just a click away.
Apply Now to Begin Your Journey with Uplers and Solarsystek!