We are seeking experienced Snowflake Data Engineers to be part of a high-impact, distributed team consisting of ~20 professionals including functional analysts, DevOps engineers, infrastructure specialists, test engineers, and software developers. The team will work under the guidance of an on-site project manager and will take full ownership of end-to-end project delivery.
This is a unique opportunity to work on a transformative project that not only includes infrastructure modernization but also focuses on building modern data architectures and enabling data-driven decision making at enterprise scale.
Key Responsibilities
- Lead the design, development, and optimization of scalable data pipelines and ETL processes within Snowflake.
- Collaborate with business analysts, application owners, infrastructure teams, and data scientists to translate data requirements into effective Snowflake-based solutions.
- Facilitate end-to-end data migration from legacy on-premises systems (e.g., SQL Server 2016, Oracle) to Snowflake, ensuring high quality and integrity.
- Design and implement optimized data models (Star and Snowflake schemas) with a deep focus on dimensional modeling and performance tuning.
- Leverage Snowflake capabilities such as Zero Copy Cloning, Time Travel, Micro-Partitioning, Snowpipe, and VARIANT data types to handle semi-structured data (JSON, XML, Parquet).
- Apply best practices for data governance, access control, and security, including RBAC configurations, resource monitors, and user authentication.
- Develop and manage CI/CD pipelines for Snowflake deployment processes, ensuring reliable and automated updates across environments.
- Use SnowSQL for writing and maintaining complex queries, stored procedures, and scripts to analyze, transform, and validate data.
- Participate in performance optimization initiatives using query profiling, indexing strategies, and auto-clustering techniques.
- Assist in re-clustering strategies and data partitioning for large-scale datasets to improve performance and cost-efficiency.
- Provide input into overall system architecture design as it pertains to the Snowflake environment.
- Document architecture, workflows, and transformation logic to enable seamless knowledge transfer and long-term maintainability.
Required Skills and Experience
- Strong hands-on experience with Snowflake – architecture, features, and best practices.
- Expertise in data warehousing concepts, including Star and Snowflake schema design and dimensional modeling.
- Proven experience in migrating data from on-premise databases to Snowflake.
- Skilled in building and optimizing data pipelines/ETL workflows using Snowflake-native capabilities and Python scripting.
-
Solid understanding of Snowflake-specific concepts such as:
-
Resource Monitors
-
RBAC (Role-Based Access Control)
-
Scalable Virtual Warehouses
-
Query performance tuning
-
Zero Copy Clone and Time Travel
-
Micro-Partitioning and Re-Clustering
-
VARIANT datatype and handling of JSON/XML/Parquet
-
Snowpipe for real-time and batch ingestion
-
- Advanced SQL and SnowSQL development capabilities, including writing and tuning complex queries and stored procedures.
- Familiarity with CI/CD practices and tools as they relate to Snowflake deployment workflows.
- Experience in handling data quality, governance, and security controls in enterprise data platforms.
- Excellent problem-solving skills and the ability to work independently in a dynamic environment.
Nice-to-Have Skills
- Experience working in financial services or capital markets domain.
- Familiarity with project management and collaboration tools such as JIRA and Confluence.
- Understanding of job scheduling tools like Control-M.
- Knowledge of Microsoft Message Queuing (MSMQ) or similar messaging systems.
Why Join Us?
- Be part of a strategic digital transformation initiative for a top-tier financial client.
- Work with modern data technologies and be at the forefront of cloud-based data engineering.
- Join a globally distributed, collaborative team that values innovation and continuous improvement.
- Luxoft offers permanent employment, a competitive compensation package, comprehensive benefits, and the opportunity for long-term career growth through diverse projects across industries and technologies.
If you’re passionate about data engineering and modernization projects, and you’re ready to help shape the next generation of enterprise data platforms—we want to hear from you!