As a Senior Engineer in the Data Engineering & Analytics team, you will play a pivotal role in developing cutting-edge data and analytics solutions leveraging vast datasets from retail stores, restaurants, banks, and other consumer-focused industries. Your focus will be on creating high-performance algorithms, employing advanced analytical techniques including machine learning and artificial intelligence, and designing intuitive workflows. These solutions will empower users to extract actionable insights from big data, thereby driving strategic decisions and business outcomes. You will have the opportunity to work with billion-scale transactional datasets and develop innovative, data-driven analytical solutions.
Responsibilities
- Write high-quality, secure, modular, functional, and testable code as a hands-on developer.
- Drive the evolution of Data & Services products/platforms with a focus on data science and engineering.
- Design and implement scalable data architecture and data pipelines to support analytics solutions.
- Solve complex problems using multi-layered datasets and optimize existing machine learning libraries and frameworks.
- Support deployed data applications and analytical models, acting as a trusted advisor to Data Scientists and stakeholders.
- Implement and validate data governance policies including Data Lineage, Quality checks, and classification.
- Integrate new sources of real-time, streaming, batch, and API-based data into the platform to enhance insights and expand testing capabilities.
- Experiment with new tools to streamline development, testing, deployment, and operation of data pipelines.
- Collaborate cross-functionally with consultants, engineering, and sales to prioritize and solve high-impact business problems.
- Evaluate various analytics solutions, considering usability, technical feasibility, timelines, and stakeholder input.
- Break down large solutions into manageable milestones, gathering feedback to refine products.
- Evangelize releases, gather user feedback, and track usage to inform iterative development.
- Establish team culture and processes within small, cross-functional teams to achieve project goals.
- Focus on key drivers of organizational value and prioritize operational activities accordingly.
- Escalate and resolve technical errors or bugs encountered during project execution.
- Stay abreast of relevant technical and product trends through self-learning, training, and job shadowing.
- Support the development of scalable machine learning production systems by designing pipelines and infrastructure.
Mandatory Skills
- Proficiency in Python/Scala, Spark (job tuning), SQL, and Hadoop platforms for building Big Data products & platforms.
- Strong programming skills in Java, Spring Boot, and experience with JUnit for testing.
- Knowledge of software development test approaches and frameworks.
- Familiarity with RESTful APIs and microservices architectures.
- Experience with CI/CD practices and tools.
- Hands-on experience with SQL databases such as Postgres and Oracle.
- Preferably, experience with Hadoop ecosystem tools like Hive, Impala, and Spark.
- Proficiency in data pipeline and workflow management tools such as NiFi and Airflow.
- Ability to develop shell scripts for automation.
- Strong troubleshooting and debugging skills.
- Proficient in standard software development practices including version control, testing, and deployment.
- Basic knowledge of statistical analytical techniques, coding, and data engineering principles.
- Quick learner with the ability to adopt and implement new technologies.
- Ability to solve complex problems using multi-layered datasets.
- Innovator who can identify and implement new approaches and technologies to solve business challenges.
- Strong attention to detail, ability to multitask, and excellent organizational skills.
- Flexibility to collaborate effectively in diverse, geographically distributed project teams.
- Excellent communication skills in English, both verbal and written, with strong relationship-building abilities.
Nice-to-Have Skills
- Experience in performance tuning of database schemas, SQL queries, ETL jobs, and related scripts.
- Familiarity with Cloud APIs (e.g., Azure, AWS).
- Participation in complex engineering projects within an Agile (e.g., Scrum) environment.
Languages
English. C1 Advanced
Our Offer to You
Join a dynamic team at the forefront of data engineering and analytics, driving innovation and business impact with cutting-edge solutions. Emerson offers competitive compensation, comprehensive benefits, and a supportive hybrid work environment that promotes work-life balance and career growth. You’ll have the opportunity to collaborate globally, tackle complex challenges, and make a meaningful contribution to our success.
About Us
At Emerson, we lead in automation technology and software, empowering customers across critical industries to operate sustainably and enhance productivity. We are committed to diversity, equity, and inclusion, fostering a culture of innovation where every team member can thrive and contribute to our global impact.