As a Datastage Developer, you will be responsible for designing, developing, and managing ETL processes using IBM DataStage. The role involves working with large datasets, transforming them according to business needs, and ensuring seamless integration and loading of data into enterprise systems. You will work closely with teams to build and optimize data pipelines, ensuring high quality, reliability, and efficiency in data operations.
Key Responsibilities
- Design, develop, and deploy DataStage jobs to handle complex data extraction, transformation, and loading tasks. You will create jobs that meet business requirements while optimizing for performance, data integrity, and accuracy.
- Write complex SQL queries to interact with relational databases (e.g., Oracle, SQL Server, DB2) and NoSQL databases. You will ensure proper data transformation and loading strategies are in place for smooth data integration.
- Develop and maintain UNIX shell scripts to automate data workflows, schedule jobs, and manage logs. Your scripting will ensure jobs are automated, reducing manual intervention and increasing efficiency.
- Integrate data from multiple sources, such as legacy systems, cloud platforms, and data warehouses, ensuring seamless integration and high data quality standards.
- Troubleshoot and optimize DataStage jobs to improve performance. This includes identifying and resolving performance bottlenecks, ensuring fast execution times, and improving job efficiency for large-scale data processing.
- Collaborate with business analysts, data engineers, and other technical teams to define data requirements and ensure the designed solutions meet business needs. You will work cross-functionally to ensure the data flows meet the standards of business reporting, analysis, and decision-making.
- Perform unit testing and validate the functionality of ETL jobs, ensuring that data transformations are correct and meet quality standards. You will be responsible for documenting test results and debugging any issues that arise.
- Document technical specifications, job design details, and processes. You will also actively look for opportunities to enhance the ETL pipeline, improving data processing efficiency and reducing overhead costs.
- Work with cross-functional teams spread across multiple locations, ensuring seamless communication and coordination between the teams involved in the data integration projects.
Required Skills and Experience
- Hands-on experience with IBM DataStage for at least 4-8 years. You must have expertise in designing, developing, and deploying ETL solutions using DataStage, covering various stages such as data extraction, data transformation, and data loading.
- In-depth knowledge of SQL, including the ability to design and optimize complex queries. Experience working with relational databases like Oracle, SQL Server, or DB2 is required.
- Experience in writing UNIX shell scripts to automate tasks, schedule jobs, and process data in batch mode. You should be comfortable working in the Linux/Unix environment.
- Strong understanding of ETL processes and experience implementing complex data integration solutions. This includes using DataStage for various data transformations and workflows.
- Strong ability to troubleshoot issues related to data integration, including identifying data quality issues, resolving errors, and ensuring that data flows correctly through all ETL layers.
- A solid understanding of data quality concepts and experience optimizing ETL job performance, focusing on improving execution time and resource usage.
- Familiarity with version control systems such as Git for managing code and configurations. You should have experience in managing versions of ETL jobs and scripts effectively.
- Strong problem-solving skills and an ability to analyze large volumes of data, identify issues in ETL workflows, and come up with solutions to resolve them effectively.
Good-to-Have Skills
- Experience with IBM Data Cloud for cloud-based data integration and management.
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform for data integration and ETL in cloud environments.
- Exposure to Big Data technologies such as Hadoop, Spark, and Kafka for processing large datasets and integrating with big data platforms.
- Experience working with automation frameworks such as Jenkins or Airflow for automating ETL pipelines, data workflows, and deployments.
- Familiarity with data warehousing concepts and experience in working with large-scale data warehouses like Amazon Redshift, Google BigQuery, or Snowflake.
- Experience working in Agile development environments, including sprint planning and managing backlogs to ensure timely delivery of tasks and projects.
Minimum Qualifications
- Education. A 15-year full-time education (minimum), including 10th, 12th, and Undergraduate degree (UG). A Postgraduate degree (PG) is optional but preferred.
- Academic Requirements. Candidates should have at least 50% marks in 10th, 12th, Undergraduate, and Postgraduate (if applicable).
- Experience. 4 to 8 years of hands-on ETL development experience with IBM DataStage.
Note. Freshers and Ex-TCS employees are not eligible for this role.
Why TCS?
- Global Leadership. Join TCS, a global leader in IT services, and work with world-renowned clients across industries.
- Career Growth. TCS values its employees and offers ample opportunities for career growth, professional development, and learning cutting-edge technologies.
- Innovation & Collaboration. TCS encourages collaboration and the free exchange of ideas across teams, which leads to innovation and the development of new solutions.
- Work-Life Balance. TCS promotes a healthy work-life balance, offering flexible work schedules, generous paid time off, and wellness programs for employee support.
- Inclusive Culture. At TCS, diversity and inclusion are core values. We promote a workplace where all employees feel valued and supported, regardless of their background.
- Compensation & Benefits. TCS offers competitive compensation, comprehensive benefits, and various perks to its employees to ensure their well-being and job satisfaction.
Application Process. Interested candidates are invited to submit their updated resumes along with valid contact details to the HR Team. For any clarifications, candidates can reach out to Supriya Kashid, HR Recruiter.
Important Notes
- Freshers and Ex-TCS employees are not eligible for this role.
- Ensure that your application meets the required qualifications before applying.