Goli Naga Mahesh

Goli Naga Mahesh

  • 1.6k
  • 3
  • 297

please anyone from this group help me with the task

Oct 30 2023 7:13 AM
  1. Create ETL job in AWS Glue,  - Read CSV file, Apply transformation, Create 2 file CSV format and Parquet format and stored in S3 bucket
  2. Schedule AWS glue to run everyday at 6 pm 
  3. Parquet output file should be created in the S3 output bucket -> under dynamic Folder name (mm-dd-yyyy) ,
  4. CSV file  should be under static folder , and file name should be unique i.e. current date time as suffix
  5. Create Crawler to catalog this file under Glue database
  6.  Query data using Athena 

pls anyone in this group help me with this task

Answers (1)