☆ Yσɠƚԋσʂ ☆

  • 501 Posts
  • 466 Comments
Joined 5 years ago
cake
Cake day: January 18th, 2020

help-circle





















  • here’s what DeepSeek gave me for the following prompt: write a small bash script to check if a CSV exists and if it does rename to the filename_date.CSV and upload to hdfs, keep it simple

    #!/bin/bash
    
    # Check if filename argument is provided
    if [ $# -eq 0 ]; then
        echo "Usage: $0 <csv_filename>"
        exit 1
    fi
    
    CSV_FILE="$1"
    
    # Check if file exists
    if [ ! -f "$CSV_FILE" ]; then
        echo "Error: File $CSV_FILE not found!"
        exit 1
    fi
    
    # Generate new filename with date (YYYYMMDD format)
    DATE=$(date +%Y%m%d)
    NEW_FILENAME="${CSV_FILE%.*}_${DATE}.csv"
    
    # Rename the file
    mv "$CSV_FILE" "$NEW_FILENAME"
    
    # Upload to HDFS
    hdfs dfs -put "$NEW_FILENAME" /path/to/hdfs/directory/
    
    echo "Successfully processed: $NEW_FILENAME"