Shell Script Code For Data Cleanup Script

Linux Shell Script For Data Cleanup Script

Data Cleanup Script 

#!/bin/bash

directory="/path/to/cleanup"

# Remove files older than 7 days in specified directory

find "$directory" -type f -mtime +7 -exec rm {} \;

echo "Old files removed."

shell script for data cleanup typically involves tasks like removing unnecessary characters, trimming whitespace, and ensuring data consistency.

#!/bin/bash

# Function to clean up a file

cleanup_file() {

    FILE=$1

    # Remove leading and trailing whitespace from each line

    sed -i 's/^[ \t]*//;s/[ \t]*$//' $FILE

    # Remove empty lines

    sed -i '/^$/d' $FILE

    # Convert DOS-style line endings to Unix-style (if needed)

    dos2unix $FILE >/dev/null 2>&1

    echo "Cleanup complete for $FILE."

}

# Example usage: clean up a sample file

FILE_TO_CLEAN="sample.txt"

echo "Cleaning up $FILE_TO_CLEAN ..."

cleanup_file "$FILE_TO_CLEAN"

Explanation:

1. Shebang: #!/bin/bash specifies that this script should be interpreted using the Bash shell.

2. cleanup_file Function: Performs the following operations on the specified file ($FILE):

   • Uses sed to remove leading and trailing whitespace from each line (^[ \t]* matches leading whitespace, [ \t]*$ matches trailing whitespace, and replaces with an empty string).
   • Removes empty lines using sed '/^$/d' (deletes lines that are empty).
   • Uses dos2unix to convert DOS-style line endings (\r\n) to Unix-style (\n) if the file originated from a Windows environment.

3. Example Usage: Specifies a file (sample.txt) to clean up. You can replace "sample.txt" with any file path you want to clean up.

Usage:

• Save this script to a file, e.g., cleanup_data.sh.
• Make it executable with chmod +x cleanup_data.sh.
• Modify the FILE_TO_CLEAN variable to point to the file you want to clean up.
• Run the script with ./cleanup_data.sh.

Notes:

• Customization: Modify the cleanup_file function to include additional cleanup operations as needed, such as removing specific characters or patterns, standardizing date formats, etc.

• Error Handling: This script assumes basic error handling. You may want to add more robust error checking and reporting based on your specific data cleanup requirements.

• Security: Be cautious when manipulating data files directly with scripts. Ensure backups are in place and test thoroughly, especially with large or critical data sets.

This script provides a foundation for basic data cleanup tasks in a Unix-like environment. Depending on your specific needs and the complexity of your data, you can expand upon it with more advanced cleanup operations and error handling.