Key Responsibilities:
• Design, develop, and maintain robust data pipelines using Python and modern ETL tools.
• Better understanding and hands-on experience in PySpark Framework
• Build and optimize data models in PostgreSQL or other relational databases.
• Write Complex SQL queries for data extraction, transformation, and loading.
• Have good experience in Optimizing the Queries for better performance.
• Implement and manage data lakes and related storage solutions.
• Utilize distributed SQL engines such as Trino (PrestoSQL) for querying across data sources.
• Develop Python scripts for data processing, automation, and API integration.
• Ensure data quality, consistency, and accuracy through monitoring and checks.
• Collaborate with data scientists and analysts to fulfill data requirements.
• Maintain data documentation and dictionaries.
• Automate repetitive tasks and improve the efficiency of data processes.
• • Troubleshoot and resolve data-related issues.
• • Manage and optimize cloud-based data infrastructure (AWS, Azure, GCP).
Qualifications:
• Bachelor’s degree in Computer Science, Engineering, or related field.
• Strong SQL skills and experience with relational databases preferably PostgreSQL
• Hands-on experience with Python for data processing.
• Experience with Apache Spark or similar big data processing frameworks.
• Experience with data pipelines, ETL, and data warehousing.
• • Familiarity with cloud data platforms (AWS, Azure, GCP).
• • Strong problem-solving, analytical, and communication skills.
apply now:https://www.hirewand.com/apply/job/detail?jid=20222711&cpid=2022&uid=151227&src=jobpost
