Job Description: Data Engineer
Location: Indore, India
Experience: 4+ years
Key Responsibilities:
- Design, implement, and maintain scalable data pipelines and ETL processes.
- Develop and optimize data architectures using AWS services.
- Work with Databricks to manage and process large datasets efficiently.
- Write complex SQL queries to extract, transform, and load data.
- Develop and maintain data models, databases, and data warehouses.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Ensure data quality, integrity, and security across all data platforms.
- Monitor and troubleshoot data pipeline issues to ensure smooth operation.
- Stay updated with the latest industry trends and technologies in data engineering.
Required Skills and Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 4+ years of experience in data engineering or a similar role.
- Strong experience with AWS services (e.g., S3, Redshift, Glue, Lambda).
- Proficiency in Databricks and working with large-scale data processing.
- Advanced SQL skills with experience in writing and optimizing complex queries.
- Proficiency in Python for data manipulation and automation.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Ability to work independently and as part of a team.