Data Engineer is hiring for Software Engineer

The job you are looking for is no longer available..
Company Name
Data Engineer
Company Website
http://magna.com/
Job Role
Data Engineer
Job Type
  • Experienced
  • Fresher
Job Location
  • Bengaluru/Bangalore
Education
  • BE/BTech
Branch
  • IT
  • CS
Job will expire on
30 Jul 2024

Eligibility Criteria

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer or similar role, with expertise in Databricks.
  • Technical expertise with data models, data mining, and segmentation techniques
  • Strong programming skills in languages such as Python.
  • Experience with big data technologies such as Hadoop, Spark, or Kafka.
  • Proficiency in SQL and database technologies (e.g., MySQL, PostgreSQL, or Oracle).
  • Familiarity with cloud platforms (e.g., AWS, Azure, or GCP) and their data services.

Job Description

  • Design, build, and maintain scalable data pipelines and ETL processes using Databricks to collect, transform, and load data from various sources into our data warehouse.
  • Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and implement solutions to meet their needs using Databricks.
  • Prepare data for the advanced analysis e.g. ML modeling
  • Optimize and tune data pipelines and ETL processes in Databricks for performance and efficiency.
  • Develop and maintain data models, schemas, and data dictionaries in Databricks.
  • Implement data quality checks and monitoring in Databricks to ensure data accuracy and integrity.
  • Troubleshoot and resolve data-related issues and incidents in Databricks.

Similar Opportunities

Latest Posts