About the Role
We are on the lookout for a proficient and driven Data Engineer, specializing in Databricks, to become a part of our team. The role involves the creation, development, and upkeep of our data infrastructure and systems using Databricks. You will work closely with various teams to ensure our data pipelines and analytics platforms are available, reliable, and scalable.
Your Responsibilities
- Design and construct scalable data pipelines and ETL processes utilizing Databricks to gather, transform, and load data from multiple sources into our data warehouse.
- Work alongside data scientists, analysts, and other team members to understand their data needs and implement Databricks-based solutions.
- Prepare data for advanced analyses, such as machine learning modeling.
- Enhance and fine-tune data pipelines and ETL processes in Databricks for optimal performance and efficiency.
- Develop and sustain data models, schemas, and data dictionaries within Databricks.
- Implement data quality checks and monitoring to ensure the accuracy and integrity of our data.
- Diagnose and resolve data-related issues and incidents in Databricks.
- Stay informed about the latest trends and technologies in data engineering, particularly those related to Databricks, and suggest improvements for our data infrastructure and systems.
Who We Are Looking For
- A Bachelor’s degree in Computer Science, Engineering, or a related discipline.
- Proven experience as a Data Engineer or a similar role, with a strong focus on Databricks.
- Technical proficiency in data models, data mining, and segmentation techniques.
- Strong programming skills, particularly in Python.
- Experience with big data technologies like Hadoop, Spark, or Kafka.
- Proficiency in SQL and database technologies such as MySQL, PostgreSQL, or Oracle.
- Familiarity with cloud platforms like AWS, Azure, or GCP and their data services.
- Knowledge of data warehousing concepts and dimensional modeling.
- Excellent problem-solving and analytical abilities.
- Strong communication and teamwork skills.
- A Data Engineering certification (e.g., Databricks Data Engineer Associate) is advantageous.
S&P Global Off Campus Hiring – Apprentice – Data Analyst – Apply Now!