Databricks Developer
Sep 29, 2024
Company: APG Emerging Tech (APGET)
At APGET, we connect skilled Databricks Developers with top companies looking to harness the power of big data, machine learning, and cloud analytics. Our clients span industries like financial services, healthcare, and e-commerce, seeking Databricks Developers to build scalable data pipelines, implement data lakes, and develop advanced analytics solutions. If you're ready to drive impactful data initiatives, we want to hear from you!
Add paragraph text. Click “Edit Text” to update the font, size and more. To change and reuse text themes, go to Site Styles.
Role Overview
As a Databricks Developer, you will leverage the Databricks platform to design and implement scalable data solutions that turn big data into actionable insights. You will work on advanced data architectures, build data pipelines, and collaborate with cross-functional teams to deliver solutions that improve data processing efficiency and drive business outcomes.
Key Responsibilities
Design, build, and maintain scalable data pipelines using Databricks and Apache Spark.
Implement and optimize data lakes and real-time data processing frameworks.
Collaborate with data scientists and machine learning engineers to integrate predictive models into data workflows.
Develop and deploy machine learning models using Databricks and MLflow.
Ensure seamless integration of Databricks solutions with cloud platforms like AWS, Azure, and Google Cloud.
Work closely with stakeholders to gather requirements and translate them into technical solutions.
Optimize data workflows to improve processing speed, scalability, and efficiency.
Qualifications
Proven experience as a Databricks Developer, Data Engineer, or a similar role.
Strong expertise in Databricks and Apache Spark for big data processing.
Experience with cloud platforms such as AWS, Azure, or Google Cloud.
Familiarity with data lakes, data warehousing, and ETL processes.
Proficiency in programming languages such as Python, Scala, or SQL.
Hands-on experience with machine learning frameworks and tools, such as MLflow.
Excellent problem-solving skills and ability to design scalable data architectures.
Strong communication skills to interact with technical and non-technical stakeholders.
Bachelor’s degree in Computer Science, Data Engineering, or a related field.