What are the responsibilities and job description for the Sr Databricks Engineer - (100% Remote) - Only W2 Contract position at XFORIA Inc?
Job Details
Senior Databricks Engineer
Long Term Contract
Columbus OH
Job Summary
We are seeking a Senior Databricks Engineer to design, develop, and maintain scalable data pipelines and analytics solutions using the Databricks platform. The ideal candidate should have strong experience with Apache Spark, Python, SQL, and cloud-based data engineering technologies.
Key Responsibilities
Design and develop ETL/ELT pipelines using Databricks and Apache Spark.
Build and optimize data processing workflows for large-scale datasets.
Develop solutions using Python, PySpark, and SQL.
Integrate data from various sources into data lakes and data warehouses.
Monitor, troubleshoot, and improve data pipeline performance.
Collaborate with data analysts, architects, and business stakeholders to deliver data solutions.
Ensure data quality, security, and governance standards are maintained.
Support deployment and maintenance of data engineering solutions in cloud environments.
Required Skills
5 years of experience in Data Engineering.
Hands-on experience with Databricks and Apache Spark.
Strong proficiency in Python, PySpark, and SQL.
Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform.
Knowledge of ETL processes and data warehousing concepts.
Familiarity with version control tools like Git.
Strong analytical and problem-solving skills.
Preferred Skills
Experience with Databricks Workflows.
Knowledge of CI/CD and DevOps practices.
Experience with Azure Data Factory, AWS Glue, or similar tools.
Understanding of data governance and security best practices.