What are the responsibilities and job description for the Senior Data Engineer position at Bitful Consulting?
You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across finance, sales, supply chain, marketing and other business functions.
Your responsibilities will include:
Developing and maintaining scalable data pipelines and reusable datasets within a Databricks lakehouse environment
Ingesting, validating, cleaning and transforming structured and unstructured data from multiple sources using Python, PySpark and SQL
Building data models and reporting datasets that support Tableau and established analytics tools such as Spotfire
Integrating established data warehouse and reporting systems with modern cloud analytics platforms
Improving pipeline reliability, data quality and processing performance
Implementing automated testing, monitoring, documentation and CI/CD practices
Partnering with analysts, architects, developers and business stakeholders to deliver practical data solutions
Providing technical guidance, reviewing code and mentoring other data engineer
7 years of experience in data engineering, including building and supporting production data pipelines
Strong SQL skills and a solid understanding of data modeling, database design and data warehousing
Hands-on experience with Databricks, Apache Spark and cloud data platforms
Strong proficiency in Python and PySpark
Experience developing ETL/ELT pipelines and integrating data from multiple source systems
Experience preparing reliable datasets for Tableau or comparable business intelligence tools
Familiarity with source control, automated testing and CI/CD practices
Ability to troubleshoot complex data issues and optimize pipeline performance
Strong communication skills and experience collaborating with technical teams and business stakeholders
Experience with Spotfire, Oracle, Informatica, R or data virtualization preferred
Databricks certification preferred
Hourly Wage Estimation for Senior Data Engineer in Pittsburgh, PA
$58.00 to $73.00
If your compensation planning software is too rigid to deploy winning incentive strategies, it’s time to find an adaptable solution.
Compensation Planning
Enhance your organization's compensation strategy with salary data sets that HR and team managers can use to pay your staff right.
Surveys & Data Sets
What is the career path for a Senior Data Engineer?
Sign up to receive alerts about other jobs on the Senior Data Engineer career path by checking the boxes next to the positions that interest you.
You’ll maintain and improve an established cloud and on-premises network and cybersecurity environment, working with a three-person IT team in a heavily re...more
You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across financ...more
You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across financ...more
You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision making across financ...more
Compensation: $130,000-$160,000 per year Location: United States – Remote or Omaha, NE - Hybrid The job: As a Senior Data Engineer-Data Platform at Builder...more
We Are Accenture is a premier Google Cloud partner helping organizations modernize data ecosystems, build real-time analytics capabilities, and responsibly...more
