What are the responsibilities and job description for the Senior Data Engineer position at ConsultNet Technology Services and Solutions?
Sr. Data Engineer
Calabasas, CA (3 days a week onsite)
6 month contract to hire
$67-$75 an hour ($140,000 - $156,000 salary upon conversion)
*NO 3rd Party C2C Please*
Immediate opening for a Senior Data Engineer to build and maintain scalable data pipelines and integrations using ETL/ELT frameworks, APIs, and messaging systems (Kafka, RabbitMQ). Partner with cross-functional teams to translate business needs into data solutions, models, and production-ready systems. Optimize Azure data platforms (Azure SQL, Data Factory, SSIS) for performance and cost, while implementing best practices in data governance, security, and compliance. Leverage Azure services (Data Lake, Blob Storage, Functions, Logic Apps) for scalable processing. Lead tool evaluations (Snowflake, Databricks, Airflow), support CI/CD with GitHub Actions, and develop automation using Python and PowerShell. Mentor junior team members and maintain clear technical documentation.
Requirements:
- 5 years of experience as a Data Engineer with a strong focus on integration design and development
- 5 years of hands-on experience with Azure Data Factory, Azure SQL, and SSIS
- Proven ability to translate business requirements into scalable, robust, and long-term data solutions, with strong ownership of system design
- Solid experience in data engineering, including data modeling, pipeline development, optimization, and troubleshooting/debugging
- Proficiency in SQL, Python, stored procedures, and data transformation techniques
- Experience with scripting and automation using Python and PowerShell
- Hands-on experience with integration platforms (e.g., SnapLogic) and iPaaS tools (TIBCO, Adeptia), including external system integrations
- Strong understanding of data pipelines and data assets, with the ability to support and maintain high-volume production environments (200 processes across varying schedules)
- Experience optimizing SQL queries and improving performance of data systems
- Exposure to modern data platforms such as Databricks, Synapse, BigQuery, or Snowflake
- Bachelor's degree in Computer Science, Information Systems, Data Analytics, or related field
Salary : $140,000 - $156,000