What are the responsibilities and job description for the REMOTE Python Staff Engineer position at Lensa?
Lensa is a career site that helps job seekers find great jobs in the US. We are not a staffing firm or agency. Lensa does not hire directly for these jobs, but promotes jobs on LinkedIn on behalf of its direct clients, recruitment ad agencies, and marketing partners. Lensa partners with DirectEmployers to promote this job for Insight Global.
Job Description
We are seeking a strong Python Developer to join our Data Engineering- Data Ingestion & Databricks Product Team, a high-impact group working in a Scrum-based Agile environment. We are seeing an engineer with a passion for clean, scalable code and a mindset rooted in metadata-driven architecture. This role is ideal for someone who thrives in a collaborative environment of shared ownership and open communication, enjoys setting engineering standards, and has hands-on experience with Databricks and Delta Lake, preferably in an Azure ecosystem. Youll work closely with technical leads to shape the development culture, contribute to architectural decisions, and help build robust, reusable Python libraries that power our data platform. As well as:
Design, develop, and maintain Python libraries with a focus on packaging, distribution, and reusability.
Champion metadata-driven development practices to build flexible and scalable systems.
Collaborate with team leads to define and enforce coding standards, including code reviews and documentation.
Implement and maintain CI/CD pipelines with tools like linters, type checkers (e.g., mypy), and automated testing frameworks (e.g., pytest).
Develop and optimize data workflows on Databricks, leveraging Delta Lake and best practices for performance and scalability.
Communicate technical decisions clearly and confidently to both technical and non-technical stakeholders.
Mentor junior engineers and contribute to a culture of continuous improvement.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills And Requirements
Strong Python skills and experience in packaging and distributing Python libraries (e.g., setuptools, poetry, pip, uv).
A metadata-driven development mindset, understanding metadata-driven architecture and its application in software or data systems.
Familiarity with CI/CD practices in Python projects, including automated testing, linting, and type checking.
Hands-on experience with Databricks and Delta Lake, ideally within an Azure environment.
Experience with Github and Github Actions for CI/CD.
Excellent communication skills with the ability to explain and justify technical decisions.
A collaborative, opinionated mindset to engineering with a drive to lead by example.
Understanding of Scrum and Agile methodologies. Experience with data ingestion frameworks or data pipeline orchestration tools (e.g. Airflow).
Familiarity with containers (Docker, Kubernetes, Helm)
CI/CD build and deploy architecture (Tekton/Argo)
Familiarity with infrastructure-as-code (e.g. Terraform).
Experience with managing Databricks infrastructure-as-code (clusters, policies, etc.)
Contributions to open-source Python projects or internal tooling libraries. null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
If you have questions about this posting, please contact support@lensa.com
Job Description
We are seeking a strong Python Developer to join our Data Engineering- Data Ingestion & Databricks Product Team, a high-impact group working in a Scrum-based Agile environment. We are seeing an engineer with a passion for clean, scalable code and a mindset rooted in metadata-driven architecture. This role is ideal for someone who thrives in a collaborative environment of shared ownership and open communication, enjoys setting engineering standards, and has hands-on experience with Databricks and Delta Lake, preferably in an Azure ecosystem. Youll work closely with technical leads to shape the development culture, contribute to architectural decisions, and help build robust, reusable Python libraries that power our data platform. As well as:
Design, develop, and maintain Python libraries with a focus on packaging, distribution, and reusability.
Champion metadata-driven development practices to build flexible and scalable systems.
Collaborate with team leads to define and enforce coding standards, including code reviews and documentation.
Implement and maintain CI/CD pipelines with tools like linters, type checkers (e.g., mypy), and automated testing frameworks (e.g., pytest).
Develop and optimize data workflows on Databricks, leveraging Delta Lake and best practices for performance and scalability.
Communicate technical decisions clearly and confidently to both technical and non-technical stakeholders.
Mentor junior engineers and contribute to a culture of continuous improvement.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf) .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills And Requirements
Strong Python skills and experience in packaging and distributing Python libraries (e.g., setuptools, poetry, pip, uv).
A metadata-driven development mindset, understanding metadata-driven architecture and its application in software or data systems.
Familiarity with CI/CD practices in Python projects, including automated testing, linting, and type checking.
Hands-on experience with Databricks and Delta Lake, ideally within an Azure environment.
Experience with Github and Github Actions for CI/CD.
Excellent communication skills with the ability to explain and justify technical decisions.
A collaborative, opinionated mindset to engineering with a drive to lead by example.
Understanding of Scrum and Agile methodologies. Experience with data ingestion frameworks or data pipeline orchestration tools (e.g. Airflow).
Familiarity with containers (Docker, Kubernetes, Helm)
CI/CD build and deploy architecture (Tekton/Argo)
Familiarity with infrastructure-as-code (e.g. Terraform).
Experience with managing Databricks infrastructure-as-code (clusters, policies, etc.)
Contributions to open-source Python projects or internal tooling libraries. null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
If you have questions about this posting, please contact support@lensa.com
