Summary:At Meta, we have many opportunities to work with data each and every day. In this role as a Data Engineer on the Meta Data Centers Data Science team, your primary responsibility will be to partner with key stakeholders, data scientists and software engineers to support and enable the continued growth critical to Meta's Data Center organization. You will be responsible for creating the technology and data architecture that moves and translates data used to inform our most critical strategic and real-time decisions. You will also help translate business needs into requirements and identify efficiency opportunities. In addition to extracting and transforming data, you will be expected to use your expertise to build extensible data models, provide meaningful recommendations and actionable strategies to partnering data scientist for performance enhancements and development of best practices, including streamlining of data sources and related programmatic initiatives. The ideal candidate will have a passion for working in white space and creating impact from the ground up in a fast-paced environment. This position is part of the Infrastructure Data Center team.Required Skills:Data Engineer Responsibilities:Partner with leadership, engineers, program managers and data scientists to understand data needsApply proven expertise and build high-performance scalable data warehousesDesign, build and launch efficient & reliable data pipelines to move and transform data (both large and small amounts)Securely source external data from numerous partnersIntelligently design data models for optimal storage and retrievalDeploy inclusive data quality checks to ensure high quality of dataOptimize existing pipelines and maintain of all domain-related data pipelinesOwnership of the end-to-end data engineering component of the solutionSupport on-call shift as needed to support the teamDesign and develop new systems in partnership with software engineers to enable quick and easy consumption of dataMinimum Qualifications:Minimum Qualifications:BS/MS in Computer Science or a related technical field5 years of Python or other modern programming language development experience5 years of SQL and relational databases experience5 years experience in custom ETL design, implementation and maintenance3 years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, Digdag, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)3 years experience with Data ModelingExperience working with cloud or on-premises Big Data/MPP analytics platform (i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar)2 years experience working with enterprise DE tools and experience learning in-house DE toolsBachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.Preferred Qualifications:Preferred Qualifications:Experience with more than one coding languageExperience designing and implementing real-time pipelinesExperience with data quality and validationExperience with SQL performance tuning and end-to-end process optimizationExperience with anomaly/outlier detectionExperience with notebook-based Data Science workflowExperience with AirflowExperience querying massive datasets using Spark, Presto, Hive, Impala, etc.Experience building systems integrations, tooling interfaces, implementing integrations for ERP systems (Oracle, SAP, Saleforce etc).Public Compensation:$134,000/year to $204,000/year bonus equity benefitsIndustry:InternetEqual Opportunity:Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.#J-18808-Ljbffr

by Jobble