Starburst Data Engineer

Location : Charlotte ,NC ;Plano ,TX;

Must Have Technical/Functional Skills

Primary Skill: Starburst

Secondary: Data Virtualization Engineer, Dremio, Presto, SQL Performance Tuning, Shell Scripting, Autosys

Experience: Minimum 10 years

Roles & Responsibilities

Key Responsibilities

• Demonstrated expertise in Starburst Data Virtualization, including designing and implementing data virtualization solutions, optimizing query performance across distributed data sources, and integrating Starburst with enterprise data architectures.
• Analyze data mapping documents and business requirements to design comprehensive test plans and cases.
• Perform source-to-target data reconciliation, check data loading, and ensure transformation rules are applied correctly.
• Write complex SQL scripts for validation (count, data completeness, data consistency, data truncation).
• Identify, log, and track data defects using tools like JIRA or HP ALM or Octane.
• Automate test scripts and validate data volume, performance, and scalability.
• Expert-level knowledge of SQL for data analysis.
• Experience with tools such as Informatica and IDMC.
• Understanding of data warehouse concepts and architectures (e.g., star/snowflake schema).
• Familiarity with Hadoop or Spark is often preferred.
• Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster.
• Strong analytical and troubleshooting skills.
• Excellent communication for collaborating with developers and stakeholders.
  
  

Tools & Skills

Starburst, IDMC, Informatica Power center, Hive, Kafka Knowledge

SQL, Oracle, PL/SQL

Domain: Banking knowledge, Payments knowledge preferred.

Concept: Data Virtualization, Data Warehousing, Data Transformation, ETL/ELT, Data Quality.

Salary :120,000-130,000/Per Annum