Lead Data Engineer
Lead Data Engineer (OMD USA LLC d/b/a Annalect Group, New York, NY)
Produce accurate information within database objects used in reporting, strategic planning and decision making to directly impact the growth of the enterprise data warehouse (“EDW”);Collaborate with the Senior Director of Data Engineering in developing long-term strategies and capacity planning for meeting future data warehouse and data automation needs; Meet with end-users and data SMEs to identify and clarify requirements and business rules needed to design, develop and implement ETL/ELT processes; Collaborate with peer Data Engineers to build upon and support the company’s Continuous Integration/Continuous Delivery (“CI/CD”) pipelines; Use strong communication skills (written and verbal) to mentor emerging Data Analysts, including providing feedback and suggestions for their planned workflows prior to deployment into production; Respond, investigate and correct reported data inaccuracies within the EDW compared to source and business-expected results; Establish relationships with external and internal points of contact to ensure seamless inbound and outbound Data Delivery expectations are met; Implement and support backend maintenance processes that enforce ongoing data optimization and corporate retention policies while ensuring the historical data needs of the client are met; Document and maintain all the processes and procedures pertaining to ETL and data warehouse usage and development, contributing to the team knowledgebase when applicable; Build products which sit atop cloud-based data infrastructure. Participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions; Participate in architecture and strategy discussions with stake holders; Create architecture diagrams and provide input to Delivery Managers on milestones and deliverables. Accountable for completion of projects on time, ensuring best practices are followed in the SDLC; Meet with end-users and data SMEs to identify and clarify requirements and business rules needed to design, develop and implement ETL/ELT processes; Use strong communication skills (written and verbal) to mentor emerging Data Analysts, including providing feedback and suggestions for their planned workflows prior to deployment into production; Collaborate with the Senior Director of Data Engineering in developing long-term strategies and capacity planning for meeting future data warehouse and data automation needs; and Meet with end-users and data SMEs to identify and clarify requirements and business rules needed to design, develop and implement ETL/ELT processes. Position is 100% remote. Must reside in U.S. Reports to HQ in New York, NY. Salary: $167,835 - $178,500 per year.
MINIMUM REQUIREMENTS: Bachelor’s degree or U.S. equivalent in Information Systems, Information Technology, Computer Science, Computer Engineering, or a related field, plus 6 years of professional experience as Data Engineer, Software Engineer, or any occupation/position/job title involving building data pipelines and utilizing big data technologies.
Must also have experience in the following: 5 years of professional experience utilizing programming languages including Python, C++, or Java; 5 years of professional experience working with relational databases (including Postgres SQL, MySQL, or Microsoft SQL); 5 years of professional experience performing data cataloging and utilizing data processing tools including Hadoop, Hive, OR Spark; 5 years of professional experience with AWS, EMR, Glue, and Redshift; 5 years of professional experience designing and managing data flows, and designing systems and APIs to integrate data into applications; 5 years of professional experience utilizing Linux, Bash, Python, and SQL; 5 years of professional experience building scalable data pipelines using Airflow, and performing data organization (including partitioning, clustering, file sizes, and file formats.
CONTACT: Send resume to:omgemployeebenefits@omnicommediagroup.com. Must specify Ad Code BTLL.