Senior Big Data Engineer

Company: Pyramid Consulting, Inc
Location: Houston
Posted on: May 16, 2022

Job Description:

Job DescriptionImmediate need for a talented Senior Big Data Engineer with experience in the Telecom Industry. This is a 12+ Months contract opportunity with long-term potential and is located in Houston, TX. Please review the job description below. Job ID: 20-30100Key Responsibilities:As part of an agile team, design, develop and maintain an optimal data pipeline architecture using both structured data sources and big data for both on-premise and cloud-based environments.Develop and automate ETL code using scripting languages, ETL tools and job scheduling software to support all reporting and analytical data needs.Design and build dimensional data models to support the data warehouse initiatives.Assemble large, complex data sets that meet the analytical needs of the data scientist teams.Assess new data sources to better understand availability and quality of data.Identify, design, and implement internal process improvements: automating manual processes, optimizing data pipeline performance, re-designing infrastructure for greater scalability and access to information.Participate in requirements gathering sessions to distill technical requirements from business requests.Collaborate with business partners to productionize, optimize, and scale enterprise analytics.Collaborate with data architects and modelers on data store designs and best practicesProvide off-hours support for all developed data pipelines in an on-call rotation. Key Requirements and Technology Experience: Bachelor's degree in Computer Science, Engineering, Information Science, Math or related disciplineData engineering, data management or cloud certification is a plusAt least six (6) to eight (8) years of experience in in a data engineering role or related specialty with demonstrated ability in data modelingAt least two (2) years Data engineering experience on the Microsoft Azure, Amazon Web Services (AWS), or SnowflakeExperience using Extract, Transformation and Load (ETL) tools with Informatica (IICS) to build automated data pipelinesExperience with object-oriented/object function scripting languages: Python, Java, C++Thorough understanding of relational, columnar and NoSQL database architectures and industry best practices for developmentUnderstanding of dimensional data modeling for designing and building data warehousesExcellent advanced SQL coding and performance tuning skillsExperience with big data tools: Hadoop, Spark, Kafka, etc.Experience with parsing data formats such as XML/JSON and leveraging external APIsUnderstanding of agile development methodologiesAbility to work in a team-oriented, collaborative environment; good interpersonal skillsStrong analytical and problem-solving skills; ability to weigh various suggested technical solutions against the original business needs and choose the most cost-effective solutionKeen attention to detail and ability to access impact of design changes prior to implementationSelf-driven, highly motivated and ability to learn quickAbility to effectively prioritize and execute tasks in a high-pressure environmentStrong customer service orientationAbility to present and explain technical information to diverse types of audiences in a way that establishes rapport and gains understandingWork experience with geospatial data and spatial analytics is preferredOur client is a leading Telecom Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Keywords: Pyramid Consulting, Inc, Houston , Senior Big Data Engineer, Engineering , Houston, Texas