IT/Software/Technology

Big Data Engineer

Contract

Strategic Staffing Solutions

Big Data Engineer 

12+ Month Contract 

Charlotte, NC – Hybrid Schedule 

Pay: $95/HR

Job Summary

  • Design high performing data models on big-data architecture as data services.
  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark and Amazon S3 based object storage architecture.
  • Work with business analysts, development teams and project managers for requirements and business rules.
  • Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
  • Support ongoing data management efforts for Development, QA and Production environments

Required Experience:

  • 10+ years of application development and implementation experience
  • 10+ years of experience delivering complex enterprise wide information technology solutions
  • Experience in Hadoop ecosystem tools for real-time batch data ingestion, processing and provisioning such as Apache Flume, Apache Kafka, Apache Sqoop, Apache Flink, Apache Spark or Apache Storm
  • 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop 5+ years of Java or Python experience
  • 10+ years of ETL (Extract, Transform, Load) Programming experience
  • 10+ years of reporting experience, analytics experience or a combination of both 5+ years of Hadoop experience 5+ years of operational risk, conduct risk or compliance domain experience
  • Knowledge and understanding of project management methodologies: used in waterfall or Agile development projects
  • Knowledge and understanding of DevOps principles Ability to interact effectively and confidently with senior management

Job ID: JOB-207368
Publish Date: 22 Sep 2022

Tagged as: Big Data Engineer