Strategic Staffing Solutions
STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!
Strategic Staffing Solutions is currently looking for Big Data Architect for a contract opportunity with one of our largest clients!
Candidates should be willing to work on our W2 ONLY.
Job Title: Big Data Architect
Remote: Yes
Location(s): Morris Plains NJ
Role Type: W2 ONLY, NO C2C
Contract Length: 9 months
How to Apply: Please send resume and contact information to Suganya, Sourcer at sprabhakar@strategicstaff.com
Job Description/Responsibilities:
This role will serve as a key member of the Big Data Engineering Services team. The role’s primary focus will be to assess the current on-prem Hadoop platform utilization and come up with strategies to migrate large volumes of data along with the applications to Data bricks and AWS. Collaborate with business and technology partners in gathering requirements to recommend, architect, get approvals and implement the best solutions.
Essential Functions:
- Designing low latency and high performing Data bricks Lakehouse platform in AWS
- The candidate will architect and develop solutions with cloud-first, automation-first and self-service first mindset with API driven data engineering capabilities.
- Through hands-on engineering approach, this individual will deliver data engineering toolchains, platform capabilities and reusable patterns.
- Familiar with data load, transformation and aggregation using Scala/Spark jobs
- Good understanding of data modeling and be able to architect the database schema
- Create frameworks and patterns for Ingress and Egress
- Collaborate in a high-performing team environment, and an ability to influence and be influenced by others
Required Skills/Qualifications:
- More than 10 years of experience in software engineering, building data engineering pipelines, middleware and API development and automation
- Experience in Data pipeline development in Data bricks, Spark, Python
- Must have recent hands-on experience using Data bricks and AWS Cloud or other cloud platforms
- Expert on all phases of data warehouse and bakehouse development lifecycle
- Strong knowledge of Delta Lake to provide best practice and optimization techniques
- Certification in Data bricks, AWS Cloud as Solution Architect Associate or higher is a plus
- Good understanding of DevOps tools Docker, Kubernetes, Git, Jenkins, Ansible, Terraform, etc.
- Experience in building CI/CD pipelines using Jenkins, GitHub Actions
- Strong knowledge of security and governance implementation leveraging DB Unity Catalog in big data engineering
Other Skills, Knowledge & Abilities:
- Experience working with Agile methodologies and cross-functional teams (Product Owners, Scrum Masters, Developers, Designers, Business Analysts)
- Strong organizational, multi-tasking and time management skills to meet key timelines.
- Quick learner and eager to explore and learn new technologies.
- Excellent communication and problem-solving skills
Education and Certifications:
5-8+ year’s relevant experience with Bachelor’s degree in computer field or have a Master’s degree with 3-5+ years of relevant experience
Job ID: JOB-220569
Publish Date: 28 Feb 2023