W2 candidates only || Data Engineer || In-Person Interview || will consider H1B Transfer***NoC2C**
Sign in to view the employer name
Share
Location
Job description
We are seeking experienced Data Engineers with strong expertise in Apache Spark, AWS, Kubernetes/EKS, and Big Data platforms.
About the RoleThe Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support our data-driven initiatives.
Responsibilities
Required Skills
Preferred Skills
About the RoleThe Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and architectures to support our data-driven initiatives.
Responsibilities
- 5+ years of Data Engineering experience
- Strong hands-on experience with Apache Spark
- Experience with Amazon EKS / EMR on EKS
- Big Data technologies: Hadoop, Hive, Trino
- Strong Python or Scala development skills
- Advanced SQL (window functions, joins, complex queries)
- Kubernetes administration and troubleshooting
- AWS services: S3, EMR, Glue, Athena, Lambda
- Experience processing large-scale datasets and tuning Spark jobs
- Familiarity with AI tools such as GitHub Copilot, ChatGPT, Claude, or Amazon Q
Required Skills
- 5+ years of Data Engineering experience
- Strong hands-on experience with Apache Spark
- Experience with Amazon EKS / EMR on EKS
- Big Data technologies: Hadoop, Hive, Trino
- Strong Python or Scala development skills
- Advanced SQL (window functions, joins, complex queries)
- Kubernetes administration and troubleshooting
- AWS services: S3, EMR, Glue, Athena, Lambda
- Experience processing large-scale datasets and tuning Spark jobs
- Familiarity with AI tools such as GitHub Copilot, ChatGPT, Claude, or Amazon Q
Preferred Skills
- CI/CD (GitLab, Jenkins, GitHub Actions, ArgoCD)
- Terraform / Infrastructure as Code
- Docker, Prometheus, Grafana
- Spark on Kubernetes
- Financial Services experience