Data Engineer ($80-85K+ Benefits) + H1b Transfers are Workable
Sign in to view the employer name
Share
Location
Job description
Data Engineer ($80-85K+ Benefits) + H1b Transfers are Workable Dallas, TX Fulltime (Permanent)
5 Positions
Job Description:
Experience: 5 Years
Core Skills:
Key Responsibilities:
5 Positions
Job Description:
Experience: 5 Years
Core Skills:
- Data Engineering: Data Pipelines, Data Processing, ETL, Large-Scale Data Processing
- Big Data Technologies: Python, PySpark, Apache Spark, Databricks, Delta Lake
- Databases: PostgreSQL, MongoDB, Redis, SQL, NoSQL
- Streaming & Real-Time Processing: Kafka, Kafka Streaming, Real-Time Data Processing
- Cloud Platforms: Azure, AWS, Cloud Data Services
- Performance Optimization: Data Partitioning, Performance Tuning, In-Memory Optimization
- DevOps & Deployment: CI/CD Pipelines, Production Deployment, Linux, Unix
- APIs & Architecture: REST APIs, Application Development, System Design, Software Architecture
- Platform & Security: Multi-User Data Platforms, Access Management
- GenAI & AI Concepts: LLM Workflows, Prompt Versioning, Evaluation Frameworks
Key Responsibilities:
- Develop and maintain scalable data pipelines using Python and PySpark.
- Work with Databricks and Delta Lake for data processing and optimization.
- Design and manage SQL/NoSQL database integrations and workflows.
- Support real-time streaming solutions using Kafka or similar frameworks.
- Optimize data processing performance and partitioning strategies.
- Collaborate with teams on cloud deployments, CI/CD, and production support.
- Integrate REST APIs and support application-level data requirements.
- Contribute to GenAI and LLM-based workflow initiatives where applicable.