Job Title: Senior Data Engineer Lead
Location: San Francisco, CA (Hybrid 2-3 Days/Week)
Rate: $65 - $70 per Hour
Work type: W2, US Citizens / GC / EAD ONLY
**Summary:**
Iexceltech is seeking a talented and experienced Candidate for Senior Data Engineer Lead, must be well versed in Scala, Java with developing applications using Apache Spark framework.
**Responsibilities:**
- Develop Applications: Build scalable applications using Scala/Java on Apache Spark.
- Data Management: Model databases and work with SQL/NoSQL systems.
- Scripting & Automation: Write Shell or Python scripts for automation.
- Workflow Orchestration: Manage workflows using Airflow or Oozie.
- Platform Expertise: Work with the Cloudera ecosystem (preferred) and version control tools like Git.
- Advanced Tools: Utilize table formats like Delta Lake or Iceberg.
- Optimization: Optimize data pipelines and troubleshoot performance issues.
- Collaboration: Work with cross-functional teams to ensure seamless data integration.
Preferred Skills: Agile methodologies, software development experience, and expertise in build tools like Maven.
**Requirements:**
- True Hands-On Developer in Programming Languages like Java or Scala.
- Expertise in Apache Spark Database modeling and working with any of the SQL or NoSQL Database is must.
- Working knowledge of Scripting languages in one of the Shell/Python.
- Experience of working with Cloudera is Preferred.
- Orchestration tools like Airflow or Oozie would be a value addition.
- Knowledge of Table formats like Delta or Iceberg is plus to have.
- Working experience of Version controls like Git, build tools like Maven is recommended.
- Having software development experience is good to have along with Data Engineering experience.
**Benefits:**
- Competitive salary and performance-based bonuses.
- Comprehensive health, dental, and vision insurance.
- Flexible work hours and remote work options.
- Opportunities for professional development and career advancement.
- A supportive and inclusive work culture that values diversity.
Join Iexceltech and contribute to innovative projects that make a difference!