MaxjobsClub US Contractor
Duration: 6 months with extension
Location: remote until covid situation changes then onsite in Carlsbad, CA
We are looking for a highly qualified senior Pyspark/DataBricks Developer with the following qualifications:
- The developer must have sound knowledge in Apache Spark and Python programming
- Good knowledge on AWS or Azure Databricks etc
- Build large scale batch and data pipelines with data processing frameworks in Azure or AWS cloud platform
- Developing highly scalable highly performant instrumented and accurate data pipelines
- Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations
- Strong analytical problem solving and unit testing skills
- Experience in deployment and operationalizing the code is added advantage
Experience:
- Up to 4-7 years of working experience in Databricks Python Spark Scala
- The developer must have sound knowledge in Apache Spark and Python programming
- Deep experience in developing data processing tasks using pySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations
- Experience in deployment and operationalizing the code is added advantage