MaxJobsClub US Contractor
Duration: contract ends on 12/31/2021 with extension.
We are looking for a highly qualified Pyspark Developer with the following
qualifications:
* The developer must have sound knowledge in Apache Spark and Python
programming
* Good knowledge on ADLS Azure Blob Storage Azure Data Factory Azure
Functions Synapse DW Azure SQL DB Event Hub SQL Databricks etc
* Build large scale batch and data pipelines with data processing
frameworks in Azure or AWS cloud platform
* Developing highly scalable highly performant instrumented and
accurate data pipelines
* Deep experience in developing data processing data manipulation
tasks using PySpark such as reading data from external sources merge data
perform data enrichment and load in to target data destinations
* Strong analytical problem solving and unit testing skills
* Experience in deployment