Ranking: 3
We are searching for a professional with expert knowledge of:
English - B2
Mandatory skills & knowledge
· English B2 / C1 (speak to English people daily)
· Experience in Big Data frameworks.
· Knowledge of underlying infrastructure for Big Data Solutions.
· Expertise in large distributed Big Data Application deployment and implement ETL Processes.
· Experience in designing, building, and operating cloud services.
· Experience with Azure DevOps, CI/CD and Artifacts (required advance experience)
· Good programming knowledge in Scala-Advance (Python is a plus).
· Good knowledge in SQL.
· Solid knowledge in Spark and Spark-Streaming, high-volume process design, and process optimization.
· Mandatory knowledge (provement experience):
o Design of programming patterns (extra).
o SQL Databases (SQL Server, PostgreSQL)
o NoSQL Databases
o Azure Data Factory: Develop generic solutions, optimizing extraction process and manage IRs.
o Databricks: Good handling with Spark Clusters, Spark Jobs, Lakehouse.
o Delta (mandatory)
o Azure Data Lake Gen 2
o Azure Functions (mandatory)
o Kafka and RabbitMQ Brokers (Advanced developer level)
Optional skills & knowledge
· Knowledge of other Big Data environments: Cloudera, GCP, AWS.
· Azure Administrator knowledge.
· Microsoft Azure Data path certifications.
· Machine Learning and Artificial intelligence.
· Test-Driven Development (Sonar is an extra).
· Knowledge of networking and security in Azure Cloud.
· Terraform is mandatory.
About the Client:
Contractual Process and Relationship:
Ranking: 3
We are searching for a professional with expert knowledge of:
English - B2
Mandatory skills & knowledge
· English B2 / C1 (speak to English people daily)
· Experience in Big Data frameworks.
· Knowledge of underlying infrastructure for Big Data Solutions.
· Expertise in large distributed Big Data Application deployment and implement ETL Processes.
· Experience in designing, building, and operating cloud services.
· Experience with Azure DevOps, CI/CD and Artifacts (required advance experience)
· Good programming knowledge in Scala-Advance (Python is a plus).
· Good knowledge in SQL.
· Solid knowledge in Spark and Spark-Streaming, high-volume process design, and process optimization.
· Mandatory knowledge (provement experience):
o Design of programming patterns (extra).
o SQL Databases (SQL Server, PostgreSQL)
o NoSQL Databases
o Azure Data Factory: Develop generic solutions, optimizing extraction process and manage IRs.
o Databricks: Good handling with Spark Clusters, Spark Jobs, Lakehouse.
o Delta (mandatory)
o Azure Data Lake Gen 2
o Azure Functions (mandatory)
o Kafka and RabbitMQ Brokers (Advanced developer level)
Optional skills & knowledge
· Knowledge of other Big Data environments: Cloudera, GCP, AWS.
· Azure Administrator knowledge.
· Microsoft Azure Data path certifications.
· Machine Learning and Artificial intelligence.
· Test-Driven Development (Sonar is an extra).
· Knowledge of networking and security in Azure Cloud.
· Terraform is mandatory.
About the Client:
Contractual Process and Relationship: