Avanceon MEA

Job Description:

Octopus Digital (a subsidiary of Avanceon Limited) is looking for experienced Data Engineers who are willing to develop and implement data warehouse solutions for company-wide applications and manage large sets of structured and unstructured data by using the technologies mentioned below.

Job Responsibilities:

  • Hands-on experience on Azure/AWS.
  • Experience on a spark, python.
  • Design and develop code, scripts, and data pipelines that leverage structured and unstructured data
  • Should be able to manage Data ingestion pipelines and stream processing
  • Write and optimize complex SQL and shell scripts
  • Experience in Big Data querying
  • Experience with NoSQL databases
  • Experience with Hadoop distributions as Azure DataLake HDFS
  • Training/Certification on Data Lake HDFS will be a plus.
  • Ability to meet deadlines, identify issues and resolve with minimal direction

Qualification/Job Requirements:

  • At least 2-3 years of relevant working experience with Cloud Development
  • Bachelor/Master Degree in Computer Science with relevant working experience.