Octopus Digital (a subsidiary of Avanceon Limited) is looking for experienced Data Engineers who are willing to develop and implement data warehouse solutions for company-wide applications and manage large sets of structured and unstructured data by using the technologies mentioned below.
- Hands-on experience on Azure/AWS.
- Experience on a spark, python.
- Design and develop code, scripts, and data pipelines that leverage structured and unstructured data
- Should be able to manage Data ingestion pipelines and stream processing
- Write and optimize complex SQL and shell scripts
- Experience in Big Data querying
- Experience with NoSQL databases
- Experience with Hadoop distributions as Azure DataLake HDFS
- Training/Certification on Data Lake HDFS will be a plus.
- Ability to meet deadlines, identify issues and resolve with minimal direction
- At least 2-3 years of relevant working experience with Cloud Development
- Bachelor/Master Degree in Computer Science with relevant working experience.