Avanceon MEA

Role Summary

As a Big Data Architect, you will be establishing the framework of foundation Big Data Analytics. You will be responsible for engaging stakeholders to understand their objectives for Big Data and utilizing information gathered to plan the computing framework with appropriate hardware and software, data sources and formats, analytical tools, data storage decisions, and results consumption.

Job Responsibilities

  • Engage with clients to understand strategic requirements
  • Responsible for translating business requirements into technology solutions
  • Utilize Big Data technologies to design, develop, and evolve scalable and fault-tolerant distributed components
  • Implementing Lambda Architecture with stream processing and batch processing
  • Implement security standards and practices in Architecture of Cloud Solution
  • Performing analysis of large data stores and derive insights using Big Data querying
  • Design and develop code, scripts, and data pipelines that leverage structured, semi -structured and unstructured data
  • Stay up to date on latest technology to implement in Product line
  • Maintaining Design Documents
  • Conduct code reviews and align the team with best coding practices
  • Perform day to day tasks to accuracy with minimal directions while meeting deadlines

Qualification & Skillset

  • Bachelor/master’s degree in computer science
  • At least 6-8 years of relevant working experience with Cloud Solutions
  • Expertise with major Big Data Solutions like Hadoop, MapReduce, Hive, HBase, MongoDB, Cassandra, Sqoop, etc
  • Experience with Azure Data Explorer and Kusto query language would be plus
  • Experience with Azure Data Bricks would be plus
  • Hands-on experience on:
    • Azure/AWS Architectures
    • SQL, Scala, Node.js, JS, Java
    • Python with Pandas, NumPy, TensorFlow
    • ETL

Preferred Requirement

  • Certified Solutions Architect
  • Microsoft Azure Security certified
  • Training/Certification on Data Lake HDFS
  • Training/Certification on Azure Data Lake Gen 2
  • Training/Certification on Data Bricks