About Us?
Octopus Digital is leading the charge in Industry 4.0 across Pakistan and the Middle East, revolutionizing industries with smart factory solutions, AI, big data, and IoT. Our cloud-native, AI-powered platforms deliver actionable insights, making complex data accessible for all professionals. We help businesses digitize manufacturing, supply chain, and financial processes, offering 24/7 support and business intelligence through flexible subscription services. With a global presence and a focus on continuous innovation, we empower companies to thrive in the digital age and stay ahead of the competition. Let us help you unlock the future of your business.
Job Overview:
We are looking for a Data Engineer to join our team and design, build, and maintain robust and scalable data pipelines. The ideal candidate will play a critical role in developing systems that process and analyze data efficiently, enabling data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and maintain ETL pipelines to ingest, transform, and load large volumes of data from various sources into data lakes and data warehouses.
- Collaborate with Data Scientists, Analysts, and Software Engineers to ensure clean and reliable data for analytical solutions and models.
- Build and optimize data storage and retrieval systems using Microsoft Azure Coud Platform
- Develop and maintain data models, databases, and schemas to support business intelligence, reporting, and analytics.
- Implement data governance principles, including quality, integrity, and security protocols.
- Monitor, troubleshoot, and improve data pipelines, ensuring systems are reliable and scalable.
- Automate data workflows and optimize performance using modern tools like Apache Spark, Airflow, or similar orchestration frameworks.
- Perform root-cause analysis on complex data issues and implement solutions.
- Keep up-to-date with emerging technologies in data engineering, proposing innovative solutions to improve data infrastructure.
Required Skills and Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, IT, or related field.
- 3-5+ years of experience in a Data Engineering role or similar capacity.
- Proficiency with SQL and programming languages such as Python or Java.
- Experience with Azure Data Platform (Data Factory, Synapse Analytics, Databricks, AppLogic)
- Hands-on experience with ETL/ELT tools (e.g., SQL SSIS , Apache Airflow, Talend, Matillion, Informatica).
- Familiarity with big data technologies like Apache Spark, Kafka, or Hadoop.
- Knowledge of data warehousing concepts and experience with platforms like SQL Server, Azure Synapse Analytics (formerly Azure SQL Data Warehouse), Snowflake, Redshift, or BigQuery.
- Strong problem-solving skills and an ability to analyze complex data architectures.
- Familiarity with CI/CD pipelines, version control (e.g., Git), and data automation.
- Experience working in an Agile environment.
Nice-to-Have Skills
- Experience with streaming data frameworks (Kafka, Flink, Kinesis).
- Knowledge of data governance and security practices (GDPR, HIPAA compliance).
- Understanding of Machine Learning Operations (MLOps) or DataOps.
- Certifications in relevant technologies like Azure Data Engineer, or Google Professional Data Engineer.
Why Join Us?
- Opportunity to work with a talented team on impactful data-driven projects.
- Access to cutting-edge tools and technologies.
- Competitive salary, benefits, and a dynamic work environment.
- Travel for easy commute.