Data Engineer/Senior Data Engineer

We are looking for a versatile and proactive Data Engineer to join our growing team. This role involves managing and optimizing data infrastructure, designing and implementing data solutions, and developing advanced analytics models. You will work with a diverse range of stakeholders to support both operational and strategic objectives across different business domains.

YOUR ROLE 

• Data Infrastructure Management: Build, maintain, and optimize data infrastructure for extraction, transformation, loading, and serving data from various sources, including batch and streaming data.

• Pipeline Monitoring: Monitor and ensure the performance, accuracy, and reliability of production data pipelines.

• Collaboration: Work closely with product teams and stakeholders to deliver scalable data solutions that meet business requirements.

• Data Solutions Development: Cleansing and Structuring data, designing, developing, and implementing data pipelines, ETL processes, and advanced analytics models, including Natural Language Processing (NLP) and large language models (LLMs).

• Integration and Optimization: Integrate data from multiple sources, build scalable storage solutions, and continuously improve data processing and analysis capabilities.

• Documentation: Document data architecture, pipelines, processes, and model performance to ensure clarity and compliance.

• Technological Advancements: Evaluate and recommend new tools and technologies to enhance data processing and analytical capabilities.

JOB REQUIREMENTS

Experience:

• 3+ years of experience in data engineering or data science roles with a focus on building and optimizing data pipelines, ETL processes, and advanced analytics.

Technical Skills:

• Expert knowledge in SQL and data modeling concepts.

• Proficiency with cloud platforms (such as AWS) and associated tools (e.g., Data Factory, Databricks, PySpark, Apache Kafka).

• Experience with big data processing tools (e.g., Spark), analytical databases (e.g., ClickHouse), and streaming data platforms.

• Proficiency in programming languages such as Python or Scala.

• Experience with NLP libraries and frameworks (e.g., PyTorch, Hugging Face) and LLMs.

Analytical Abilities: 

• Strong analytical and problem-solving skills with a drive for optimization and results.

Communication Skills: 

• Excellent verbal and written communication skills with the ability to document processes and collaborate effectively with diverse teams.

Education: 

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field. Professional certifications in Data Engineering or related areas are a plus.