About the job
About the role:

The role of an expert Big Data Engineer entails integrating diverse data sources and systems, crafting data engineering workflows, and adapting to rapidly evolving technology solutions.
Collaboration with data architects, data scientists, data analysts, and business stakeholders is essential to achieve strategic business objectives.


About you:

We are seeking a skilled Big Data Engineer with a minimum of 4 years of experience in developing scalable data solutions. The ideal candidate will have a comprehensive skill set, including data ingestion, data pipeline development, proficiency in Cloudera stack and data integration tools, handling diverse data types and formats, transformation using Spark and Hive, and database querying.
Solid Experience in creating data pipelines using NiFi.
Solid Experience in Cloudera stack. Or equivalent
Solid Experience in Data integration tools such as Talend, Informatica Power Center, Informatica BDM, ODI, Denodo or Altryx.
Experience with implementation of real-time data processing using Snowflake, Apache Kafka, and Spark Streaming.
Experience with design and development of ETL workflows and data pipelines for high-volume data systems.


Additionally, expertise in Python, Java, Scala, and SQL, multithreading, Unix scripting, and experience with various databases is crucial.

Key Job Requirements:

• >5 years of experience in big data engineering
• Experience with Hadoop, Spark, Kafka, and other big data technologies

Skills:

• - Proficiency in programming languages like Java, Python, or Scala
• - Strong understanding of data warehousing concepts and ETL processes
• - Experience with cloud platforms like AWS or Azure
• - Ability to work with large datasets and optimize performance

Seniority Level: Other

• Mid-Senior level

Job Functions: Software Development

• Data Engineering
• Information Technology

Industries : Information Technology

• Technology
• Information Technology