Vilnius

Big Data Engineer

Your main task will be:

  • Ensure data quality and integrity through data governance best practices, including validation, transformation, and security protocols, using technologies such as PySpark, Impala, Hive, HDFS, ClickHouse, Zabbix, and Airflow.
  • Work closely with business and technology representatives to gather functional and technical requirements.
  • Contribute to engineering best practices, standards, and architectural approaches within the data ecosystem.
  • Collaborate with the project management team to develop the overall implementation solution plan and actively contribute to project life cycle phases, leveraging technologies like PySpark and Airflow.
  • Stay updated on the latest technology trends, particularly in the areas of data platforms, focusing on technologies such as PySpark, Impala, Hive, HDFS, ClickHouse, and Zabbix.
  • Continuously monitor and improve the performance of data systems to ensure they are optimized for speed, reliability, and scalability, utilizing technologies like PySpark and HDFS.

Job Requirements

  • 3+ years of data engineering or similar technical experience.
  • Knowledge of SQL, Data modelling architecture and ETL processes with tools such as Apache Airflow.
  • Experience with AWS, AI and NiFi is a plus.
  • Proficiency in PySpark, Python, Linux, HDFS, Elasticsearch, ClickHouse, and various SQL databases.
  • Experience with AWS and NiFi is a plus.
  • Knowledge of SQL and ETL processes with tools such as Apache Airflow.
  • Strong analytical and problem-solving skills.
  • Experience with version control systems like Git.
  • Understanding of data quality assurance and governance best practices.
  • Willingness to learn and adapt to new technologies and industry trends in data engineering.

As part of our client team You:

  • Have freedom to implement best ideas
  • Be a part of an inspiring working culture that values high standards
  • Be an owner of your flexible working hours and results
  • Have FUN at team building activities and workshops
  • Personal phone with unlimited calls, sms and internet, mobile portable internet, Go3 TV on your phone and TV
  • Additional health and accident insurances, accumulation of tier III pensions
  • Benefit from other motivational perks such as healthy snacks and fruits, coffee, team lunches and much more!

Gross salary 2000-7000 EUR/month